@atlanai/sdk 0.2.1 → 0.2.3
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +65 -14
- package/dist/client.d.ts +4 -1
- package/dist/client.js +14 -2
- package/dist/errors.d.ts +1 -0
- package/dist/errors.js +12 -1
- package/dist/evals.d.ts +136 -1
- package/dist/evals.js +902 -1
- package/dist/index.d.ts +3 -2
- package/dist/index.js +2 -1
- package/dist/manifest.json +264 -218
- package/dist/raw/agent/apis/AgentEnvironmentsApi.d.ts +36 -0
- package/dist/raw/agent/apis/AgentEnvironmentsApi.js +49 -1
- package/dist/raw/agent/apis/AgentFrameworksApi.d.ts +36 -0
- package/dist/raw/agent/apis/AgentFrameworksApi.js +49 -1
- package/dist/raw/agent/apis/AgentProvidersApi.d.ts +36 -0
- package/dist/raw/agent/apis/AgentProvidersApi.js +49 -1
- package/dist/raw/agent/apis/AgentsApi.d.ts +78 -4
- package/dist/raw/agent/apis/AgentsApi.js +126 -5
- package/dist/raw/agent/apis/HarnessVendorsApi.d.ts +36 -0
- package/dist/raw/agent/apis/HarnessVendorsApi.js +49 -1
- package/dist/raw/agent/apis/HarnessesApi.d.ts +36 -0
- package/dist/raw/agent/apis/HarnessesApi.js +49 -1
- package/dist/raw/agent/apis/OutputsApi.d.ts +45 -0
- package/dist/raw/agent/apis/OutputsApi.js +61 -1
- package/dist/raw/agent/apis/SessionsApi.d.ts +38 -2
- package/dist/raw/agent/apis/SessionsApi.js +51 -3
- package/dist/raw/agent/apis/TracesApi.d.ts +18 -0
- package/dist/raw/agent/apis/TracesApi.js +25 -1
- package/dist/raw/agent/apis/VisitorsApi.d.ts +9 -0
- package/dist/raw/agent/apis/VisitorsApi.js +13 -1
- package/dist/raw/agent/models/AgentAgentArtifactView.d.ts +75 -15
- package/dist/raw/agent/models/AgentAgentArtifactView.js +15 -2
- package/dist/raw/agent/models/AgentAgentEnvironmentArtifactView.d.ts +39 -15
- package/dist/raw/agent/models/AgentAgentEnvironmentArtifactView.js +4 -2
- package/dist/raw/agent/models/AgentAgentEnvironmentMeta.d.ts +12 -0
- package/dist/raw/agent/models/AgentAgentEnvironmentMeta.js +2 -0
- package/dist/raw/agent/models/AgentAgentFrameworkArtifactView.d.ts +27 -15
- package/dist/raw/agent/models/AgentAgentFrameworkArtifactView.js +2 -2
- package/dist/raw/agent/models/AgentAgentMeta.d.ts +48 -0
- package/dist/raw/agent/models/AgentAgentMeta.js +13 -0
- package/dist/raw/agent/models/AgentAgentProviderArtifactView.d.ts +82 -17
- package/dist/raw/agent/models/AgentAgentProviderArtifactView.js +10 -2
- package/dist/raw/agent/models/AgentAgentProviderCreate.d.ts +24 -3
- package/dist/raw/agent/models/AgentAgentProviderCreate.js +4 -0
- package/dist/raw/agent/models/AgentAgentProviderMeta.d.ts +56 -13
- package/dist/raw/agent/models/AgentAgentProviderMeta.js +8 -0
- package/dist/raw/agent/models/AgentAgentProviderPatch.d.ts +13 -0
- package/dist/raw/agent/models/AgentAgentProviderPatch.js +4 -0
- package/dist/raw/agent/models/AgentAgentProviderType.d.ts +19 -9
- package/dist/raw/agent/models/AgentAgentProviderType.js +18 -8
- package/dist/raw/agent/models/AgentCreateAgentFramework400Response.d.ts +2 -0
- package/dist/raw/agent/models/AgentCreateAgentFramework400Response.js +2 -2
- package/dist/raw/agent/models/AgentCreateAgentFramework413Response.d.ts +64 -0
- package/dist/raw/agent/models/AgentCreateAgentFramework413Response.js +74 -0
- package/dist/raw/agent/models/AgentCreateAgentFramework415Response.d.ts +1 -0
- package/dist/raw/agent/models/AgentCreateAgentFramework415Response.js +1 -2
- package/dist/raw/agent/models/AgentGetAgentTrace400Response.d.ts +63 -0
- package/dist/raw/agent/models/AgentGetAgentTrace400Response.js +75 -0
- package/dist/raw/agent/models/AgentHarnessArtifactView.d.ts +27 -15
- package/dist/raw/agent/models/AgentHarnessArtifactView.js +2 -2
- package/dist/raw/agent/models/AgentHarnessVendorArtifactView.d.ts +27 -15
- package/dist/raw/agent/models/AgentHarnessVendorArtifactView.js +2 -2
- package/dist/raw/agent/models/AgentListAgentFrameworks401Response.d.ts +1 -0
- package/dist/raw/agent/models/AgentListAgentFrameworks401Response.js +1 -0
- package/dist/raw/agent/models/AgentOutputArtifactView.d.ts +27 -15
- package/dist/raw/agent/models/AgentOutputArtifactView.js +2 -2
- package/dist/raw/agent/models/AgentPageSessionEventView.d.ts +3 -3
- package/dist/raw/agent/models/AgentPageSessionEventView.js +3 -3
- package/dist/raw/agent/models/AgentQueryAgentTraceStats400Response.d.ts +2 -0
- package/dist/raw/agent/models/AgentQueryAgentTraceStats400Response.js +2 -0
- package/dist/raw/agent/models/AgentRemoteSessionEvent.d.ts +38 -0
- package/dist/raw/agent/models/AgentRemoteSessionEvent.js +58 -0
- package/dist/raw/agent/models/AgentSessionArtifactView.d.ts +52 -15
- package/dist/raw/agent/models/AgentSessionArtifactView.js +4 -2
- package/dist/raw/agent/models/AgentSessionEventView.d.ts +30 -0
- package/dist/raw/agent/models/AgentSessionEventView.js +57 -0
- package/dist/raw/agent/models/AgentSessionMessageArtifactView.d.ts +27 -15
- package/dist/raw/agent/models/AgentSessionMessageArtifactView.js +2 -2
- package/dist/raw/agent/models/AgentSessionMeta.d.ts +25 -0
- package/dist/raw/agent/models/AgentSessionMeta.js +2 -0
- package/dist/raw/agent/models/AgentSessionStreamFrame.d.ts +8 -6
- package/dist/raw/agent/models/AgentSessionStreamFrame.js +7 -0
- package/dist/raw/agent/models/AgentSyncState.d.ts +27 -0
- package/dist/raw/agent/models/AgentSyncState.js +55 -0
- package/dist/raw/agent/models/AgentUploadAgentProfileImage400Response.d.ts +2 -1
- package/dist/raw/agent/models/AgentUploadAgentProfileImage400Response.js +2 -3
- package/dist/raw/agent/models/AgentUploadAgentProfileImage413Response.d.ts +2 -0
- package/dist/raw/agent/models/AgentUploadAgentProfileImage413Response.js +2 -2
- package/dist/raw/agent/models/AgentVisitorArtifactView.d.ts +27 -15
- package/dist/raw/agent/models/AgentVisitorArtifactView.js +2 -2
- package/dist/raw/agent/models/GatewayArtifactBase.d.ts +27 -15
- package/dist/raw/agent/models/GatewayArtifactBase.js +2 -2
- package/dist/raw/agent/models/GatewayTraceStatsGroupBy.d.ts +5 -1
- package/dist/raw/agent/models/GatewayTraceStatsGroupBy.js +4 -0
- package/dist/raw/agent/models/GatewayTraceStatsMeasure.d.ts +3 -1
- package/dist/raw/agent/models/GatewayTraceStatsMeasure.js +2 -0
- package/dist/raw/agent/models/SpanViewDto.d.ts +25 -0
- package/dist/raw/agent/models/SpanViewDto.js +8 -0
- package/dist/raw/agent/models/TraceDetailView.d.ts +9 -0
- package/dist/raw/agent/models/TraceDetailView.js +2 -0
- package/dist/raw/agent/models/TriggerBody.d.ts +52 -0
- package/dist/raw/agent/models/TriggerBody.js +58 -0
- package/dist/raw/agent/models/index.d.ts +6 -1
- package/dist/raw/agent/models/index.js +6 -1
- package/dist/raw/eval/apis/DatasetsApi.d.ts +43 -3
- package/dist/raw/eval/apis/DatasetsApi.js +108 -3
- package/dist/raw/eval/apis/ExperimentsApi.d.ts +8 -24
- package/dist/raw/eval/apis/ExperimentsApi.js +10 -49
- package/dist/raw/eval/apis/ScorersApi.d.ts +1 -1
- package/dist/raw/eval/apis/ScorersApi.js +1 -1
- package/dist/raw/eval/models/AccessView.d.ts +1 -1
- package/dist/raw/eval/models/AccessView.js +1 -1
- package/dist/raw/eval/models/ArtifactConflictProblem.d.ts +1 -1
- package/dist/raw/eval/models/ArtifactConflictProblem.js +1 -1
- package/dist/raw/eval/models/CostView.d.ts +1 -1
- package/dist/raw/eval/models/CostView.js +1 -1
- package/dist/raw/eval/models/CursorPage.d.ts +1 -1
- package/dist/raw/eval/models/CursorPage.js +1 -1
- package/dist/raw/eval/models/EvalArtifactEnvelope.d.ts +1 -1
- package/dist/raw/eval/models/EvalArtifactEnvelope.js +1 -1
- package/dist/raw/eval/models/EvalArtifactSearchRequest.d.ts +1 -1
- package/dist/raw/eval/models/EvalArtifactSearchRequest.js +1 -1
- package/dist/raw/eval/models/EvalBulkDatasetRecordResponse.d.ts +1 -1
- package/dist/raw/eval/models/EvalBulkDatasetRecordResponse.js +1 -1
- package/dist/raw/eval/models/EvalBulkDatasetRecordResult.d.ts +1 -1
- package/dist/raw/eval/models/EvalBulkDatasetRecordResult.js +1 -1
- package/dist/raw/eval/models/EvalBulkExperimentResultResponse.d.ts +1 -1
- package/dist/raw/eval/models/EvalBulkExperimentResultResponse.js +1 -1
- package/dist/raw/eval/models/EvalBulkExperimentResultSlot.d.ts +1 -1
- package/dist/raw/eval/models/EvalBulkExperimentResultSlot.js +1 -1
- package/dist/raw/eval/models/EvalCreateDataset400Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalCreateDataset400Response.js +1 -1
- package/dist/raw/eval/models/EvalCreateDataset409Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalCreateDataset409Response.js +1 -1
- package/dist/raw/eval/models/EvalCreateDataset413Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalCreateDataset413Response.js +1 -1
- package/dist/raw/eval/models/EvalCreateDataset415Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalCreateDataset415Response.js +1 -1
- package/dist/raw/eval/models/EvalCreateDataset422Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalCreateDataset422Response.js +1 -1
- package/dist/raw/eval/models/EvalDatasetArtifactView.d.ts +35 -16
- package/dist/raw/eval/models/EvalDatasetArtifactView.js +5 -3
- package/dist/raw/eval/models/EvalDatasetCreate.d.ts +7 -1
- package/dist/raw/eval/models/EvalDatasetCreate.js +3 -1
- package/dist/raw/eval/models/EvalDatasetMeta.d.ts +8 -1
- package/dist/raw/eval/models/EvalDatasetMeta.js +3 -1
- package/dist/raw/eval/models/EvalDatasetPatch.d.ts +7 -1
- package/dist/raw/eval/models/EvalDatasetPatch.js +3 -1
- package/dist/raw/eval/models/EvalDatasetRecordArtifactView.d.ts +34 -16
- package/dist/raw/eval/models/EvalDatasetRecordArtifactView.js +5 -3
- package/dist/raw/eval/models/EvalDatasetRecordBulkCreate.d.ts +1 -1
- package/dist/raw/eval/models/EvalDatasetRecordBulkCreate.js +1 -1
- package/dist/raw/eval/models/EvalDatasetRecordCreate.d.ts +1 -1
- package/dist/raw/eval/models/EvalDatasetRecordCreate.js +1 -1
- package/dist/raw/eval/models/EvalDatasetRecordMeta.d.ts +7 -1
- package/dist/raw/eval/models/EvalDatasetRecordMeta.js +3 -1
- package/dist/raw/eval/models/EvalDatasetRecordPatch.d.ts +1 -1
- package/dist/raw/eval/models/EvalDatasetRecordPatch.js +1 -1
- package/dist/raw/eval/models/EvalDatasetSnapshot.d.ts +57 -0
- package/dist/raw/eval/models/EvalDatasetSnapshot.js +65 -0
- package/dist/raw/eval/models/EvalDatasetSnapshotRecord.d.ts +99 -0
- package/dist/raw/eval/models/EvalDatasetSnapshotRecord.js +77 -0
- package/dist/raw/eval/models/EvalExperimentArtifactView.d.ts +35 -16
- package/dist/raw/eval/models/EvalExperimentArtifactView.js +6 -3
- package/dist/raw/eval/models/EvalExperimentCreate.d.ts +1 -1
- package/dist/raw/eval/models/EvalExperimentCreate.js +1 -1
- package/dist/raw/eval/models/EvalExperimentMeta.d.ts +10 -4
- package/dist/raw/eval/models/EvalExperimentMeta.js +4 -1
- package/dist/raw/eval/models/EvalExperimentPatch.d.ts +4 -3
- package/dist/raw/eval/models/EvalExperimentPatch.js +1 -1
- package/dist/raw/eval/models/EvalExperimentResultArtifactView.d.ts +45 -16
- package/dist/raw/eval/models/EvalExperimentResultArtifactView.js +7 -3
- package/dist/raw/eval/models/EvalExperimentResultBulkCreate.d.ts +1 -1
- package/dist/raw/eval/models/EvalExperimentResultBulkCreate.js +1 -1
- package/dist/raw/eval/models/EvalExperimentResultCreate.d.ts +16 -1
- package/dist/raw/eval/models/EvalExperimentResultCreate.js +5 -1
- package/dist/raw/eval/models/EvalExperimentResultMeta.d.ts +18 -1
- package/dist/raw/eval/models/EvalExperimentResultMeta.js +5 -1
- package/dist/raw/eval/models/EvalExperimentStatus.d.ts +1 -1
- package/dist/raw/eval/models/EvalExperimentStatus.js +1 -1
- package/dist/raw/eval/models/EvalGetDataset404Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalGetDataset404Response.js +1 -1
- package/dist/raw/eval/models/EvalGetExperimentTrace400Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalGetExperimentTrace400Response.js +1 -1
- package/dist/raw/eval/models/EvalListDatasets400Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalListDatasets400Response.js +1 -1
- package/dist/raw/eval/models/EvalListDatasets401Response.d.ts +2 -1
- package/dist/raw/eval/models/EvalListDatasets401Response.js +2 -1
- package/dist/raw/eval/models/EvalListDatasets403Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalListDatasets403Response.js +1 -1
- package/dist/raw/eval/models/EvalListDatasets500Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalListDatasets500Response.js +1 -1
- package/dist/raw/eval/models/EvalListDatasets503Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalListDatasets503Response.js +1 -1
- package/dist/raw/eval/models/EvalListDatasets504Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalListDatasets504Response.js +1 -1
- package/dist/raw/eval/models/EvalPageDatasetArtifactView.d.ts +1 -1
- package/dist/raw/eval/models/EvalPageDatasetArtifactView.js +1 -1
- package/dist/raw/eval/models/EvalPageDatasetRecordArtifactView.d.ts +1 -1
- package/dist/raw/eval/models/EvalPageDatasetRecordArtifactView.js +1 -1
- package/dist/raw/eval/models/EvalPageExperimentArtifactView.d.ts +1 -1
- package/dist/raw/eval/models/EvalPageExperimentArtifactView.js +1 -1
- package/dist/raw/eval/models/EvalPageExperimentResultArtifactView.d.ts +1 -1
- package/dist/raw/eval/models/EvalPageExperimentResultArtifactView.js +1 -1
- package/dist/raw/eval/models/EvalPageScorerArtifactView.d.ts +1 -1
- package/dist/raw/eval/models/EvalPageScorerArtifactView.js +1 -1
- package/dist/raw/eval/models/EvalPatchDataset412Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalPatchDataset412Response.js +1 -1
- package/dist/raw/eval/models/EvalRecordSource.d.ts +1 -1
- package/dist/raw/eval/models/EvalRecordSource.js +1 -1
- package/dist/raw/eval/models/EvalScorerArtifactView.d.ts +28 -16
- package/dist/raw/eval/models/EvalScorerArtifactView.js +3 -3
- package/dist/raw/eval/models/EvalScorerCreate.d.ts +1 -1
- package/dist/raw/eval/models/EvalScorerCreate.js +1 -1
- package/dist/raw/eval/models/EvalScorerKind.d.ts +1 -1
- package/dist/raw/eval/models/EvalScorerKind.js +1 -1
- package/dist/raw/eval/models/EvalScorerMeta.d.ts +1 -1
- package/dist/raw/eval/models/EvalScorerMeta.js +1 -1
- package/dist/raw/eval/models/EvalScorerPatch.d.ts +1 -1
- package/dist/raw/eval/models/EvalScorerPatch.js +1 -1
- package/dist/raw/eval/models/EvalScorerScope.d.ts +1 -1
- package/dist/raw/eval/models/EvalScorerScope.js +1 -1
- package/dist/raw/eval/models/EvalSubjectKind.d.ts +1 -1
- package/dist/raw/eval/models/EvalSubjectKind.js +1 -1
- package/dist/raw/eval/models/GatewayArtifactBase.d.ts +28 -16
- package/dist/raw/eval/models/GatewayArtifactBase.js +3 -3
- package/dist/raw/eval/models/GatewayArtifactIdentityRevealView.d.ts +1 -1
- package/dist/raw/eval/models/GatewayArtifactIdentityRevealView.js +1 -1
- package/dist/raw/eval/models/GatewayPageMeta.d.ts +1 -1
- package/dist/raw/eval/models/GatewayPageMeta.js +1 -1
- package/dist/raw/eval/models/GatewaySourceEnvelope.d.ts +1 -1
- package/dist/raw/eval/models/GatewaySourceEnvelope.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsBucket.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsBucket.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsCompareMode.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsCompareMode.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsComparison.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsComparison.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsData.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsData.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsDataOneOf.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsDataOneOf.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsDataOneOf1.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsDataOneOf1.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsDataOneOf2.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsDataOneOf2.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsEnvelope.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsEnvelope.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsFilter.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsFilter.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsFilterOperator.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsFilterOperator.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsFilterValue.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsFilterValue.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsGroupBy.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsGroupBy.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsMeasure.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsMeasure.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsMeta.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsMeta.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsOrder.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsOrder.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsOrderBy.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsOrderBy.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsOrderDirection.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsOrderDirection.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsPanelQuery.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsPanelQuery.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsRequest.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsRequest.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsRequestType.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsRequestType.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsScalarResult.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsScalarResult.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsSeries.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsSeries.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsSeriesPoint.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsSeriesPoint.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsTableColumn.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsTableColumn.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsTableColumnType.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsTableColumnType.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsTableRow.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsTableRow.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsWindow.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsWindow.js +1 -1
- package/dist/raw/eval/models/ProblemDetails.d.ts +1 -1
- package/dist/raw/eval/models/ProblemDetails.js +1 -1
- package/dist/raw/eval/models/RegistryEdgeTarget.d.ts +1 -1
- package/dist/raw/eval/models/RegistryEdgeTarget.js +1 -1
- package/dist/raw/eval/models/RegistryRelationshipEdge.d.ts +1 -1
- package/dist/raw/eval/models/RegistryRelationshipEdge.js +1 -1
- package/dist/raw/eval/models/RegistryRelationshipsView.d.ts +1 -1
- package/dist/raw/eval/models/RegistryRelationshipsView.js +1 -1
- package/dist/raw/eval/models/SpanListEnvelope.d.ts +1 -1
- package/dist/raw/eval/models/SpanListEnvelope.js +1 -1
- package/dist/raw/eval/models/SpanViewDto.d.ts +26 -1
- package/dist/raw/eval/models/SpanViewDto.js +9 -1
- package/dist/raw/eval/models/TraceDetailView.d.ts +10 -1
- package/dist/raw/eval/models/TraceDetailView.js +3 -1
- package/dist/raw/eval/models/TraceLinks.d.ts +1 -1
- package/dist/raw/eval/models/TraceLinks.js +1 -1
- package/dist/raw/eval/models/TraceListEnvelope.d.ts +1 -1
- package/dist/raw/eval/models/TraceListEnvelope.js +1 -1
- package/dist/raw/eval/models/TraceParentView.d.ts +1 -1
- package/dist/raw/eval/models/TraceParentView.js +1 -1
- package/dist/raw/eval/models/TraceStatus.d.ts +1 -1
- package/dist/raw/eval/models/TraceStatus.js +1 -1
- package/dist/raw/eval/models/TraceSummaryStats.d.ts +1 -1
- package/dist/raw/eval/models/TraceSummaryStats.js +1 -1
- package/dist/raw/eval/models/TraceSummaryView.d.ts +1 -1
- package/dist/raw/eval/models/TraceSummaryView.js +1 -1
- package/dist/raw/eval/models/UsageView.d.ts +1 -1
- package/dist/raw/eval/models/UsageView.js +1 -1
- package/dist/raw/eval/models/index.d.ts +2 -0
- package/dist/raw/eval/models/index.js +2 -0
- package/dist/raw/eval/runtime.d.ts +1 -1
- package/dist/raw/eval/runtime.js +1 -1
- package/dist/raw/file/apis/FileApi.d.ts +18 -0
- package/dist/raw/file/apis/FileApi.js +25 -1
- package/dist/raw/file/models/FileCreateUpload400Response.d.ts +2 -0
- package/dist/raw/file/models/FileCreateUpload400Response.js +2 -2
- package/dist/raw/file/models/FileCreateUpload413Response.d.ts +2 -1
- package/dist/raw/file/models/FileCreateUpload413Response.js +2 -3
- package/dist/raw/file/models/FileCreateUpload415Response.d.ts +1 -0
- package/dist/raw/file/models/FileCreateUpload415Response.js +1 -2
- package/dist/raw/file/models/FileFile.d.ts +4 -0
- package/dist/raw/file/models/FileFileArtifact.d.ts +31 -15
- package/dist/raw/file/models/FileFileArtifact.js +2 -2
- package/dist/raw/file/models/FileIngestUpload400Response.d.ts +2 -1
- package/dist/raw/file/models/FileIngestUpload400Response.js +2 -3
- package/dist/raw/file/models/FileIngestUpload415Response.d.ts +63 -0
- package/dist/raw/file/models/FileIngestUpload415Response.js +75 -0
- package/dist/raw/file/models/FileList401Response.d.ts +1 -0
- package/dist/raw/file/models/FileList401Response.js +1 -0
- package/dist/raw/file/models/GatewayArtifactBase.d.ts +27 -15
- package/dist/raw/file/models/GatewayArtifactBase.js +2 -2
- package/dist/raw/file/models/index.d.ts +1 -0
- package/dist/raw/file/models/index.js +1 -0
- package/dist/raw/mcp/apis/ServersApi.d.ts +20 -2
- package/dist/raw/mcp/apis/ServersApi.js +27 -3
- package/dist/raw/mcp/apis/ToolsApi.d.ts +18 -0
- package/dist/raw/mcp/apis/ToolsApi.js +25 -1
- package/dist/raw/mcp/models/GatewayArtifactBase.d.ts +27 -15
- package/dist/raw/mcp/models/GatewayArtifactBase.js +2 -2
- package/dist/raw/mcp/models/McpAggregateServers400Response.d.ts +2 -0
- package/dist/raw/mcp/models/McpAggregateServers400Response.js +2 -0
- package/dist/raw/mcp/models/McpAggregateServers413Response.d.ts +64 -0
- package/dist/raw/mcp/models/McpAggregateServers413Response.js +74 -0
- package/dist/raw/mcp/models/McpAggregateServers415Response.d.ts +1 -0
- package/dist/raw/mcp/models/McpAggregateServers415Response.js +1 -2
- package/dist/raw/mcp/models/McpConnectionState.d.ts +2 -1
- package/dist/raw/mcp/models/McpConnectionState.js +2 -1
- package/dist/raw/mcp/models/McpListServers401Response.d.ts +1 -0
- package/dist/raw/mcp/models/McpListServers401Response.js +1 -0
- package/dist/raw/mcp/models/McpMcpServer.d.ts +27 -0
- package/dist/raw/mcp/models/McpMcpServer.js +4 -0
- package/dist/raw/mcp/models/McpMcpServerArtifactView.d.ts +54 -15
- package/dist/raw/mcp/models/McpMcpServerArtifactView.js +6 -2
- package/dist/raw/mcp/models/McpMcpSessionMessage.d.ts +1 -1
- package/dist/raw/mcp/models/McpMcpToolArtifactView.d.ts +27 -15
- package/dist/raw/mcp/models/McpMcpToolArtifactView.js +2 -2
- package/dist/raw/mcp/models/McpServerTestResponse.d.ts +13 -2
- package/dist/raw/mcp/models/index.d.ts +1 -0
- package/dist/raw/mcp/models/index.js +1 -0
- package/dist/raw/model/apis/OpenaiApi.d.ts +4 -4
- package/dist/raw/model/apis/OpenaiApi.js +4 -4
- package/dist/raw/model/models/ModelListProviders401Response.d.ts +1 -0
- package/dist/raw/model/models/ModelListProviders401Response.js +1 -0
- package/dist/raw/registry/apis/AppsApi.d.ts +159 -0
- package/dist/raw/registry/apis/AppsApi.js +385 -0
- package/dist/raw/registry/apis/AuthApi.d.ts +2 -2
- package/dist/raw/registry/apis/AuthApi.js +2 -2
- package/dist/raw/registry/apis/DiscoveryApi.d.ts +27 -0
- package/dist/raw/registry/apis/DiscoveryApi.js +37 -1
- package/dist/raw/registry/apis/InvitationsApi.d.ts +159 -0
- package/dist/raw/registry/apis/InvitationsApi.js +383 -0
- package/dist/raw/registry/apis/OrganisationsApi.d.ts +51 -0
- package/dist/raw/registry/apis/OrganisationsApi.js +108 -1
- package/dist/raw/registry/apis/ReleasesApi.d.ts +199 -0
- package/dist/raw/registry/apis/ReleasesApi.js +484 -0
- package/dist/raw/registry/apis/ReposApi.d.ts +27 -0
- package/dist/raw/registry/apis/ReposApi.js +37 -1
- package/dist/raw/registry/apis/RolesApi.d.ts +32 -0
- package/dist/raw/registry/apis/RolesApi.js +95 -0
- package/dist/raw/registry/apis/ServiceAccountsApi.d.ts +13 -4
- package/dist/raw/registry/apis/ServiceAccountsApi.js +17 -5
- package/dist/raw/registry/apis/SessionsApi.d.ts +60 -0
- package/dist/raw/registry/apis/SessionsApi.js +150 -0
- package/dist/raw/registry/apis/UsersApi.d.ts +75 -43
- package/dist/raw/registry/apis/UsersApi.js +139 -74
- package/dist/raw/registry/apis/WorkspacesApi.d.ts +80 -4
- package/dist/raw/registry/apis/WorkspacesApi.js +152 -5
- package/dist/raw/registry/apis/index.d.ts +5 -7
- package/dist/raw/registry/apis/index.js +5 -7
- package/dist/raw/registry/models/{ExtensionJobDto.d.ts → AppActionDto.d.ts} +33 -27
- package/dist/raw/registry/models/{ExtensionJobDto.js → AppActionDto.js} +22 -20
- package/dist/raw/registry/models/AppActionsPage.d.ts +40 -0
- package/dist/raw/registry/models/{PublishersPage.js → AppActionsPage.js} +16 -16
- package/dist/raw/registry/models/AppDto.d.ts +174 -0
- package/dist/raw/registry/models/AppDto.js +116 -0
- package/dist/raw/registry/models/AppsPage.d.ts +40 -0
- package/dist/raw/registry/models/{GroupsPage.js → AppsPage.js} +16 -16
- package/dist/raw/registry/models/ArtifactView.d.ts +76 -15
- package/dist/raw/registry/models/ArtifactView.js +10 -2
- package/dist/raw/registry/models/CreateInvitationsRequest.d.ts +33 -0
- package/dist/raw/registry/models/CreateInvitationsRequest.js +51 -0
- package/dist/raw/registry/models/CreateWorkspaceBody.d.ts +9 -0
- package/dist/raw/registry/models/CreateWorkspaceBody.js +2 -0
- package/dist/raw/registry/models/CutReleaseBody.d.ts +56 -0
- package/dist/raw/registry/models/CutReleaseBody.js +56 -0
- package/dist/raw/registry/models/EdgeTarget.d.ts +4 -0
- package/dist/raw/registry/models/InstallAppBody.d.ts +34 -0
- package/dist/raw/registry/models/InstallAppBody.js +48 -0
- package/dist/raw/registry/models/IntrospectedIdentity.d.ts +12 -3
- package/dist/raw/registry/models/IntrospectedIdentity.js +5 -3
- package/dist/raw/registry/models/InvitationDto.d.ts +98 -0
- package/dist/raw/registry/models/InvitationDto.js +88 -0
- package/dist/raw/registry/models/InvitationSendResult.d.ts +38 -0
- package/dist/raw/registry/models/InvitationSendResult.js +54 -0
- package/dist/raw/registry/models/InvitationSummaryDto.d.ts +86 -0
- package/dist/raw/registry/models/InvitationSummaryDto.js +84 -0
- package/dist/raw/registry/models/InvitationsPage.d.ts +40 -0
- package/dist/raw/registry/models/{MembershipsPage.js → InvitationsPage.js} +16 -16
- package/dist/raw/registry/models/InvitationsResponse.d.ts +33 -0
- package/dist/raw/registry/models/InvitationsResponse.js +51 -0
- package/dist/raw/registry/models/InviteeRequest.d.ts +44 -0
- package/dist/raw/registry/models/InviteeRequest.js +56 -0
- package/dist/raw/registry/models/InviteeResult.d.ts +69 -0
- package/dist/raw/registry/models/InviteeResult.js +66 -0
- package/dist/raw/registry/models/ReconcileAcceptedDto.d.ts +40 -0
- package/dist/raw/registry/models/ReconcileAcceptedDto.js +54 -0
- package/dist/raw/registry/models/RegistryAggregate400Response.d.ts +2 -0
- package/dist/raw/registry/models/RegistryAggregate400Response.js +2 -2
- package/dist/raw/registry/models/{RegistryListActionRuns401Response.d.ts → RegistryAggregate401Response.d.ts} +17 -16
- package/dist/raw/registry/models/RegistryAggregate401Response.js +90 -0
- package/dist/raw/registry/models/RegistryAggregate403Response.d.ts +64 -0
- package/dist/raw/registry/models/RegistryAggregate403Response.js +74 -0
- package/dist/raw/registry/models/RegistryAggregate413Response.d.ts +64 -0
- package/dist/raw/registry/models/RegistryAggregate413Response.js +74 -0
- package/dist/raw/registry/models/RegistryAggregate415Response.d.ts +1 -0
- package/dist/raw/registry/models/RegistryAggregate415Response.js +1 -2
- package/dist/raw/registry/models/RegistryAggregate500Response.d.ts +63 -0
- package/dist/raw/registry/models/RegistryAggregate500Response.js +75 -0
- package/dist/raw/registry/models/RegistryAggregate503Response.d.ts +64 -0
- package/dist/raw/registry/models/RegistryAggregate503Response.js +74 -0
- package/dist/raw/registry/models/RegistryAggregate504Response.d.ts +63 -0
- package/dist/raw/registry/models/RegistryAggregate504Response.js +75 -0
- package/dist/raw/registry/models/RegistryAggregateKind404Response.d.ts +63 -0
- package/dist/raw/registry/models/{RegistryGetActionRun404Response.js → RegistryAggregateKind404Response.js} +18 -18
- package/dist/raw/registry/models/RegistryCreateServiceAccount400Response.d.ts +66 -0
- package/dist/raw/registry/models/RegistryCreateServiceAccount400Response.js +76 -0
- package/dist/raw/registry/models/RegistryInstallApp409Response.d.ts +63 -0
- package/dist/raw/registry/models/RegistryInstallApp409Response.js +75 -0
- package/dist/raw/registry/models/RegistryListApps400Response.d.ts +63 -0
- package/dist/raw/registry/models/RegistryListApps400Response.js +75 -0
- package/dist/raw/registry/models/RegistryListApps503Response.d.ts +65 -0
- package/dist/raw/registry/models/RegistryListApps503Response.js +75 -0
- package/dist/raw/registry/models/RegistryListArtifactReleases400Response.d.ts +63 -0
- package/dist/raw/registry/models/RegistryListArtifactReleases400Response.js +75 -0
- package/dist/raw/registry/models/RegistryListUserTraces503Response.d.ts +66 -0
- package/dist/raw/registry/models/RegistryListUserTraces503Response.js +76 -0
- package/dist/raw/registry/models/RegistryRevokeOwnSessions400Response.d.ts +64 -0
- package/dist/raw/registry/models/RegistryRevokeOwnSessions400Response.js +74 -0
- package/dist/raw/registry/models/RegistryRevokeOwnSessions415Response.d.ts +63 -0
- package/dist/raw/registry/models/RegistryRevokeOwnSessions415Response.js +75 -0
- package/dist/raw/registry/models/RegistryWhoami503Response.d.ts +66 -0
- package/dist/raw/registry/models/RegistryWhoami503Response.js +76 -0
- package/dist/raw/registry/models/RegistryWorkspacePluginRef.d.ts +61 -0
- package/dist/raw/registry/models/RegistryWorkspacePluginRef.js +62 -0
- package/dist/raw/registry/models/RegistryWorkspaceRecommendation.d.ts +66 -0
- package/dist/raw/registry/models/RegistryWorkspaceRecommendation.js +64 -0
- package/dist/raw/registry/models/RegistryWorkspaceRecommendationReason.d.ts +29 -0
- package/dist/raw/registry/models/RegistryWorkspaceRecommendationReason.js +57 -0
- package/dist/raw/registry/models/RegistryWorkspaceView.d.ts +42 -0
- package/dist/raw/registry/models/RegistryWorkspaceView.js +11 -0
- package/dist/raw/registry/models/RelationshipsView.d.ts +5 -1
- package/dist/raw/registry/models/ReleaseDto.d.ts +123 -0
- package/dist/raw/registry/models/ReleaseDto.js +100 -0
- package/dist/raw/registry/models/ReleasePage.d.ts +40 -0
- package/dist/raw/registry/models/{BudgetsPage.js → ReleasePage.js} +16 -16
- package/dist/raw/registry/models/ReleasePolicyDto.d.ts +76 -0
- package/dist/raw/registry/models/ReleasePolicyDto.js +78 -0
- package/dist/raw/registry/models/RoleDto.d.ts +38 -0
- package/dist/raw/registry/models/RoleDto.js +54 -0
- package/dist/raw/registry/models/RoleListDto.d.ts +33 -0
- package/dist/raw/registry/models/RoleListDto.js +51 -0
- package/dist/raw/registry/models/SearchRequest.d.ts +1 -1
- package/dist/raw/registry/models/ServiceAccountDto.d.ts +5 -1
- package/dist/raw/registry/models/SetReleasePolicyBody.d.ts +55 -0
- package/dist/raw/registry/models/SetReleasePolicyBody.js +54 -0
- package/dist/raw/registry/models/SetTraceContentPolicyDto.d.ts +34 -0
- package/dist/raw/registry/models/SetTraceContentPolicyDto.js +48 -0
- package/dist/raw/registry/models/SetVisibilityBody.d.ts +33 -0
- package/dist/raw/registry/models/SetVisibilityBody.js +50 -0
- package/dist/raw/registry/models/SpanViewDto.d.ts +25 -0
- package/dist/raw/registry/models/SpanViewDto.js +8 -0
- package/dist/raw/registry/models/TraceContentDeletionDto.d.ts +32 -0
- package/dist/raw/registry/models/TraceContentDeletionDto.js +50 -0
- package/dist/raw/registry/models/TraceContentPolicyDto.d.ts +48 -0
- package/dist/raw/registry/models/TraceContentPolicyDto.js +52 -0
- package/dist/raw/registry/models/TraceDetailView.d.ts +9 -0
- package/dist/raw/registry/models/TraceDetailView.js +2 -0
- package/dist/raw/registry/models/UpdateInvitationRequest.d.ts +38 -0
- package/dist/raw/registry/models/UpdateInvitationRequest.js +50 -0
- package/dist/raw/registry/models/UpgradeAppBody.d.ts +37 -0
- package/dist/raw/registry/models/UpgradeAppBody.js +48 -0
- package/dist/raw/registry/models/UserDirectoryDto.d.ts +55 -0
- package/dist/raw/registry/models/UserDirectoryDto.js +58 -0
- package/dist/raw/registry/models/UsersPage.d.ts +3 -3
- package/dist/raw/registry/models/UsersPage.js +3 -3
- package/dist/raw/registry/models/WhoamiResponse.d.ts +12 -3
- package/dist/raw/registry/models/WhoamiResponse.js +5 -3
- package/dist/raw/registry/models/WithdrawBody.d.ts +33 -0
- package/dist/raw/registry/models/WithdrawBody.js +48 -0
- package/dist/raw/registry/models/WorkspaceInvitationListDto.d.ts +33 -0
- package/dist/raw/registry/models/WorkspaceInvitationListDto.js +51 -0
- package/dist/raw/registry/models/WorkspaceInvitationRow.d.ts +44 -0
- package/dist/raw/registry/models/WorkspaceInvitationRow.js +58 -0
- package/dist/raw/registry/models/WorkspaceRecommendationsPage.d.ts +40 -0
- package/dist/raw/registry/models/WorkspaceRecommendationsPage.js +56 -0
- package/dist/raw/registry/models/index.d.ts +51 -50
- package/dist/raw/registry/models/index.js +51 -50
- package/dist/raw/secret/apis/OauthApi.d.ts +143 -0
- package/dist/raw/secret/apis/OauthApi.js +335 -0
- package/dist/raw/secret/apis/index.d.ts +1 -0
- package/dist/raw/secret/apis/index.js +19 -0
- package/dist/raw/secret/index.d.ts +1 -0
- package/dist/raw/secret/index.js +1 -0
- package/dist/raw/secret/models/GatewayOauthCompleteRequest.d.ts +32 -0
- package/dist/raw/secret/models/GatewayOauthCompleteRequest.js +50 -0
- package/dist/raw/secret/models/GatewayOauthCompletion.d.ts +46 -0
- package/dist/raw/secret/models/GatewayOauthCompletion.js +55 -0
- package/dist/raw/secret/models/GatewayOauthConnection.d.ts +83 -0
- package/dist/raw/secret/models/GatewayOauthConnection.js +83 -0
- package/dist/raw/secret/models/GatewayOauthOwner.d.ts +31 -0
- package/dist/raw/secret/models/GatewayOauthOwner.js +59 -0
- package/dist/raw/secret/models/GatewayOauthProviderView.d.ts +69 -0
- package/dist/raw/secret/models/GatewayOauthProviderView.js +69 -0
- package/dist/raw/secret/models/GatewayOauthStartRequest.d.ts +52 -0
- package/dist/raw/secret/models/GatewayOauthStartRequest.js +59 -0
- package/dist/raw/secret/models/GatewayOauthStarted.d.ts +39 -0
- package/dist/raw/secret/models/GatewayOauthStarted.js +54 -0
- package/dist/raw/secret/models/SecretCompleteOauth400Response.d.ts +70 -0
- package/dist/raw/secret/models/SecretCompleteOauth400Response.js +80 -0
- package/dist/raw/secret/models/SecretCompleteOauth413Response.d.ts +64 -0
- package/dist/raw/secret/models/SecretCompleteOauth413Response.js +74 -0
- package/dist/raw/secret/models/SecretCompleteOauth415Response.d.ts +64 -0
- package/dist/raw/secret/models/SecretCompleteOauth415Response.js +74 -0
- package/dist/raw/secret/models/SecretCompleteOauth422Response.d.ts +63 -0
- package/dist/raw/secret/models/SecretCompleteOauth422Response.js +75 -0
- package/dist/raw/secret/models/SecretDisconnectOauth400Response.d.ts +67 -0
- package/dist/raw/secret/models/SecretDisconnectOauth400Response.js +77 -0
- package/dist/raw/secret/models/SecretOauthCallback400Response.d.ts +68 -0
- package/dist/raw/secret/models/SecretOauthCallback400Response.js +78 -0
- package/dist/raw/secret/models/SecretOauthCallback401Response.d.ts +80 -0
- package/dist/raw/secret/models/SecretOauthCallback401Response.js +90 -0
- package/dist/raw/secret/models/SecretOauthCallback403Response.d.ts +66 -0
- package/dist/raw/secret/models/SecretOauthCallback403Response.js +76 -0
- package/dist/raw/secret/models/SecretOauthCallback404Response.d.ts +65 -0
- package/dist/raw/secret/models/SecretOauthCallback404Response.js +75 -0
- package/dist/raw/secret/models/SecretOauthCallback500Response.d.ts +64 -0
- package/dist/raw/secret/models/SecretOauthCallback500Response.js +74 -0
- package/dist/raw/secret/models/SecretOauthCallback503Response.d.ts +66 -0
- package/dist/raw/secret/models/SecretOauthCallback503Response.js +76 -0
- package/dist/raw/secret/models/SecretOauthCallback504Response.d.ts +63 -0
- package/dist/raw/secret/models/SecretOauthCallback504Response.js +75 -0
- package/dist/raw/secret/models/index.d.ts +19 -0
- package/dist/raw/secret/models/index.js +19 -0
- package/dist/raw/skill/apis/SkillApi.d.ts +65 -10
- package/dist/raw/skill/apis/SkillApi.js +86 -11
- package/dist/raw/skill/models/GatewayArtifactBase.d.ts +27 -15
- package/dist/raw/skill/models/GatewayArtifactBase.js +2 -2
- package/dist/raw/skill/models/GatewayTraceStatsGroupBy.d.ts +5 -1
- package/dist/raw/skill/models/GatewayTraceStatsGroupBy.js +4 -0
- package/dist/raw/skill/models/GatewayTraceStatsMeasure.d.ts +3 -1
- package/dist/raw/skill/models/GatewayTraceStatsMeasure.js +2 -0
- package/dist/raw/skill/models/SkillAggregate400Response.d.ts +2 -0
- package/dist/raw/skill/models/SkillAggregate400Response.js +2 -2
- package/dist/raw/skill/models/SkillAggregate415Response.d.ts +1 -0
- package/dist/raw/skill/models/SkillAggregate415Response.js +1 -2
- package/dist/raw/skill/models/SkillCreate400Response.d.ts +2 -1
- package/dist/raw/skill/models/SkillCreate400Response.js +2 -3
- package/dist/raw/skill/models/SkillCreate413Response.d.ts +64 -0
- package/dist/raw/skill/models/SkillCreate413Response.js +74 -0
- package/dist/raw/skill/models/SkillCreate415Response.d.ts +63 -0
- package/dist/raw/skill/models/SkillCreate415Response.js +75 -0
- package/dist/raw/skill/models/SkillInsightSchemas401Response.d.ts +1 -0
- package/dist/raw/skill/models/SkillInsightSchemas401Response.js +1 -0
- package/dist/raw/skill/models/SkillQuerySkillTraceStats400Response.d.ts +2 -0
- package/dist/raw/skill/models/SkillQuerySkillTraceStats400Response.js +2 -0
- package/dist/raw/skill/models/SkillSkill.d.ts +6 -7
- package/dist/raw/skill/models/SkillSkillArtifactView.d.ts +33 -22
- package/dist/raw/skill/models/SkillSkillArtifactView.js +2 -2
- package/dist/raw/skill/models/SpanViewDto.d.ts +25 -0
- package/dist/raw/skill/models/SpanViewDto.js +8 -0
- package/dist/raw/skill/models/TraceDetailView.d.ts +9 -0
- package/dist/raw/skill/models/TraceDetailView.js +2 -0
- package/dist/raw/skill/models/index.d.ts +2 -0
- package/dist/raw/skill/models/index.js +2 -0
- package/dist/resource-types.d.ts +670 -0
- package/dist/resource-types.js +2 -0
- package/dist/resources.d.ts +6 -1
- package/dist/resources.js +9 -6
- package/dist/resources.json +398 -329
- package/dist/tracing/client.d.ts +10 -1
- package/dist/tracing/client.js +50 -16
- package/dist/tracing/compat.d.ts +82 -0
- package/dist/tracing/compat.js +128 -0
- package/dist/tracing/config.d.ts +3 -1
- package/dist/tracing/config.js +7 -2
- package/dist/tracing/exporter.d.ts +19 -1
- package/dist/tracing/exporter.js +56 -14
- package/dist/tracing/index.d.ts +2 -0
- package/dist/tracing/index.js +13 -1
- package/dist/tracing/integrations.d.ts +35 -0
- package/dist/tracing/integrations.js +95 -0
- package/dist/tracing/propagation.d.ts +2 -0
- package/dist/tracing/propagation.js +16 -0
- package/dist/tracing/semconv.d.ts +4 -0
- package/dist/tracing/semconv.js +14 -2
- package/dist/tracing/spans.d.ts +6 -0
- package/dist/tracing/spans.js +20 -1
- package/dist/tracing/version.d.ts +1 -1
- package/dist/tracing/version.js +1 -1
- package/package.json +1 -1
- package/dist/raw/agent/models/Box.d.ts +0 -330
- package/dist/raw/agent/models/Box.js +0 -167
- package/dist/raw/registry/apis/ActionsApi.d.ts +0 -68
- package/dist/raw/registry/apis/ActionsApi.js +0 -181
- package/dist/raw/registry/apis/CatalogApi.d.ts +0 -98
- package/dist/raw/registry/apis/CatalogApi.js +0 -259
- package/dist/raw/registry/apis/DetectedUsersApi.d.ts +0 -89
- package/dist/raw/registry/apis/DetectedUsersApi.js +0 -239
- package/dist/raw/registry/apis/ExtensionsApi.d.ts +0 -68
- package/dist/raw/registry/apis/ExtensionsApi.js +0 -181
- package/dist/raw/registry/apis/GroupsApi.d.ts +0 -68
- package/dist/raw/registry/apis/GroupsApi.js +0 -181
- package/dist/raw/registry/apis/ProjectsApi.d.ts +0 -159
- package/dist/raw/registry/apis/ProjectsApi.js +0 -402
- package/dist/raw/registry/apis/UsageApi.d.ts +0 -134
- package/dist/raw/registry/apis/UsageApi.js +0 -349
- package/dist/raw/registry/models/ActionRunDto.d.ts +0 -99
- package/dist/raw/registry/models/ActionRunDto.js +0 -86
- package/dist/raw/registry/models/ActionRunJobDto.d.ts +0 -92
- package/dist/raw/registry/models/ActionRunJobDto.js +0 -78
- package/dist/raw/registry/models/ActionRunJobsPage.d.ts +0 -40
- package/dist/raw/registry/models/ActionRunJobsPage.js +0 -56
- package/dist/raw/registry/models/ActionRunsPage.d.ts +0 -40
- package/dist/raw/registry/models/ActionRunsPage.js +0 -56
- package/dist/raw/registry/models/AvailableExtensionDto.d.ts +0 -123
- package/dist/raw/registry/models/AvailableExtensionDto.js +0 -96
- package/dist/raw/registry/models/AvailableExtensionsPage.d.ts +0 -40
- package/dist/raw/registry/models/AvailableExtensionsPage.js +0 -56
- package/dist/raw/registry/models/BudgetDto.d.ts +0 -111
- package/dist/raw/registry/models/BudgetDto.js +0 -96
- package/dist/raw/registry/models/BudgetsPage.d.ts +0 -40
- package/dist/raw/registry/models/CreateBudgetBody.d.ts +0 -86
- package/dist/raw/registry/models/CreateBudgetBody.js +0 -78
- package/dist/raw/registry/models/CreateProjectBody.d.ts +0 -56
- package/dist/raw/registry/models/CreateProjectBody.js +0 -60
- package/dist/raw/registry/models/DetectedUserDto.d.ts +0 -84
- package/dist/raw/registry/models/DetectedUserDto.js +0 -74
- package/dist/raw/registry/models/DetectedUsersPage.d.ts +0 -40
- package/dist/raw/registry/models/DetectedUsersPage.js +0 -56
- package/dist/raw/registry/models/ExtensionJobsPage.d.ts +0 -40
- package/dist/raw/registry/models/ExtensionJobsPage.js +0 -56
- package/dist/raw/registry/models/ExtensionVersionDto.d.ts +0 -50
- package/dist/raw/registry/models/ExtensionVersionDto.js +0 -58
- package/dist/raw/registry/models/ExtensionVersionsPage.d.ts +0 -40
- package/dist/raw/registry/models/ExtensionVersionsPage.js +0 -56
- package/dist/raw/registry/models/GroupMemberDto.d.ts +0 -44
- package/dist/raw/registry/models/GroupMemberDto.js +0 -58
- package/dist/raw/registry/models/GroupMembersPage.d.ts +0 -40
- package/dist/raw/registry/models/GroupMembersPage.js +0 -56
- package/dist/raw/registry/models/GroupsPage.d.ts +0 -40
- package/dist/raw/registry/models/InstalledExtensionDto.d.ts +0 -80
- package/dist/raw/registry/models/InstalledExtensionDto.js +0 -82
- package/dist/raw/registry/models/InstalledExtensionsPage.d.ts +0 -40
- package/dist/raw/registry/models/InstalledExtensionsPage.js +0 -56
- package/dist/raw/registry/models/MembershipDto.d.ts +0 -60
- package/dist/raw/registry/models/MembershipDto.js +0 -66
- package/dist/raw/registry/models/MembershipsPage.d.ts +0 -40
- package/dist/raw/registry/models/PatchBudgetBody.d.ts +0 -62
- package/dist/raw/registry/models/PatchBudgetBody.js +0 -58
- package/dist/raw/registry/models/PatchProjectBody.d.ts +0 -50
- package/dist/raw/registry/models/PatchProjectBody.js +0 -54
- package/dist/raw/registry/models/PatchUserBody.d.ts +0 -35
- package/dist/raw/registry/models/PatchUserBody.js +0 -48
- package/dist/raw/registry/models/ProjectBulkCreateRequest.d.ts +0 -33
- package/dist/raw/registry/models/ProjectBulkCreateRequest.js +0 -51
- package/dist/raw/registry/models/ProjectDto.d.ts +0 -102
- package/dist/raw/registry/models/ProjectDto.js +0 -92
- package/dist/raw/registry/models/ProjectExport.d.ts +0 -49
- package/dist/raw/registry/models/ProjectExport.js +0 -59
- package/dist/raw/registry/models/ProjectSlot.d.ts +0 -54
- package/dist/raw/registry/models/ProjectSlot.js +0 -60
- package/dist/raw/registry/models/ProjectsBulkResponse.d.ts +0 -40
- package/dist/raw/registry/models/ProjectsBulkResponse.js +0 -51
- package/dist/raw/registry/models/ProjectsPage.d.ts +0 -40
- package/dist/raw/registry/models/ProjectsPage.js +0 -56
- package/dist/raw/registry/models/PublisherDto.d.ts +0 -80
- package/dist/raw/registry/models/PublisherDto.js +0 -76
- package/dist/raw/registry/models/PublishersPage.d.ts +0 -40
- package/dist/raw/registry/models/RegistryCreateServiceAccount409Response.d.ts +0 -63
- package/dist/raw/registry/models/RegistryCreateServiceAccount409Response.js +0 -75
- package/dist/raw/registry/models/RegistryGetActionRun404Response.d.ts +0 -63
- package/dist/raw/registry/models/RegistryListActionRuns400Response.d.ts +0 -63
- package/dist/raw/registry/models/RegistryListActionRuns400Response.js +0 -75
- package/dist/raw/registry/models/RegistryListActionRuns401Response.js +0 -89
- package/dist/raw/registry/models/RegistryListActionRuns403Response.d.ts +0 -64
- package/dist/raw/registry/models/RegistryListActionRuns403Response.js +0 -74
- package/dist/raw/registry/models/RegistryListActionRuns500Response.d.ts +0 -63
- package/dist/raw/registry/models/RegistryListActionRuns500Response.js +0 -75
- package/dist/raw/registry/models/RegistryListActionRuns503Response.d.ts +0 -64
- package/dist/raw/registry/models/RegistryListActionRuns503Response.js +0 -74
- package/dist/raw/registry/models/RegistryListActionRuns504Response.d.ts +0 -63
- package/dist/raw/registry/models/RegistryListActionRuns504Response.js +0 -75
- package/dist/raw/registry/models/RegistryListUserTraces400Response.d.ts +0 -63
- package/dist/raw/registry/models/RegistryListUserTraces400Response.js +0 -75
- package/dist/raw/registry/models/RegistryListWorkspaces503Response.d.ts +0 -65
- package/dist/raw/registry/models/RegistryListWorkspaces503Response.js +0 -75
- package/dist/raw/registry/models/UpdateDetectedUserRequest.d.ts +0 -48
- package/dist/raw/registry/models/UpdateDetectedUserRequest.js +0 -52
- package/dist/raw/registry/models/UsageCounters.d.ts +0 -78
- package/dist/raw/registry/models/UsageCounters.js +0 -78
- package/dist/raw/registry/models/UsageDayDto.d.ts +0 -129
- package/dist/raw/registry/models/UsageDayDto.js +0 -114
- package/dist/raw/registry/models/UsageDaysPage.d.ts +0 -40
- package/dist/raw/registry/models/UsageDaysPage.js +0 -56
- package/dist/raw/registry/models/UsageMinuteDto.d.ts +0 -136
- package/dist/raw/registry/models/UsageMinuteDto.js +0 -118
- package/dist/raw/registry/models/UsageMinutesPage.d.ts +0 -40
- package/dist/raw/registry/models/UsageMinutesPage.js +0 -56
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -65,6 +65,7 @@ export declare enum EvalListDatasets401ResponseCodeEnum {
|
|
|
65
65
|
TokenNotYetValid = "token_not_yet_valid",
|
|
66
66
|
TokenRejected = "token_rejected",
|
|
67
67
|
TokenServiceAccountUnbound = "token_service_account_unbound",
|
|
68
|
+
Unauthorized = "unauthorized",
|
|
68
69
|
UnknownAccount = "unknown_account",
|
|
69
70
|
UnknownKey = "unknown_key",
|
|
70
71
|
UntrustedIssuer = "untrusted_issuer"
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -39,6 +39,7 @@ var EvalListDatasets401ResponseCodeEnum;
|
|
|
39
39
|
EvalListDatasets401ResponseCodeEnum["TokenNotYetValid"] = "token_not_yet_valid";
|
|
40
40
|
EvalListDatasets401ResponseCodeEnum["TokenRejected"] = "token_rejected";
|
|
41
41
|
EvalListDatasets401ResponseCodeEnum["TokenServiceAccountUnbound"] = "token_service_account_unbound";
|
|
42
|
+
EvalListDatasets401ResponseCodeEnum["Unauthorized"] = "unauthorized";
|
|
42
43
|
EvalListDatasets401ResponseCodeEnum["UnknownAccount"] = "unknown_account";
|
|
43
44
|
EvalListDatasets401ResponseCodeEnum["UnknownKey"] = "unknown_key";
|
|
44
45
|
EvalListDatasets401ResponseCodeEnum["UntrustedIssuer"] = "untrusted_issuer";
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -19,6 +19,12 @@ import type { RegistryRelationshipsView } from './RegistryRelationshipsView';
|
|
|
19
19
|
* @interface EvalScorerArtifactView
|
|
20
20
|
*/
|
|
21
21
|
export interface EvalScorerArtifactView {
|
|
22
|
+
/**
|
|
23
|
+
* Value of the `app` field.
|
|
24
|
+
* @type {string}
|
|
25
|
+
* @memberof EvalScorerArtifactView
|
|
26
|
+
*/
|
|
27
|
+
app?: string;
|
|
22
28
|
/**
|
|
23
29
|
* Value of the `artifact_status` field.
|
|
24
30
|
* @type {string}
|
|
@@ -61,12 +67,6 @@ export interface EvalScorerArtifactView {
|
|
|
61
67
|
* @memberof EvalScorerArtifactView
|
|
62
68
|
*/
|
|
63
69
|
displayName?: string;
|
|
64
|
-
/**
|
|
65
|
-
* Value of the `extension` field.
|
|
66
|
-
* @type {string}
|
|
67
|
-
* @memberof EvalScorerArtifactView
|
|
68
|
-
*/
|
|
69
|
-
extension?: string;
|
|
70
70
|
/**
|
|
71
71
|
* Kind-prefixed Crockford-base32 handle (`<kind>_<base32>`).
|
|
72
72
|
* @type {string}
|
|
@@ -105,19 +105,28 @@ export interface EvalScorerArtifactView {
|
|
|
105
105
|
* The Control-Plane OIDC client id this artifact authenticates as
|
|
106
106
|
* (`x-gateway-identity` kinds); absent for every other kind.
|
|
107
107
|
*
|
|
108
|
-
* **Derived, not stored
|
|
109
|
-
*
|
|
110
|
-
*
|
|
111
|
-
*
|
|
112
|
-
*
|
|
113
|
-
*
|
|
108
|
+
* **Derived, not stored, and present on the create response only.** The
|
|
109
|
+
* registry would resolve it from the artifact's `service_principals` row
|
|
110
|
+
* rather than keep a second copy on the artifact — but only the create path
|
|
111
|
+
* does that lookup, because it has just provisioned the identity. Every read
|
|
112
|
+
* shape (single read, list, search, `PATCH`) is built by one constructor that
|
|
113
|
+
* sets this `None`, so it is absent from all four.
|
|
114
|
+
*
|
|
115
|
+
* This block used to name the single-artifact read as a second populated path.
|
|
116
|
+
* It was never one. Adding it means deciding whether list and search pay a
|
|
117
|
+
* per-row identity read too; the lookup a future implementation would call is
|
|
118
|
+
* `registry_server::identity::artifact_principal`. It is the public half of the
|
|
119
|
+
* credential pair and is not secret.
|
|
114
120
|
* @type {string}
|
|
115
121
|
* @memberof EvalScorerArtifactView
|
|
116
122
|
*/
|
|
117
123
|
oidcClientId?: string;
|
|
118
124
|
/**
|
|
119
125
|
* Canonical owner: the `users.user_id` this artifact belongs to, FK-backed.
|
|
120
|
-
*
|
|
126
|
+
*
|
|
127
|
+
* Defaulted to the creating principal, so this is normally set. Absent for a row created
|
|
128
|
+
* before that default landed, for a system-plane write, and for a principal with no directory
|
|
129
|
+
* row — a service account or a seed has nothing to own anything with.
|
|
121
130
|
* @type {string}
|
|
122
131
|
* @memberof EvalScorerArtifactView
|
|
123
132
|
*/
|
|
@@ -225,13 +234,16 @@ export interface EvalScorerArtifactView {
|
|
|
225
234
|
*/
|
|
226
235
|
updatedBy: string;
|
|
227
236
|
/**
|
|
228
|
-
*
|
|
237
|
+
* The free-form label the write set, verbatim. Absent when none was sent, and *not* the name
|
|
238
|
+
* the version shipped under — that is the release's own `version_label`.
|
|
229
239
|
* @type {string}
|
|
230
240
|
* @memberof EvalScorerArtifactView
|
|
231
241
|
*/
|
|
232
242
|
versionLabel?: string;
|
|
233
243
|
/**
|
|
234
|
-
*
|
|
244
|
+
* This version's position in its line — the write index, 1-based and dense over versions
|
|
245
|
+
* *written*. Distinct from a release's `version_ordinal`, which counts versions **shipped**;
|
|
246
|
+
* the two agree under the default `auto` release policy and diverge under `manual`.
|
|
235
247
|
* @type {number}
|
|
236
248
|
* @memberof EvalScorerArtifactView
|
|
237
249
|
*/
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -62,6 +62,7 @@ function EvalScorerArtifactViewFromJSONTyped(json, ignoreDiscriminator) {
|
|
|
62
62
|
return json;
|
|
63
63
|
}
|
|
64
64
|
return {
|
|
65
|
+
'app': json['app'] == null ? undefined : json['app'],
|
|
65
66
|
'artifactStatus': json['artifact_status'],
|
|
66
67
|
'commitTs': json['commit_ts'],
|
|
67
68
|
'contentHashHex': json['content_hash_hex'] == null ? undefined : json['content_hash_hex'],
|
|
@@ -69,7 +70,6 @@ function EvalScorerArtifactViewFromJSONTyped(json, ignoreDiscriminator) {
|
|
|
69
70
|
'createdBy': json['created_by'],
|
|
70
71
|
'description': json['description'] == null ? undefined : json['description'],
|
|
71
72
|
'displayName': json['display_name'] == null ? undefined : json['display_name'],
|
|
72
|
-
'extension': json['extension'] == null ? undefined : json['extension'],
|
|
73
73
|
'id': json['id'],
|
|
74
74
|
'identity': json['identity'] == null ? undefined : (0, GatewayArtifactIdentityRevealView_1.GatewayArtifactIdentityRevealViewFromJSON)(json['identity']),
|
|
75
75
|
'isLatest': json['is_latest'],
|
|
@@ -111,6 +111,7 @@ function EvalScorerArtifactViewToJSONTyped(value, ignoreDiscriminator = false) {
|
|
|
111
111
|
return value;
|
|
112
112
|
}
|
|
113
113
|
return {
|
|
114
|
+
'app': value['app'],
|
|
114
115
|
'artifact_status': value['artifactStatus'],
|
|
115
116
|
'commit_ts': value['commitTs'],
|
|
116
117
|
'content_hash_hex': value['contentHashHex'],
|
|
@@ -118,7 +119,6 @@ function EvalScorerArtifactViewToJSONTyped(value, ignoreDiscriminator = false) {
|
|
|
118
119
|
'created_by': value['createdBy'],
|
|
119
120
|
'description': value['description'],
|
|
120
121
|
'display_name': value['displayName'],
|
|
121
|
-
'extension': value['extension'],
|
|
122
122
|
'id': value['id'],
|
|
123
123
|
'identity': (0, GatewayArtifactIdentityRevealView_1.GatewayArtifactIdentityRevealViewToJSON)(value['identity']),
|
|
124
124
|
'is_latest': value['isLatest'],
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|