eval-studio-client 1.1.0a5__py3-none-any.whl → 1.1.0a6__py3-none-any.whl

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (107) hide show
  1. eval_studio_client/api/__init__.py +7 -3
  2. eval_studio_client/api/api/__init__.py +0 -1
  3. eval_studio_client/api/api/dashboard_service_api.py +17 -0
  4. eval_studio_client/api/api/test_service_api.py +34 -0
  5. eval_studio_client/api/api/workflow_service_api.py +510 -0
  6. eval_studio_client/api/docs/DashboardServiceApi.md +4 -2
  7. eval_studio_client/api/docs/PromptGenerationServiceAutoGeneratePromptsRequest.md +1 -1
  8. eval_studio_client/api/docs/RequiredTheDashboardToUpdate.md +1 -0
  9. eval_studio_client/api/docs/RequiredTheTestToUpdate.md +1 -0
  10. eval_studio_client/api/docs/TestServiceApi.md +8 -4
  11. eval_studio_client/api/docs/TestServiceGenerateTestCasesRequest.md +1 -1
  12. eval_studio_client/api/docs/V1Context.md +9 -4
  13. eval_studio_client/api/docs/V1Dashboard.md +1 -0
  14. eval_studio_client/api/docs/V1DashboardType.md +12 -0
  15. eval_studio_client/api/docs/V1DependencyList.md +30 -0
  16. eval_studio_client/api/docs/V1Evaluator.md +2 -0
  17. eval_studio_client/api/docs/V1GetGuardrailsConfigurationResponse.md +29 -0
  18. eval_studio_client/api/docs/V1LeaderboardReportModel.md +0 -2
  19. eval_studio_client/api/docs/V1ListWorkflowDependenciesResponse.md +30 -0
  20. eval_studio_client/api/docs/V1RepeatedContext.md +29 -0
  21. eval_studio_client/api/docs/V1Test.md +1 -0
  22. eval_studio_client/api/docs/V1TestType.md +12 -0
  23. eval_studio_client/api/docs/V1WorkflowDependency.md +30 -0
  24. eval_studio_client/api/docs/V1WorkflowEdgeType.md +1 -1
  25. eval_studio_client/api/docs/V1WorkflowNodeArtifact.md +1 -0
  26. eval_studio_client/api/docs/WorkflowServiceApi.md +135 -0
  27. eval_studio_client/api/models/__init__.py +7 -2
  28. eval_studio_client/api/models/prompt_generation_service_auto_generate_prompts_request.py +3 -2
  29. eval_studio_client/api/models/required_the_dashboard_to_update.py +5 -2
  30. eval_studio_client/api/models/required_the_test_to_update.py +5 -2
  31. eval_studio_client/api/models/test_service_generate_test_cases_request.py +10 -2
  32. eval_studio_client/api/models/v1_context.py +16 -6
  33. eval_studio_client/api/models/v1_dashboard.py +5 -2
  34. eval_studio_client/api/models/v1_dashboard_type.py +38 -0
  35. eval_studio_client/api/models/{generated_questions_validation_service_validate_generated_questions_request.py → v1_dependency_list.py} +14 -14
  36. eval_studio_client/api/models/v1_evaluator.py +11 -3
  37. eval_studio_client/api/models/v1_get_guardrails_configuration_response.py +87 -0
  38. eval_studio_client/api/models/v1_leaderboard_report_model.py +2 -10
  39. eval_studio_client/api/models/v1_list_workflow_dependencies_response.py +105 -0
  40. eval_studio_client/api/models/{v1_generated_test_case.py → v1_repeated_context.py} +12 -18
  41. eval_studio_client/api/models/v1_test.py +5 -2
  42. eval_studio_client/api/models/v1_test_type.py +38 -0
  43. eval_studio_client/api/models/v1_workflow_dependency.py +89 -0
  44. eval_studio_client/api/models/v1_workflow_edge_type.py +3 -2
  45. eval_studio_client/api/models/v1_workflow_node_artifact.py +6 -2
  46. eval_studio_client/api/test/test_prompt_generation_service_auto_generate_prompts_request.py +10 -2
  47. eval_studio_client/api/test/test_required_the_dashboard_to_update.py +2 -1
  48. eval_studio_client/api/test/test_required_the_test_to_update.py +2 -1
  49. eval_studio_client/api/test/test_required_the_updated_workflow.py +2 -1
  50. eval_studio_client/api/test/test_required_the_updated_workflow_node.py +2 -1
  51. eval_studio_client/api/test/test_test_service_generate_test_cases_request.py +10 -1
  52. eval_studio_client/api/test/test_v1_batch_delete_dashboards_response.py +2 -1
  53. eval_studio_client/api/test/test_v1_batch_delete_evaluators_response.py +3 -1
  54. eval_studio_client/api/test/test_v1_batch_delete_tests_response.py +2 -1
  55. eval_studio_client/api/test/test_v1_batch_get_dashboards_response.py +2 -1
  56. eval_studio_client/api/test/test_v1_batch_get_tests_response.py +2 -1
  57. eval_studio_client/api/test/test_v1_batch_import_tests_response.py +2 -1
  58. eval_studio_client/api/test/test_v1_clone_test_response.py +2 -1
  59. eval_studio_client/api/test/test_v1_context.py +6 -1
  60. eval_studio_client/api/test/test_v1_create_dashboard_response.py +2 -1
  61. eval_studio_client/api/test/test_v1_create_evaluator_response.py +3 -1
  62. eval_studio_client/api/test/test_v1_create_test_response.py +2 -1
  63. eval_studio_client/api/test/test_v1_dashboard.py +2 -1
  64. eval_studio_client/api/test/test_v1_dashboard_type.py +33 -0
  65. eval_studio_client/api/test/test_v1_delete_dashboard_response.py +2 -1
  66. eval_studio_client/api/test/test_v1_delete_evaluator_response.py +3 -1
  67. eval_studio_client/api/test/test_v1_delete_test_response.py +2 -1
  68. eval_studio_client/api/test/test_v1_dependency_list.py +56 -0
  69. eval_studio_client/api/test/test_v1_evaluator.py +3 -1
  70. eval_studio_client/api/test/test_v1_get_dashboard_response.py +2 -1
  71. eval_studio_client/api/test/test_v1_get_evaluator_response.py +3 -1
  72. eval_studio_client/api/test/test_v1_get_guardrails_configuration_response.py +51 -0
  73. eval_studio_client/api/test/test_v1_get_leaderboard_report_response.py +1 -3
  74. eval_studio_client/api/test/test_v1_get_test_response.py +2 -1
  75. eval_studio_client/api/test/test_v1_leaderboard_report.py +1 -3
  76. eval_studio_client/api/test/test_v1_leaderboard_report_model.py +1 -3
  77. eval_studio_client/api/test/test_v1_list_dashboards_response.py +2 -1
  78. eval_studio_client/api/test/test_v1_list_evaluators_response.py +3 -1
  79. eval_studio_client/api/test/test_v1_list_most_recent_dashboards_response.py +2 -1
  80. eval_studio_client/api/test/test_v1_list_most_recent_tests_response.py +2 -1
  81. eval_studio_client/api/test/test_v1_list_tests_response.py +2 -1
  82. eval_studio_client/api/test/test_v1_list_workflow_dependencies_response.py +93 -0
  83. eval_studio_client/api/test/test_v1_perturb_test_in_place_response.py +2 -1
  84. eval_studio_client/api/test/test_v1_perturb_test_response.py +2 -1
  85. eval_studio_client/api/test/test_v1_repeated_context.py +62 -0
  86. eval_studio_client/api/test/test_v1_test.py +2 -1
  87. eval_studio_client/api/test/test_v1_test_type.py +33 -0
  88. eval_studio_client/api/test/test_v1_update_dashboard_response.py +2 -1
  89. eval_studio_client/api/test/test_v1_update_test_response.py +2 -1
  90. eval_studio_client/api/test/test_v1_workflow.py +2 -1
  91. eval_studio_client/api/test/test_v1_workflow_dependency.py +52 -0
  92. eval_studio_client/api/test/test_v1_workflow_node.py +2 -1
  93. eval_studio_client/api/test/test_v1_workflow_node_artifact.py +2 -1
  94. eval_studio_client/api/test/test_v1_workflow_node_artifacts.py +2 -1
  95. eval_studio_client/api/test/test_workflow_service_api.py +13 -0
  96. eval_studio_client/client.py +11 -2
  97. eval_studio_client/gen/openapiv2/eval_studio.swagger.json +241 -92
  98. {eval_studio_client-1.1.0a5.dist-info → eval_studio_client-1.1.0a6.dist-info}/METADATA +1 -1
  99. {eval_studio_client-1.1.0a5.dist-info → eval_studio_client-1.1.0a6.dist-info}/RECORD +100 -88
  100. eval_studio_client/api/api/generated_questions_validation_service_api.py +0 -321
  101. eval_studio_client/api/docs/GeneratedQuestionsValidationServiceApi.md +0 -78
  102. eval_studio_client/api/docs/GeneratedQuestionsValidationServiceValidateGeneratedQuestionsRequest.md +0 -30
  103. eval_studio_client/api/docs/V1GeneratedTestCase.md +0 -30
  104. eval_studio_client/api/test/test_generated_questions_validation_service_api.py +0 -37
  105. eval_studio_client/api/test/test_generated_questions_validation_service_validate_generated_questions_request.py +0 -83
  106. eval_studio_client/api/test/test_v1_generated_test_case.py +0 -79
  107. {eval_studio_client-1.1.0a5.dist-info → eval_studio_client-1.1.0a6.dist-info}/WHEEL +0 -0
@@ -24,7 +24,9 @@ from eval_studio_client.api.models.v1_batch_delete_workflows_response import V1B
24
24
  from eval_studio_client.api.models.v1_clone_workflow_response import V1CloneWorkflowResponse
25
25
  from eval_studio_client.api.models.v1_create_workflow_response import V1CreateWorkflowResponse
26
26
  from eval_studio_client.api.models.v1_delete_workflow_response import V1DeleteWorkflowResponse
27
+ from eval_studio_client.api.models.v1_get_guardrails_configuration_response import V1GetGuardrailsConfigurationResponse
27
28
  from eval_studio_client.api.models.v1_get_workflow_response import V1GetWorkflowResponse
29
+ from eval_studio_client.api.models.v1_list_workflow_dependencies_response import V1ListWorkflowDependenciesResponse
28
30
  from eval_studio_client.api.models.v1_list_workflows_response import V1ListWorkflowsResponse
29
31
  from eval_studio_client.api.models.v1_update_workflow_response import V1UpdateWorkflowResponse
30
32
  from eval_studio_client.api.models.v1_workflow import V1Workflow
@@ -1118,6 +1120,260 @@ class WorkflowServiceApi:
1118
1120
 
1119
1121
 
1120
1122
 
1123
+ @validate_call
1124
+ def workflow_service_get_guardrails_configuration(
1125
+ self,
1126
+ name: Annotated[str, Field(strict=True, description="Required. The name of the Workflow to retrieve guardrails configuration for. The Human Calibration node must be completed, otherwise an error is returned.")],
1127
+ _request_timeout: Union[
1128
+ None,
1129
+ Annotated[StrictFloat, Field(gt=0)],
1130
+ Tuple[
1131
+ Annotated[StrictFloat, Field(gt=0)],
1132
+ Annotated[StrictFloat, Field(gt=0)]
1133
+ ]
1134
+ ] = None,
1135
+ _request_auth: Optional[Dict[StrictStr, Any]] = None,
1136
+ _content_type: Optional[StrictStr] = None,
1137
+ _headers: Optional[Dict[StrictStr, Any]] = None,
1138
+ _host_index: Annotated[StrictInt, Field(ge=0, le=0)] = 0,
1139
+ ) -> V1GetGuardrailsConfigurationResponse:
1140
+ """workflow_service_get_guardrails_configuration
1141
+
1142
+
1143
+ :param name: Required. The name of the Workflow to retrieve guardrails configuration for. The Human Calibration node must be completed, otherwise an error is returned. (required)
1144
+ :type name: str
1145
+ :param _request_timeout: timeout setting for this request. If one
1146
+ number provided, it will be total request
1147
+ timeout. It can also be a pair (tuple) of
1148
+ (connection, read) timeouts.
1149
+ :type _request_timeout: int, tuple(int, int), optional
1150
+ :param _request_auth: set to override the auth_settings for an a single
1151
+ request; this effectively ignores the
1152
+ authentication in the spec for a single request.
1153
+ :type _request_auth: dict, optional
1154
+ :param _content_type: force content-type for the request.
1155
+ :type _content_type: str, Optional
1156
+ :param _headers: set to override the headers for a single
1157
+ request; this effectively ignores the headers
1158
+ in the spec for a single request.
1159
+ :type _headers: dict, optional
1160
+ :param _host_index: set to override the host_index for a single
1161
+ request; this effectively ignores the host_index
1162
+ in the spec for a single request.
1163
+ :type _host_index: int, optional
1164
+ :return: Returns the result object.
1165
+ """ # noqa: E501
1166
+
1167
+ _param = self._workflow_service_get_guardrails_configuration_serialize(
1168
+ name=name,
1169
+ _request_auth=_request_auth,
1170
+ _content_type=_content_type,
1171
+ _headers=_headers,
1172
+ _host_index=_host_index
1173
+ )
1174
+
1175
+ _response_types_map: Dict[str, Optional[str]] = {
1176
+ '200': "V1GetGuardrailsConfigurationResponse",
1177
+ }
1178
+ response_data = self.api_client.call_api(
1179
+ *_param,
1180
+ _request_timeout=_request_timeout
1181
+ )
1182
+ response_data.read()
1183
+ return self.api_client.response_deserialize(
1184
+ response_data=response_data,
1185
+ response_types_map=_response_types_map,
1186
+ ).data
1187
+
1188
+
1189
+ @validate_call
1190
+ def workflow_service_get_guardrails_configuration_with_http_info(
1191
+ self,
1192
+ name: Annotated[str, Field(strict=True, description="Required. The name of the Workflow to retrieve guardrails configuration for. The Human Calibration node must be completed, otherwise an error is returned.")],
1193
+ _request_timeout: Union[
1194
+ None,
1195
+ Annotated[StrictFloat, Field(gt=0)],
1196
+ Tuple[
1197
+ Annotated[StrictFloat, Field(gt=0)],
1198
+ Annotated[StrictFloat, Field(gt=0)]
1199
+ ]
1200
+ ] = None,
1201
+ _request_auth: Optional[Dict[StrictStr, Any]] = None,
1202
+ _content_type: Optional[StrictStr] = None,
1203
+ _headers: Optional[Dict[StrictStr, Any]] = None,
1204
+ _host_index: Annotated[StrictInt, Field(ge=0, le=0)] = 0,
1205
+ ) -> ApiResponse[V1GetGuardrailsConfigurationResponse]:
1206
+ """workflow_service_get_guardrails_configuration
1207
+
1208
+
1209
+ :param name: Required. The name of the Workflow to retrieve guardrails configuration for. The Human Calibration node must be completed, otherwise an error is returned. (required)
1210
+ :type name: str
1211
+ :param _request_timeout: timeout setting for this request. If one
1212
+ number provided, it will be total request
1213
+ timeout. It can also be a pair (tuple) of
1214
+ (connection, read) timeouts.
1215
+ :type _request_timeout: int, tuple(int, int), optional
1216
+ :param _request_auth: set to override the auth_settings for an a single
1217
+ request; this effectively ignores the
1218
+ authentication in the spec for a single request.
1219
+ :type _request_auth: dict, optional
1220
+ :param _content_type: force content-type for the request.
1221
+ :type _content_type: str, Optional
1222
+ :param _headers: set to override the headers for a single
1223
+ request; this effectively ignores the headers
1224
+ in the spec for a single request.
1225
+ :type _headers: dict, optional
1226
+ :param _host_index: set to override the host_index for a single
1227
+ request; this effectively ignores the host_index
1228
+ in the spec for a single request.
1229
+ :type _host_index: int, optional
1230
+ :return: Returns the result object.
1231
+ """ # noqa: E501
1232
+
1233
+ _param = self._workflow_service_get_guardrails_configuration_serialize(
1234
+ name=name,
1235
+ _request_auth=_request_auth,
1236
+ _content_type=_content_type,
1237
+ _headers=_headers,
1238
+ _host_index=_host_index
1239
+ )
1240
+
1241
+ _response_types_map: Dict[str, Optional[str]] = {
1242
+ '200': "V1GetGuardrailsConfigurationResponse",
1243
+ }
1244
+ response_data = self.api_client.call_api(
1245
+ *_param,
1246
+ _request_timeout=_request_timeout
1247
+ )
1248
+ response_data.read()
1249
+ return self.api_client.response_deserialize(
1250
+ response_data=response_data,
1251
+ response_types_map=_response_types_map,
1252
+ )
1253
+
1254
+
1255
+ @validate_call
1256
+ def workflow_service_get_guardrails_configuration_without_preload_content(
1257
+ self,
1258
+ name: Annotated[str, Field(strict=True, description="Required. The name of the Workflow to retrieve guardrails configuration for. The Human Calibration node must be completed, otherwise an error is returned.")],
1259
+ _request_timeout: Union[
1260
+ None,
1261
+ Annotated[StrictFloat, Field(gt=0)],
1262
+ Tuple[
1263
+ Annotated[StrictFloat, Field(gt=0)],
1264
+ Annotated[StrictFloat, Field(gt=0)]
1265
+ ]
1266
+ ] = None,
1267
+ _request_auth: Optional[Dict[StrictStr, Any]] = None,
1268
+ _content_type: Optional[StrictStr] = None,
1269
+ _headers: Optional[Dict[StrictStr, Any]] = None,
1270
+ _host_index: Annotated[StrictInt, Field(ge=0, le=0)] = 0,
1271
+ ) -> RESTResponseType:
1272
+ """workflow_service_get_guardrails_configuration
1273
+
1274
+
1275
+ :param name: Required. The name of the Workflow to retrieve guardrails configuration for. The Human Calibration node must be completed, otherwise an error is returned. (required)
1276
+ :type name: str
1277
+ :param _request_timeout: timeout setting for this request. If one
1278
+ number provided, it will be total request
1279
+ timeout. It can also be a pair (tuple) of
1280
+ (connection, read) timeouts.
1281
+ :type _request_timeout: int, tuple(int, int), optional
1282
+ :param _request_auth: set to override the auth_settings for an a single
1283
+ request; this effectively ignores the
1284
+ authentication in the spec for a single request.
1285
+ :type _request_auth: dict, optional
1286
+ :param _content_type: force content-type for the request.
1287
+ :type _content_type: str, Optional
1288
+ :param _headers: set to override the headers for a single
1289
+ request; this effectively ignores the headers
1290
+ in the spec for a single request.
1291
+ :type _headers: dict, optional
1292
+ :param _host_index: set to override the host_index for a single
1293
+ request; this effectively ignores the host_index
1294
+ in the spec for a single request.
1295
+ :type _host_index: int, optional
1296
+ :return: Returns the result object.
1297
+ """ # noqa: E501
1298
+
1299
+ _param = self._workflow_service_get_guardrails_configuration_serialize(
1300
+ name=name,
1301
+ _request_auth=_request_auth,
1302
+ _content_type=_content_type,
1303
+ _headers=_headers,
1304
+ _host_index=_host_index
1305
+ )
1306
+
1307
+ _response_types_map: Dict[str, Optional[str]] = {
1308
+ '200': "V1GetGuardrailsConfigurationResponse",
1309
+ }
1310
+ response_data = self.api_client.call_api(
1311
+ *_param,
1312
+ _request_timeout=_request_timeout
1313
+ )
1314
+ return response_data.response
1315
+
1316
+
1317
+ def _workflow_service_get_guardrails_configuration_serialize(
1318
+ self,
1319
+ name,
1320
+ _request_auth,
1321
+ _content_type,
1322
+ _headers,
1323
+ _host_index,
1324
+ ) -> RequestSerialized:
1325
+
1326
+ _host = None
1327
+
1328
+ _collection_formats: Dict[str, str] = {
1329
+ }
1330
+
1331
+ _path_params: Dict[str, str] = {}
1332
+ _query_params: List[Tuple[str, str]] = []
1333
+ _header_params: Dict[str, Optional[str]] = _headers or {}
1334
+ _form_params: List[Tuple[str, str]] = []
1335
+ _files: Dict[str, Union[str, bytes]] = {}
1336
+ _body_params: Optional[bytes] = None
1337
+
1338
+ # process the path parameters
1339
+ if name is not None:
1340
+ _path_params['name'] = name
1341
+ # process the query parameters
1342
+ # process the header parameters
1343
+ # process the form parameters
1344
+ # process the body parameter
1345
+
1346
+
1347
+ # set the HTTP header `Accept`
1348
+ _header_params['Accept'] = self.api_client.select_header_accept(
1349
+ [
1350
+ 'application/json'
1351
+ ]
1352
+ )
1353
+
1354
+
1355
+ # authentication setting
1356
+ _auth_settings: List[str] = [
1357
+ ]
1358
+
1359
+ return self.api_client.param_serialize(
1360
+ method='GET',
1361
+ resource_path='/v1/{name}:getGuardrailsConfiguration',
1362
+ path_params=_path_params,
1363
+ query_params=_query_params,
1364
+ header_params=_header_params,
1365
+ body=_body_params,
1366
+ post_params=_form_params,
1367
+ files=_files,
1368
+ auth_settings=_auth_settings,
1369
+ collection_formats=_collection_formats,
1370
+ _host=_host,
1371
+ _request_auth=_request_auth
1372
+ )
1373
+
1374
+
1375
+
1376
+
1121
1377
  @validate_call
1122
1378
  def workflow_service_get_workflow(
1123
1379
  self,
@@ -1372,6 +1628,260 @@ class WorkflowServiceApi:
1372
1628
 
1373
1629
 
1374
1630
 
1631
+ @validate_call
1632
+ def workflow_service_list_workflow_dependencies(
1633
+ self,
1634
+ name: Annotated[str, Field(strict=True, description="Required. The name of the Workflow to retrieve dependencies for.")],
1635
+ _request_timeout: Union[
1636
+ None,
1637
+ Annotated[StrictFloat, Field(gt=0)],
1638
+ Tuple[
1639
+ Annotated[StrictFloat, Field(gt=0)],
1640
+ Annotated[StrictFloat, Field(gt=0)]
1641
+ ]
1642
+ ] = None,
1643
+ _request_auth: Optional[Dict[StrictStr, Any]] = None,
1644
+ _content_type: Optional[StrictStr] = None,
1645
+ _headers: Optional[Dict[StrictStr, Any]] = None,
1646
+ _host_index: Annotated[StrictInt, Field(ge=0, le=0)] = 0,
1647
+ ) -> V1ListWorkflowDependenciesResponse:
1648
+ """ListWorkflowDependencies lists workflow nodes and map of the node dependencies.
1649
+
1650
+
1651
+ :param name: Required. The name of the Workflow to retrieve dependencies for. (required)
1652
+ :type name: str
1653
+ :param _request_timeout: timeout setting for this request. If one
1654
+ number provided, it will be total request
1655
+ timeout. It can also be a pair (tuple) of
1656
+ (connection, read) timeouts.
1657
+ :type _request_timeout: int, tuple(int, int), optional
1658
+ :param _request_auth: set to override the auth_settings for an a single
1659
+ request; this effectively ignores the
1660
+ authentication in the spec for a single request.
1661
+ :type _request_auth: dict, optional
1662
+ :param _content_type: force content-type for the request.
1663
+ :type _content_type: str, Optional
1664
+ :param _headers: set to override the headers for a single
1665
+ request; this effectively ignores the headers
1666
+ in the spec for a single request.
1667
+ :type _headers: dict, optional
1668
+ :param _host_index: set to override the host_index for a single
1669
+ request; this effectively ignores the host_index
1670
+ in the spec for a single request.
1671
+ :type _host_index: int, optional
1672
+ :return: Returns the result object.
1673
+ """ # noqa: E501
1674
+
1675
+ _param = self._workflow_service_list_workflow_dependencies_serialize(
1676
+ name=name,
1677
+ _request_auth=_request_auth,
1678
+ _content_type=_content_type,
1679
+ _headers=_headers,
1680
+ _host_index=_host_index
1681
+ )
1682
+
1683
+ _response_types_map: Dict[str, Optional[str]] = {
1684
+ '200': "V1ListWorkflowDependenciesResponse",
1685
+ }
1686
+ response_data = self.api_client.call_api(
1687
+ *_param,
1688
+ _request_timeout=_request_timeout
1689
+ )
1690
+ response_data.read()
1691
+ return self.api_client.response_deserialize(
1692
+ response_data=response_data,
1693
+ response_types_map=_response_types_map,
1694
+ ).data
1695
+
1696
+
1697
+ @validate_call
1698
+ def workflow_service_list_workflow_dependencies_with_http_info(
1699
+ self,
1700
+ name: Annotated[str, Field(strict=True, description="Required. The name of the Workflow to retrieve dependencies for.")],
1701
+ _request_timeout: Union[
1702
+ None,
1703
+ Annotated[StrictFloat, Field(gt=0)],
1704
+ Tuple[
1705
+ Annotated[StrictFloat, Field(gt=0)],
1706
+ Annotated[StrictFloat, Field(gt=0)]
1707
+ ]
1708
+ ] = None,
1709
+ _request_auth: Optional[Dict[StrictStr, Any]] = None,
1710
+ _content_type: Optional[StrictStr] = None,
1711
+ _headers: Optional[Dict[StrictStr, Any]] = None,
1712
+ _host_index: Annotated[StrictInt, Field(ge=0, le=0)] = 0,
1713
+ ) -> ApiResponse[V1ListWorkflowDependenciesResponse]:
1714
+ """ListWorkflowDependencies lists workflow nodes and map of the node dependencies.
1715
+
1716
+
1717
+ :param name: Required. The name of the Workflow to retrieve dependencies for. (required)
1718
+ :type name: str
1719
+ :param _request_timeout: timeout setting for this request. If one
1720
+ number provided, it will be total request
1721
+ timeout. It can also be a pair (tuple) of
1722
+ (connection, read) timeouts.
1723
+ :type _request_timeout: int, tuple(int, int), optional
1724
+ :param _request_auth: set to override the auth_settings for an a single
1725
+ request; this effectively ignores the
1726
+ authentication in the spec for a single request.
1727
+ :type _request_auth: dict, optional
1728
+ :param _content_type: force content-type for the request.
1729
+ :type _content_type: str, Optional
1730
+ :param _headers: set to override the headers for a single
1731
+ request; this effectively ignores the headers
1732
+ in the spec for a single request.
1733
+ :type _headers: dict, optional
1734
+ :param _host_index: set to override the host_index for a single
1735
+ request; this effectively ignores the host_index
1736
+ in the spec for a single request.
1737
+ :type _host_index: int, optional
1738
+ :return: Returns the result object.
1739
+ """ # noqa: E501
1740
+
1741
+ _param = self._workflow_service_list_workflow_dependencies_serialize(
1742
+ name=name,
1743
+ _request_auth=_request_auth,
1744
+ _content_type=_content_type,
1745
+ _headers=_headers,
1746
+ _host_index=_host_index
1747
+ )
1748
+
1749
+ _response_types_map: Dict[str, Optional[str]] = {
1750
+ '200': "V1ListWorkflowDependenciesResponse",
1751
+ }
1752
+ response_data = self.api_client.call_api(
1753
+ *_param,
1754
+ _request_timeout=_request_timeout
1755
+ )
1756
+ response_data.read()
1757
+ return self.api_client.response_deserialize(
1758
+ response_data=response_data,
1759
+ response_types_map=_response_types_map,
1760
+ )
1761
+
1762
+
1763
+ @validate_call
1764
+ def workflow_service_list_workflow_dependencies_without_preload_content(
1765
+ self,
1766
+ name: Annotated[str, Field(strict=True, description="Required. The name of the Workflow to retrieve dependencies for.")],
1767
+ _request_timeout: Union[
1768
+ None,
1769
+ Annotated[StrictFloat, Field(gt=0)],
1770
+ Tuple[
1771
+ Annotated[StrictFloat, Field(gt=0)],
1772
+ Annotated[StrictFloat, Field(gt=0)]
1773
+ ]
1774
+ ] = None,
1775
+ _request_auth: Optional[Dict[StrictStr, Any]] = None,
1776
+ _content_type: Optional[StrictStr] = None,
1777
+ _headers: Optional[Dict[StrictStr, Any]] = None,
1778
+ _host_index: Annotated[StrictInt, Field(ge=0, le=0)] = 0,
1779
+ ) -> RESTResponseType:
1780
+ """ListWorkflowDependencies lists workflow nodes and map of the node dependencies.
1781
+
1782
+
1783
+ :param name: Required. The name of the Workflow to retrieve dependencies for. (required)
1784
+ :type name: str
1785
+ :param _request_timeout: timeout setting for this request. If one
1786
+ number provided, it will be total request
1787
+ timeout. It can also be a pair (tuple) of
1788
+ (connection, read) timeouts.
1789
+ :type _request_timeout: int, tuple(int, int), optional
1790
+ :param _request_auth: set to override the auth_settings for an a single
1791
+ request; this effectively ignores the
1792
+ authentication in the spec for a single request.
1793
+ :type _request_auth: dict, optional
1794
+ :param _content_type: force content-type for the request.
1795
+ :type _content_type: str, Optional
1796
+ :param _headers: set to override the headers for a single
1797
+ request; this effectively ignores the headers
1798
+ in the spec for a single request.
1799
+ :type _headers: dict, optional
1800
+ :param _host_index: set to override the host_index for a single
1801
+ request; this effectively ignores the host_index
1802
+ in the spec for a single request.
1803
+ :type _host_index: int, optional
1804
+ :return: Returns the result object.
1805
+ """ # noqa: E501
1806
+
1807
+ _param = self._workflow_service_list_workflow_dependencies_serialize(
1808
+ name=name,
1809
+ _request_auth=_request_auth,
1810
+ _content_type=_content_type,
1811
+ _headers=_headers,
1812
+ _host_index=_host_index
1813
+ )
1814
+
1815
+ _response_types_map: Dict[str, Optional[str]] = {
1816
+ '200': "V1ListWorkflowDependenciesResponse",
1817
+ }
1818
+ response_data = self.api_client.call_api(
1819
+ *_param,
1820
+ _request_timeout=_request_timeout
1821
+ )
1822
+ return response_data.response
1823
+
1824
+
1825
+ def _workflow_service_list_workflow_dependencies_serialize(
1826
+ self,
1827
+ name,
1828
+ _request_auth,
1829
+ _content_type,
1830
+ _headers,
1831
+ _host_index,
1832
+ ) -> RequestSerialized:
1833
+
1834
+ _host = None
1835
+
1836
+ _collection_formats: Dict[str, str] = {
1837
+ }
1838
+
1839
+ _path_params: Dict[str, str] = {}
1840
+ _query_params: List[Tuple[str, str]] = []
1841
+ _header_params: Dict[str, Optional[str]] = _headers or {}
1842
+ _form_params: List[Tuple[str, str]] = []
1843
+ _files: Dict[str, Union[str, bytes]] = {}
1844
+ _body_params: Optional[bytes] = None
1845
+
1846
+ # process the path parameters
1847
+ if name is not None:
1848
+ _path_params['name'] = name
1849
+ # process the query parameters
1850
+ # process the header parameters
1851
+ # process the form parameters
1852
+ # process the body parameter
1853
+
1854
+
1855
+ # set the HTTP header `Accept`
1856
+ _header_params['Accept'] = self.api_client.select_header_accept(
1857
+ [
1858
+ 'application/json'
1859
+ ]
1860
+ )
1861
+
1862
+
1863
+ # authentication setting
1864
+ _auth_settings: List[str] = [
1865
+ ]
1866
+
1867
+ return self.api_client.param_serialize(
1868
+ method='GET',
1869
+ resource_path='/v1/{name}:nodeDependencies',
1870
+ path_params=_path_params,
1871
+ query_params=_query_params,
1872
+ header_params=_header_params,
1873
+ body=_body_params,
1874
+ post_params=_form_params,
1875
+ files=_files,
1876
+ auth_settings=_auth_settings,
1877
+ collection_formats=_collection_formats,
1878
+ _host=_host,
1879
+ _request_auth=_request_auth
1880
+ )
1881
+
1882
+
1883
+
1884
+
1375
1885
  @validate_call
1376
1886
  def workflow_service_list_workflows(
1377
1887
  self,
@@ -413,7 +413,7 @@ No authorization required
413
413
  [[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
414
414
 
415
415
  # **dashboard_service_list_most_recent_dashboards**
416
- > V1ListMostRecentDashboardsResponse dashboard_service_list_most_recent_dashboards(limit=limit)
416
+ > V1ListMostRecentDashboardsResponse dashboard_service_list_most_recent_dashboards(limit=limit, filter=filter)
417
417
 
418
418
 
419
419
 
@@ -438,9 +438,10 @@ with eval_studio_client.api.ApiClient(configuration) as api_client:
438
438
  # Create an instance of the API class
439
439
  api_instance = eval_studio_client.api.DashboardServiceApi(api_client)
440
440
  limit = 56 # int | Optional. The max number of the most recent Dashboards to retrieve. Use -1 to retrieve all. Defaults to 3. (optional)
441
+ filter = 'filter_example' # str | Optional. If specified, only leaderboards matching the filter will be returned. Attempts to implement AIP-160 (https://aip.dev/160), although not all fields, operators and features are supported. Supported fields: - model - only '=' operator is supported, e.g. \"model = \\\"models/<UUID>\\\"\" (optional)
441
442
 
442
443
  try:
443
- api_response = api_instance.dashboard_service_list_most_recent_dashboards(limit=limit)
444
+ api_response = api_instance.dashboard_service_list_most_recent_dashboards(limit=limit, filter=filter)
444
445
  print("The response of DashboardServiceApi->dashboard_service_list_most_recent_dashboards:\n")
445
446
  pprint(api_response)
446
447
  except Exception as e:
@@ -455,6 +456,7 @@ with eval_studio_client.api.ApiClient(configuration) as api_client:
455
456
  Name | Type | Description | Notes
456
457
  ------------- | ------------- | ------------- | -------------
457
458
  **limit** | **int**| Optional. The max number of the most recent Dashboards to retrieve. Use -1 to retrieve all. Defaults to 3. | [optional]
459
+ **filter** | **str**| Optional. If specified, only leaderboards matching the filter will be returned. Attempts to implement AIP-160 (https://aip.dev/160), although not all fields, operators and features are supported. Supported fields: - model - only &#39;&#x3D;&#39; operator is supported, e.g. \&quot;model &#x3D; \\\&quot;models/&lt;UUID&gt;\\\&quot;\&quot; | [optional]
458
460
 
459
461
  ### Return type
460
462
 
@@ -10,7 +10,7 @@ Name | Type | Description | Notes
10
10
  **count** | **int** | Required. The number of TestCases to generate. | [optional]
11
11
  **base_llm_model** | **str** | Required. Base LLM model to use for generating the prompts. | [optional]
12
12
  **document_urls** | [**V1RepeatedString**](V1RepeatedString.md) | | [optional]
13
- **chunks** | [**V1RepeatedString**](V1RepeatedString.md) | | [optional]
13
+ **chunks** | [**V1RepeatedContext**](V1RepeatedContext.md) | | [optional]
14
14
  **generators** | [**List[V1TestCasesGenerator]**](V1TestCasesGenerator.md) | Optional. Type of questions to generate TestCases for. If not specified, all types of questions are selected. | [optional]
15
15
  **h2ogpte_collection_id** | **str** | Optional. The ID of the h2oGPTe collection to use. If empty, new temporary collection will be created. | [optional]
16
16
  **topics** | **List[str]** | Optional. Topics to generate questions for. If not specified, use document summarization as topic generation. | [optional]
@@ -18,6 +18,7 @@ Name | Type | Description | Notes
18
18
  **leaderboards** | **List[str]** | Immutable. Resource names of the Leaderboards used in this Dashboard. | [optional]
19
19
  **create_operation** | **str** | Output only. Operation resource name that created this Dashboard. | [optional] [readonly]
20
20
  **demo** | **bool** | Output only. Whether the Dashboard is a demo resource or not. Demo resources are read only. | [optional] [readonly]
21
+ **type** | [**V1DashboardType**](V1DashboardType.md) | | [optional]
21
22
 
22
23
  ## Example
23
24
 
@@ -16,6 +16,7 @@ Name | Type | Description | Notes
16
16
  **documents** | **List[str]** | Immutable. Resource names of Documents assigned to the Test. | [optional]
17
17
  **tags** | **List[str]** | Tags assigned to the Test. | [optional]
18
18
  **demo** | **bool** | Output only. Whether the Test is a demo resource or not. Demo resources are read only. | [optional] [readonly]
19
+ **type** | [**V1TestType**](V1TestType.md) | | [optional]
19
20
 
20
21
  ## Example
21
22
 
@@ -630,7 +630,7 @@ No authorization required
630
630
  [[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
631
631
 
632
632
  # **test_service_list_most_recent_tests**
633
- > V1ListMostRecentTestsResponse test_service_list_most_recent_tests(limit=limit)
633
+ > V1ListMostRecentTestsResponse test_service_list_most_recent_tests(limit=limit, filter=filter)
634
634
 
635
635
 
636
636
 
@@ -655,9 +655,10 @@ with eval_studio_client.api.ApiClient(configuration) as api_client:
655
655
  # Create an instance of the API class
656
656
  api_instance = eval_studio_client.api.TestServiceApi(api_client)
657
657
  limit = 56 # int | Optional. The max number of the most recent Tests to retrieve. Use -1 to retrieve all. Defaults to 3. (optional)
658
+ filter = 'filter_example' # str | Optional. If specified, only leaderboards matching the filter will be returned. Attempts to implement AIP-160 (https://aip.dev/160), although not all fields, operators and features are supported. Supported fields: - type - only '=' operator is supported (optional)
658
659
 
659
660
  try:
660
- api_response = api_instance.test_service_list_most_recent_tests(limit=limit)
661
+ api_response = api_instance.test_service_list_most_recent_tests(limit=limit, filter=filter)
661
662
  print("The response of TestServiceApi->test_service_list_most_recent_tests:\n")
662
663
  pprint(api_response)
663
664
  except Exception as e:
@@ -672,6 +673,7 @@ with eval_studio_client.api.ApiClient(configuration) as api_client:
672
673
  Name | Type | Description | Notes
673
674
  ------------- | ------------- | ------------- | -------------
674
675
  **limit** | **int**| Optional. The max number of the most recent Tests to retrieve. Use -1 to retrieve all. Defaults to 3. | [optional]
676
+ **filter** | **str**| Optional. If specified, only leaderboards matching the filter will be returned. Attempts to implement AIP-160 (https://aip.dev/160), although not all fields, operators and features are supported. Supported fields: - type - only &#39;&#x3D;&#39; operator is supported | [optional]
675
677
 
676
678
  ### Return type
677
679
 
@@ -765,7 +767,7 @@ No authorization required
765
767
  [[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
766
768
 
767
769
  # **test_service_list_tests**
768
- > V1ListTestsResponse test_service_list_tests(order_by=order_by)
770
+ > V1ListTestsResponse test_service_list_tests(filter=filter, order_by=order_by)
769
771
 
770
772
 
771
773
 
@@ -789,10 +791,11 @@ configuration = eval_studio_client.api.Configuration(
789
791
  with eval_studio_client.api.ApiClient(configuration) as api_client:
790
792
  # Create an instance of the API class
791
793
  api_instance = eval_studio_client.api.TestServiceApi(api_client)
794
+ filter = 'filter_example' # str | Optional. If specified, only leaderboards matching the filter will be returned. Attempts to implement AIP-160 (https://aip.dev/160), although not all fields, operators and features are supported. Supported fields: - type - only '=' operator is supported (optional)
792
795
  order_by = 'order_by_example' # str | If specified, the returned tests will be ordered by the specified field. Attempts to implement AIP-130 (https://google.aip.dev/132#ordering), although not all features are supported yet. Supported fields: - create_time - update_time (optional)
793
796
 
794
797
  try:
795
- api_response = api_instance.test_service_list_tests(order_by=order_by)
798
+ api_response = api_instance.test_service_list_tests(filter=filter, order_by=order_by)
796
799
  print("The response of TestServiceApi->test_service_list_tests:\n")
797
800
  pprint(api_response)
798
801
  except Exception as e:
@@ -806,6 +809,7 @@ with eval_studio_client.api.ApiClient(configuration) as api_client:
806
809
 
807
810
  Name | Type | Description | Notes
808
811
  ------------- | ------------- | ------------- | -------------
812
+ **filter** | **str**| Optional. If specified, only leaderboards matching the filter will be returned. Attempts to implement AIP-160 (https://aip.dev/160), although not all fields, operators and features are supported. Supported fields: - type - only &#39;&#x3D;&#39; operator is supported | [optional]
809
813
  **order_by** | **str**| If specified, the returned tests will be ordered by the specified field. Attempts to implement AIP-130 (https://google.aip.dev/132#ordering), although not all features are supported yet. Supported fields: - create_time - update_time | [optional]
810
814
 
811
815
  ### Return type
@@ -11,7 +11,7 @@ Name | Type | Description | Notes
11
11
  **generators** | [**List[V1TestCasesGenerator]**](V1TestCasesGenerator.md) | Optional. Generators to use for generation. If not specified, all generators are selected. | [optional]
12
12
  **h2ogpte_collection_id** | **str** | Optional. ID of the h2oGPTe collection to use. If provided, documents referenced by Test and any specified chunks are ignored. This field is required if Test does not reference any documents and no chunks are provided. If this field is left empty, a temporary collection will be created. | [optional]
13
13
  **topics** | **List[str]** | Optional. Topics to generate questions for. If not specified, use document summarization as topic generation. | [optional]
14
- **chunks** | **List[str]** | Optional. The list of chunks to use for generation. If set, the Documents assigned to the Test and h2ogpte_collection_id are ignored. | [optional]
14
+ **chunks** | [**List[V1Context]**](V1Context.md) | Optional. The list of chunks to use for generation. If set, the Documents assigned to the Test and h2ogpte_collection_id are ignored. | [optional]
15
15
 
16
16
  ## Example
17
17
 
@@ -5,10 +5,15 @@
5
5
 
6
6
  Name | Type | Description | Notes
7
7
  ------------ | ------------- | ------------- | -------------
8
- **collection_id** | **str** | Collection Id. | [optional]
9
- **chunk_id** | **int** | Chunk Id. | [optional]
10
- **score** | **float** | Chunk score. | [optional]
11
- **content** | **str** | Content. | [optional]
8
+ **collection_id** | **str** | Optional. Collection Id. | [optional]
9
+ **chunk_id** | **int** | Required. Chunk Id. | [optional]
10
+ **score** | **float** | Optional. Chunk score. | [optional]
11
+ **content** | **str** | Required. Content. | [optional]
12
+ **document_id** | **str** | Optional. Document Id. | [optional]
13
+ **document_name** | **str** | Optional. Document name. | [optional]
14
+ **pages** | **str** | Optional. Pages. | [optional]
15
+ **topic** | **str** | Required. Topic. | [optional]
16
+ **topic_id** | **int** | Required. Topic Id. | [optional]
12
17
 
13
18
  ## Example
14
19