eval-studio-client 1.0.0a1__py3-none-any.whl → 1.0.1__py3-none-any.whl

eval_studio_client/api/docs/WorkflowServiceApi.md

@@ -0,0 +1,417 @@
+# eval_studio_client.api.WorkflowServiceApi
+
+All URIs are relative to *http://localhost*
+
+Method | HTTP request | Description
+------------- | ------------- | -------------
+[**workflow_service_batch_delete_workflows**](WorkflowServiceApi.md#workflow_service_batch_delete_workflows) | **POST** /v1/workflows:batchDelete | BatchDeleteWorkflows deletes Workflows by names. If any of the Workflows do not exist an error is returned.
+[**workflow_service_create_workflow**](WorkflowServiceApi.md#workflow_service_create_workflow) | **POST** /v1/workflows | CreateWorkflow creates a Workflow.
+[**workflow_service_delete_workflow**](WorkflowServiceApi.md#workflow_service_delete_workflow) | **DELETE** /v1/{name_8} | DeleteWorkflow deletes a Workflow by name. If the Workflow does not exist an error is returned.
+[**workflow_service_get_workflow**](WorkflowServiceApi.md#workflow_service_get_workflow) | **GET** /v1/{name_11} | GetWorkflow retrieves a Workflow by name. Deleted Workflow is returned without error, it has a delete_time and deleter fields set.
+[**workflow_service_list_workflows**](WorkflowServiceApi.md#workflow_service_list_workflows) | **GET** /v1/workflows | ListWorkflows lists Workflows.
+[**workflow_service_update_workflow**](WorkflowServiceApi.md#workflow_service_update_workflow) | **PATCH** /v1/{workflow.name} | UpdateWorkflow updates a Workflow. The update_mask is used to specify the fields to be updated.
+
+
+# **workflow_service_batch_delete_workflows**
+> V1BatchDeleteWorkflowsResponse workflow_service_batch_delete_workflows(body)
+
+BatchDeleteWorkflows deletes Workflows by names. If any of the Workflows do not exist an error is returned.
+
+### Example
+
+
+```python
+import eval_studio_client.api
+from eval_studio_client.api.models.v1_batch_delete_workflows_request import V1BatchDeleteWorkflowsRequest
+from eval_studio_client.api.models.v1_batch_delete_workflows_response import V1BatchDeleteWorkflowsResponse
+from eval_studio_client.api.rest import ApiException
+from pprint import pprint
+
+# Defining the host is optional and defaults to http://localhost
+# See configuration.py for a list of all supported configuration parameters.
+configuration = eval_studio_client.api.Configuration(
+    host = "http://localhost"
+)
+
+
+# Enter a context with an instance of the API client
+with eval_studio_client.api.ApiClient(configuration) as api_client:
+    # Create an instance of the API class
+    api_instance = eval_studio_client.api.WorkflowServiceApi(api_client)
+    body = eval_studio_client.api.V1BatchDeleteWorkflowsRequest() # V1BatchDeleteWorkflowsRequest | 
+
+    try:
+        # BatchDeleteWorkflows deletes Workflows by names. If any of the Workflows do not exist an error is returned.
+        api_response = api_instance.workflow_service_batch_delete_workflows(body)
+        print("The response of WorkflowServiceApi->workflow_service_batch_delete_workflows:\n")
+        pprint(api_response)
+    except Exception as e:
+        print("Exception when calling WorkflowServiceApi->workflow_service_batch_delete_workflows: %s\n" % e)
+```
+
+
+
+### Parameters
+
+
+Name | Type | Description  | Notes
+------------- | ------------- | ------------- | -------------
+ **body** | [**V1BatchDeleteWorkflowsRequest**](V1BatchDeleteWorkflowsRequest.md)|  | 
+
+### Return type
+
+[**V1BatchDeleteWorkflowsResponse**](V1BatchDeleteWorkflowsResponse.md)
+
+### Authorization
+
+No authorization required
+
+### HTTP request headers
+
+ - **Content-Type**: application/json
+ - **Accept**: application/json
+
+### HTTP response details
+
+| Status code | Description | Response headers |
+|-------------|-------------|------------------|
+**200** | A successful response. |  -  |
+**0** | An unexpected error response. |  -  |
+
+[[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
+
+# **workflow_service_create_workflow**
+> V1CreateWorkflowResponse workflow_service_create_workflow(workflow)
+
+CreateWorkflow creates a Workflow.
+
+### Example
+
+
+```python
+import eval_studio_client.api
+from eval_studio_client.api.models.v1_create_workflow_response import V1CreateWorkflowResponse
+from eval_studio_client.api.models.v1_workflow import V1Workflow
+from eval_studio_client.api.rest import ApiException
+from pprint import pprint
+
+# Defining the host is optional and defaults to http://localhost
+# See configuration.py for a list of all supported configuration parameters.
+configuration = eval_studio_client.api.Configuration(
+    host = "http://localhost"
+)
+
+
+# Enter a context with an instance of the API client
+with eval_studio_client.api.ApiClient(configuration) as api_client:
+    # Create an instance of the API class
+    api_instance = eval_studio_client.api.WorkflowServiceApi(api_client)
+    workflow = eval_studio_client.api.V1Workflow() # V1Workflow | Required. The Workflow to create.
+
+    try:
+        # CreateWorkflow creates a Workflow.
+        api_response = api_instance.workflow_service_create_workflow(workflow)
+        print("The response of WorkflowServiceApi->workflow_service_create_workflow:\n")
+        pprint(api_response)
+    except Exception as e:
+        print("Exception when calling WorkflowServiceApi->workflow_service_create_workflow: %s\n" % e)
+```
+
+
+
+### Parameters
+
+
+Name | Type | Description  | Notes
+------------- | ------------- | ------------- | -------------
+ **workflow** | [**V1Workflow**](V1Workflow.md)| Required. The Workflow to create. | 
+
+### Return type
+
+[**V1CreateWorkflowResponse**](V1CreateWorkflowResponse.md)
+
+### Authorization
+
+No authorization required
+
+### HTTP request headers
+
+ - **Content-Type**: application/json
+ - **Accept**: application/json
+
+### HTTP response details
+
+| Status code | Description | Response headers |
+|-------------|-------------|------------------|
+**200** | A successful response. |  -  |
+**0** | An unexpected error response. |  -  |
+
+[[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
+
+# **workflow_service_delete_workflow**
+> V1DeleteWorkflowResponse workflow_service_delete_workflow(name_8)
+
+DeleteWorkflow deletes a Workflow by name. If the Workflow does not exist an error is returned.
+
+### Example
+
+
+```python
+import eval_studio_client.api
+from eval_studio_client.api.models.v1_delete_workflow_response import V1DeleteWorkflowResponse
+from eval_studio_client.api.rest import ApiException
+from pprint import pprint
+
+# Defining the host is optional and defaults to http://localhost
+# See configuration.py for a list of all supported configuration parameters.
+configuration = eval_studio_client.api.Configuration(
+    host = "http://localhost"
+)
+
+
+# Enter a context with an instance of the API client
+with eval_studio_client.api.ApiClient(configuration) as api_client:
+    # Create an instance of the API class
+    api_instance = eval_studio_client.api.WorkflowServiceApi(api_client)
+    name_8 = 'name_8_example' # str | Required. The name of the Workflow to delete.
+
+    try:
+        # DeleteWorkflow deletes a Workflow by name. If the Workflow does not exist an error is returned.
+        api_response = api_instance.workflow_service_delete_workflow(name_8)
+        print("The response of WorkflowServiceApi->workflow_service_delete_workflow:\n")
+        pprint(api_response)
+    except Exception as e:
+        print("Exception when calling WorkflowServiceApi->workflow_service_delete_workflow: %s\n" % e)
+```
+
+
+
+### Parameters
+
+
+Name | Type | Description  | Notes
+------------- | ------------- | ------------- | -------------
+ **name_8** | **str**| Required. The name of the Workflow to delete. | 
+
+### Return type
+
+[**V1DeleteWorkflowResponse**](V1DeleteWorkflowResponse.md)
+
+### Authorization
+
+No authorization required
+
+### HTTP request headers
+
+ - **Content-Type**: Not defined
+ - **Accept**: application/json
+
+### HTTP response details
+
+| Status code | Description | Response headers |
+|-------------|-------------|------------------|
+**200** | A successful response. |  -  |
+**0** | An unexpected error response. |  -  |
+
+[[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
+
+# **workflow_service_get_workflow**
+> V1GetWorkflowResponse workflow_service_get_workflow(name_11)
+
+GetWorkflow retrieves a Workflow by name. Deleted Workflow is returned without error, it has a delete_time and deleter fields set.
+
+### Example
+
+
+```python
+import eval_studio_client.api
+from eval_studio_client.api.models.v1_get_workflow_response import V1GetWorkflowResponse
+from eval_studio_client.api.rest import ApiException
+from pprint import pprint
+
+# Defining the host is optional and defaults to http://localhost
+# See configuration.py for a list of all supported configuration parameters.
+configuration = eval_studio_client.api.Configuration(
+    host = "http://localhost"
+)
+
+
+# Enter a context with an instance of the API client
+with eval_studio_client.api.ApiClient(configuration) as api_client:
+    # Create an instance of the API class
+    api_instance = eval_studio_client.api.WorkflowServiceApi(api_client)
+    name_11 = 'name_11_example' # str | Required. The name of the Workflow to retrieve.
+
+    try:
+        # GetWorkflow retrieves a Workflow by name. Deleted Workflow is returned without error, it has a delete_time and deleter fields set.
+        api_response = api_instance.workflow_service_get_workflow(name_11)
+        print("The response of WorkflowServiceApi->workflow_service_get_workflow:\n")
+        pprint(api_response)
+    except Exception as e:
+        print("Exception when calling WorkflowServiceApi->workflow_service_get_workflow: %s\n" % e)
+```
+
+
+
+### Parameters
+
+
+Name | Type | Description  | Notes
+------------- | ------------- | ------------- | -------------
+ **name_11** | **str**| Required. The name of the Workflow to retrieve. | 
+
+### Return type
+
+[**V1GetWorkflowResponse**](V1GetWorkflowResponse.md)
+
+### Authorization
+
+No authorization required
+
+### HTTP request headers
+
+ - **Content-Type**: Not defined
+ - **Accept**: application/json
+
+### HTTP response details
+
+| Status code | Description | Response headers |
+|-------------|-------------|------------------|
+**200** | A successful response. |  -  |
+**0** | An unexpected error response. |  -  |
+
+[[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
+
+# **workflow_service_list_workflows**
+> V1ListWorkflowsResponse workflow_service_list_workflows()
+
+ListWorkflows lists Workflows.
+
+### Example
+
+
+```python
+import eval_studio_client.api
+from eval_studio_client.api.models.v1_list_workflows_response import V1ListWorkflowsResponse
+from eval_studio_client.api.rest import ApiException
+from pprint import pprint
+
+# Defining the host is optional and defaults to http://localhost
+# See configuration.py for a list of all supported configuration parameters.
+configuration = eval_studio_client.api.Configuration(
+    host = "http://localhost"
+)
+
+
+# Enter a context with an instance of the API client
+with eval_studio_client.api.ApiClient(configuration) as api_client:
+    # Create an instance of the API class
+    api_instance = eval_studio_client.api.WorkflowServiceApi(api_client)
+
+    try:
+        # ListWorkflows lists Workflows.
+        api_response = api_instance.workflow_service_list_workflows()
+        print("The response of WorkflowServiceApi->workflow_service_list_workflows:\n")
+        pprint(api_response)
+    except Exception as e:
+        print("Exception when calling WorkflowServiceApi->workflow_service_list_workflows: %s\n" % e)
+```
+
+
+
+### Parameters
+
+This endpoint does not need any parameter.
+
+### Return type
+
+[**V1ListWorkflowsResponse**](V1ListWorkflowsResponse.md)
+
+### Authorization
+
+No authorization required
+
+### HTTP request headers
+
+ - **Content-Type**: Not defined
+ - **Accept**: application/json
+
+### HTTP response details
+
+| Status code | Description | Response headers |
+|-------------|-------------|------------------|
+**200** | A successful response. |  -  |
+**0** | An unexpected error response. |  -  |
+
+[[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
+
+# **workflow_service_update_workflow**
+> V1UpdateWorkflowResponse workflow_service_update_workflow(workflow_name, workflow)
+
+UpdateWorkflow updates a Workflow. The update_mask is used to specify the fields to be updated.
+
+### Example
+
+
+```python
+import eval_studio_client.api
+from eval_studio_client.api.models.required_the_updated_workflow import RequiredTheUpdatedWorkflow
+from eval_studio_client.api.models.v1_update_workflow_response import V1UpdateWorkflowResponse
+from eval_studio_client.api.rest import ApiException
+from pprint import pprint
+
+# Defining the host is optional and defaults to http://localhost
+# See configuration.py for a list of all supported configuration parameters.
+configuration = eval_studio_client.api.Configuration(
+    host = "http://localhost"
+)
+
+
+# Enter a context with an instance of the API client
+with eval_studio_client.api.ApiClient(configuration) as api_client:
+    # Create an instance of the API class
+    api_instance = eval_studio_client.api.WorkflowServiceApi(api_client)
+    workflow_name = 'workflow_name_example' # str | Output only. Immutable. Resource name of the Workflow in format of `workflows/{workflow_id}`.
+    workflow = eval_studio_client.api.RequiredTheUpdatedWorkflow() # RequiredTheUpdatedWorkflow | Required. The updated Workflow.
+
+    try:
+        # UpdateWorkflow updates a Workflow. The update_mask is used to specify the fields to be updated.
+        api_response = api_instance.workflow_service_update_workflow(workflow_name, workflow)
+        print("The response of WorkflowServiceApi->workflow_service_update_workflow:\n")
+        pprint(api_response)
+    except Exception as e:
+        print("Exception when calling WorkflowServiceApi->workflow_service_update_workflow: %s\n" % e)
+```
+
+
+
+### Parameters
+
+
+Name | Type | Description  | Notes
+------------- | ------------- | ------------- | -------------
+ **workflow_name** | **str**| Output only. Immutable. Resource name of the Workflow in format of `workflows/{workflow_id}`. | 
+ **workflow** | [**RequiredTheUpdatedWorkflow**](RequiredTheUpdatedWorkflow.md)| Required. The updated Workflow. | 
+
+### Return type
+
+[**V1UpdateWorkflowResponse**](V1UpdateWorkflowResponse.md)
+
+### Authorization
+
+No authorization required
+
+### HTTP request headers
+
+ - **Content-Type**: application/json
+ - **Accept**: application/json
+
+### HTTP response details
+
+| Status code | Description | Response headers |
+|-------------|-------------|------------------|
+**200** | A successful response. |  -  |
+**0** | An unexpected error response. |  -  |
+
+[[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
+

eval_studio_client/api/models/__init__.py

@@ -17,6 +17,7 @@
 from eval_studio_client.api.models.perturbation_service_create_perturbation_request import PerturbationServiceCreatePerturbationRequest
 from eval_studio_client.api.models.prompt_generation_service_auto_generate_prompts_request import PromptGenerationServiceAutoGeneratePromptsRequest
 from eval_studio_client.api.models.protobuf_any import ProtobufAny
+from eval_studio_client.api.models.protobuf_null_value import ProtobufNullValue
 from eval_studio_client.api.models.required_the_dashboard_to_update import RequiredTheDashboardToUpdate
 from eval_studio_client.api.models.required_the_document_to_update import RequiredTheDocumentToUpdate
 from eval_studio_client.api.models.required_the_leaderboard_to_update import RequiredTheLeaderboardToUpdate
@@ -25,9 +26,13 @@ from eval_studio_client.api.models.required_the_operation_to_finalize import Req
 from eval_studio_client.api.models.required_the_operation_to_update import RequiredTheOperationToUpdate
 from eval_studio_client.api.models.required_the_test_case_to_update import RequiredTheTestCaseToUpdate
 from eval_studio_client.api.models.required_the_test_to_update import RequiredTheTestToUpdate
+from eval_studio_client.api.models.required_the_updated_workflow import RequiredTheUpdatedWorkflow
+from eval_studio_client.api.models.required_the_updated_workflow_node import RequiredTheUpdatedWorkflowNode
 from eval_studio_client.api.models.rpc_status import RpcStatus
 from eval_studio_client.api.models.test_case_service_batch_delete_test_cases_request import TestCaseServiceBatchDeleteTestCasesRequest
 from eval_studio_client.api.models.test_service_generate_test_cases_request import TestServiceGenerateTestCasesRequest
+from eval_studio_client.api.models.test_service_import_test_cases_from_library_request import TestServiceImportTestCasesFromLibraryRequest
+from eval_studio_client.api.models.test_service_list_test_case_library_items_request import TestServiceListTestCaseLibraryItemsRequest
 from eval_studio_client.api.models.test_service_perturb_test_request import TestServicePerturbTestRequest
 from eval_studio_client.api.models.v1_batch_create_leaderboards_request import V1BatchCreateLeaderboardsRequest
 from eval_studio_client.api.models.v1_batch_create_leaderboards_response import V1BatchCreateLeaderboardsResponse
@@ -44,12 +49,16 @@ from eval_studio_client.api.models.v1_batch_delete_models_response import V1Batc
 from eval_studio_client.api.models.v1_batch_delete_test_cases_response import V1BatchDeleteTestCasesResponse
 from eval_studio_client.api.models.v1_batch_delete_tests_request import V1BatchDeleteTestsRequest
 from eval_studio_client.api.models.v1_batch_delete_tests_response import V1BatchDeleteTestsResponse
+from eval_studio_client.api.models.v1_batch_delete_workflows_request import V1BatchDeleteWorkflowsRequest
+from eval_studio_client.api.models.v1_batch_delete_workflows_response import V1BatchDeleteWorkflowsResponse
 from eval_studio_client.api.models.v1_batch_get_dashboards_response import V1BatchGetDashboardsResponse
 from eval_studio_client.api.models.v1_batch_get_documents_response import V1BatchGetDocumentsResponse
 from eval_studio_client.api.models.v1_batch_get_leaderboards_response import V1BatchGetLeaderboardsResponse
 from eval_studio_client.api.models.v1_batch_get_models_response import V1BatchGetModelsResponse
 from eval_studio_client.api.models.v1_batch_get_operations_response import V1BatchGetOperationsResponse
 from eval_studio_client.api.models.v1_batch_get_tests_response import V1BatchGetTestsResponse
+from eval_studio_client.api.models.v1_batch_get_workflow_edges_response import V1BatchGetWorkflowEdgesResponse
+from eval_studio_client.api.models.v1_batch_get_workflow_nodes_response import V1BatchGetWorkflowNodesResponse
 from eval_studio_client.api.models.v1_batch_import_leaderboard_request import V1BatchImportLeaderboardRequest
 from eval_studio_client.api.models.v1_batch_import_leaderboard_response import V1BatchImportLeaderboardResponse
 from eval_studio_client.api.models.v1_batch_import_tests_request import V1BatchImportTestsRequest
@@ -68,6 +77,7 @@ from eval_studio_client.api.models.v1_create_perturbation_response import V1Crea
 from eval_studio_client.api.models.v1_create_test_case_response import V1CreateTestCaseResponse
 from eval_studio_client.api.models.v1_create_test_lab_response import V1CreateTestLabResponse
 from eval_studio_client.api.models.v1_create_test_response import V1CreateTestResponse
+from eval_studio_client.api.models.v1_create_workflow_response import V1CreateWorkflowResponse
 from eval_studio_client.api.models.v1_dashboard import V1Dashboard
 from eval_studio_client.api.models.v1_dashboard_status import V1DashboardStatus
 from eval_studio_client.api.models.v1_delete_dashboard_response import V1DeleteDashboardResponse
@@ -77,7 +87,10 @@ from eval_studio_client.api.models.v1_delete_leaderboard_response import V1Delet
 from eval_studio_client.api.models.v1_delete_model_response import V1DeleteModelResponse
 from eval_studio_client.api.models.v1_delete_test_case_response import V1DeleteTestCaseResponse
 from eval_studio_client.api.models.v1_delete_test_response import V1DeleteTestResponse
+from eval_studio_client.api.models.v1_delete_workflow_node_response import V1DeleteWorkflowNodeResponse
+from eval_studio_client.api.models.v1_delete_workflow_response import V1DeleteWorkflowResponse
 from eval_studio_client.api.models.v1_document import V1Document
+from eval_studio_client.api.models.v1_estimate_threshold_request import V1EstimateThresholdRequest
 from eval_studio_client.api.models.v1_evaluation_test import V1EvaluationTest
 from eval_studio_client.api.models.v1_evaluator import V1Evaluator
 from eval_studio_client.api.models.v1_evaluator_param_type import V1EvaluatorParamType
@@ -99,11 +112,17 @@ from eval_studio_client.api.models.v1_get_perturbator_response import V1GetPertu
 from eval_studio_client.api.models.v1_get_test_case_response import V1GetTestCaseResponse
 from eval_studio_client.api.models.v1_get_test_class_response import V1GetTestClassResponse
 from eval_studio_client.api.models.v1_get_test_response import V1GetTestResponse
+from eval_studio_client.api.models.v1_get_workflow_node_prerequisites_response import V1GetWorkflowNodePrerequisitesResponse
+from eval_studio_client.api.models.v1_get_workflow_node_response import V1GetWorkflowNodeResponse
+from eval_studio_client.api.models.v1_get_workflow_response import V1GetWorkflowResponse
 from eval_studio_client.api.models.v1_import_evaluation_request import V1ImportEvaluationRequest
 from eval_studio_client.api.models.v1_import_leaderboard_request import V1ImportLeaderboardRequest
 from eval_studio_client.api.models.v1_import_leaderboard_response import V1ImportLeaderboardResponse
+from eval_studio_client.api.models.v1_import_test_cases_from_library_response import V1ImportTestCasesFromLibraryResponse
+from eval_studio_client.api.models.v1_import_test_cases_request import V1ImportTestCasesRequest
 from eval_studio_client.api.models.v1_info import V1Info
 from eval_studio_client.api.models.v1_insight import V1Insight
+from eval_studio_client.api.models.v1_labeled_test_case import V1LabeledTestCase
 from eval_studio_client.api.models.v1_leaderboard import V1Leaderboard
 from eval_studio_client.api.models.v1_leaderboard_status import V1LeaderboardStatus
 from eval_studio_client.api.models.v1_leaderboard_type import V1LeaderboardType
@@ -122,10 +141,13 @@ from eval_studio_client.api.models.v1_list_most_recent_models_response import V1
 from eval_studio_client.api.models.v1_list_most_recent_tests_response import V1ListMostRecentTestsResponse
 from eval_studio_client.api.models.v1_list_operations_response import V1ListOperationsResponse
 from eval_studio_client.api.models.v1_list_perturbators_response import V1ListPerturbatorsResponse
+from eval_studio_client.api.models.v1_list_prompt_library_items_response import V1ListPromptLibraryItemsResponse
 from eval_studio_client.api.models.v1_list_rag_collections_response import V1ListRAGCollectionsResponse
+from eval_studio_client.api.models.v1_list_test_case_library_items_response import V1ListTestCaseLibraryItemsResponse
 from eval_studio_client.api.models.v1_list_test_cases_response import V1ListTestCasesResponse
 from eval_studio_client.api.models.v1_list_test_classes_response import V1ListTestClassesResponse
 from eval_studio_client.api.models.v1_list_tests_response import V1ListTestsResponse
+from eval_studio_client.api.models.v1_list_workflows_response import V1ListWorkflowsResponse
 from eval_studio_client.api.models.v1_model import V1Model
 from eval_studio_client.api.models.v1_model_type import V1ModelType
 from eval_studio_client.api.models.v1_operation import V1Operation
@@ -135,6 +157,8 @@ from eval_studio_client.api.models.v1_perturbator import V1Perturbator
 from eval_studio_client.api.models.v1_perturbator_configuration import V1PerturbatorConfiguration
 from eval_studio_client.api.models.v1_perturbator_intensity import V1PerturbatorIntensity
 from eval_studio_client.api.models.v1_problem_and_action import V1ProblemAndAction
+from eval_studio_client.api.models.v1_process_workflow_node_response import V1ProcessWorkflowNodeResponse
+from eval_studio_client.api.models.v1_prompt_library_item import V1PromptLibraryItem
 from eval_studio_client.api.models.v1_test import V1Test
 from eval_studio_client.api.models.v1_test_case import V1TestCase
 from eval_studio_client.api.models.v1_test_case_relationship import V1TestCaseRelationship
@@ -142,6 +166,7 @@ from eval_studio_client.api.models.v1_test_cases_generator import V1TestCasesGen
 from eval_studio_client.api.models.v1_test_class import V1TestClass
 from eval_studio_client.api.models.v1_test_class_type import V1TestClassType
 from eval_studio_client.api.models.v1_test_lab import V1TestLab
+from eval_studio_client.api.models.v1_test_suite_evaluates import V1TestSuiteEvaluates
 from eval_studio_client.api.models.v1_update_dashboard_response import V1UpdateDashboardResponse
 from eval_studio_client.api.models.v1_update_document_response import V1UpdateDocumentResponse
 from eval_studio_client.api.models.v1_update_leaderboard_response import V1UpdateLeaderboardResponse
@@ -149,4 +174,17 @@ from eval_studio_client.api.models.v1_update_model_response import V1UpdateModel
 from eval_studio_client.api.models.v1_update_operation_response import V1UpdateOperationResponse
 from eval_studio_client.api.models.v1_update_test_case_response import V1UpdateTestCaseResponse
 from eval_studio_client.api.models.v1_update_test_response import V1UpdateTestResponse
+from eval_studio_client.api.models.v1_update_workflow_node_response import V1UpdateWorkflowNodeResponse
+from eval_studio_client.api.models.v1_update_workflow_response import V1UpdateWorkflowResponse
 from eval_studio_client.api.models.v1_who_am_i_response import V1WhoAmIResponse
+from eval_studio_client.api.models.v1_workflow import V1Workflow
+from eval_studio_client.api.models.v1_workflow_edge import V1WorkflowEdge
+from eval_studio_client.api.models.v1_workflow_edge_type import V1WorkflowEdgeType
+from eval_studio_client.api.models.v1_workflow_node import V1WorkflowNode
+from eval_studio_client.api.models.v1_workflow_node_artifact import V1WorkflowNodeArtifact
+from eval_studio_client.api.models.v1_workflow_node_artifacts import V1WorkflowNodeArtifacts
+from eval_studio_client.api.models.v1_workflow_node_attributes import V1WorkflowNodeAttributes
+from eval_studio_client.api.models.v1_workflow_node_status import V1WorkflowNodeStatus
+from eval_studio_client.api.models.v1_workflow_node_type import V1WorkflowNodeType
+from eval_studio_client.api.models.v1_workflow_node_view import V1WorkflowNodeView
+from eval_studio_client.api.models.v1_workflow_type import V1WorkflowType

eval_studio_client/api/models/perturbation_service_create_perturbation_request.py

@@ -19,6 +19,7 @@ import json
 
 from pydantic import BaseModel, ConfigDict, Field
 from typing import Any, ClassVar, Dict, List, Optional
+from eval_studio_client.api.models.v1_model import V1Model
 from eval_studio_client.api.models.v1_perturbator_configuration import V1PerturbatorConfiguration
 from eval_studio_client.api.models.v1_test_case import V1TestCase
 from eval_studio_client.api.models.v1_test_case_relationship import V1TestCaseRelationship
@@ -32,7 +33,8 @@ class PerturbationServiceCreatePerturbationRequest(BaseModel):
     perturbator_configurations: Optional[List[V1PerturbatorConfiguration]] = Field(default=None, description="Required. PerturbatorConfiguration to apply to the parent Test.", alias="perturbatorConfigurations")
     test_cases: Optional[List[V1TestCase]] = Field(default=None, description="Required. List of test cases to perturbate. These are the test cases from the parent test.  TODO: breaks https://google.aip.dev/144", alias="testCases")
     test_case_relationships: Optional[List[V1TestCaseRelationship]] = Field(default=None, description="Optional. List of relationships between test cases.", alias="testCaseRelationships")
-    __properties: ClassVar[List[str]] = ["perturbatorConfigurations", "testCases", "testCaseRelationships"]
+    default_h2ogpte_model: Optional[V1Model] = Field(default=None, alias="defaultH2ogpteModel")
+    __properties: ClassVar[List[str]] = ["perturbatorConfigurations", "testCases", "testCaseRelationships", "defaultH2ogpteModel"]
 
     model_config = ConfigDict(
         populate_by_name=True,
@@ -94,6 +96,9 @@ class PerturbationServiceCreatePerturbationRequest(BaseModel):
                 if _item:
                     _items.append(_item.to_dict())
             _dict['testCaseRelationships'] = _items
+        # override the default output from pydantic by calling `to_dict()` of default_h2ogpte_model
+        if self.default_h2ogpte_model:
+            _dict['defaultH2ogpteModel'] = self.default_h2ogpte_model.to_dict()
         return _dict
 
     @classmethod
@@ -108,7 +113,8 @@ class PerturbationServiceCreatePerturbationRequest(BaseModel):
         _obj = cls.model_validate({
             "perturbatorConfigurations": [V1PerturbatorConfiguration.from_dict(_item) for _item in obj["perturbatorConfigurations"]] if obj.get("perturbatorConfigurations") is not None else None,
             "testCases": [V1TestCase.from_dict(_item) for _item in obj["testCases"]] if obj.get("testCases") is not None else None,
-            "testCaseRelationships": [V1TestCaseRelationship.from_dict(_item) for _item in obj["testCaseRelationships"]] if obj.get("testCaseRelationships") is not None else None
+            "testCaseRelationships": [V1TestCaseRelationship.from_dict(_item) for _item in obj["testCaseRelationships"]] if obj.get("testCaseRelationships") is not None else None,
+            "defaultH2ogpteModel": V1Model.from_dict(obj["defaultH2ogpteModel"]) if obj.get("defaultH2ogpteModel") is not None else None
         })
         return _obj
 

eval_studio_client/api/models/prompt_generation_service_auto_generate_prompts_request.py

@@ -33,9 +33,10 @@ class PromptGenerationServiceAutoGeneratePromptsRequest(BaseModel):
     count: Optional[StrictInt] = Field(default=None, description="Required. The number of TestCases to generate.")
     base_llm_model: Optional[StrictStr] = Field(default=None, description="Required. Base LLM model to use for generating the prompts.", alias="baseLlmModel")
     document_urls: Optional[List[StrictStr]] = Field(default=None, description="Optional. The list of document URLs. The document URL might be a managed document URL or a public URL.", alias="documentUrls")
-    generators: Optional[List[V1TestCasesGenerator]] = Field(default=None, description="Optional. Topics to generate TestCases for. If not specified, all topics are selected.")
+    generators: Optional[List[V1TestCasesGenerator]] = Field(default=None, description="Optional. Type of questions to generate TestCases for. If not specified, all types of questions are selected.")
     h2ogpte_collection_id: Optional[StrictStr] = Field(default=None, description="Optional. The ID of the h2oGPTe collection to use. If empty, new temporary collection will be created.", alias="h2ogpteCollectionId")
-    __properties: ClassVar[List[str]] = ["operation", "model", "count", "baseLlmModel", "documentUrls", "generators", "h2ogpteCollectionId"]
+    topics: Optional[List[StrictStr]] = Field(default=None, description="Optional. Topics to generate questions for. If not specified, use document summarization as topic generation.")
+    __properties: ClassVar[List[str]] = ["operation", "model", "count", "baseLlmModel", "documentUrls", "generators", "h2ogpteCollectionId", "topics"]
 
     model_config = ConfigDict(
         populate_by_name=True,
@@ -97,7 +98,8 @@ class PromptGenerationServiceAutoGeneratePromptsRequest(BaseModel):
             "baseLlmModel": obj.get("baseLlmModel"),
             "documentUrls": obj.get("documentUrls"),
             "generators": obj.get("generators"),
-            "h2ogpteCollectionId": obj.get("h2ogpteCollectionId")
+            "h2ogpteCollectionId": obj.get("h2ogpteCollectionId"),
+            "topics": obj.get("topics")
         })
         return _obj
 

eval_studio_client/api/models/protobuf_null_value.py

@@ -0,0 +1,36 @@
+# coding: utf-8
+
+"""
+    ai/h2o/eval_studio/v1/collection.proto
+
+    No description provided (generated by Openapi Generator https://github.com/openapitools/openapi-generator)
+
+    The version of the OpenAPI document: version not set
+    Generated by OpenAPI Generator (https://openapi-generator.tech)
+
+    Do not edit the class manually.
+"""  # noqa: E501
+
+
+from __future__ import annotations
+import json
+from enum import Enum
+from typing_extensions import Self
+
+
+class ProtobufNullValue(str, Enum):
+    """
+    `NullValue` is a singleton enumeration to represent the null value for the `Value` type union.  The JSON representation for `NullValue` is JSON `null`.   - NULL_VALUE: Null value.
+    """
+
+    """
+    allowed enum values
+    """
+    NULL_VALUE = 'NULL_VALUE'
+
+    @classmethod
+    def from_json(cls, json_str: str) -> Self:
+        """Create an instance of ProtobufNullValue from a JSON string"""
+        return cls(json.loads(json_str))
+
+