eval-studio-client 1.0.0__py3-none-any.whl → 1.0.1__py3-none-any.whl

eval_studio_client/api/docs/HumanCalibrationServiceApi.md

@@ -0,0 +1,77 @@
+# eval_studio_client.api.HumanCalibrationServiceApi
+
+All URIs are relative to *http://localhost*
+
+Method | HTTP request | Description
+------------- | ------------- | -------------
+[**human_calibration_service_estimate_threshold**](HumanCalibrationServiceApi.md#human_calibration_service_estimate_threshold) | **POST** /v1:estimateThreshold | EstimateThreshold runs a threshold estimation process based on human labeling of randomly sampled test-cases.
+
+
+# **human_calibration_service_estimate_threshold**
+> V1Operation human_calibration_service_estimate_threshold(body)
+
+EstimateThreshold runs a threshold estimation process based on human labeling of randomly sampled test-cases.
+
+### Example
+
+
+```python
+import eval_studio_client.api
+from eval_studio_client.api.models.v1_estimate_threshold_request import V1EstimateThresholdRequest
+from eval_studio_client.api.models.v1_operation import V1Operation
+from eval_studio_client.api.rest import ApiException
+from pprint import pprint
+
+# Defining the host is optional and defaults to http://localhost
+# See configuration.py for a list of all supported configuration parameters.
+configuration = eval_studio_client.api.Configuration(
+    host = "http://localhost"
+)
+
+
+# Enter a context with an instance of the API client
+with eval_studio_client.api.ApiClient(configuration) as api_client:
+    # Create an instance of the API class
+    api_instance = eval_studio_client.api.HumanCalibrationServiceApi(api_client)
+    body = eval_studio_client.api.V1EstimateThresholdRequest() # V1EstimateThresholdRequest | 
+
+    try:
+        # EstimateThreshold runs a threshold estimation process based on human labeling of randomly sampled test-cases.
+        api_response = api_instance.human_calibration_service_estimate_threshold(body)
+        print("The response of HumanCalibrationServiceApi->human_calibration_service_estimate_threshold:\n")
+        pprint(api_response)
+    except Exception as e:
+        print("Exception when calling HumanCalibrationServiceApi->human_calibration_service_estimate_threshold: %s\n" % e)
+```
+
+
+
+### Parameters
+
+
+Name | Type | Description  | Notes
+------------- | ------------- | ------------- | -------------
+ **body** | [**V1EstimateThresholdRequest**](V1EstimateThresholdRequest.md)|  | 
+
+### Return type
+
+[**V1Operation**](V1Operation.md)
+
+### Authorization
+
+No authorization required
+
+### HTTP request headers
+
+ - **Content-Type**: application/json
+ - **Accept**: application/json
+
+### HTTP response details
+
+| Status code | Description | Response headers |
+|-------------|-------------|------------------|
+**200** | A successful response. |  -  |
+**0** | An unexpected error response. |  -  |
+
+[[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
+

eval_studio_client/api/docs/PerturbationServiceCreatePerturbationRequest.md

@@ -8,6 +8,7 @@ Name | Type | Description | Notes
 **perturbator_configurations** | [**List[V1PerturbatorConfiguration]**](V1PerturbatorConfiguration.md) | Required. PerturbatorConfiguration to apply to the parent Test. | [optional] 
 **test_cases** | [**List[V1TestCase]**](V1TestCase.md) | Required. List of test cases to perturbate. These are the test cases from the parent test.  TODO: breaks https://google.aip.dev/144 | [optional] 
 **test_case_relationships** | [**List[V1TestCaseRelationship]**](V1TestCaseRelationship.md) | Optional. List of relationships between test cases. | [optional] 
+**default_h2ogpte_model** | [**V1Model**](V1Model.md) |  | [optional] 
 
 ## Example
 

eval_studio_client/api/docs/PerturbatorServiceApi.md

@@ -75,7 +75,7 @@ No authorization required
 [[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
 
 # **perturbator_service_list_perturbators**
-> V1ListPerturbatorsResponse perturbator_service_list_perturbators()
+> V1ListPerturbatorsResponse perturbator_service_list_perturbators(default_h2ogpte_model_name=default_h2ogpte_model_name, default_h2ogpte_model_create_time=default_h2ogpte_model_create_time, default_h2ogpte_model_creator=default_h2ogpte_model_creator, default_h2ogpte_model_update_time=default_h2ogpte_model_update_time, default_h2ogpte_model_updater=default_h2ogpte_model_updater, default_h2ogpte_model_delete_time=default_h2ogpte_model_delete_time, default_h2ogpte_model_deleter=default_h2ogpte_model_deleter, default_h2ogpte_model_display_name=default_h2ogpte_model_display_name, default_h2ogpte_model_description=default_h2ogpte_model_description, default_h2ogpte_model_url=default_h2ogpte_model_url, default_h2ogpte_model_api_key=default_h2ogpte_model_api_key, default_h2ogpte_model_type=default_h2ogpte_model_type, default_h2ogpte_model_parameters=default_h2ogpte_model_parameters, default_h2ogpte_model_demo=default_h2ogpte_model_demo)
 
 
 
@@ -99,9 +99,23 @@ configuration = eval_studio_client.api.Configuration(
 with eval_studio_client.api.ApiClient(configuration) as api_client:
     # Create an instance of the API class
     api_instance = eval_studio_client.api.PerturbatorServiceApi(api_client)
+    default_h2ogpte_model_name = 'default_h2ogpte_model_name_example' # str | Output only. Name of the Model resource. e.g.: \"models/<UUID>\" (optional)
+    default_h2ogpte_model_create_time = '2013-10-20T19:20:30+01:00' # datetime | Output only. Timestamp when the Model was created. (optional)
+    default_h2ogpte_model_creator = 'default_h2ogpte_model_creator_example' # str | Output only. Name of the user or service that requested creation of the Model. (optional)
+    default_h2ogpte_model_update_time = '2013-10-20T19:20:30+01:00' # datetime | Output only. Optional. Timestamp when the Model was last updated. (optional)
+    default_h2ogpte_model_updater = 'default_h2ogpte_model_updater_example' # str | Output only. Optional. Name of the user or service that requested update of the Model. (optional)
+    default_h2ogpte_model_delete_time = '2013-10-20T19:20:30+01:00' # datetime | Output only. Optional. Set when the Model is deleted. When set Model should be considered as deleted. (optional)
+    default_h2ogpte_model_deleter = 'default_h2ogpte_model_deleter_example' # str | Output only. Optional. Name of the user or service that requested deletion of the Model. (optional)
+    default_h2ogpte_model_display_name = 'default_h2ogpte_model_display_name_example' # str | Human readable name of the Model. (optional)
+    default_h2ogpte_model_description = 'default_h2ogpte_model_description_example' # str | Optional. Arbitrary description of the Model. (optional)
+    default_h2ogpte_model_url = 'default_h2ogpte_model_url_example' # str | Optional. Immutable. Absolute URL to the Model. (optional)
+    default_h2ogpte_model_api_key = 'default_h2ogpte_model_api_key_example' # str | Optional. API key used to access the Model. Not set for read calls (i.e. get, list) by public clients (front-end). Set only for internal (server-to-worker) communication. (optional)
+    default_h2ogpte_model_type = 'MODEL_TYPE_UNSPECIFIED' # str | Immutable. Type of this Model.   - MODEL_TYPE_UNSPECIFIED: Unspecified type.  - MODEL_TYPE_H2OGPTE_RAG: h2oGPTe RAG.  - MODEL_TYPE_OPENAI_RAG: OpenAI Assistant RAG.  - MODEL_TYPE_H2OGPTE_LLM: h2oGPTe LLM.  - MODEL_TYPE_H2OGPT_LLM: h2oGPT LLM.  - MODEL_TYPE_OPENAI_CHAT: OpenAI chat.  - MODEL_TYPE_AZURE_OPENAI_CHAT: Microsoft Azure hosted OpenAI Chat.  - MODEL_TYPE_OPENAI_API_CHAT: OpenAI API chat.  - MODEL_TYPE_H2OLLMOPS: H2O LLMOps.  - MODEL_TYPE_OLLAMA: Ollama.  - MODEL_TYPE_AMAZON_BEDROCK: Amazon Bedrock. (optional) (default to 'MODEL_TYPE_UNSPECIFIED')
+    default_h2ogpte_model_parameters = 'default_h2ogpte_model_parameters_example' # str | Optional. Model specific parameters in JSON format. (optional)
+    default_h2ogpte_model_demo = True # bool | Output only. Whether the Model is a demo resource or not. Demo resources are read only. (optional)
 
     try:
-        api_response = api_instance.perturbator_service_list_perturbators()
+        api_response = api_instance.perturbator_service_list_perturbators(default_h2ogpte_model_name=default_h2ogpte_model_name, default_h2ogpte_model_create_time=default_h2ogpte_model_create_time, default_h2ogpte_model_creator=default_h2ogpte_model_creator, default_h2ogpte_model_update_time=default_h2ogpte_model_update_time, default_h2ogpte_model_updater=default_h2ogpte_model_updater, default_h2ogpte_model_delete_time=default_h2ogpte_model_delete_time, default_h2ogpte_model_deleter=default_h2ogpte_model_deleter, default_h2ogpte_model_display_name=default_h2ogpte_model_display_name, default_h2ogpte_model_description=default_h2ogpte_model_description, default_h2ogpte_model_url=default_h2ogpte_model_url, default_h2ogpte_model_api_key=default_h2ogpte_model_api_key, default_h2ogpte_model_type=default_h2ogpte_model_type, default_h2ogpte_model_parameters=default_h2ogpte_model_parameters, default_h2ogpte_model_demo=default_h2ogpte_model_demo)
         print("The response of PerturbatorServiceApi->perturbator_service_list_perturbators:\n")
         pprint(api_response)
     except Exception as e:
@@ -112,7 +126,23 @@ with eval_studio_client.api.ApiClient(configuration) as api_client:
 
 ### Parameters
 
-This endpoint does not need any parameter.
+
+Name | Type | Description  | Notes
+------------- | ------------- | ------------- | -------------
+ **default_h2ogpte_model_name** | **str**| Output only. Name of the Model resource. e.g.: \&quot;models/&lt;UUID&gt;\&quot; | [optional] 
+ **default_h2ogpte_model_create_time** | **datetime**| Output only. Timestamp when the Model was created. | [optional] 
+ **default_h2ogpte_model_creator** | **str**| Output only. Name of the user or service that requested creation of the Model. | [optional] 
+ **default_h2ogpte_model_update_time** | **datetime**| Output only. Optional. Timestamp when the Model was last updated. | [optional] 
+ **default_h2ogpte_model_updater** | **str**| Output only. Optional. Name of the user or service that requested update of the Model. | [optional] 
+ **default_h2ogpte_model_delete_time** | **datetime**| Output only. Optional. Set when the Model is deleted. When set Model should be considered as deleted. | [optional] 
+ **default_h2ogpte_model_deleter** | **str**| Output only. Optional. Name of the user or service that requested deletion of the Model. | [optional] 
+ **default_h2ogpte_model_display_name** | **str**| Human readable name of the Model. | [optional] 
+ **default_h2ogpte_model_description** | **str**| Optional. Arbitrary description of the Model. | [optional] 
+ **default_h2ogpte_model_url** | **str**| Optional. Immutable. Absolute URL to the Model. | [optional] 
+ **default_h2ogpte_model_api_key** | **str**| Optional. API key used to access the Model. Not set for read calls (i.e. get, list) by public clients (front-end). Set only for internal (server-to-worker) communication. | [optional] 
+ **default_h2ogpte_model_type** | **str**| Immutable. Type of this Model.   - MODEL_TYPE_UNSPECIFIED: Unspecified type.  - MODEL_TYPE_H2OGPTE_RAG: h2oGPTe RAG.  - MODEL_TYPE_OPENAI_RAG: OpenAI Assistant RAG.  - MODEL_TYPE_H2OGPTE_LLM: h2oGPTe LLM.  - MODEL_TYPE_H2OGPT_LLM: h2oGPT LLM.  - MODEL_TYPE_OPENAI_CHAT: OpenAI chat.  - MODEL_TYPE_AZURE_OPENAI_CHAT: Microsoft Azure hosted OpenAI Chat.  - MODEL_TYPE_OPENAI_API_CHAT: OpenAI API chat.  - MODEL_TYPE_H2OLLMOPS: H2O LLMOps.  - MODEL_TYPE_OLLAMA: Ollama.  - MODEL_TYPE_AMAZON_BEDROCK: Amazon Bedrock. | [optional] [default to &#39;MODEL_TYPE_UNSPECIFIED&#39;]
+ **default_h2ogpte_model_parameters** | **str**| Optional. Model specific parameters in JSON format. | [optional] 
+ **default_h2ogpte_model_demo** | **bool**| Output only. Whether the Model is a demo resource or not. Demo resources are read only. | [optional] 
 
 ### Return type
 

eval_studio_client/api/docs/PromptGenerationServiceAutoGeneratePromptsRequest.md

@@ -10,8 +10,9 @@ Name | Type | Description | Notes
 **count** | **int** | Required. The number of TestCases to generate. | [optional] 
 **base_llm_model** | **str** | Required. Base LLM model to use for generating the prompts. | [optional] 
 **document_urls** | **List[str]** | Optional. The list of document URLs. The document URL might be a managed document URL or a public URL. | [optional] 
-**generators** | [**List[V1TestCasesGenerator]**](V1TestCasesGenerator.md) | Optional. Topics to generate TestCases for. If not specified, all topics are selected. | [optional] 
+**generators** | [**List[V1TestCasesGenerator]**](V1TestCasesGenerator.md) | Optional. Type of questions to generate TestCases for. If not specified, all types of questions are selected. | [optional] 
 **h2ogpte_collection_id** | **str** | Optional. The ID of the h2oGPTe collection to use. If empty, new temporary collection will be created. | [optional] 
+**topics** | **List[str]** | Optional. Topics to generate questions for. If not specified, use document summarization as topic generation. | [optional] 
 
 ## Example
 

eval_studio_client/api/docs/PromptLibraryServiceApi.md

@@ -0,0 +1,155 @@
+# eval_studio_client.api.PromptLibraryServiceApi
+
+All URIs are relative to *http://localhost*
+
+Method | HTTP request | Description
+------------- | ------------- | -------------
+[**prompt_library_service_import_test_cases**](PromptLibraryServiceApi.md#prompt_library_service_import_test_cases) | **POST** /v1/promptLibraryItems:importTestCases | 
+[**prompt_library_service_list_prompt_library_items**](PromptLibraryServiceApi.md#prompt_library_service_list_prompt_library_items) | **GET** /v1/promptLibraryItems | 
+
+
+# **prompt_library_service_import_test_cases**
+> V1Operation prompt_library_service_import_test_cases(body)
+
+
+
+### Example
+
+
+```python
+import eval_studio_client.api
+from eval_studio_client.api.models.v1_import_test_cases_request import V1ImportTestCasesRequest
+from eval_studio_client.api.models.v1_operation import V1Operation
+from eval_studio_client.api.rest import ApiException
+from pprint import pprint
+
+# Defining the host is optional and defaults to http://localhost
+# See configuration.py for a list of all supported configuration parameters.
+configuration = eval_studio_client.api.Configuration(
+    host = "http://localhost"
+)
+
+
+# Enter a context with an instance of the API client
+with eval_studio_client.api.ApiClient(configuration) as api_client:
+    # Create an instance of the API class
+    api_instance = eval_studio_client.api.PromptLibraryServiceApi(api_client)
+    body = eval_studio_client.api.V1ImportTestCasesRequest() # V1ImportTestCasesRequest | 
+
+    try:
+        api_response = api_instance.prompt_library_service_import_test_cases(body)
+        print("The response of PromptLibraryServiceApi->prompt_library_service_import_test_cases:\n")
+        pprint(api_response)
+    except Exception as e:
+        print("Exception when calling PromptLibraryServiceApi->prompt_library_service_import_test_cases: %s\n" % e)
+```
+
+
+
+### Parameters
+
+
+Name | Type | Description  | Notes
+------------- | ------------- | ------------- | -------------
+ **body** | [**V1ImportTestCasesRequest**](V1ImportTestCasesRequest.md)|  | 
+
+### Return type
+
+[**V1Operation**](V1Operation.md)
+
+### Authorization
+
+No authorization required
+
+### HTTP request headers
+
+ - **Content-Type**: application/json
+ - **Accept**: application/json
+
+### HTTP response details
+
+| Status code | Description | Response headers |
+|-------------|-------------|------------------|
+**200** | A successful response. |  -  |
+**0** | An unexpected error response. |  -  |
+
+[[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
+
+# **prompt_library_service_list_prompt_library_items**
+> V1ListPromptLibraryItemsResponse prompt_library_service_list_prompt_library_items(filter_by_categories=filter_by_categories, filter_by_purposes=filter_by_purposes, filter_by_evaluates=filter_by_evaluates, filter_by_origin=filter_by_origin, filter_by_test_case_count=filter_by_test_case_count, filter_by_test_count=filter_by_test_count, filter_by_fts=filter_by_fts)
+
+
+
+### Example
+
+
+```python
+import eval_studio_client.api
+from eval_studio_client.api.models.v1_list_prompt_library_items_response import V1ListPromptLibraryItemsResponse
+from eval_studio_client.api.rest import ApiException
+from pprint import pprint
+
+# Defining the host is optional and defaults to http://localhost
+# See configuration.py for a list of all supported configuration parameters.
+configuration = eval_studio_client.api.Configuration(
+    host = "http://localhost"
+)
+
+
+# Enter a context with an instance of the API client
+with eval_studio_client.api.ApiClient(configuration) as api_client:
+    # Create an instance of the API class
+    api_instance = eval_studio_client.api.PromptLibraryServiceApi(api_client)
+    filter_by_categories = ['filter_by_categories_example'] # List[str] | Optional. Filter by categories. (optional)
+    filter_by_purposes = ['filter_by_purposes_example'] # List[str] | Optional. Filter by purposes. (optional)
+    filter_by_evaluates = ['filter_by_evaluates_example'] # List[str] | Optional. Filter by evaluates. (optional)
+    filter_by_origin = 'filter_by_origin_example' # str | Optional. Filter by origin. (optional)
+    filter_by_test_case_count = 56 # int | Optional. Filter by test case count. (optional)
+    filter_by_test_count = 56 # int | Optional. Filter by test count. (optional)
+    filter_by_fts = 'filter_by_fts_example' # str | Optional. Filter by FTS. (optional)
+
+    try:
+        api_response = api_instance.prompt_library_service_list_prompt_library_items(filter_by_categories=filter_by_categories, filter_by_purposes=filter_by_purposes, filter_by_evaluates=filter_by_evaluates, filter_by_origin=filter_by_origin, filter_by_test_case_count=filter_by_test_case_count, filter_by_test_count=filter_by_test_count, filter_by_fts=filter_by_fts)
+        print("The response of PromptLibraryServiceApi->prompt_library_service_list_prompt_library_items:\n")
+        pprint(api_response)
+    except Exception as e:
+        print("Exception when calling PromptLibraryServiceApi->prompt_library_service_list_prompt_library_items: %s\n" % e)
+```
+
+
+
+### Parameters
+
+
+Name | Type | Description  | Notes
+------------- | ------------- | ------------- | -------------
+ **filter_by_categories** | [**List[str]**](str.md)| Optional. Filter by categories. | [optional] 
+ **filter_by_purposes** | [**List[str]**](str.md)| Optional. Filter by purposes. | [optional] 
+ **filter_by_evaluates** | [**List[str]**](str.md)| Optional. Filter by evaluates. | [optional] 
+ **filter_by_origin** | **str**| Optional. Filter by origin. | [optional] 
+ **filter_by_test_case_count** | **int**| Optional. Filter by test case count. | [optional] 
+ **filter_by_test_count** | **int**| Optional. Filter by test count. | [optional] 
+ **filter_by_fts** | **str**| Optional. Filter by FTS. | [optional] 
+
+### Return type
+
+[**V1ListPromptLibraryItemsResponse**](V1ListPromptLibraryItemsResponse.md)
+
+### Authorization
+
+No authorization required
+
+### HTTP request headers
+
+ - **Content-Type**: Not defined
+ - **Accept**: application/json
+
+### HTTP response details
+
+| Status code | Description | Response headers |
+|-------------|-------------|------------------|
+**200** | A successful response. |  -  |
+**0** | An unexpected error response. |  -  |
+
+[[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
+

eval_studio_client/api/docs/ProtobufNullValue.md

@@ -0,0 +1,12 @@
+# ProtobufNullValue
+
+`NullValue` is a singleton enumeration to represent the null value for the `Value` type union.  The JSON representation for `NullValue` is JSON `null`.   - NULL_VALUE: Null value.
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/RequiredTheTestCaseToUpdate.md

@@ -16,6 +16,7 @@ Name | Type | Description | Notes
 **answer** | **str** | Expected answer text. Model output. | [optional] 
 **constraints** | **List[str]** | Constraints on the model output. | [optional] 
 **condition** | **str** | Optional. Test case output condition, in a form of AIP-160 compliant filter expression. | [optional] 
+**perturbed_by** | **List[str]** | Output only. The list of perturbators applied to this test case. | [optional] [readonly] 
 
 ## Example
 

eval_studio_client/api/docs/RequiredTheUpdatedWorkflow.md

@@ -0,0 +1,44 @@
+# RequiredTheUpdatedWorkflow
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**display_name** | **str** | Human-readable name of the Workflow. | [optional] 
+**description** | **str** | Optional description of the Workflow. | [optional] 
+**create_time** | **datetime** | Output only. Immutable. Creation time of the Workflow. | [optional] [readonly] 
+**creator** | **str** | Output only. Immutable. Name of the user or service that requested creation of the Workflow. | [optional] [readonly] 
+**update_time** | **datetime** | Output only. Optional. Last update time of the Workflow. | [optional] [readonly] 
+**updater** | **str** | Output only. Name of the user or service that requested update of the Workflow. | [optional] [readonly] 
+**delete_time** | **datetime** | Output only. Optional. Deletion time of the Workflow. | [optional] [readonly] 
+**deleter** | **str** | Output only. Name of the user or service that requested deletion of the Workflow. | [optional] [readonly] 
+**type** | [**V1WorkflowType**](V1WorkflowType.md) |  | [optional] 
+**model** | **str** | Immutable. Resource name of the Model associated with this Workflow. | [optional] 
+**nodes** | **List[str]** | Output only. List of the WorkflowNodes in the Workflow. | [optional] [readonly] 
+**edges** | **List[str]** | Output only. List of the WorkflowEdges in the Workflow. | [optional] [readonly] 
+**outputs** | **Dict[str, object]** | Output only. Optional. Computed outputs of all the WorkflowNodes in the Workflow. | [optional] [readonly] 
+**output_artifacts** | [**Dict[str, V1WorkflowNodeArtifacts]**](V1WorkflowNodeArtifacts.md) | Output only. Optional. List of the WorkflowNodeArtifacts produces by all the WorkflowNodes in the Workflow. | [optional] [readonly] 
+**llm_model** | **str** | Immutable. LLM Model to use. | [optional] 
+**model_parameters** | **str** | Optional. Immutable. Model parameter overrides in JSON format. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.required_the_updated_workflow import RequiredTheUpdatedWorkflow
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of RequiredTheUpdatedWorkflow from a JSON string
+required_the_updated_workflow_instance = RequiredTheUpdatedWorkflow.from_json(json)
+# print the JSON string representation of the object
+print(RequiredTheUpdatedWorkflow.to_json())
+
+# convert the object into a dict
+required_the_updated_workflow_dict = required_the_updated_workflow_instance.to_dict()
+# create an instance of RequiredTheUpdatedWorkflow from a dict
+required_the_updated_workflow_from_dict = RequiredTheUpdatedWorkflow.from_dict(required_the_updated_workflow_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/RequiredTheUpdatedWorkflowNode.md

@@ -0,0 +1,44 @@
+# RequiredTheUpdatedWorkflowNode
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**parent** | **str** | Output only. Immutable. Resource name of the parent Workflow in format of `workflows/{workflow_id}/`. | [optional] [readonly] 
+**display_name** | **str** | Human-readable name of the WorkflowNode. | [optional] 
+**description** | **str** | Optional description of the WorkflowNode. | [optional] 
+**create_time** | **datetime** | Output only. Immutable. Creation time of the WorkflowNode. | [optional] [readonly] 
+**creator** | **str** | Output only. Immutable. Name of the user or service that requested creation of the WorkflowNode. | [optional] [readonly] 
+**update_time** | **datetime** | Output only. Optional. Last update time of the WorkflowNode. | [optional] [readonly] 
+**updater** | **str** | Output only. Name of the user or service that requested update of the WorkflowNode. | [optional] [readonly] 
+**delete_time** | **datetime** | Output only. Optional. Deletion time of the WorkflowNode. | [optional] [readonly] 
+**deleter** | **str** | Output only. Name of the user or service that requested deletion of the WorkflowNode. | [optional] [readonly] 
+**type** | [**V1WorkflowNodeType**](V1WorkflowNodeType.md) |  | [optional] 
+**parameters** | **object** | User-given parameters for the WorkflowNode. | [optional] 
+**outputs** | **object** | Output only. Computed outputs of the WorkflowNode. | [optional] [readonly] 
+**output_artifacts** | [**List[V1WorkflowNodeArtifact]**](V1WorkflowNodeArtifact.md) | Output only. Optional. List of the WorkflowNodeArtifacts produces by the WorkflowNode. | [optional] [readonly] 
+**status** | [**V1WorkflowNodeStatus**](V1WorkflowNodeStatus.md) |  | [optional] 
+**attributes** | [**V1WorkflowNodeAttributes**](V1WorkflowNodeAttributes.md) |  | [optional] 
+**processed_by_operation** | **str** | Output only. Optional. Resource name of the latest Operation that has processed or is currently processing this WorkflowNode. | [optional] [readonly] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.required_the_updated_workflow_node import RequiredTheUpdatedWorkflowNode
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of RequiredTheUpdatedWorkflowNode from a JSON string
+required_the_updated_workflow_node_instance = RequiredTheUpdatedWorkflowNode.from_json(json)
+# print the JSON string representation of the object
+print(RequiredTheUpdatedWorkflowNode.to_json())
+
+# convert the object into a dict
+required_the_updated_workflow_node_dict = required_the_updated_workflow_node_instance.to_dict()
+# create an instance of RequiredTheUpdatedWorkflowNode from a dict
+required_the_updated_workflow_node_from_dict = RequiredTheUpdatedWorkflowNode.from_dict(required_the_updated_workflow_node_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/TestServiceApi.md

@@ -11,7 +11,9 @@ Method | HTTP request | Description
 [**test_service_delete_test**](TestServiceApi.md#test_service_delete_test) | **DELETE** /v1/{name_6} | 
 [**test_service_generate_test_cases**](TestServiceApi.md#test_service_generate_test_cases) | **POST** /v1/{name}:generateTestCases | 
 [**test_service_get_test**](TestServiceApi.md#test_service_get_test) | **GET** /v1/{name_9} | 
+[**test_service_import_test_cases_from_library**](TestServiceApi.md#test_service_import_test_cases_from_library) | **POST** /v1/{name}:importTestCasesFromLibrary | 
 [**test_service_list_most_recent_tests**](TestServiceApi.md#test_service_list_most_recent_tests) | **GET** /v1/tests:mostRecent | 
+[**test_service_list_test_case_library_items**](TestServiceApi.md#test_service_list_test_case_library_items) | **POST** /v1/{name}:listTestCaseLibraryItems | 
 [**test_service_list_tests**](TestServiceApi.md#test_service_list_tests) | **GET** /v1/tests | 
 [**test_service_perturb_test**](TestServiceApi.md#test_service_perturb_test) | **POST** /v1/{name}:perturb | 
 [**test_service_update_test**](TestServiceApi.md#test_service_update_test) | **PATCH** /v1/{test.name} | 
@@ -487,6 +489,75 @@ No authorization required
 
 [[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
 
+# **test_service_import_test_cases_from_library**
+> V1ImportTestCasesFromLibraryResponse test_service_import_test_cases_from_library(name, body)
+
+
+
+### Example
+
+
+```python
+import eval_studio_client.api
+from eval_studio_client.api.models.test_service_import_test_cases_from_library_request import TestServiceImportTestCasesFromLibraryRequest
+from eval_studio_client.api.models.v1_import_test_cases_from_library_response import V1ImportTestCasesFromLibraryResponse
+from eval_studio_client.api.rest import ApiException
+from pprint import pprint
+
+# Defining the host is optional and defaults to http://localhost
+# See configuration.py for a list of all supported configuration parameters.
+configuration = eval_studio_client.api.Configuration(
+    host = "http://localhost"
+)
+
+
+# Enter a context with an instance of the API client
+with eval_studio_client.api.ApiClient(configuration) as api_client:
+    # Create an instance of the API class
+    api_instance = eval_studio_client.api.TestServiceApi(api_client)
+    name = 'name_example' # str | Required. The Test for which to get TestCases.
+    body = eval_studio_client.api.TestServiceImportTestCasesFromLibraryRequest() # TestServiceImportTestCasesFromLibraryRequest | 
+
+    try:
+        api_response = api_instance.test_service_import_test_cases_from_library(name, body)
+        print("The response of TestServiceApi->test_service_import_test_cases_from_library:\n")
+        pprint(api_response)
+    except Exception as e:
+        print("Exception when calling TestServiceApi->test_service_import_test_cases_from_library: %s\n" % e)
+```
+
+
+
+### Parameters
+
+
+Name | Type | Description  | Notes
+------------- | ------------- | ------------- | -------------
+ **name** | **str**| Required. The Test for which to get TestCases. | 
+ **body** | [**TestServiceImportTestCasesFromLibraryRequest**](TestServiceImportTestCasesFromLibraryRequest.md)|  | 
+
+### Return type
+
+[**V1ImportTestCasesFromLibraryResponse**](V1ImportTestCasesFromLibraryResponse.md)
+
+### Authorization
+
+No authorization required
+
+### HTTP request headers
+
+ - **Content-Type**: application/json
+ - **Accept**: application/json
+
+### HTTP response details
+
+| Status code | Description | Response headers |
+|-------------|-------------|------------------|
+**200** | A successful response. |  -  |
+**0** | An unexpected error response. |  -  |
+
+[[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
+
 # **test_service_list_most_recent_tests**
 > V1ListMostRecentTestsResponse test_service_list_most_recent_tests(limit=limit)
 
@@ -553,6 +624,75 @@ No authorization required
 
 [[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
 
+# **test_service_list_test_case_library_items**
+> V1ListTestCaseLibraryItemsResponse test_service_list_test_case_library_items(name, body)
+
+
+
+### Example
+
+
+```python
+import eval_studio_client.api
+from eval_studio_client.api.models.test_service_list_test_case_library_items_request import TestServiceListTestCaseLibraryItemsRequest
+from eval_studio_client.api.models.v1_list_test_case_library_items_response import V1ListTestCaseLibraryItemsResponse
+from eval_studio_client.api.rest import ApiException
+from pprint import pprint
+
+# Defining the host is optional and defaults to http://localhost
+# See configuration.py for a list of all supported configuration parameters.
+configuration = eval_studio_client.api.Configuration(
+    host = "http://localhost"
+)
+
+
+# Enter a context with an instance of the API client
+with eval_studio_client.api.ApiClient(configuration) as api_client:
+    # Create an instance of the API class
+    api_instance = eval_studio_client.api.TestServiceApi(api_client)
+    name = 'name_example' # str | Required. The Test for which to list the items.
+    body = eval_studio_client.api.TestServiceListTestCaseLibraryItemsRequest() # TestServiceListTestCaseLibraryItemsRequest | 
+
+    try:
+        api_response = api_instance.test_service_list_test_case_library_items(name, body)
+        print("The response of TestServiceApi->test_service_list_test_case_library_items:\n")
+        pprint(api_response)
+    except Exception as e:
+        print("Exception when calling TestServiceApi->test_service_list_test_case_library_items: %s\n" % e)
+```
+
+
+
+### Parameters
+
+
+Name | Type | Description  | Notes
+------------- | ------------- | ------------- | -------------
+ **name** | **str**| Required. The Test for which to list the items. | 
+ **body** | [**TestServiceListTestCaseLibraryItemsRequest**](TestServiceListTestCaseLibraryItemsRequest.md)|  | 
+
+### Return type
+
+[**V1ListTestCaseLibraryItemsResponse**](V1ListTestCaseLibraryItemsResponse.md)
+
+### Authorization
+
+No authorization required
+
+### HTTP request headers
+
+ - **Content-Type**: application/json
+ - **Accept**: application/json
+
+### HTTP response details
+
+| Status code | Description | Response headers |
+|-------------|-------------|------------------|
+**200** | A successful response. |  -  |
+**0** | An unexpected error response. |  -  |
+
+[[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
+
 # **test_service_list_tests**
 > V1ListTestsResponse test_service_list_tests(order_by=order_by)
 

eval_studio_client/api/docs/TestServiceGenerateTestCasesRequest.md

@@ -10,6 +10,7 @@ Name | Type | Description | Notes
 **base_llm_model** | **str** | Optional. The base LLM model to use for generating the prompts. Selected automatically if not specified. | [optional] 
 **generators** | [**List[V1TestCasesGenerator]**](V1TestCasesGenerator.md) | Optional. Generators to use for generation. If not specified, all generators are selected. | [optional] 
 **h2ogpte_collection_id** | **str** | Optional. The ID of the h2oGPTe collection to use. If empty, new temporary collection will be created. | [optional] 
+**topics** | **List[str]** | Optional. Optional. Topics to generate questions for. If not specified, use document summarization as topic generation. | [optional] 
 
 ## Example
 

eval_studio_client/api/docs/TestServiceImportTestCasesFromLibraryRequest.md

@@ -0,0 +1,32 @@
+# TestServiceImportTestCasesFromLibraryRequest
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**operation** | **str** | Required. The Operation processing this prompt library retrieval process. | [optional] 
+**test_suite_url** | **str** | Required. The URL of the library test suite to get TestCases from (sample). | [optional] 
+**count** | **int** | Required. The number of TestCases to get from the library. | [optional] 
+**test_document_urls** | **List[str]** | Optional. The list of target Test corpus document URLs to skip when returning library TestCases corpus. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.test_service_import_test_cases_from_library_request import TestServiceImportTestCasesFromLibraryRequest
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of TestServiceImportTestCasesFromLibraryRequest from a JSON string
+test_service_import_test_cases_from_library_request_instance = TestServiceImportTestCasesFromLibraryRequest.from_json(json)
+# print the JSON string representation of the object
+print(TestServiceImportTestCasesFromLibraryRequest.to_json())
+
+# convert the object into a dict
+test_service_import_test_cases_from_library_request_dict = test_service_import_test_cases_from_library_request_instance.to_dict()
+# create an instance of TestServiceImportTestCasesFromLibraryRequest from a dict
+test_service_import_test_cases_from_library_request_from_dict = TestServiceImportTestCasesFromLibraryRequest.from_dict(test_service_import_test_cases_from_library_request_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+