eval-studio-client 1.1.0a5__py3-none-any.whl → 1.1.0a7__py3-none-any.whl

eval_studio_client/api/docs/V1Dashboard.md

@@ -18,6 +18,7 @@ Name | Type | Description | Notes
 **leaderboards** | **List[str]** | Immutable. Resource names of the Leaderboards used in this Dashboard. | [optional] 
 **create_operation** | **str** | Output only. Operation resource name that created this Dashboard. | [optional] [readonly] 
 **demo** | **bool** | Output only. Whether the Dashboard is a demo resource or not. Demo resources are read only. | [optional] [readonly] 
+**type** | [**V1DashboardType**](V1DashboardType.md) |  | [optional] 
 
 ## Example
 

eval_studio_client/api/docs/V1DashboardType.md

@@ -0,0 +1,12 @@
+# V1DashboardType
+
+ - DASHBOARD_TYPE_UNSPECIFIED: Unspecified type.  - DASHBOARD_TYPE_STANDALONE: Standalone dashboard.  - DASHBOARD_TYPE_WORKFLOW: Dashboard is part of a dashboard group.
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1DependencyList.md

@@ -0,0 +1,30 @@
+# V1DependencyList
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**node** | **str** | The name of the Workflow Node to retrieve dependencies for. | [optional] 
+**dependencies** | [**List[V1WorkflowDependency]**](V1WorkflowDependency.md) | The names of the Workflow Node dependencies. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_dependency_list import V1DependencyList
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1DependencyList from a JSON string
+v1_dependency_list_instance = V1DependencyList.from_json(json)
+# print the JSON string representation of the object
+print(V1DependencyList.to_json())
+
+# convert the object into a dict
+v1_dependency_list_dict = v1_dependency_list_instance.to_dict()
+# create an instance of V1DependencyList from a dict
+v1_dependency_list_from_dict = V1DependencyList.from_dict(v1_dependency_list_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1Evaluator.md

@@ -23,6 +23,8 @@ Name | Type | Description | Notes
 **brief_description** | **str** | Optional. Short preview of the Evaluator's description. | [optional] 
 **enabled** | **bool** | Output only. Whether this Evaluator can be used for creating evaluations. Evaluator might be disabled because it has some external requirements that are not met. | [optional] [readonly] 
 **tagline** | **str** | Output only. Tagline is a short (single-line) and high-level description of the evaluator. | [optional] [readonly] 
+**primary_metric** | **str** | Output only. Optional. The name of the primary metric. | [optional] [readonly] 
+**primary_metric_default_threshold** | **float** | Output only. Optional. Default threshold of the primary metric. Value must be ignored if primary_metric is invalid. | [optional] [readonly] 
 
 ## Example
 

eval_studio_client/api/docs/V1GetGuardrailsConfigurationResponse.md

@@ -0,0 +1,29 @@
+# V1GetGuardrailsConfigurationResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**guardrails_configuration_json** | **str** | The guardrails configuration for the Workflow requested in JSON format. This configuration is usable by the guardrails client as is. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_get_guardrails_configuration_response import V1GetGuardrailsConfigurationResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1GetGuardrailsConfigurationResponse from a JSON string
+v1_get_guardrails_configuration_response_instance = V1GetGuardrailsConfigurationResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1GetGuardrailsConfigurationResponse.to_json())
+
+# convert the object into a dict
+v1_get_guardrails_configuration_response_dict = v1_get_guardrails_configuration_response_instance.to_dict()
+# create an instance of V1GetGuardrailsConfigurationResponse from a dict
+v1_get_guardrails_configuration_response_from_dict = V1GetGuardrailsConfigurationResponse.from_dict(v1_get_guardrails_configuration_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1LeaderboardReportModel.md

@@ -13,9 +13,7 @@ Name | Type | Description | Notes
 **collection_name** | **str** | Optional. Collection name. | [optional] 
 **llm_model_name** | **str** | Output only. LLM model name. | [optional] [readonly] 
 **documents** | **List[str]** | Output only. List of documents. | [optional] [readonly] 
-**model_cfg** | **object** | Output only. Model configuration. | [optional] [readonly] 
 **key** | **str** | Output only. Model key. | [optional] [readonly] 
-**llm_model_meta** | **object** | Output only. LLM model metadata - recursive dictionaries with an additional info like performance stats. | [optional] [readonly] 
 
 ## Example
 

eval_studio_client/api/docs/V1ListWorkflowDependenciesResponse.md

@@ -0,0 +1,30 @@
+# V1ListWorkflowDependenciesResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**nodes** | [**List[V1WorkflowNode]**](V1WorkflowNode.md) | The list of the WorkflowNodes related to requested workflow. | [optional] 
+**dependencies** | [**List[V1DependencyList]**](V1DependencyList.md) | The dependency map for the workflow. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_list_workflow_dependencies_response import V1ListWorkflowDependenciesResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1ListWorkflowDependenciesResponse from a JSON string
+v1_list_workflow_dependencies_response_instance = V1ListWorkflowDependenciesResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1ListWorkflowDependenciesResponse.to_json())
+
+# convert the object into a dict
+v1_list_workflow_dependencies_response_dict = v1_list_workflow_dependencies_response_instance.to_dict()
+# create an instance of V1ListWorkflowDependenciesResponse from a dict
+v1_list_workflow_dependencies_response_from_dict = V1ListWorkflowDependenciesResponse.from_dict(v1_list_workflow_dependencies_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1RepeatedContext.md

@@ -0,0 +1,29 @@
+# V1RepeatedContext
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**content** | [**List[V1Context]**](V1Context.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_repeated_context import V1RepeatedContext
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1RepeatedContext from a JSON string
+v1_repeated_context_instance = V1RepeatedContext.from_json(json)
+# print the JSON string representation of the object
+print(V1RepeatedContext.to_json())
+
+# convert the object into a dict
+v1_repeated_context_dict = v1_repeated_context_instance.to_dict()
+# create an instance of V1RepeatedContext from a dict
+v1_repeated_context_from_dict = V1RepeatedContext.from_dict(v1_repeated_context_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1Test.md

@@ -17,6 +17,7 @@ Name | Type | Description | Notes
 **documents** | **List[str]** | Immutable. Resource names of Documents assigned to the Test. | [optional] 
 **tags** | **List[str]** | Tags assigned to the Test. | [optional] 
 **demo** | **bool** | Output only. Whether the Test is a demo resource or not. Demo resources are read only. | [optional] [readonly] 
+**type** | [**V1TestType**](V1TestType.md) |  | [optional] 
 
 ## Example
 

eval_studio_client/api/docs/V1TestType.md

@@ -0,0 +1,12 @@
+# V1TestType
+
+ - TEST_TYPE_UNSPECIFIED: Unspecified type.  - TEST_TYPE_STANDALONE: Standalone test.  - TEST_TYPE_WORKFLOW: Test is part of a dashboard.
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1WorkflowDependency.md

@@ -0,0 +1,30 @@
+# V1WorkflowDependency
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**name** | **str** | Required. The name of the Workflow Dependency node. | [optional] 
+**optional** | **bool** | Optional. Whether the dependency is optional. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_workflow_dependency import V1WorkflowDependency
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1WorkflowDependency from a JSON string
+v1_workflow_dependency_instance = V1WorkflowDependency.from_json(json)
+# print the JSON string representation of the object
+print(V1WorkflowDependency.to_json())
+
+# convert the object into a dict
+v1_workflow_dependency_dict = v1_workflow_dependency_instance.to_dict()
+# create an instance of V1WorkflowDependency from a dict
+v1_workflow_dependency_from_dict = V1WorkflowDependency.from_dict(v1_workflow_dependency_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1WorkflowEdgeType.md

@@ -1,6 +1,6 @@
 # V1WorkflowEdgeType
 
-WorkflowEdgeType represents the type of a WorkflowEdge.   - WORKFLOW_EDGE_TYPE_UNSPECIFIED: Unspecified type.  - WORKFLOW_EDGE_TYPE_SIMPLE: Simple edge without any conditions.
+WorkflowEdgeType represents the type of a WorkflowEdge.   - WORKFLOW_EDGE_TYPE_UNSPECIFIED: Unspecified type.  - WORKFLOW_EDGE_TYPE_DEPENDENCY: A required dependency type of edge. This edge type defines that the \"to\" node depends on the outputs of the \"from\" node.  - WORKFLOW_EDGE_TYPE_OPTIONAL_DEPENDENCY: Optional dependency edge, which indicates that the outputs of the \"from\" node can be used in case they exist, but the \"to\" node does not rely on them.
 
 ## Properties
 

eval_studio_client/api/docs/V1WorkflowNodeArtifact.md

@@ -17,6 +17,7 @@ Name | Type | Description | Notes
 **delete_time** | **datetime** | Output only. Optional. Deletion time of the WorkflowNodeArtifact. | [optional] [readonly] 
 **deleter** | **str** | Output only. Name of the user or service that requested deletion of the WorkflowNodeArtifact. | [optional] [readonly] 
 **mime_type** | **str** | Optional MIME type of the WorkflowNodeArtifact. | [optional] 
+**type** | **str** | Output only. Immutable. Type of the WorkflowNodeArtifact. | [optional] [readonly] 
 
 ## Example
 

eval_studio_client/api/docs/WorkflowServiceApi.md

@@ -8,7 +8,9 @@ Method | HTTP request | Description
 [**workflow_service_clone_workflow**](WorkflowServiceApi.md#workflow_service_clone_workflow) | **POST** /v1/{name_1}:clone | CloneWorkflow clones an existing Workflow.
 [**workflow_service_create_workflow**](WorkflowServiceApi.md#workflow_service_create_workflow) | **POST** /v1/workflows | CreateWorkflow creates a Workflow.
 [**workflow_service_delete_workflow**](WorkflowServiceApi.md#workflow_service_delete_workflow) | **DELETE** /v1/{name_9} | DeleteWorkflow deletes a Workflow by name. If the Workflow does not exist an error is returned.
+[**workflow_service_get_guardrails_configuration**](WorkflowServiceApi.md#workflow_service_get_guardrails_configuration) | **GET** /v1/{name}:getGuardrailsConfiguration | 
 [**workflow_service_get_workflow**](WorkflowServiceApi.md#workflow_service_get_workflow) | **GET** /v1/{name_12} | GetWorkflow retrieves a Workflow by name. Deleted Workflow is returned without error, it has a delete_time and deleter fields set.
+[**workflow_service_list_workflow_dependencies**](WorkflowServiceApi.md#workflow_service_list_workflow_dependencies) | **GET** /v1/{name}:nodeDependencies | ListWorkflowDependencies lists workflow nodes and map of the node dependencies.
 [**workflow_service_list_workflows**](WorkflowServiceApi.md#workflow_service_list_workflows) | **GET** /v1/workflows | ListWorkflows lists Workflows.
 [**workflow_service_update_workflow**](WorkflowServiceApi.md#workflow_service_update_workflow) | **PATCH** /v1/{workflow.name} | UpdateWorkflow updates a Workflow. The update_mask is used to specify the fields to be updated.
 
@@ -286,6 +288,72 @@ No authorization required
 
 [[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
 
+# **workflow_service_get_guardrails_configuration**
+> V1GetGuardrailsConfigurationResponse workflow_service_get_guardrails_configuration(name)
+
+
+
+### Example
+
+
+```python
+import eval_studio_client.api
+from eval_studio_client.api.models.v1_get_guardrails_configuration_response import V1GetGuardrailsConfigurationResponse
+from eval_studio_client.api.rest import ApiException
+from pprint import pprint
+
+# Defining the host is optional and defaults to http://localhost
+# See configuration.py for a list of all supported configuration parameters.
+configuration = eval_studio_client.api.Configuration(
+    host = "http://localhost"
+)
+
+
+# Enter a context with an instance of the API client
+with eval_studio_client.api.ApiClient(configuration) as api_client:
+    # Create an instance of the API class
+    api_instance = eval_studio_client.api.WorkflowServiceApi(api_client)
+    name = 'name_example' # str | Required. The name of the Workflow to retrieve guardrails configuration for. The Human Calibration node must be completed, otherwise an error is returned.
+
+    try:
+        api_response = api_instance.workflow_service_get_guardrails_configuration(name)
+        print("The response of WorkflowServiceApi->workflow_service_get_guardrails_configuration:\n")
+        pprint(api_response)
+    except Exception as e:
+        print("Exception when calling WorkflowServiceApi->workflow_service_get_guardrails_configuration: %s\n" % e)
+```
+
+
+
+### Parameters
+
+
+Name | Type | Description  | Notes
+------------- | ------------- | ------------- | -------------
+ **name** | **str**| Required. The name of the Workflow to retrieve guardrails configuration for. The Human Calibration node must be completed, otherwise an error is returned. | 
+
+### Return type
+
+[**V1GetGuardrailsConfigurationResponse**](V1GetGuardrailsConfigurationResponse.md)
+
+### Authorization
+
+No authorization required
+
+### HTTP request headers
+
+ - **Content-Type**: Not defined
+ - **Accept**: application/json
+
+### HTTP response details
+
+| Status code | Description | Response headers |
+|-------------|-------------|------------------|
+**200** | A successful response. |  -  |
+**0** | An unexpected error response. |  -  |
+
+[[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
+
 # **workflow_service_get_workflow**
 > V1GetWorkflowResponse workflow_service_get_workflow(name_12)
 
@@ -353,6 +421,73 @@ No authorization required
 
 [[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
 
+# **workflow_service_list_workflow_dependencies**
+> V1ListWorkflowDependenciesResponse workflow_service_list_workflow_dependencies(name)
+
+ListWorkflowDependencies lists workflow nodes and map of the node dependencies.
+
+### Example
+
+
+```python
+import eval_studio_client.api
+from eval_studio_client.api.models.v1_list_workflow_dependencies_response import V1ListWorkflowDependenciesResponse
+from eval_studio_client.api.rest import ApiException
+from pprint import pprint
+
+# Defining the host is optional and defaults to http://localhost
+# See configuration.py for a list of all supported configuration parameters.
+configuration = eval_studio_client.api.Configuration(
+    host = "http://localhost"
+)
+
+
+# Enter a context with an instance of the API client
+with eval_studio_client.api.ApiClient(configuration) as api_client:
+    # Create an instance of the API class
+    api_instance = eval_studio_client.api.WorkflowServiceApi(api_client)
+    name = 'name_example' # str | Required. The name of the Workflow to retrieve dependencies for.
+
+    try:
+        # ListWorkflowDependencies lists workflow nodes and map of the node dependencies.
+        api_response = api_instance.workflow_service_list_workflow_dependencies(name)
+        print("The response of WorkflowServiceApi->workflow_service_list_workflow_dependencies:\n")
+        pprint(api_response)
+    except Exception as e:
+        print("Exception when calling WorkflowServiceApi->workflow_service_list_workflow_dependencies: %s\n" % e)
+```
+
+
+
+### Parameters
+
+
+Name | Type | Description  | Notes
+------------- | ------------- | ------------- | -------------
+ **name** | **str**| Required. The name of the Workflow to retrieve dependencies for. | 
+
+### Return type
+
+[**V1ListWorkflowDependenciesResponse**](V1ListWorkflowDependenciesResponse.md)
+
+### Authorization
+
+No authorization required
+
+### HTTP request headers
+
+ - **Content-Type**: Not defined
+ - **Accept**: application/json
+
+### HTTP response details
+
+| Status code | Description | Response headers |
+|-------------|-------------|------------------|
+**200** | A successful response. |  -  |
+**0** | An unexpected error response. |  -  |
+
+[[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
+
 # **workflow_service_list_workflows**
 > V1ListWorkflowsResponse workflow_service_list_workflows()
 

eval_studio_client/api/models/__init__.py

@@ -15,7 +15,6 @@
 
 # import models into model package
 from eval_studio_client.api.models.adversarial_inputs_service_test_adversarial_inputs_robustness_request import AdversarialInputsServiceTestAdversarialInputsRobustnessRequest
-from eval_studio_client.api.models.generated_questions_validation_service_validate_generated_questions_request import GeneratedQuestionsValidationServiceValidateGeneratedQuestionsRequest
 from eval_studio_client.api.models.perturbation_service_create_perturbation_request import PerturbationServiceCreatePerturbationRequest
 from eval_studio_client.api.models.prompt_generation_service_auto_generate_prompts_request import PromptGenerationServiceAutoGeneratePromptsRequest
 from eval_studio_client.api.models.protobuf_any import ProtobufAny
@@ -90,6 +89,7 @@ from eval_studio_client.api.models.v1_create_workflow_node_response import V1Cre
 from eval_studio_client.api.models.v1_create_workflow_response import V1CreateWorkflowResponse
 from eval_studio_client.api.models.v1_dashboard import V1Dashboard
 from eval_studio_client.api.models.v1_dashboard_status import V1DashboardStatus
+from eval_studio_client.api.models.v1_dashboard_type import V1DashboardType
 from eval_studio_client.api.models.v1_delete_dashboard_response import V1DeleteDashboardResponse
 from eval_studio_client.api.models.v1_delete_document_response import V1DeleteDocumentResponse
 from eval_studio_client.api.models.v1_delete_evaluator_response import V1DeleteEvaluatorResponse
@@ -100,6 +100,7 @@ from eval_studio_client.api.models.v1_delete_test_response import V1DeleteTestRe
 from eval_studio_client.api.models.v1_delete_workflow_edge_response import V1DeleteWorkflowEdgeResponse
 from eval_studio_client.api.models.v1_delete_workflow_node_response import V1DeleteWorkflowNodeResponse
 from eval_studio_client.api.models.v1_delete_workflow_response import V1DeleteWorkflowResponse
+from eval_studio_client.api.models.v1_dependency_list import V1DependencyList
 from eval_studio_client.api.models.v1_document import V1Document
 from eval_studio_client.api.models.v1_estimate_threshold_request import V1EstimateThresholdRequest
 from eval_studio_client.api.models.v1_evaluation_test import V1EvaluationTest
@@ -111,10 +112,10 @@ from eval_studio_client.api.models.v1_finalize_operation_response import V1Final
 from eval_studio_client.api.models.v1_find_all_test_cases_by_id_response import V1FindAllTestCasesByIDResponse
 from eval_studio_client.api.models.v1_find_test_lab_response import V1FindTestLabResponse
 from eval_studio_client.api.models.v1_generate_test_cases_response import V1GenerateTestCasesResponse
-from eval_studio_client.api.models.v1_generated_test_case import V1GeneratedTestCase
 from eval_studio_client.api.models.v1_get_dashboard_response import V1GetDashboardResponse
 from eval_studio_client.api.models.v1_get_document_response import V1GetDocumentResponse
 from eval_studio_client.api.models.v1_get_evaluator_response import V1GetEvaluatorResponse
+from eval_studio_client.api.models.v1_get_guardrails_configuration_response import V1GetGuardrailsConfigurationResponse
 from eval_studio_client.api.models.v1_get_info_response import V1GetInfoResponse
 from eval_studio_client.api.models.v1_get_leaderboard_report_response import V1GetLeaderboardReportResponse
 from eval_studio_client.api.models.v1_get_leaderboard_response import V1GetLeaderboardResponse
@@ -172,6 +173,7 @@ from eval_studio_client.api.models.v1_list_test_case_relationships_response impo
 from eval_studio_client.api.models.v1_list_test_cases_response import V1ListTestCasesResponse
 from eval_studio_client.api.models.v1_list_test_classes_response import V1ListTestClassesResponse
 from eval_studio_client.api.models.v1_list_tests_response import V1ListTestsResponse
+from eval_studio_client.api.models.v1_list_workflow_dependencies_response import V1ListWorkflowDependenciesResponse
 from eval_studio_client.api.models.v1_list_workflows_response import V1ListWorkflowsResponse
 from eval_studio_client.api.models.v1_metric_score import V1MetricScore
 from eval_studio_client.api.models.v1_metric_scores import V1MetricScores
@@ -187,6 +189,7 @@ from eval_studio_client.api.models.v1_perturbator_intensity import V1Perturbator
 from eval_studio_client.api.models.v1_problem_and_action import V1ProblemAndAction
 from eval_studio_client.api.models.v1_process_workflow_node_response import V1ProcessWorkflowNodeResponse
 from eval_studio_client.api.models.v1_prompt_library_item import V1PromptLibraryItem
+from eval_studio_client.api.models.v1_repeated_context import V1RepeatedContext
 from eval_studio_client.api.models.v1_repeated_string import V1RepeatedString
 from eval_studio_client.api.models.v1_reset_workflow_node_response import V1ResetWorkflowNodeResponse
 from eval_studio_client.api.models.v1_test import V1Test
@@ -197,6 +200,7 @@ from eval_studio_client.api.models.v1_test_class import V1TestClass
 from eval_studio_client.api.models.v1_test_class_type import V1TestClassType
 from eval_studio_client.api.models.v1_test_lab import V1TestLab
 from eval_studio_client.api.models.v1_test_suite_evaluates import V1TestSuiteEvaluates
+from eval_studio_client.api.models.v1_test_type import V1TestType
 from eval_studio_client.api.models.v1_update_dashboard_response import V1UpdateDashboardResponse
 from eval_studio_client.api.models.v1_update_document_response import V1UpdateDocumentResponse
 from eval_studio_client.api.models.v1_update_leaderboard_response import V1UpdateLeaderboardResponse
@@ -208,6 +212,7 @@ from eval_studio_client.api.models.v1_update_workflow_node_response import V1Upd
 from eval_studio_client.api.models.v1_update_workflow_response import V1UpdateWorkflowResponse
 from eval_studio_client.api.models.v1_who_am_i_response import V1WhoAmIResponse
 from eval_studio_client.api.models.v1_workflow import V1Workflow
+from eval_studio_client.api.models.v1_workflow_dependency import V1WorkflowDependency
 from eval_studio_client.api.models.v1_workflow_edge import V1WorkflowEdge
 from eval_studio_client.api.models.v1_workflow_edge_type import V1WorkflowEdgeType
 from eval_studio_client.api.models.v1_workflow_node import V1WorkflowNode

eval_studio_client/api/models/prompt_generation_service_auto_generate_prompts_request.py

@@ -20,6 +20,7 @@ import json
 from pydantic import BaseModel, ConfigDict, Field, StrictInt, StrictStr
 from typing import Any, ClassVar, Dict, List, Optional
 from eval_studio_client.api.models.v1_model import V1Model
+from eval_studio_client.api.models.v1_repeated_context import V1RepeatedContext
 from eval_studio_client.api.models.v1_repeated_string import V1RepeatedString
 from eval_studio_client.api.models.v1_test_cases_generator import V1TestCasesGenerator
 from typing import Optional, Set
@@ -34,7 +35,7 @@ class PromptGenerationServiceAutoGeneratePromptsRequest(BaseModel):
     count: Optional[StrictInt] = Field(default=None, description="Required. The number of TestCases to generate.")
     base_llm_model: Optional[StrictStr] = Field(default=None, description="Required. Base LLM model to use for generating the prompts.", alias="baseLlmModel")
     document_urls: Optional[V1RepeatedString] = Field(default=None, alias="documentUrls")
-    chunks: Optional[V1RepeatedString] = None
+    chunks: Optional[V1RepeatedContext] = None
     generators: Optional[List[V1TestCasesGenerator]] = Field(default=None, description="Optional. Type of questions to generate TestCases for. If not specified, all types of questions are selected.")
     h2ogpte_collection_id: Optional[StrictStr] = Field(default=None, description="Optional. The ID of the h2oGPTe collection to use. If empty, new temporary collection will be created.", alias="h2ogpteCollectionId")
     topics: Optional[List[StrictStr]] = Field(default=None, description="Optional. Topics to generate questions for. If not specified, use document summarization as topic generation.")
@@ -105,7 +106,7 @@ class PromptGenerationServiceAutoGeneratePromptsRequest(BaseModel):
             "count": obj.get("count"),
             "baseLlmModel": obj.get("baseLlmModel"),
             "documentUrls": V1RepeatedString.from_dict(obj["documentUrls"]) if obj.get("documentUrls") is not None else None,
-            "chunks": V1RepeatedString.from_dict(obj["chunks"]) if obj.get("chunks") is not None else None,
+            "chunks": V1RepeatedContext.from_dict(obj["chunks"]) if obj.get("chunks") is not None else None,
             "generators": obj.get("generators"),
             "h2ogpteCollectionId": obj.get("h2ogpteCollectionId"),
             "topics": obj.get("topics")

eval_studio_client/api/models/required_the_dashboard_to_update.py

@@ -21,6 +21,7 @@ from datetime import datetime
 from pydantic import BaseModel, ConfigDict, Field, StrictBool, StrictStr
 from typing import Any, ClassVar, Dict, List, Optional
 from eval_studio_client.api.models.v1_dashboard_status import V1DashboardStatus
+from eval_studio_client.api.models.v1_dashboard_type import V1DashboardType
 from typing import Optional, Set
 from typing_extensions import Self
 
@@ -40,7 +41,8 @@ class RequiredTheDashboardToUpdate(BaseModel):
     leaderboards: Optional[List[StrictStr]] = Field(default=None, description="Immutable. Resource names of the Leaderboards used in this Dashboard.")
     create_operation: Optional[StrictStr] = Field(default=None, description="Output only. Operation resource name that created this Dashboard.", alias="createOperation")
     demo: Optional[StrictBool] = Field(default=None, description="Output only. Whether the Dashboard is a demo resource or not. Demo resources are read only.")
-    __properties: ClassVar[List[str]] = ["createTime", "creator", "updateTime", "updater", "deleteTime", "deleter", "displayName", "description", "status", "leaderboards", "createOperation", "demo"]
+    type: Optional[V1DashboardType] = None
+    __properties: ClassVar[List[str]] = ["createTime", "creator", "updateTime", "updater", "deleteTime", "deleter", "displayName", "description", "status", "leaderboards", "createOperation", "demo", "type"]
 
     model_config = ConfigDict(
         populate_by_name=True,
@@ -120,7 +122,8 @@ class RequiredTheDashboardToUpdate(BaseModel):
             "status": obj.get("status"),
             "leaderboards": obj.get("leaderboards"),
             "createOperation": obj.get("createOperation"),
-            "demo": obj.get("demo")
+            "demo": obj.get("demo"),
+            "type": obj.get("type")
         })
         return _obj
 

eval_studio_client/api/models/required_the_test_to_update.py

@@ -20,6 +20,7 @@ import json
 from datetime import datetime
 from pydantic import BaseModel, ConfigDict, Field, StrictBool, StrictStr
 from typing import Any, ClassVar, Dict, List, Optional
+from eval_studio_client.api.models.v1_test_type import V1TestType
 from typing import Optional, Set
 from typing_extensions import Self
 
@@ -38,7 +39,8 @@ class RequiredTheTestToUpdate(BaseModel):
     documents: Optional[List[StrictStr]] = Field(default=None, description="Immutable. Resource names of Documents assigned to the Test.")
     tags: Optional[List[StrictStr]] = Field(default=None, description="Tags assigned to the Test.")
     demo: Optional[StrictBool] = Field(default=None, description="Output only. Whether the Test is a demo resource or not. Demo resources are read only.")
-    __properties: ClassVar[List[str]] = ["createTime", "creator", "updateTime", "updater", "deleteTime", "deleter", "displayName", "description", "documents", "tags", "demo"]
+    type: Optional[V1TestType] = None
+    __properties: ClassVar[List[str]] = ["createTime", "creator", "updateTime", "updater", "deleteTime", "deleter", "displayName", "description", "documents", "tags", "demo", "type"]
 
     model_config = ConfigDict(
         populate_by_name=True,
@@ -115,7 +117,8 @@ class RequiredTheTestToUpdate(BaseModel):
             "description": obj.get("description"),
             "documents": obj.get("documents"),
             "tags": obj.get("tags"),
-            "demo": obj.get("demo")
+            "demo": obj.get("demo"),
+            "type": obj.get("type")
         })
         return _obj
 

eval_studio_client/api/models/test_service_generate_test_cases_request.py

@@ -19,6 +19,7 @@ import json
 
 from pydantic import BaseModel, ConfigDict, Field, StrictInt, StrictStr
 from typing import Any, ClassVar, Dict, List, Optional
+from eval_studio_client.api.models.v1_context import V1Context
 from eval_studio_client.api.models.v1_test_cases_generator import V1TestCasesGenerator
 from typing import Optional, Set
 from typing_extensions import Self
@@ -33,7 +34,7 @@ class TestServiceGenerateTestCasesRequest(BaseModel):
     generators: Optional[List[V1TestCasesGenerator]] = Field(default=None, description="Optional. Generators to use for generation. If not specified, all generators are selected.")
     h2ogpte_collection_id: Optional[StrictStr] = Field(default=None, description="Optional. ID of the h2oGPTe collection to use. If provided, documents referenced by Test and any specified chunks are ignored. This field is required if Test does not reference any documents and no chunks are provided. If this field is left empty, a temporary collection will be created.", alias="h2ogpteCollectionId")
     topics: Optional[List[StrictStr]] = Field(default=None, description="Optional. Topics to generate questions for. If not specified, use document summarization as topic generation.")
-    chunks: Optional[List[StrictStr]] = Field(default=None, description="Optional. The list of chunks to use for generation. If set, the Documents assigned to the Test and h2ogpte_collection_id are ignored.")
+    chunks: Optional[List[V1Context]] = Field(default=None, description="Optional. The list of chunks to use for generation. If set, the Documents assigned to the Test and h2ogpte_collection_id are ignored.")
     __properties: ClassVar[List[str]] = ["count", "model", "baseLlmModel", "generators", "h2ogpteCollectionId", "topics", "chunks"]
 
     model_config = ConfigDict(
@@ -75,6 +76,13 @@ class TestServiceGenerateTestCasesRequest(BaseModel):
             exclude=excluded_fields,
             exclude_none=True,
         )
+        # override the default output from pydantic by calling `to_dict()` of each item in chunks (list)
+        _items = []
+        if self.chunks:
+            for _item in self.chunks:
+                if _item:
+                    _items.append(_item.to_dict())
+            _dict['chunks'] = _items
         return _dict
 
     @classmethod
@@ -93,7 +101,7 @@ class TestServiceGenerateTestCasesRequest(BaseModel):
             "generators": obj.get("generators"),
             "h2ogpteCollectionId": obj.get("h2ogpteCollectionId"),
             "topics": obj.get("topics"),
-            "chunks": obj.get("chunks")
+            "chunks": [V1Context.from_dict(_item) for _item in obj["chunks"]] if obj.get("chunks") is not None else None
         })
         return _obj
 

eval_studio_client/api/models/v1_context.py

@@ -26,11 +26,16 @@ class V1Context(BaseModel):
     """
     V1Context
     """ # noqa: E501
-    collection_id: Optional[StrictStr] = Field(default=None, description="Collection Id.", alias="collectionId")
-    chunk_id: Optional[StrictInt] = Field(default=None, description="Chunk Id.", alias="chunkId")
-    score: Optional[Union[StrictFloat, StrictInt]] = Field(default=None, description="Chunk score.")
-    content: Optional[StrictStr] = Field(default=None, description="Content.")
-    __properties: ClassVar[List[str]] = ["collectionId", "chunkId", "score", "content"]
+    collection_id: Optional[StrictStr] = Field(default=None, description="Optional. Collection Id.", alias="collectionId")
+    chunk_id: Optional[StrictInt] = Field(default=None, description="Required. Chunk Id.", alias="chunkId")
+    score: Optional[Union[StrictFloat, StrictInt]] = Field(default=None, description="Optional. Chunk score.")
+    content: Optional[StrictStr] = Field(default=None, description="Required. Content.")
+    document_id: Optional[StrictStr] = Field(default=None, description="Optional. Document Id.", alias="documentId")
+    document_name: Optional[StrictStr] = Field(default=None, description="Optional. Document name.", alias="documentName")
+    pages: Optional[StrictStr] = Field(default=None, description="Optional. Pages.")
+    topic: Optional[StrictStr] = Field(default=None, description="Required. Topic.")
+    topic_id: Optional[StrictInt] = Field(default=None, description="Required. Topic Id.", alias="topicId")
+    __properties: ClassVar[List[str]] = ["collectionId", "chunkId", "score", "content", "documentId", "documentName", "pages", "topic", "topicId"]
 
     model_config = ConfigDict(
         populate_by_name=True,
@@ -86,7 +91,12 @@ class V1Context(BaseModel):
             "collectionId": obj.get("collectionId"),
             "chunkId": obj.get("chunkId"),
             "score": obj.get("score"),
-            "content": obj.get("content")
+            "content": obj.get("content"),
+            "documentId": obj.get("documentId"),
+            "documentName": obj.get("documentName"),
+            "pages": obj.get("pages"),
+            "topic": obj.get("topic"),
+            "topicId": obj.get("topicId")
         })
         return _obj