eval-studio-client 1.0.0a1__py3-none-any.whl → 1.1.0a5__py3-none-any.whl

eval_studio_client/api/docs/V1CloneTestResponse.md

@@ -0,0 +1,29 @@
+# V1CloneTestResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**test** | [**V1Test**](V1Test.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_clone_test_response import V1CloneTestResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1CloneTestResponse from a JSON string
+v1_clone_test_response_instance = V1CloneTestResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1CloneTestResponse.to_json())
+
+# convert the object into a dict
+v1_clone_test_response_dict = v1_clone_test_response_instance.to_dict()
+# create an instance of V1CloneTestResponse from a dict
+v1_clone_test_response_from_dict = V1CloneTestResponse.from_dict(v1_clone_test_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1CloneWorkflowResponse.md

@@ -0,0 +1,29 @@
+# V1CloneWorkflowResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**workflow** | [**V1Workflow**](V1Workflow.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_clone_workflow_response import V1CloneWorkflowResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1CloneWorkflowResponse from a JSON string
+v1_clone_workflow_response_instance = V1CloneWorkflowResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1CloneWorkflowResponse.to_json())
+
+# convert the object into a dict
+v1_clone_workflow_response_dict = v1_clone_workflow_response_instance.to_dict()
+# create an instance of V1CloneWorkflowResponse from a dict
+v1_clone_workflow_response_from_dict = V1CloneWorkflowResponse.from_dict(v1_clone_workflow_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1Context.md

@@ -0,0 +1,32 @@
+# V1Context
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**collection_id** | **str** | Collection Id. | [optional] 
+**chunk_id** | **int** | Chunk Id. | [optional] 
+**score** | **float** | Chunk score. | [optional] 
+**content** | **str** | Content. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_context import V1Context
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1Context from a JSON string
+v1_context_instance = V1Context.from_json(json)
+# print the JSON string representation of the object
+print(V1Context.to_json())
+
+# convert the object into a dict
+v1_context_dict = v1_context_instance.to_dict()
+# create an instance of V1Context from a dict
+v1_context_from_dict = V1Context.from_dict(v1_context_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1CreateEvaluationRequest.md

@@ -14,6 +14,7 @@ Name | Type | Description | Notes
 **evaluators_parameters** | **Dict[str, str]** | Optional. Additional evaluators configuration, for all the evaluators used in the evaluation. Key is the evaluator identifier, and the value is a JSON string containing the configuration dictionary. | [optional] 
 **model_parameters** | **str** | Optional. Parameters overrides in JSON format. | [optional] 
 **h2ogpte_collection** | **str** | The existing collection name in H2OGPTe. | [optional] 
+**default_h2ogpte_model** | [**V1Model**](V1Model.md) |  | [optional] 
 
 ## Example
 

eval_studio_client/api/docs/V1CreateWorkflowEdgeResponse.md

@@ -0,0 +1,29 @@
+# V1CreateWorkflowEdgeResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**edge** | [**V1WorkflowEdge**](V1WorkflowEdge.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_create_workflow_edge_response import V1CreateWorkflowEdgeResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1CreateWorkflowEdgeResponse from a JSON string
+v1_create_workflow_edge_response_instance = V1CreateWorkflowEdgeResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1CreateWorkflowEdgeResponse.to_json())
+
+# convert the object into a dict
+v1_create_workflow_edge_response_dict = v1_create_workflow_edge_response_instance.to_dict()
+# create an instance of V1CreateWorkflowEdgeResponse from a dict
+v1_create_workflow_edge_response_from_dict = V1CreateWorkflowEdgeResponse.from_dict(v1_create_workflow_edge_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1CreateWorkflowNodeResponse.md

@@ -0,0 +1,29 @@
+# V1CreateWorkflowNodeResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**node** | [**V1WorkflowNode**](V1WorkflowNode.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_create_workflow_node_response import V1CreateWorkflowNodeResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1CreateWorkflowNodeResponse from a JSON string
+v1_create_workflow_node_response_instance = V1CreateWorkflowNodeResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1CreateWorkflowNodeResponse.to_json())
+
+# convert the object into a dict
+v1_create_workflow_node_response_dict = v1_create_workflow_node_response_instance.to_dict()
+# create an instance of V1CreateWorkflowNodeResponse from a dict
+v1_create_workflow_node_response_from_dict = V1CreateWorkflowNodeResponse.from_dict(v1_create_workflow_node_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1CreateWorkflowResponse.md

@@ -0,0 +1,29 @@
+# V1CreateWorkflowResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**workflow** | [**V1Workflow**](V1Workflow.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_create_workflow_response import V1CreateWorkflowResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1CreateWorkflowResponse from a JSON string
+v1_create_workflow_response_instance = V1CreateWorkflowResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1CreateWorkflowResponse.to_json())
+
+# convert the object into a dict
+v1_create_workflow_response_dict = v1_create_workflow_response_instance.to_dict()
+# create an instance of V1CreateWorkflowResponse from a dict
+v1_create_workflow_response_from_dict = V1CreateWorkflowResponse.from_dict(v1_create_workflow_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1DeleteWorkflowEdgeResponse.md

@@ -0,0 +1,29 @@
+# V1DeleteWorkflowEdgeResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**edge** | [**V1WorkflowEdge**](V1WorkflowEdge.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_delete_workflow_edge_response import V1DeleteWorkflowEdgeResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1DeleteWorkflowEdgeResponse from a JSON string
+v1_delete_workflow_edge_response_instance = V1DeleteWorkflowEdgeResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1DeleteWorkflowEdgeResponse.to_json())
+
+# convert the object into a dict
+v1_delete_workflow_edge_response_dict = v1_delete_workflow_edge_response_instance.to_dict()
+# create an instance of V1DeleteWorkflowEdgeResponse from a dict
+v1_delete_workflow_edge_response_from_dict = V1DeleteWorkflowEdgeResponse.from_dict(v1_delete_workflow_edge_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1DeleteWorkflowNodeResponse.md

@@ -0,0 +1,29 @@
+# V1DeleteWorkflowNodeResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**node** | [**V1WorkflowNode**](V1WorkflowNode.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_delete_workflow_node_response import V1DeleteWorkflowNodeResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1DeleteWorkflowNodeResponse from a JSON string
+v1_delete_workflow_node_response_instance = V1DeleteWorkflowNodeResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1DeleteWorkflowNodeResponse.to_json())
+
+# convert the object into a dict
+v1_delete_workflow_node_response_dict = v1_delete_workflow_node_response_instance.to_dict()
+# create an instance of V1DeleteWorkflowNodeResponse from a dict
+v1_delete_workflow_node_response_from_dict = V1DeleteWorkflowNodeResponse.from_dict(v1_delete_workflow_node_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1DeleteWorkflowResponse.md

@@ -0,0 +1,29 @@
+# V1DeleteWorkflowResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**workflow** | [**V1Workflow**](V1Workflow.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_delete_workflow_response import V1DeleteWorkflowResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1DeleteWorkflowResponse from a JSON string
+v1_delete_workflow_response_instance = V1DeleteWorkflowResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1DeleteWorkflowResponse.to_json())
+
+# convert the object into a dict
+v1_delete_workflow_response_dict = v1_delete_workflow_response_instance.to_dict()
+# create an instance of V1DeleteWorkflowResponse from a dict
+v1_delete_workflow_response_from_dict = V1DeleteWorkflowResponse.from_dict(v1_delete_workflow_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1EstimateThresholdRequest.md

@@ -0,0 +1,33 @@
+# V1EstimateThresholdRequest
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**operation** | **str** | Required. The Operation processing the estimation. | [optional] 
+**original_threshold** | **float** | Required. Original threshold. | [optional] 
+**evaluator** | **str** | Required. The evaluator resource name. | [optional] 
+**metric** | **str** | Optional. The metric name. If no metric is provided, the evaluator's primary metric is used. | [optional] 
+**train_set** | [**List[V1LabeledTestCase]**](V1LabeledTestCase.md) | Required. Test cases with metric value and labels used for estimating the threshold. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_estimate_threshold_request import V1EstimateThresholdRequest
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1EstimateThresholdRequest from a JSON string
+v1_estimate_threshold_request_instance = V1EstimateThresholdRequest.from_json(json)
+# print the JSON string representation of the object
+print(V1EstimateThresholdRequest.to_json())
+
+# convert the object into a dict
+v1_estimate_threshold_request_dict = v1_estimate_threshold_request_instance.to_dict()
+# create an instance of V1EstimateThresholdRequest from a dict
+v1_estimate_threshold_request_from_dict = V1EstimateThresholdRequest.from_dict(v1_estimate_threshold_request_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1GeneratedTestCase.md

@@ -0,0 +1,30 @@
+# V1GeneratedTestCase
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**test_case** | [**V1TestCase**](V1TestCase.md) |  | [optional] 
+**context** | [**List[V1Context]**](V1Context.md) | Context used for test_case generation. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_generated_test_case import V1GeneratedTestCase
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1GeneratedTestCase from a JSON string
+v1_generated_test_case_instance = V1GeneratedTestCase.from_json(json)
+# print the JSON string representation of the object
+print(V1GeneratedTestCase.to_json())
+
+# convert the object into a dict
+v1_generated_test_case_dict = v1_generated_test_case_instance.to_dict()
+# create an instance of V1GeneratedTestCase from a dict
+v1_generated_test_case_from_dict = V1GeneratedTestCase.from_dict(v1_generated_test_case_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1GetLeaderboardReportResponse.md

@@ -0,0 +1,29 @@
+# V1GetLeaderboardReportResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**leaderboard_report** | [**V1LeaderboardReport**](V1LeaderboardReport.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_get_leaderboard_report_response import V1GetLeaderboardReportResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1GetLeaderboardReportResponse from a JSON string
+v1_get_leaderboard_report_response_instance = V1GetLeaderboardReportResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1GetLeaderboardReportResponse.to_json())
+
+# convert the object into a dict
+v1_get_leaderboard_report_response_dict = v1_get_leaderboard_report_response_instance.to_dict()
+# create an instance of V1GetLeaderboardReportResponse from a dict
+v1_get_leaderboard_report_response_from_dict = V1GetLeaderboardReportResponse.from_dict(v1_get_leaderboard_report_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1GetWorkflowNodePrerequisitesResponse.md

@@ -0,0 +1,30 @@
+# V1GetWorkflowNodePrerequisitesResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**nodes** | **List[str]** | The WorkflowNodes that are the prerequisites of the specified WorkflowNode. | [optional] 
+**edges** | **List[str]** | The WorkflowEdges that are the prerequisites of the specified WorkflowNode. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_get_workflow_node_prerequisites_response import V1GetWorkflowNodePrerequisitesResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1GetWorkflowNodePrerequisitesResponse from a JSON string
+v1_get_workflow_node_prerequisites_response_instance = V1GetWorkflowNodePrerequisitesResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1GetWorkflowNodePrerequisitesResponse.to_json())
+
+# convert the object into a dict
+v1_get_workflow_node_prerequisites_response_dict = v1_get_workflow_node_prerequisites_response_instance.to_dict()
+# create an instance of V1GetWorkflowNodePrerequisitesResponse from a dict
+v1_get_workflow_node_prerequisites_response_from_dict = V1GetWorkflowNodePrerequisitesResponse.from_dict(v1_get_workflow_node_prerequisites_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1GetWorkflowNodeResponse.md

@@ -0,0 +1,29 @@
+# V1GetWorkflowNodeResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**node** | [**V1WorkflowNode**](V1WorkflowNode.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_get_workflow_node_response import V1GetWorkflowNodeResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1GetWorkflowNodeResponse from a JSON string
+v1_get_workflow_node_response_instance = V1GetWorkflowNodeResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1GetWorkflowNodeResponse.to_json())
+
+# convert the object into a dict
+v1_get_workflow_node_response_dict = v1_get_workflow_node_response_instance.to_dict()
+# create an instance of V1GetWorkflowNodeResponse from a dict
+v1_get_workflow_node_response_from_dict = V1GetWorkflowNodeResponse.from_dict(v1_get_workflow_node_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1GetWorkflowResponse.md

@@ -0,0 +1,29 @@
+# V1GetWorkflowResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**workflow** | [**V1Workflow**](V1Workflow.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_get_workflow_response import V1GetWorkflowResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1GetWorkflowResponse from a JSON string
+v1_get_workflow_response_instance = V1GetWorkflowResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1GetWorkflowResponse.to_json())
+
+# convert the object into a dict
+v1_get_workflow_response_dict = v1_get_workflow_response_instance.to_dict()
+# create an instance of V1GetWorkflowResponse from a dict
+v1_get_workflow_response_from_dict = V1GetWorkflowResponse.from_dict(v1_get_workflow_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1ImportEvaluationRequest.md

@@ -10,6 +10,7 @@ Name | Type | Description | Notes
 **test_lab** | **str** | Required. The JSON representation of the pre-built test-lab. | [optional] 
 **operation** | **str** | Required. Resource name of the long-running operation. | [optional] 
 **evaluators_parameters** | **Dict[str, str]** | Optional. Additional evaluators configuration, for all the evaluators used in the evaluation. Key is the evaluator identifier, and the value is a JSON string containing the configuration dictionary. | [optional] 
+**default_h2ogpte_model** | [**V1Model**](V1Model.md) |  | [optional] 
 
 ## Example
 

eval_studio_client/api/docs/V1ImportTestCasesFromLibraryResponse.md

@@ -0,0 +1,29 @@
+# V1ImportTestCasesFromLibraryResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**operation** | [**V1Operation**](V1Operation.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_import_test_cases_from_library_response import V1ImportTestCasesFromLibraryResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1ImportTestCasesFromLibraryResponse from a JSON string
+v1_import_test_cases_from_library_response_instance = V1ImportTestCasesFromLibraryResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1ImportTestCasesFromLibraryResponse.to_json())
+
+# convert the object into a dict
+v1_import_test_cases_from_library_response_dict = v1_import_test_cases_from_library_response_instance.to_dict()
+# create an instance of V1ImportTestCasesFromLibraryResponse from a dict
+v1_import_test_cases_from_library_response_from_dict = V1ImportTestCasesFromLibraryResponse.from_dict(v1_import_test_cases_from_library_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1ImportTestCasesRequest.md

@@ -0,0 +1,33 @@
+# V1ImportTestCasesRequest
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**test** | **str** | Required. The Test for which to get TestCases. | [optional] 
+**operation** | **str** | Required. The Operation processing this prompt library retrieval process. | [optional] 
+**test_suite_url** | **str** | Required. The URL of the library test suite to get TestCases from (sample). | [optional] 
+**count** | **int** | Required. The number of TestCases to get from the library. | [optional] 
+**test_document_urls** | **List[str]** | Optional. The list of target Test corpus document URLs which don't have to be included when returning library TestCases corpus as they are already in the Test. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_import_test_cases_request import V1ImportTestCasesRequest
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1ImportTestCasesRequest from a JSON string
+v1_import_test_cases_request_instance = V1ImportTestCasesRequest.from_json(json)
+# print the JSON string representation of the object
+print(V1ImportTestCasesRequest.to_json())
+
+# convert the object into a dict
+v1_import_test_cases_request_dict = v1_import_test_cases_request_instance.to_dict()
+# create an instance of V1ImportTestCasesRequest from a dict
+v1_import_test_cases_request_from_dict = V1ImportTestCasesRequest.from_dict(v1_import_test_cases_request_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1Info.md

@@ -12,6 +12,9 @@ Name | Type | Description | Notes
 **h2o_gpte_allowlist** | **List[str]** | Allowlist of H2OGPTe models for UI that can be used in Eval Studio. E.g. gpt-35-turbo-1106, h2oai/h2ogpt-4096-llama2-13b-chat, h2oai/h2ogpt-4096-llama2-70b-chat-4bit, HuggingFaceH4/zephyr-7b-beta, h2oai/h2ogpt-gm-7b-mistral-chat-sft-dpo-v1, h2oai/h2ogpt-gm-experimental. | [optional] 
 **h2o_gpte_client_version** | **str** | The version of h2oGPTe client used by the workers. | [optional] 
 **h2o_sonar_version** | **str** | The version of H2O Sonar used by the workers. | [optional] 
+**preferred_llms_for_test_generation** | **List[str]** | Ordered list of LLMs preferred for test generation. The value might be a regular expression. | [optional] 
+**h2o_cloud_url** | **str** | The URL for the H2O Cloud host. | [optional] 
+**public_instance** | **bool** | If the Eval Studio instance is public. | [optional] 
 
 ## Example
 

eval_studio_client/api/docs/V1InitWorkflowNodeResponse.md

@@ -0,0 +1,29 @@
+# V1InitWorkflowNodeResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**node** | [**V1WorkflowNode**](V1WorkflowNode.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_init_workflow_node_response import V1InitWorkflowNodeResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1InitWorkflowNodeResponse from a JSON string
+v1_init_workflow_node_response_instance = V1InitWorkflowNodeResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1InitWorkflowNodeResponse.to_json())
+
+# convert the object into a dict
+v1_init_workflow_node_response_dict = v1_init_workflow_node_response_instance.to_dict()
+# create an instance of V1InitWorkflowNodeResponse from a dict
+v1_init_workflow_node_response_from_dict = V1InitWorkflowNodeResponse.from_dict(v1_init_workflow_node_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1LabeledTestCase.md

@@ -0,0 +1,31 @@
+# V1LabeledTestCase
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**name** | **str** | Required. The test case resource name. | [optional] 
+**metric_value** | **float** | Required. The metric value. | [optional] 
+**label** | **bool** | Required. Human label. True means the test case should be labeled as passed (positive), false means failed (negative). | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_labeled_test_case import V1LabeledTestCase
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1LabeledTestCase from a JSON string
+v1_labeled_test_case_instance = V1LabeledTestCase.from_json(json)
+# print the JSON string representation of the object
+print(V1LabeledTestCase.to_json())
+
+# convert the object into a dict
+v1_labeled_test_case_dict = v1_labeled_test_case_instance.to_dict()
+# create an instance of V1LabeledTestCase from a dict
+v1_labeled_test_case_from_dict = V1LabeledTestCase.from_dict(v1_labeled_test_case_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1LeaderboardReport.md

@@ -0,0 +1,32 @@
+# V1LeaderboardReport
+
+LeaderboardReport represents the leaderboard report which is formed by the results, models and evaluator.
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**results** | [**List[V1LeaderboardReportResult]**](V1LeaderboardReportResult.md) | Output only. List of per test case results. | [optional] [readonly] 
+**models** | [**List[V1LeaderboardReportModel]**](V1LeaderboardReportModel.md) | Output only. List of models which were used to create the results. | [optional] [readonly] 
+**evaluator** | [**V1LeaderboardReportEvaluator**](V1LeaderboardReportEvaluator.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_leaderboard_report import V1LeaderboardReport
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1LeaderboardReport from a JSON string
+v1_leaderboard_report_instance = V1LeaderboardReport.from_json(json)
+# print the JSON string representation of the object
+print(V1LeaderboardReport.to_json())
+
+# convert the object into a dict
+v1_leaderboard_report_dict = v1_leaderboard_report_instance.to_dict()
+# create an instance of V1LeaderboardReport from a dict
+v1_leaderboard_report_from_dict = V1LeaderboardReport.from_dict(v1_leaderboard_report_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+