eval-studio-client 1.0.1__py3-none-any.whl → 1.1.0a5__py3-none-any.whl

eval_studio_client/api/docs/TestServiceApi.md

@@ -7,15 +7,17 @@ Method | HTTP request | Description
 [**test_service_batch_delete_tests**](TestServiceApi.md#test_service_batch_delete_tests) | **POST** /v1/tests:batchDelete | 
 [**test_service_batch_get_tests**](TestServiceApi.md#test_service_batch_get_tests) | **GET** /v1/tests:batchGet | 
 [**test_service_batch_import_tests**](TestServiceApi.md#test_service_batch_import_tests) | **POST** /v1/tests:batchImport | 
+[**test_service_clone_test**](TestServiceApi.md#test_service_clone_test) | **POST** /v1/{name}:clone | 
 [**test_service_create_test**](TestServiceApi.md#test_service_create_test) | **POST** /v1/tests | 
 [**test_service_delete_test**](TestServiceApi.md#test_service_delete_test) | **DELETE** /v1/{name_6} | 
 [**test_service_generate_test_cases**](TestServiceApi.md#test_service_generate_test_cases) | **POST** /v1/{name}:generateTestCases | 
-[**test_service_get_test**](TestServiceApi.md#test_service_get_test) | **GET** /v1/{name_9} | 
+[**test_service_get_test**](TestServiceApi.md#test_service_get_test) | **GET** /v1/{name_10} | 
 [**test_service_import_test_cases_from_library**](TestServiceApi.md#test_service_import_test_cases_from_library) | **POST** /v1/{name}:importTestCasesFromLibrary | 
 [**test_service_list_most_recent_tests**](TestServiceApi.md#test_service_list_most_recent_tests) | **GET** /v1/tests:mostRecent | 
 [**test_service_list_test_case_library_items**](TestServiceApi.md#test_service_list_test_case_library_items) | **POST** /v1/{name}:listTestCaseLibraryItems | 
 [**test_service_list_tests**](TestServiceApi.md#test_service_list_tests) | **GET** /v1/tests | 
 [**test_service_perturb_test**](TestServiceApi.md#test_service_perturb_test) | **POST** /v1/{name}:perturb | 
+[**test_service_perturb_test_in_place**](TestServiceApi.md#test_service_perturb_test_in_place) | **POST** /v1/{name}:perturbInPlace | 
 [**test_service_update_test**](TestServiceApi.md#test_service_update_test) | **PATCH** /v1/{test.name} | 
 
 
@@ -219,6 +221,75 @@ No authorization required
 
 [[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
 
+# **test_service_clone_test**
+> V1CloneTestResponse test_service_clone_test(name, body)
+
+
+
+### Example
+
+
+```python
+import eval_studio_client.api
+from eval_studio_client.api.models.test_service_clone_test_request import TestServiceCloneTestRequest
+from eval_studio_client.api.models.v1_clone_test_response import V1CloneTestResponse
+from eval_studio_client.api.rest import ApiException
+from pprint import pprint
+
+# Defining the host is optional and defaults to http://localhost
+# See configuration.py for a list of all supported configuration parameters.
+configuration = eval_studio_client.api.Configuration(
+    host = "http://localhost"
+)
+
+
+# Enter a context with an instance of the API client
+with eval_studio_client.api.ApiClient(configuration) as api_client:
+    # Create an instance of the API class
+    api_instance = eval_studio_client.api.TestServiceApi(api_client)
+    name = 'name_example' # str | Required. The name of the Test to clone.
+    body = eval_studio_client.api.TestServiceCloneTestRequest() # TestServiceCloneTestRequest | 
+
+    try:
+        api_response = api_instance.test_service_clone_test(name, body)
+        print("The response of TestServiceApi->test_service_clone_test:\n")
+        pprint(api_response)
+    except Exception as e:
+        print("Exception when calling TestServiceApi->test_service_clone_test: %s\n" % e)
+```
+
+
+
+### Parameters
+
+
+Name | Type | Description  | Notes
+------------- | ------------- | ------------- | -------------
+ **name** | **str**| Required. The name of the Test to clone. | 
+ **body** | [**TestServiceCloneTestRequest**](TestServiceCloneTestRequest.md)|  | 
+
+### Return type
+
+[**V1CloneTestResponse**](V1CloneTestResponse.md)
+
+### Authorization
+
+No authorization required
+
+### HTTP request headers
+
+ - **Content-Type**: application/json
+ - **Accept**: application/json
+
+### HTTP response details
+
+| Status code | Description | Response headers |
+|-------------|-------------|------------------|
+**200** | A successful response. |  -  |
+**0** | An unexpected error response. |  -  |
+
+[[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
+
 # **test_service_create_test**
 > V1CreateTestResponse test_service_create_test(test)
 
@@ -424,7 +495,7 @@ No authorization required
 [[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
 
 # **test_service_get_test**
-> V1GetTestResponse test_service_get_test(name_9)
+> V1GetTestResponse test_service_get_test(name_10)
 
 
 
@@ -448,10 +519,10 @@ configuration = eval_studio_client.api.Configuration(
 with eval_studio_client.api.ApiClient(configuration) as api_client:
     # Create an instance of the API class
     api_instance = eval_studio_client.api.TestServiceApi(api_client)
-    name_9 = 'name_9_example' # str | Required. The name of the Test to retrieve.
+    name_10 = 'name_10_example' # str | Required. The name of the Test to retrieve.
 
     try:
-        api_response = api_instance.test_service_get_test(name_9)
+        api_response = api_instance.test_service_get_test(name_10)
         print("The response of TestServiceApi->test_service_get_test:\n")
         pprint(api_response)
     except Exception as e:
@@ -465,7 +536,7 @@ with eval_studio_client.api.ApiClient(configuration) as api_client:
 
 Name | Type | Description  | Notes
 ------------- | ------------- | ------------- | -------------
- **name_9** | **str**| Required. The name of the Test to retrieve. | 
+ **name_10** | **str**| Required. The name of the Test to retrieve. | 
 
 ### Return type
 
@@ -828,6 +899,75 @@ No authorization required
 
 [[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
 
+# **test_service_perturb_test_in_place**
+> V1PerturbTestInPlaceResponse test_service_perturb_test_in_place(name, body)
+
+
+
+### Example
+
+
+```python
+import eval_studio_client.api
+from eval_studio_client.api.models.test_service_perturb_test_in_place_request import TestServicePerturbTestInPlaceRequest
+from eval_studio_client.api.models.v1_perturb_test_in_place_response import V1PerturbTestInPlaceResponse
+from eval_studio_client.api.rest import ApiException
+from pprint import pprint
+
+# Defining the host is optional and defaults to http://localhost
+# See configuration.py for a list of all supported configuration parameters.
+configuration = eval_studio_client.api.Configuration(
+    host = "http://localhost"
+)
+
+
+# Enter a context with an instance of the API client
+with eval_studio_client.api.ApiClient(configuration) as api_client:
+    # Create an instance of the API class
+    api_instance = eval_studio_client.api.TestServiceApi(api_client)
+    name = 'name_example' # str | Required. The name of the Test to perturb.
+    body = eval_studio_client.api.TestServicePerturbTestInPlaceRequest() # TestServicePerturbTestInPlaceRequest | 
+
+    try:
+        api_response = api_instance.test_service_perturb_test_in_place(name, body)
+        print("The response of TestServiceApi->test_service_perturb_test_in_place:\n")
+        pprint(api_response)
+    except Exception as e:
+        print("Exception when calling TestServiceApi->test_service_perturb_test_in_place: %s\n" % e)
+```
+
+
+
+### Parameters
+
+
+Name | Type | Description  | Notes
+------------- | ------------- | ------------- | -------------
+ **name** | **str**| Required. The name of the Test to perturb. | 
+ **body** | [**TestServicePerturbTestInPlaceRequest**](TestServicePerturbTestInPlaceRequest.md)|  | 
+
+### Return type
+
+[**V1PerturbTestInPlaceResponse**](V1PerturbTestInPlaceResponse.md)
+
+### Authorization
+
+No authorization required
+
+### HTTP request headers
+
+ - **Content-Type**: application/json
+ - **Accept**: application/json
+
+### HTTP response details
+
+| Status code | Description | Response headers |
+|-------------|-------------|------------------|
+**200** | A successful response. |  -  |
+**0** | An unexpected error response. |  -  |
+
+[[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
+
 # **test_service_update_test**
 > V1UpdateTestResponse test_service_update_test(test_name, test)
 

eval_studio_client/api/docs/TestServiceCloneTestRequest.md

@@ -0,0 +1,30 @@
+# TestServiceCloneTestRequest
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**new_test_display_name** | **str** | Optional. Name of the newly created test. | [optional] 
+**new_test_description** | **str** | Optional. Description of the newly created Test. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.test_service_clone_test_request import TestServiceCloneTestRequest
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of TestServiceCloneTestRequest from a JSON string
+test_service_clone_test_request_instance = TestServiceCloneTestRequest.from_json(json)
+# print the JSON string representation of the object
+print(TestServiceCloneTestRequest.to_json())
+
+# convert the object into a dict
+test_service_clone_test_request_dict = test_service_clone_test_request_instance.to_dict()
+# create an instance of TestServiceCloneTestRequest from a dict
+test_service_clone_test_request_from_dict = TestServiceCloneTestRequest.from_dict(test_service_clone_test_request_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/TestServiceGenerateTestCasesRequest.md

@@ -9,8 +9,9 @@ Name | Type | Description | Notes
 **model** | **str** | Optional. The Model to use for generating TestCases. If not specified, the default RAG h2oGPTe will be used. Error is returned, if no default model is specified and this field is not set. | [optional] 
 **base_llm_model** | **str** | Optional. The base LLM model to use for generating the prompts. Selected automatically if not specified. | [optional] 
 **generators** | [**List[V1TestCasesGenerator]**](V1TestCasesGenerator.md) | Optional. Generators to use for generation. If not specified, all generators are selected. | [optional] 
-**h2ogpte_collection_id** | **str** | Optional. The ID of the h2oGPTe collection to use. If empty, new temporary collection will be created. | [optional] 
-**topics** | **List[str]** | Optional. Optional. Topics to generate questions for. If not specified, use document summarization as topic generation. | [optional] 
+**h2ogpte_collection_id** | **str** | Optional. ID of the h2oGPTe collection to use. If provided, documents referenced by Test and any specified chunks are ignored. This field is required if Test does not reference any documents and no chunks are provided. If this field is left empty, a temporary collection will be created. | [optional] 
+**topics** | **List[str]** | Optional. Topics to generate questions for. If not specified, use document summarization as topic generation. | [optional] 
+**chunks** | **List[str]** | Optional. The list of chunks to use for generation. If set, the Documents assigned to the Test and h2ogpte_collection_id are ignored. | [optional] 
 
 ## Example
 

eval_studio_client/api/docs/TestServicePerturbTestInPlaceRequest.md

@@ -0,0 +1,30 @@
+# TestServicePerturbTestInPlaceRequest
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**perturbator_configurations** | [**List[V1PerturbatorConfiguration]**](V1PerturbatorConfiguration.md) | Required. PerturbatorConfigurations to apply to the Test. | [optional] 
+**test_case_names** | **List[str]** | Optional. Perturbation apply only to selected testCases. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.test_service_perturb_test_in_place_request import TestServicePerturbTestInPlaceRequest
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of TestServicePerturbTestInPlaceRequest from a JSON string
+test_service_perturb_test_in_place_request_instance = TestServicePerturbTestInPlaceRequest.from_json(json)
+# print the JSON string representation of the object
+print(TestServicePerturbTestInPlaceRequest.to_json())
+
+# convert the object into a dict
+test_service_perturb_test_in_place_request_dict = test_service_perturb_test_in_place_request_instance.to_dict()
+# create an instance of TestServicePerturbTestInPlaceRequest from a dict
+test_service_perturb_test_in_place_request_from_dict = TestServicePerturbTestInPlaceRequest.from_dict(test_service_perturb_test_in_place_request_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1AbortOperationResponse.md

@@ -0,0 +1,29 @@
+# V1AbortOperationResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**operation** | [**V1Operation**](V1Operation.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_abort_operation_response import V1AbortOperationResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1AbortOperationResponse from a JSON string
+v1_abort_operation_response_instance = V1AbortOperationResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1AbortOperationResponse.to_json())
+
+# convert the object into a dict
+v1_abort_operation_response_dict = v1_abort_operation_response_instance.to_dict()
+# create an instance of V1AbortOperationResponse from a dict
+v1_abort_operation_response_from_dict = V1AbortOperationResponse.from_dict(v1_abort_operation_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1CloneTestResponse.md

@@ -0,0 +1,29 @@
+# V1CloneTestResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**test** | [**V1Test**](V1Test.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_clone_test_response import V1CloneTestResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1CloneTestResponse from a JSON string
+v1_clone_test_response_instance = V1CloneTestResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1CloneTestResponse.to_json())
+
+# convert the object into a dict
+v1_clone_test_response_dict = v1_clone_test_response_instance.to_dict()
+# create an instance of V1CloneTestResponse from a dict
+v1_clone_test_response_from_dict = V1CloneTestResponse.from_dict(v1_clone_test_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1CloneWorkflowResponse.md

@@ -0,0 +1,29 @@
+# V1CloneWorkflowResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**workflow** | [**V1Workflow**](V1Workflow.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_clone_workflow_response import V1CloneWorkflowResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1CloneWorkflowResponse from a JSON string
+v1_clone_workflow_response_instance = V1CloneWorkflowResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1CloneWorkflowResponse.to_json())
+
+# convert the object into a dict
+v1_clone_workflow_response_dict = v1_clone_workflow_response_instance.to_dict()
+# create an instance of V1CloneWorkflowResponse from a dict
+v1_clone_workflow_response_from_dict = V1CloneWorkflowResponse.from_dict(v1_clone_workflow_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1Context.md

@@ -0,0 +1,32 @@
+# V1Context
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**collection_id** | **str** | Collection Id. | [optional] 
+**chunk_id** | **int** | Chunk Id. | [optional] 
+**score** | **float** | Chunk score. | [optional] 
+**content** | **str** | Content. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_context import V1Context
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1Context from a JSON string
+v1_context_instance = V1Context.from_json(json)
+# print the JSON string representation of the object
+print(V1Context.to_json())
+
+# convert the object into a dict
+v1_context_dict = v1_context_instance.to_dict()
+# create an instance of V1Context from a dict
+v1_context_from_dict = V1Context.from_dict(v1_context_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1CreateWorkflowEdgeResponse.md

@@ -0,0 +1,29 @@
+# V1CreateWorkflowEdgeResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**edge** | [**V1WorkflowEdge**](V1WorkflowEdge.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_create_workflow_edge_response import V1CreateWorkflowEdgeResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1CreateWorkflowEdgeResponse from a JSON string
+v1_create_workflow_edge_response_instance = V1CreateWorkflowEdgeResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1CreateWorkflowEdgeResponse.to_json())
+
+# convert the object into a dict
+v1_create_workflow_edge_response_dict = v1_create_workflow_edge_response_instance.to_dict()
+# create an instance of V1CreateWorkflowEdgeResponse from a dict
+v1_create_workflow_edge_response_from_dict = V1CreateWorkflowEdgeResponse.from_dict(v1_create_workflow_edge_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1CreateWorkflowNodeResponse.md

@@ -0,0 +1,29 @@
+# V1CreateWorkflowNodeResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**node** | [**V1WorkflowNode**](V1WorkflowNode.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_create_workflow_node_response import V1CreateWorkflowNodeResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1CreateWorkflowNodeResponse from a JSON string
+v1_create_workflow_node_response_instance = V1CreateWorkflowNodeResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1CreateWorkflowNodeResponse.to_json())
+
+# convert the object into a dict
+v1_create_workflow_node_response_dict = v1_create_workflow_node_response_instance.to_dict()
+# create an instance of V1CreateWorkflowNodeResponse from a dict
+v1_create_workflow_node_response_from_dict = V1CreateWorkflowNodeResponse.from_dict(v1_create_workflow_node_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1DeleteWorkflowEdgeResponse.md

@@ -0,0 +1,29 @@
+# V1DeleteWorkflowEdgeResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**edge** | [**V1WorkflowEdge**](V1WorkflowEdge.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_delete_workflow_edge_response import V1DeleteWorkflowEdgeResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1DeleteWorkflowEdgeResponse from a JSON string
+v1_delete_workflow_edge_response_instance = V1DeleteWorkflowEdgeResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1DeleteWorkflowEdgeResponse.to_json())
+
+# convert the object into a dict
+v1_delete_workflow_edge_response_dict = v1_delete_workflow_edge_response_instance.to_dict()
+# create an instance of V1DeleteWorkflowEdgeResponse from a dict
+v1_delete_workflow_edge_response_from_dict = V1DeleteWorkflowEdgeResponse.from_dict(v1_delete_workflow_edge_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1GeneratedTestCase.md

@@ -0,0 +1,30 @@
+# V1GeneratedTestCase
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**test_case** | [**V1TestCase**](V1TestCase.md) |  | [optional] 
+**context** | [**List[V1Context]**](V1Context.md) | Context used for test_case generation. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_generated_test_case import V1GeneratedTestCase
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1GeneratedTestCase from a JSON string
+v1_generated_test_case_instance = V1GeneratedTestCase.from_json(json)
+# print the JSON string representation of the object
+print(V1GeneratedTestCase.to_json())
+
+# convert the object into a dict
+v1_generated_test_case_dict = v1_generated_test_case_instance.to_dict()
+# create an instance of V1GeneratedTestCase from a dict
+v1_generated_test_case_from_dict = V1GeneratedTestCase.from_dict(v1_generated_test_case_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1GetLeaderboardReportResponse.md

@@ -0,0 +1,29 @@
+# V1GetLeaderboardReportResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**leaderboard_report** | [**V1LeaderboardReport**](V1LeaderboardReport.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_get_leaderboard_report_response import V1GetLeaderboardReportResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1GetLeaderboardReportResponse from a JSON string
+v1_get_leaderboard_report_response_instance = V1GetLeaderboardReportResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1GetLeaderboardReportResponse.to_json())
+
+# convert the object into a dict
+v1_get_leaderboard_report_response_dict = v1_get_leaderboard_report_response_instance.to_dict()
+# create an instance of V1GetLeaderboardReportResponse from a dict
+v1_get_leaderboard_report_response_from_dict = V1GetLeaderboardReportResponse.from_dict(v1_get_leaderboard_report_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1Info.md

@@ -12,6 +12,9 @@ Name | Type | Description | Notes
 **h2o_gpte_allowlist** | **List[str]** | Allowlist of H2OGPTe models for UI that can be used in Eval Studio. E.g. gpt-35-turbo-1106, h2oai/h2ogpt-4096-llama2-13b-chat, h2oai/h2ogpt-4096-llama2-70b-chat-4bit, HuggingFaceH4/zephyr-7b-beta, h2oai/h2ogpt-gm-7b-mistral-chat-sft-dpo-v1, h2oai/h2ogpt-gm-experimental. | [optional] 
 **h2o_gpte_client_version** | **str** | The version of h2oGPTe client used by the workers. | [optional] 
 **h2o_sonar_version** | **str** | The version of H2O Sonar used by the workers. | [optional] 
+**preferred_llms_for_test_generation** | **List[str]** | Ordered list of LLMs preferred for test generation. The value might be a regular expression. | [optional] 
+**h2o_cloud_url** | **str** | The URL for the H2O Cloud host. | [optional] 
+**public_instance** | **bool** | If the Eval Studio instance is public. | [optional] 
 
 ## Example
 

eval_studio_client/api/docs/V1InitWorkflowNodeResponse.md

@@ -0,0 +1,29 @@
+# V1InitWorkflowNodeResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**node** | [**V1WorkflowNode**](V1WorkflowNode.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_init_workflow_node_response import V1InitWorkflowNodeResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1InitWorkflowNodeResponse from a JSON string
+v1_init_workflow_node_response_instance = V1InitWorkflowNodeResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1InitWorkflowNodeResponse.to_json())
+
+# convert the object into a dict
+v1_init_workflow_node_response_dict = v1_init_workflow_node_response_instance.to_dict()
+# create an instance of V1InitWorkflowNodeResponse from a dict
+v1_init_workflow_node_response_from_dict = V1InitWorkflowNodeResponse.from_dict(v1_init_workflow_node_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1LeaderboardReport.md

@@ -0,0 +1,32 @@
+# V1LeaderboardReport
+
+LeaderboardReport represents the leaderboard report which is formed by the results, models and evaluator.
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**results** | [**List[V1LeaderboardReportResult]**](V1LeaderboardReportResult.md) | Output only. List of per test case results. | [optional] [readonly] 
+**models** | [**List[V1LeaderboardReportModel]**](V1LeaderboardReportModel.md) | Output only. List of models which were used to create the results. | [optional] [readonly] 
+**evaluator** | [**V1LeaderboardReportEvaluator**](V1LeaderboardReportEvaluator.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_leaderboard_report import V1LeaderboardReport
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1LeaderboardReport from a JSON string
+v1_leaderboard_report_instance = V1LeaderboardReport.from_json(json)
+# print the JSON string representation of the object
+print(V1LeaderboardReport.to_json())
+
+# convert the object into a dict
+v1_leaderboard_report_dict = v1_leaderboard_report_instance.to_dict()
+# create an instance of V1LeaderboardReport from a dict
+v1_leaderboard_report_from_dict = V1LeaderboardReport.from_dict(v1_leaderboard_report_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1LeaderboardReportActualOutputData.md

@@ -0,0 +1,31 @@
+# V1LeaderboardReportActualOutputData
+
+ActualOutputData represents the actual output data.
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**text** | **str** | Output only. Text fragment. | [optional] [readonly] 
+**metrics** | **object** | Output only. Metrics parsed as string to Value map. | [optional] [readonly] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_leaderboard_report_actual_output_data import V1LeaderboardReportActualOutputData
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1LeaderboardReportActualOutputData from a JSON string
+v1_leaderboard_report_actual_output_data_instance = V1LeaderboardReportActualOutputData.from_json(json)
+# print the JSON string representation of the object
+print(V1LeaderboardReportActualOutputData.to_json())
+
+# convert the object into a dict
+v1_leaderboard_report_actual_output_data_dict = v1_leaderboard_report_actual_output_data_instance.to_dict()
+# create an instance of V1LeaderboardReportActualOutputData from a dict
+v1_leaderboard_report_actual_output_data_from_dict = V1LeaderboardReportActualOutputData.from_dict(v1_leaderboard_report_actual_output_data_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+