eval-studio-client 1.0.1__py3-none-any.whl → 1.0.3__py3-none-any.whl

eval_studio_client/api/docs/RequiredTheTestCaseToUpdate.md

@@ -16,7 +16,6 @@ Name | Type | Description | Notes
 **answer** | **str** | Expected answer text. Model output. | [optional] 
 **constraints** | **List[str]** | Constraints on the model output. | [optional] 
 **condition** | **str** | Optional. Test case output condition, in a form of AIP-160 compliant filter expression. | [optional] 
-**perturbed_by** | **List[str]** | Output only. The list of perturbators applied to this test case. | [optional] [readonly] 
 
 ## Example
 

eval_studio_client/api/docs/TestServiceApi.md

@@ -11,9 +11,7 @@ Method | HTTP request | Description
 [**test_service_delete_test**](TestServiceApi.md#test_service_delete_test) | **DELETE** /v1/{name_6} | 
 [**test_service_generate_test_cases**](TestServiceApi.md#test_service_generate_test_cases) | **POST** /v1/{name}:generateTestCases | 
 [**test_service_get_test**](TestServiceApi.md#test_service_get_test) | **GET** /v1/{name_9} | 
-[**test_service_import_test_cases_from_library**](TestServiceApi.md#test_service_import_test_cases_from_library) | **POST** /v1/{name}:importTestCasesFromLibrary | 
 [**test_service_list_most_recent_tests**](TestServiceApi.md#test_service_list_most_recent_tests) | **GET** /v1/tests:mostRecent | 
-[**test_service_list_test_case_library_items**](TestServiceApi.md#test_service_list_test_case_library_items) | **POST** /v1/{name}:listTestCaseLibraryItems | 
 [**test_service_list_tests**](TestServiceApi.md#test_service_list_tests) | **GET** /v1/tests | 
 [**test_service_perturb_test**](TestServiceApi.md#test_service_perturb_test) | **POST** /v1/{name}:perturb | 
 [**test_service_update_test**](TestServiceApi.md#test_service_update_test) | **PATCH** /v1/{test.name} | 
@@ -489,75 +487,6 @@ No authorization required
 
 [[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
 
-# **test_service_import_test_cases_from_library**
-> V1ImportTestCasesFromLibraryResponse test_service_import_test_cases_from_library(name, body)
-
-
-
-### Example
-
-
-```python
-import eval_studio_client.api
-from eval_studio_client.api.models.test_service_import_test_cases_from_library_request import TestServiceImportTestCasesFromLibraryRequest
-from eval_studio_client.api.models.v1_import_test_cases_from_library_response import V1ImportTestCasesFromLibraryResponse
-from eval_studio_client.api.rest import ApiException
-from pprint import pprint
-
-# Defining the host is optional and defaults to http://localhost
-# See configuration.py for a list of all supported configuration parameters.
-configuration = eval_studio_client.api.Configuration(
-    host = "http://localhost"
-)
-
-
-# Enter a context with an instance of the API client
-with eval_studio_client.api.ApiClient(configuration) as api_client:
-    # Create an instance of the API class
-    api_instance = eval_studio_client.api.TestServiceApi(api_client)
-    name = 'name_example' # str | Required. The Test for which to get TestCases.
-    body = eval_studio_client.api.TestServiceImportTestCasesFromLibraryRequest() # TestServiceImportTestCasesFromLibraryRequest | 
-
-    try:
-        api_response = api_instance.test_service_import_test_cases_from_library(name, body)
-        print("The response of TestServiceApi->test_service_import_test_cases_from_library:\n")
-        pprint(api_response)
-    except Exception as e:
-        print("Exception when calling TestServiceApi->test_service_import_test_cases_from_library: %s\n" % e)
-```
-
-
-
-### Parameters
-
-
-Name | Type | Description  | Notes
-------------- | ------------- | ------------- | -------------
- **name** | **str**| Required. The Test for which to get TestCases. | 
- **body** | [**TestServiceImportTestCasesFromLibraryRequest**](TestServiceImportTestCasesFromLibraryRequest.md)|  | 
-
-### Return type
-
-[**V1ImportTestCasesFromLibraryResponse**](V1ImportTestCasesFromLibraryResponse.md)
-
-### Authorization
-
-No authorization required
-
-### HTTP request headers
-
- - **Content-Type**: application/json
- - **Accept**: application/json
-
-### HTTP response details
-
-| Status code | Description | Response headers |
-|-------------|-------------|------------------|
-**200** | A successful response. |  -  |
-**0** | An unexpected error response. |  -  |
-
-[[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
-
 # **test_service_list_most_recent_tests**
 > V1ListMostRecentTestsResponse test_service_list_most_recent_tests(limit=limit)
 
@@ -624,75 +553,6 @@ No authorization required
 
 [[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
 
-# **test_service_list_test_case_library_items**
-> V1ListTestCaseLibraryItemsResponse test_service_list_test_case_library_items(name, body)
-
-
-
-### Example
-
-
-```python
-import eval_studio_client.api
-from eval_studio_client.api.models.test_service_list_test_case_library_items_request import TestServiceListTestCaseLibraryItemsRequest
-from eval_studio_client.api.models.v1_list_test_case_library_items_response import V1ListTestCaseLibraryItemsResponse
-from eval_studio_client.api.rest import ApiException
-from pprint import pprint
-
-# Defining the host is optional and defaults to http://localhost
-# See configuration.py for a list of all supported configuration parameters.
-configuration = eval_studio_client.api.Configuration(
-    host = "http://localhost"
-)
-
-
-# Enter a context with an instance of the API client
-with eval_studio_client.api.ApiClient(configuration) as api_client:
-    # Create an instance of the API class
-    api_instance = eval_studio_client.api.TestServiceApi(api_client)
-    name = 'name_example' # str | Required. The Test for which to list the items.
-    body = eval_studio_client.api.TestServiceListTestCaseLibraryItemsRequest() # TestServiceListTestCaseLibraryItemsRequest | 
-
-    try:
-        api_response = api_instance.test_service_list_test_case_library_items(name, body)
-        print("The response of TestServiceApi->test_service_list_test_case_library_items:\n")
-        pprint(api_response)
-    except Exception as e:
-        print("Exception when calling TestServiceApi->test_service_list_test_case_library_items: %s\n" % e)
-```
-
-
-
-### Parameters
-
-
-Name | Type | Description  | Notes
-------------- | ------------- | ------------- | -------------
- **name** | **str**| Required. The Test for which to list the items. | 
- **body** | [**TestServiceListTestCaseLibraryItemsRequest**](TestServiceListTestCaseLibraryItemsRequest.md)|  | 
-
-### Return type
-
-[**V1ListTestCaseLibraryItemsResponse**](V1ListTestCaseLibraryItemsResponse.md)
-
-### Authorization
-
-No authorization required
-
-### HTTP request headers
-
- - **Content-Type**: application/json
- - **Accept**: application/json
-
-### HTTP response details
-
-| Status code | Description | Response headers |
-|-------------|-------------|------------------|
-**200** | A successful response. |  -  |
-**0** | An unexpected error response. |  -  |
-
-[[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
-
 # **test_service_list_tests**
 > V1ListTestsResponse test_service_list_tests(order_by=order_by)
 

eval_studio_client/api/docs/TestServiceGenerateTestCasesRequest.md

@@ -10,7 +10,6 @@ Name | Type | Description | Notes
 **base_llm_model** | **str** | Optional. The base LLM model to use for generating the prompts. Selected automatically if not specified. | [optional] 
 **generators** | [**List[V1TestCasesGenerator]**](V1TestCasesGenerator.md) | Optional. Generators to use for generation. If not specified, all generators are selected. | [optional] 
 **h2ogpte_collection_id** | **str** | Optional. The ID of the h2oGPTe collection to use. If empty, new temporary collection will be created. | [optional] 
-**topics** | **List[str]** | Optional. Optional. Topics to generate questions for. If not specified, use document summarization as topic generation. | [optional] 
 
 ## Example
 

eval_studio_client/api/docs/TestServicePerturbTestRequest.md

@@ -8,7 +8,6 @@ Name | Type | Description | Notes
 **perturbator_configurations** | [**List[V1PerturbatorConfiguration]**](V1PerturbatorConfiguration.md) | Required. PerturbatorConfigurations to apply to the Test. | [optional] 
 **new_test_display_name** | **str** | Required. Name of the newly created test. | [optional] 
 **new_test_description** | **str** | Optional. Description of the newly created Test. | [optional] 
-**test_case_names** | **List[str]** | Optional. Perturbation apply only to selected testCases. | [optional] 
 
 ## Example
 

eval_studio_client/api/docs/V1CreateEvaluationRequest.md

@@ -14,7 +14,6 @@ Name | Type | Description | Notes
 **evaluators_parameters** | **Dict[str, str]** | Optional. Additional evaluators configuration, for all the evaluators used in the evaluation. Key is the evaluator identifier, and the value is a JSON string containing the configuration dictionary. | [optional] 
 **model_parameters** | **str** | Optional. Parameters overrides in JSON format. | [optional] 
 **h2ogpte_collection** | **str** | The existing collection name in H2OGPTe. | [optional] 
-**default_h2ogpte_model** | [**V1Model**](V1Model.md) |  | [optional] 
 
 ## Example
 

eval_studio_client/api/docs/V1ImportEvaluationRequest.md

@@ -10,7 +10,6 @@ Name | Type | Description | Notes
 **test_lab** | **str** | Required. The JSON representation of the pre-built test-lab. | [optional] 
 **operation** | **str** | Required. Resource name of the long-running operation. | [optional] 
 **evaluators_parameters** | **Dict[str, str]** | Optional. Additional evaluators configuration, for all the evaluators used in the evaluation. Key is the evaluator identifier, and the value is a JSON string containing the configuration dictionary. | [optional] 
-**default_h2ogpte_model** | [**V1Model**](V1Model.md) |  | [optional] 
 
 ## Example
 

eval_studio_client/api/docs/V1TestCase.md

@@ -17,7 +17,6 @@ Name | Type | Description | Notes
 **answer** | **str** | Expected answer text. Model output. | [optional] 
 **constraints** | **List[str]** | Constraints on the model output. | [optional] 
 **condition** | **str** | Optional. Test case output condition, in a form of AIP-160 compliant filter expression. | [optional] 
-**perturbed_by** | **List[str]** | Output only. The list of perturbators applied to this test case. | [optional] [readonly] 
 
 ## Example
 

eval_studio_client/api/models/__init__.py

@@ -17,7 +17,6 @@
 from eval_studio_client.api.models.perturbation_service_create_perturbation_request import PerturbationServiceCreatePerturbationRequest
 from eval_studio_client.api.models.prompt_generation_service_auto_generate_prompts_request import PromptGenerationServiceAutoGeneratePromptsRequest
 from eval_studio_client.api.models.protobuf_any import ProtobufAny
-from eval_studio_client.api.models.protobuf_null_value import ProtobufNullValue
 from eval_studio_client.api.models.required_the_dashboard_to_update import RequiredTheDashboardToUpdate
 from eval_studio_client.api.models.required_the_document_to_update import RequiredTheDocumentToUpdate
 from eval_studio_client.api.models.required_the_leaderboard_to_update import RequiredTheLeaderboardToUpdate
@@ -26,13 +25,9 @@ from eval_studio_client.api.models.required_the_operation_to_finalize import Req
 from eval_studio_client.api.models.required_the_operation_to_update import RequiredTheOperationToUpdate
 from eval_studio_client.api.models.required_the_test_case_to_update import RequiredTheTestCaseToUpdate
 from eval_studio_client.api.models.required_the_test_to_update import RequiredTheTestToUpdate
-from eval_studio_client.api.models.required_the_updated_workflow import RequiredTheUpdatedWorkflow
-from eval_studio_client.api.models.required_the_updated_workflow_node import RequiredTheUpdatedWorkflowNode
 from eval_studio_client.api.models.rpc_status import RpcStatus
 from eval_studio_client.api.models.test_case_service_batch_delete_test_cases_request import TestCaseServiceBatchDeleteTestCasesRequest
 from eval_studio_client.api.models.test_service_generate_test_cases_request import TestServiceGenerateTestCasesRequest
-from eval_studio_client.api.models.test_service_import_test_cases_from_library_request import TestServiceImportTestCasesFromLibraryRequest
-from eval_studio_client.api.models.test_service_list_test_case_library_items_request import TestServiceListTestCaseLibraryItemsRequest
 from eval_studio_client.api.models.test_service_perturb_test_request import TestServicePerturbTestRequest
 from eval_studio_client.api.models.v1_batch_create_leaderboards_request import V1BatchCreateLeaderboardsRequest
 from eval_studio_client.api.models.v1_batch_create_leaderboards_response import V1BatchCreateLeaderboardsResponse
@@ -49,16 +44,12 @@ from eval_studio_client.api.models.v1_batch_delete_models_response import V1Batc
 from eval_studio_client.api.models.v1_batch_delete_test_cases_response import V1BatchDeleteTestCasesResponse
 from eval_studio_client.api.models.v1_batch_delete_tests_request import V1BatchDeleteTestsRequest
 from eval_studio_client.api.models.v1_batch_delete_tests_response import V1BatchDeleteTestsResponse
-from eval_studio_client.api.models.v1_batch_delete_workflows_request import V1BatchDeleteWorkflowsRequest
-from eval_studio_client.api.models.v1_batch_delete_workflows_response import V1BatchDeleteWorkflowsResponse
 from eval_studio_client.api.models.v1_batch_get_dashboards_response import V1BatchGetDashboardsResponse
 from eval_studio_client.api.models.v1_batch_get_documents_response import V1BatchGetDocumentsResponse
 from eval_studio_client.api.models.v1_batch_get_leaderboards_response import V1BatchGetLeaderboardsResponse
 from eval_studio_client.api.models.v1_batch_get_models_response import V1BatchGetModelsResponse
 from eval_studio_client.api.models.v1_batch_get_operations_response import V1BatchGetOperationsResponse
 from eval_studio_client.api.models.v1_batch_get_tests_response import V1BatchGetTestsResponse
-from eval_studio_client.api.models.v1_batch_get_workflow_edges_response import V1BatchGetWorkflowEdgesResponse
-from eval_studio_client.api.models.v1_batch_get_workflow_nodes_response import V1BatchGetWorkflowNodesResponse
 from eval_studio_client.api.models.v1_batch_import_leaderboard_request import V1BatchImportLeaderboardRequest
 from eval_studio_client.api.models.v1_batch_import_leaderboard_response import V1BatchImportLeaderboardResponse
 from eval_studio_client.api.models.v1_batch_import_tests_request import V1BatchImportTestsRequest
@@ -77,7 +68,6 @@ from eval_studio_client.api.models.v1_create_perturbation_response import V1Crea
 from eval_studio_client.api.models.v1_create_test_case_response import V1CreateTestCaseResponse
 from eval_studio_client.api.models.v1_create_test_lab_response import V1CreateTestLabResponse
 from eval_studio_client.api.models.v1_create_test_response import V1CreateTestResponse
-from eval_studio_client.api.models.v1_create_workflow_response import V1CreateWorkflowResponse
 from eval_studio_client.api.models.v1_dashboard import V1Dashboard
 from eval_studio_client.api.models.v1_dashboard_status import V1DashboardStatus
 from eval_studio_client.api.models.v1_delete_dashboard_response import V1DeleteDashboardResponse
@@ -87,10 +77,7 @@ from eval_studio_client.api.models.v1_delete_leaderboard_response import V1Delet
 from eval_studio_client.api.models.v1_delete_model_response import V1DeleteModelResponse
 from eval_studio_client.api.models.v1_delete_test_case_response import V1DeleteTestCaseResponse
 from eval_studio_client.api.models.v1_delete_test_response import V1DeleteTestResponse
-from eval_studio_client.api.models.v1_delete_workflow_node_response import V1DeleteWorkflowNodeResponse
-from eval_studio_client.api.models.v1_delete_workflow_response import V1DeleteWorkflowResponse
 from eval_studio_client.api.models.v1_document import V1Document
-from eval_studio_client.api.models.v1_estimate_threshold_request import V1EstimateThresholdRequest
 from eval_studio_client.api.models.v1_evaluation_test import V1EvaluationTest
 from eval_studio_client.api.models.v1_evaluator import V1Evaluator
 from eval_studio_client.api.models.v1_evaluator_param_type import V1EvaluatorParamType
@@ -112,17 +99,11 @@ from eval_studio_client.api.models.v1_get_perturbator_response import V1GetPertu
 from eval_studio_client.api.models.v1_get_test_case_response import V1GetTestCaseResponse
 from eval_studio_client.api.models.v1_get_test_class_response import V1GetTestClassResponse
 from eval_studio_client.api.models.v1_get_test_response import V1GetTestResponse
-from eval_studio_client.api.models.v1_get_workflow_node_prerequisites_response import V1GetWorkflowNodePrerequisitesResponse
-from eval_studio_client.api.models.v1_get_workflow_node_response import V1GetWorkflowNodeResponse
-from eval_studio_client.api.models.v1_get_workflow_response import V1GetWorkflowResponse
 from eval_studio_client.api.models.v1_import_evaluation_request import V1ImportEvaluationRequest
 from eval_studio_client.api.models.v1_import_leaderboard_request import V1ImportLeaderboardRequest
 from eval_studio_client.api.models.v1_import_leaderboard_response import V1ImportLeaderboardResponse
-from eval_studio_client.api.models.v1_import_test_cases_from_library_response import V1ImportTestCasesFromLibraryResponse
-from eval_studio_client.api.models.v1_import_test_cases_request import V1ImportTestCasesRequest
 from eval_studio_client.api.models.v1_info import V1Info
 from eval_studio_client.api.models.v1_insight import V1Insight
-from eval_studio_client.api.models.v1_labeled_test_case import V1LabeledTestCase
 from eval_studio_client.api.models.v1_leaderboard import V1Leaderboard
 from eval_studio_client.api.models.v1_leaderboard_status import V1LeaderboardStatus
 from eval_studio_client.api.models.v1_leaderboard_type import V1LeaderboardType
@@ -141,13 +122,10 @@ from eval_studio_client.api.models.v1_list_most_recent_models_response import V1
 from eval_studio_client.api.models.v1_list_most_recent_tests_response import V1ListMostRecentTestsResponse
 from eval_studio_client.api.models.v1_list_operations_response import V1ListOperationsResponse
 from eval_studio_client.api.models.v1_list_perturbators_response import V1ListPerturbatorsResponse
-from eval_studio_client.api.models.v1_list_prompt_library_items_response import V1ListPromptLibraryItemsResponse
 from eval_studio_client.api.models.v1_list_rag_collections_response import V1ListRAGCollectionsResponse
-from eval_studio_client.api.models.v1_list_test_case_library_items_response import V1ListTestCaseLibraryItemsResponse
 from eval_studio_client.api.models.v1_list_test_cases_response import V1ListTestCasesResponse
 from eval_studio_client.api.models.v1_list_test_classes_response import V1ListTestClassesResponse
 from eval_studio_client.api.models.v1_list_tests_response import V1ListTestsResponse
-from eval_studio_client.api.models.v1_list_workflows_response import V1ListWorkflowsResponse
 from eval_studio_client.api.models.v1_model import V1Model
 from eval_studio_client.api.models.v1_model_type import V1ModelType
 from eval_studio_client.api.models.v1_operation import V1Operation
@@ -157,8 +135,6 @@ from eval_studio_client.api.models.v1_perturbator import V1Perturbator
 from eval_studio_client.api.models.v1_perturbator_configuration import V1PerturbatorConfiguration
 from eval_studio_client.api.models.v1_perturbator_intensity import V1PerturbatorIntensity
 from eval_studio_client.api.models.v1_problem_and_action import V1ProblemAndAction
-from eval_studio_client.api.models.v1_process_workflow_node_response import V1ProcessWorkflowNodeResponse
-from eval_studio_client.api.models.v1_prompt_library_item import V1PromptLibraryItem
 from eval_studio_client.api.models.v1_test import V1Test
 from eval_studio_client.api.models.v1_test_case import V1TestCase
 from eval_studio_client.api.models.v1_test_case_relationship import V1TestCaseRelationship
@@ -166,7 +142,6 @@ from eval_studio_client.api.models.v1_test_cases_generator import V1TestCasesGen
 from eval_studio_client.api.models.v1_test_class import V1TestClass
 from eval_studio_client.api.models.v1_test_class_type import V1TestClassType
 from eval_studio_client.api.models.v1_test_lab import V1TestLab
-from eval_studio_client.api.models.v1_test_suite_evaluates import V1TestSuiteEvaluates
 from eval_studio_client.api.models.v1_update_dashboard_response import V1UpdateDashboardResponse
 from eval_studio_client.api.models.v1_update_document_response import V1UpdateDocumentResponse
 from eval_studio_client.api.models.v1_update_leaderboard_response import V1UpdateLeaderboardResponse
@@ -174,17 +149,4 @@ from eval_studio_client.api.models.v1_update_model_response import V1UpdateModel
 from eval_studio_client.api.models.v1_update_operation_response import V1UpdateOperationResponse
 from eval_studio_client.api.models.v1_update_test_case_response import V1UpdateTestCaseResponse
 from eval_studio_client.api.models.v1_update_test_response import V1UpdateTestResponse
-from eval_studio_client.api.models.v1_update_workflow_node_response import V1UpdateWorkflowNodeResponse
-from eval_studio_client.api.models.v1_update_workflow_response import V1UpdateWorkflowResponse
 from eval_studio_client.api.models.v1_who_am_i_response import V1WhoAmIResponse
-from eval_studio_client.api.models.v1_workflow import V1Workflow
-from eval_studio_client.api.models.v1_workflow_edge import V1WorkflowEdge
-from eval_studio_client.api.models.v1_workflow_edge_type import V1WorkflowEdgeType
-from eval_studio_client.api.models.v1_workflow_node import V1WorkflowNode
-from eval_studio_client.api.models.v1_workflow_node_artifact import V1WorkflowNodeArtifact
-from eval_studio_client.api.models.v1_workflow_node_artifacts import V1WorkflowNodeArtifacts
-from eval_studio_client.api.models.v1_workflow_node_attributes import V1WorkflowNodeAttributes
-from eval_studio_client.api.models.v1_workflow_node_status import V1WorkflowNodeStatus
-from eval_studio_client.api.models.v1_workflow_node_type import V1WorkflowNodeType
-from eval_studio_client.api.models.v1_workflow_node_view import V1WorkflowNodeView
-from eval_studio_client.api.models.v1_workflow_type import V1WorkflowType

eval_studio_client/api/models/perturbation_service_create_perturbation_request.py

@@ -19,7 +19,6 @@ import json
 
 from pydantic import BaseModel, ConfigDict, Field
 from typing import Any, ClassVar, Dict, List, Optional
-from eval_studio_client.api.models.v1_model import V1Model
 from eval_studio_client.api.models.v1_perturbator_configuration import V1PerturbatorConfiguration
 from eval_studio_client.api.models.v1_test_case import V1TestCase
 from eval_studio_client.api.models.v1_test_case_relationship import V1TestCaseRelationship
@@ -33,8 +32,7 @@ class PerturbationServiceCreatePerturbationRequest(BaseModel):
     perturbator_configurations: Optional[List[V1PerturbatorConfiguration]] = Field(default=None, description="Required. PerturbatorConfiguration to apply to the parent Test.", alias="perturbatorConfigurations")
     test_cases: Optional[List[V1TestCase]] = Field(default=None, description="Required. List of test cases to perturbate. These are the test cases from the parent test.  TODO: breaks https://google.aip.dev/144", alias="testCases")
     test_case_relationships: Optional[List[V1TestCaseRelationship]] = Field(default=None, description="Optional. List of relationships between test cases.", alias="testCaseRelationships")
-    default_h2ogpte_model: Optional[V1Model] = Field(default=None, alias="defaultH2ogpteModel")
-    __properties: ClassVar[List[str]] = ["perturbatorConfigurations", "testCases", "testCaseRelationships", "defaultH2ogpteModel"]
+    __properties: ClassVar[List[str]] = ["perturbatorConfigurations", "testCases", "testCaseRelationships"]
 
     model_config = ConfigDict(
         populate_by_name=True,
@@ -96,9 +94,6 @@ class PerturbationServiceCreatePerturbationRequest(BaseModel):
                 if _item:
                     _items.append(_item.to_dict())
             _dict['testCaseRelationships'] = _items
-        # override the default output from pydantic by calling `to_dict()` of default_h2ogpte_model
-        if self.default_h2ogpte_model:
-            _dict['defaultH2ogpteModel'] = self.default_h2ogpte_model.to_dict()
         return _dict
 
     @classmethod
@@ -113,8 +108,7 @@ class PerturbationServiceCreatePerturbationRequest(BaseModel):
         _obj = cls.model_validate({
             "perturbatorConfigurations": [V1PerturbatorConfiguration.from_dict(_item) for _item in obj["perturbatorConfigurations"]] if obj.get("perturbatorConfigurations") is not None else None,
             "testCases": [V1TestCase.from_dict(_item) for _item in obj["testCases"]] if obj.get("testCases") is not None else None,
-            "testCaseRelationships": [V1TestCaseRelationship.from_dict(_item) for _item in obj["testCaseRelationships"]] if obj.get("testCaseRelationships") is not None else None,
-            "defaultH2ogpteModel": V1Model.from_dict(obj["defaultH2ogpteModel"]) if obj.get("defaultH2ogpteModel") is not None else None
+            "testCaseRelationships": [V1TestCaseRelationship.from_dict(_item) for _item in obj["testCaseRelationships"]] if obj.get("testCaseRelationships") is not None else None
         })
         return _obj
 

eval_studio_client/api/models/prompt_generation_service_auto_generate_prompts_request.py

@@ -33,10 +33,9 @@ class PromptGenerationServiceAutoGeneratePromptsRequest(BaseModel):
     count: Optional[StrictInt] = Field(default=None, description="Required. The number of TestCases to generate.")
     base_llm_model: Optional[StrictStr] = Field(default=None, description="Required. Base LLM model to use for generating the prompts.", alias="baseLlmModel")
     document_urls: Optional[List[StrictStr]] = Field(default=None, description="Optional. The list of document URLs. The document URL might be a managed document URL or a public URL.", alias="documentUrls")
-    generators: Optional[List[V1TestCasesGenerator]] = Field(default=None, description="Optional. Type of questions to generate TestCases for. If not specified, all types of questions are selected.")
+    generators: Optional[List[V1TestCasesGenerator]] = Field(default=None, description="Optional. Topics to generate TestCases for. If not specified, all topics are selected.")
     h2ogpte_collection_id: Optional[StrictStr] = Field(default=None, description="Optional. The ID of the h2oGPTe collection to use. If empty, new temporary collection will be created.", alias="h2ogpteCollectionId")
-    topics: Optional[List[StrictStr]] = Field(default=None, description="Optional. Topics to generate questions for. If not specified, use document summarization as topic generation.")
-    __properties: ClassVar[List[str]] = ["operation", "model", "count", "baseLlmModel", "documentUrls", "generators", "h2ogpteCollectionId", "topics"]
+    __properties: ClassVar[List[str]] = ["operation", "model", "count", "baseLlmModel", "documentUrls", "generators", "h2ogpteCollectionId"]
 
     model_config = ConfigDict(
         populate_by_name=True,
@@ -98,8 +97,7 @@ class PromptGenerationServiceAutoGeneratePromptsRequest(BaseModel):
             "baseLlmModel": obj.get("baseLlmModel"),
             "documentUrls": obj.get("documentUrls"),
             "generators": obj.get("generators"),
-            "h2ogpteCollectionId": obj.get("h2ogpteCollectionId"),
-            "topics": obj.get("topics")
+            "h2ogpteCollectionId": obj.get("h2ogpteCollectionId")
         })
         return _obj
 

eval_studio_client/api/models/required_the_test_case_to_update.py

@@ -38,8 +38,7 @@ class RequiredTheTestCaseToUpdate(BaseModel):
     answer: Optional[StrictStr] = Field(default=None, description="Expected answer text. Model output.")
     constraints: Optional[List[StrictStr]] = Field(default=None, description="Constraints on the model output.")
     condition: Optional[StrictStr] = Field(default=None, description="Optional. Test case output condition, in a form of AIP-160 compliant filter expression.")
-    perturbed_by: Optional[List[StrictStr]] = Field(default=None, description="Output only. The list of perturbators applied to this test case.", alias="perturbedBy")
-    __properties: ClassVar[List[str]] = ["createTime", "creator", "updateTime", "updater", "deleteTime", "deleter", "parent", "prompt", "answer", "constraints", "condition", "perturbedBy"]
+    __properties: ClassVar[List[str]] = ["createTime", "creator", "updateTime", "updater", "deleteTime", "deleter", "parent", "prompt", "answer", "constraints", "condition"]
 
     model_config = ConfigDict(
         populate_by_name=True,
@@ -77,7 +76,6 @@ class RequiredTheTestCaseToUpdate(BaseModel):
         * OpenAPI `readOnly` fields are excluded.
         * OpenAPI `readOnly` fields are excluded.
         * OpenAPI `readOnly` fields are excluded.
-        * OpenAPI `readOnly` fields are excluded.
         """
         excluded_fields: Set[str] = set([
             "create_time",
@@ -86,7 +84,6 @@ class RequiredTheTestCaseToUpdate(BaseModel):
             "updater",
             "delete_time",
             "deleter",
-            "perturbed_by",
         ])
 
         _dict = self.model_dump(
@@ -116,8 +113,7 @@ class RequiredTheTestCaseToUpdate(BaseModel):
             "prompt": obj.get("prompt"),
             "answer": obj.get("answer"),
             "constraints": obj.get("constraints"),
-            "condition": obj.get("condition"),
-            "perturbedBy": obj.get("perturbedBy")
+            "condition": obj.get("condition")
         })
         return _obj
 

eval_studio_client/api/models/test_service_generate_test_cases_request.py

@@ -32,8 +32,7 @@ class TestServiceGenerateTestCasesRequest(BaseModel):
     base_llm_model: Optional[StrictStr] = Field(default=None, description="Optional. The base LLM model to use for generating the prompts. Selected automatically if not specified.", alias="baseLlmModel")
     generators: Optional[List[V1TestCasesGenerator]] = Field(default=None, description="Optional. Generators to use for generation. If not specified, all generators are selected.")
     h2ogpte_collection_id: Optional[StrictStr] = Field(default=None, description="Optional. The ID of the h2oGPTe collection to use. If empty, new temporary collection will be created.", alias="h2ogpteCollectionId")
-    topics: Optional[List[StrictStr]] = Field(default=None, description="Optional. Optional. Topics to generate questions for. If not specified, use document summarization as topic generation.")
-    __properties: ClassVar[List[str]] = ["count", "model", "baseLlmModel", "generators", "h2ogpteCollectionId", "topics"]
+    __properties: ClassVar[List[str]] = ["count", "model", "baseLlmModel", "generators", "h2ogpteCollectionId"]
 
     model_config = ConfigDict(
         populate_by_name=True,
@@ -90,8 +89,7 @@ class TestServiceGenerateTestCasesRequest(BaseModel):
             "model": obj.get("model"),
             "baseLlmModel": obj.get("baseLlmModel"),
             "generators": obj.get("generators"),
-            "h2ogpteCollectionId": obj.get("h2ogpteCollectionId"),
-            "topics": obj.get("topics")
+            "h2ogpteCollectionId": obj.get("h2ogpteCollectionId")
         })
         return _obj
 

eval_studio_client/api/models/test_service_perturb_test_request.py

@@ -30,8 +30,7 @@ class TestServicePerturbTestRequest(BaseModel):
     perturbator_configurations: Optional[List[V1PerturbatorConfiguration]] = Field(default=None, description="Required. PerturbatorConfigurations to apply to the Test.", alias="perturbatorConfigurations")
     new_test_display_name: Optional[StrictStr] = Field(default=None, description="Required. Name of the newly created test.", alias="newTestDisplayName")
     new_test_description: Optional[StrictStr] = Field(default=None, description="Optional. Description of the newly created Test.", alias="newTestDescription")
-    test_case_names: Optional[List[StrictStr]] = Field(default=None, description="Optional. Perturbation apply only to selected testCases.", alias="testCaseNames")
-    __properties: ClassVar[List[str]] = ["perturbatorConfigurations", "newTestDisplayName", "newTestDescription", "testCaseNames"]
+    __properties: ClassVar[List[str]] = ["perturbatorConfigurations", "newTestDisplayName", "newTestDescription"]
 
     model_config = ConfigDict(
         populate_by_name=True,
@@ -93,8 +92,7 @@ class TestServicePerturbTestRequest(BaseModel):
         _obj = cls.model_validate({
             "perturbatorConfigurations": [V1PerturbatorConfiguration.from_dict(_item) for _item in obj["perturbatorConfigurations"]] if obj.get("perturbatorConfigurations") is not None else None,
             "newTestDisplayName": obj.get("newTestDisplayName"),
-            "newTestDescription": obj.get("newTestDescription"),
-            "testCaseNames": obj.get("testCaseNames")
+            "newTestDescription": obj.get("newTestDescription")
         })
         return _obj
 

eval_studio_client/api/models/v1_create_evaluation_request.py

@@ -37,8 +37,7 @@ class V1CreateEvaluationRequest(BaseModel):
     evaluators_parameters: Optional[Dict[str, StrictStr]] = Field(default=None, description="Optional. Additional evaluators configuration, for all the evaluators used in the evaluation. Key is the evaluator identifier, and the value is a JSON string containing the configuration dictionary.", alias="evaluatorsParameters")
     model_parameters: Optional[StrictStr] = Field(default=None, description="Optional. Parameters overrides in JSON format.", alias="modelParameters")
     h2ogpte_collection: Optional[StrictStr] = Field(default=None, description="The existing collection name in H2OGPTe.", alias="h2ogpteCollection")
-    default_h2ogpte_model: Optional[V1Model] = Field(default=None, alias="defaultH2ogpteModel")
-    __properties: ClassVar[List[str]] = ["evaluatorIdentifiers", "model", "evaluationTests", "operation", "llmModels", "useCache", "evaluatorsParameters", "modelParameters", "h2ogpteCollection", "defaultH2ogpteModel"]
+    __properties: ClassVar[List[str]] = ["evaluatorIdentifiers", "model", "evaluationTests", "operation", "llmModels", "useCache", "evaluatorsParameters", "modelParameters", "h2ogpteCollection"]
 
     model_config = ConfigDict(
         populate_by_name=True,
@@ -89,9 +88,6 @@ class V1CreateEvaluationRequest(BaseModel):
                 if _item:
                     _items.append(_item.to_dict())
             _dict['evaluationTests'] = _items
-        # override the default output from pydantic by calling `to_dict()` of default_h2ogpte_model
-        if self.default_h2ogpte_model:
-            _dict['defaultH2ogpteModel'] = self.default_h2ogpte_model.to_dict()
         return _dict
 
     @classmethod
@@ -112,8 +108,7 @@ class V1CreateEvaluationRequest(BaseModel):
             "useCache": obj.get("useCache"),
             "evaluatorsParameters": obj.get("evaluatorsParameters"),
             "modelParameters": obj.get("modelParameters"),
-            "h2ogpteCollection": obj.get("h2ogpteCollection"),
-            "defaultH2ogpteModel": V1Model.from_dict(obj["defaultH2ogpteModel"]) if obj.get("defaultH2ogpteModel") is not None else None
+            "h2ogpteCollection": obj.get("h2ogpteCollection")
         })
         return _obj
 

eval_studio_client/api/models/v1_import_evaluation_request.py

@@ -32,8 +32,7 @@ class V1ImportEvaluationRequest(BaseModel):
     test_lab: Optional[StrictStr] = Field(default=None, description="Required. The JSON representation of the pre-built test-lab.", alias="testLab")
     operation: Optional[StrictStr] = Field(default=None, description="Required. Resource name of the long-running operation.")
     evaluators_parameters: Optional[Dict[str, StrictStr]] = Field(default=None, description="Optional. Additional evaluators configuration, for all the evaluators used in the evaluation. Key is the evaluator identifier, and the value is a JSON string containing the configuration dictionary.", alias="evaluatorsParameters")
-    default_h2ogpte_model: Optional[V1Model] = Field(default=None, alias="defaultH2ogpteModel")
-    __properties: ClassVar[List[str]] = ["evaluatorIdentifiers", "model", "testLab", "operation", "evaluatorsParameters", "defaultH2ogpteModel"]
+    __properties: ClassVar[List[str]] = ["evaluatorIdentifiers", "model", "testLab", "operation", "evaluatorsParameters"]
 
     model_config = ConfigDict(
         populate_by_name=True,
@@ -77,9 +76,6 @@ class V1ImportEvaluationRequest(BaseModel):
         # override the default output from pydantic by calling `to_dict()` of model
         if self.model:
             _dict['model'] = self.model.to_dict()
-        # override the default output from pydantic by calling `to_dict()` of default_h2ogpte_model
-        if self.default_h2ogpte_model:
-            _dict['defaultH2ogpteModel'] = self.default_h2ogpte_model.to_dict()
         return _dict
 
     @classmethod
@@ -96,8 +92,7 @@ class V1ImportEvaluationRequest(BaseModel):
             "model": V1Model.from_dict(obj["model"]) if obj.get("model") is not None else None,
             "testLab": obj.get("testLab"),
             "operation": obj.get("operation"),
-            "evaluatorsParameters": obj.get("evaluatorsParameters"),
-            "defaultH2ogpteModel": V1Model.from_dict(obj["defaultH2ogpteModel"]) if obj.get("defaultH2ogpteModel") is not None else None
+            "evaluatorsParameters": obj.get("evaluatorsParameters")
         })
         return _obj
 

eval_studio_client/api/models/v1_test_case.py

@@ -39,8 +39,7 @@ class V1TestCase(BaseModel):
     answer: Optional[StrictStr] = Field(default=None, description="Expected answer text. Model output.")
     constraints: Optional[List[StrictStr]] = Field(default=None, description="Constraints on the model output.")
     condition: Optional[StrictStr] = Field(default=None, description="Optional. Test case output condition, in a form of AIP-160 compliant filter expression.")
-    perturbed_by: Optional[List[StrictStr]] = Field(default=None, description="Output only. The list of perturbators applied to this test case.", alias="perturbedBy")
-    __properties: ClassVar[List[str]] = ["name", "createTime", "creator", "updateTime", "updater", "deleteTime", "deleter", "parent", "prompt", "answer", "constraints", "condition", "perturbedBy"]
+    __properties: ClassVar[List[str]] = ["name", "createTime", "creator", "updateTime", "updater", "deleteTime", "deleter", "parent", "prompt", "answer", "constraints", "condition"]
 
     model_config = ConfigDict(
         populate_by_name=True,
@@ -79,7 +78,6 @@ class V1TestCase(BaseModel):
         * OpenAPI `readOnly` fields are excluded.
         * OpenAPI `readOnly` fields are excluded.
         * OpenAPI `readOnly` fields are excluded.
-        * OpenAPI `readOnly` fields are excluded.
         """
         excluded_fields: Set[str] = set([
             "name",
@@ -89,7 +87,6 @@ class V1TestCase(BaseModel):
             "updater",
             "delete_time",
             "deleter",
-            "perturbed_by",
         ])
 
         _dict = self.model_dump(
@@ -120,8 +117,7 @@ class V1TestCase(BaseModel):
             "prompt": obj.get("prompt"),
             "answer": obj.get("answer"),
             "constraints": obj.get("constraints"),
-            "condition": obj.get("condition"),
-            "perturbedBy": obj.get("perturbedBy")
+            "condition": obj.get("condition")
         })
         return _obj
 

eval_studio_client/api/test/test_perturbation_service_create_perturbation_request.py

@@ -56,32 +56,14 @@ class TestPerturbationServiceCreatePerturbationRequest(unittest.TestCase):
                         constraints = [
                             ''
                             ], 
-                        condition = '', 
-                        perturbed_by = [
-                            ''
-                            ], )
+                        condition = '', )
                     ],
                 test_case_relationships = [
                     eval_studio_client.api.models.v1_test_case_relationship.v1TestCaseRelationship(
                         source = '', 
                         target = '', 
                         type = '', )
-                    ],
-                default_h2ogpte_model = eval_studio_client.api.models.v1_model.v1Model(
-                    name = '', 
-                    create_time = datetime.datetime.strptime('2013-10-20 19:20:30.00', '%Y-%m-%d %H:%M:%S.%f'), 
-                    creator = '', 
-                    update_time = datetime.datetime.strptime('2013-10-20 19:20:30.00', '%Y-%m-%d %H:%M:%S.%f'), 
-                    updater = '', 
-                    delete_time = datetime.datetime.strptime('2013-10-20 19:20:30.00', '%Y-%m-%d %H:%M:%S.%f'), 
-                    deleter = '', 
-                    display_name = '', 
-                    description = '', 
-                    url = '', 
-                    api_key = '', 
-                    type = 'MODEL_TYPE_UNSPECIFIED', 
-                    parameters = '', 
-                    demo = True, )
+                    ]
             )
         else:
             return PerturbationServiceCreatePerturbationRequest(

eval_studio_client/api/test/test_prompt_generation_service_auto_generate_prompts_request.py

@@ -59,10 +59,7 @@ class TestPromptGenerationServiceAutoGeneratePromptsRequest(unittest.TestCase):
                 generators = [
                     'TEST_CASES_GENERATOR_UNSPECIFIED'
                     ],
-                h2ogpte_collection_id = '',
-                topics = [
-                    ''
-                    ]
+                h2ogpte_collection_id = ''
             )
         else:
             return PromptGenerationServiceAutoGeneratePromptsRequest(