eval-studio-client 1.2.5__py3-none-any.whl → 1.3.0a1__py3-none-any.whl

eval_studio_client/api/docs/V1MetricAverage.md

@@ -0,0 +1,36 @@
+# V1MetricAverage
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**metric_key** | **str** | Metric key. | [optional] 
+**baseline_avg** | **float** | Baseline average. | [optional] 
+**current_avg** | **float** | Current average. | [optional] 
+**diff** | **float** | Difference between current and baseline. | [optional] 
+**baseline_better_wins** | **int** | Baseline better wins count. | [optional] 
+**current_better_wins** | **int** | Current better wins count. | [optional] 
+**baseline_rank_avg** | **float** | Baseline rank average. | [optional] 
+**current_rank_avg** | **float** | Current rank average. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_metric_average import V1MetricAverage
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1MetricAverage from a JSON string
+v1_metric_average_instance = V1MetricAverage.from_json(json)
+# print the JSON string representation of the object
+print(V1MetricAverage.to_json())
+
+# convert the object into a dict
+v1_metric_average_dict = v1_metric_average_instance.to_dict()
+# create an instance of V1MetricAverage from a dict
+v1_metric_average_from_dict = V1MetricAverage.from_dict(v1_metric_average_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1MetricMeta.md

@@ -0,0 +1,40 @@
+# V1MetricMeta
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**key** | **str** | Metric key. | [optional] 
+**display_name** | **str** | Display name. | [optional] 
+**data_type** | **str** | Data type. | [optional] 
+**display_value** | **str** | Display value format. | [optional] 
+**description** | **str** | Description. | [optional] 
+**value_range** | **List[float]** | Value range (min, max). | [optional] 
+**value_enum** | **List[str]** | Value enum (null if not applicable). | [optional] 
+**higher_is_better** | **bool** | Whether higher is better. | [optional] 
+**threshold** | **float** | Threshold value. | [optional] 
+**is_primary_metric** | **bool** | Is primary metric. | [optional] 
+**parent_metric** | **str** | Parent metric. | [optional] 
+**exclude** | **bool** | Exclude flag. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_metric_meta import V1MetricMeta
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1MetricMeta from a JSON string
+v1_metric_meta_instance = V1MetricMeta.from_json(json)
+# print the JSON string representation of the object
+print(V1MetricMeta.to_json())
+
+# convert the object into a dict
+v1_metric_meta_dict = v1_metric_meta_instance.to_dict()
+# create an instance of V1MetricMeta from a dict
+v1_metric_meta_from_dict = V1MetricMeta.from_dict(v1_metric_meta_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1MetricScore.md

@@ -7,7 +7,7 @@ MetricScore represents the metric score.
 Name | Type | Description | Notes
 ------------ | ------------- | ------------- | -------------
 **key** | **str** | Required. Metric key. | [optional] 
-**value** | **float** | Required. Metric value - consider NaN, Infinity or -Infinity for float representation. | [optional] 
+**value** | **float** | Optional. Metric value. May be omitted if the metric could not be computed. Valid values include normal floats, as well as special values: NaN, Infinity, or -Infinity. | [optional] 
 
 ## Example
 

eval_studio_client/api/docs/V1MetricScores.md

@@ -5,7 +5,7 @@
 
 Name | Type | Description | Notes
 ------------ | ------------- | ------------- | -------------
-**scores** | [**List[V1MetricScore]**](V1MetricScore.md) | Required. The metric scores. | [optional] 
+**scores** | [**List[V1MetricScore]**](V1MetricScore.md) | Repeated. List of metric scores. | [optional] 
 
 ## Example
 

eval_studio_client/api/docs/V1ModelType.md

@@ -1,6 +1,6 @@
 # V1ModelType
 
- - MODEL_TYPE_UNSPECIFIED: Unspecified type.  - MODEL_TYPE_H2OGPTE_RAG: h2oGPTe RAG.  - MODEL_TYPE_OPENAI_RAG: OpenAI Assistant RAG.  - MODEL_TYPE_H2OGPTE_LLM: h2oGPTe LLM.  - MODEL_TYPE_H2OGPT_LLM: h2oGPT LLM.  - MODEL_TYPE_OPENAI_CHAT: OpenAI chat.  - MODEL_TYPE_AZURE_OPENAI_CHAT: Microsoft Azure hosted OpenAI Chat.  - MODEL_TYPE_OPENAI_API_CHAT: OpenAI API chat.  - MODEL_TYPE_H2OLLMOPS: H2O LLMOps.  - MODEL_TYPE_OLLAMA: Ollama.  - MODEL_TYPE_AMAZON_BEDROCK: Amazon Bedrock.
+ - MODEL_TYPE_UNSPECIFIED: Unspecified type.  - MODEL_TYPE_H2OGPTE_RAG: h2oGPTe RAG.  - MODEL_TYPE_OPENAI_RAG: OpenAI Assistant RAG.  - MODEL_TYPE_H2OGPTE_LLM: h2oGPTe LLM.  - MODEL_TYPE_H2OGPT_LLM: h2oGPT LLM.  - MODEL_TYPE_OPENAI_CHAT: OpenAI chat.  - MODEL_TYPE_AZURE_OPENAI_CHAT: Microsoft Azure hosted OpenAI Chat.  - MODEL_TYPE_OPENAI_API_CHAT: OpenAI API chat.  - MODEL_TYPE_H2OLLMOPS: H2O LLMOps.  - MODEL_TYPE_OLLAMA: Ollama.  - MODEL_TYPE_AMAZON_BEDROCK: Amazon Bedrock.  - MODEL_TYPE_ANTHROPIC_CLAUDE: Anthropic Claude chat.
 
 ## Properties
 

eval_studio_client/api/docs/V1ModelsComparisons.md

@@ -0,0 +1,32 @@
+# V1ModelsComparisons
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**test_case_ranks_baseline** | **int** | Test case ranks for baseline. | [optional] 
+**test_case_ranks_current** | **int** | Test case ranks for current. | [optional] 
+**test_case_wins_baseline** | **int** | Test case wins for baseline. | [optional] 
+**test_case_wins_current** | **int** | Test case wins for current. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_models_comparisons import V1ModelsComparisons
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1ModelsComparisons from a JSON string
+v1_models_comparisons_instance = V1ModelsComparisons.from_json(json)
+# print the JSON string representation of the object
+print(V1ModelsComparisons.to_json())
+
+# convert the object into a dict
+v1_models_comparisons_dict = v1_models_comparisons_instance.to_dict()
+# create an instance of V1ModelsComparisons from a dict
+v1_models_comparisons_from_dict = V1ModelsComparisons.from_dict(v1_models_comparisons_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1ModelsComparisonsMetrics.md

@@ -0,0 +1,33 @@
+# V1ModelsComparisonsMetrics
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**metrics_ranks_baseline** | **float** | Metrics ranks for baseline. | [optional] 
+**metrics_ranks_current** | **float** | Metrics ranks for current. | [optional] 
+**metrics_wins_baseline** | **int** | Metrics wins for baseline. | [optional] 
+**metrics_wins_current** | **int** | Metrics wins for current. | [optional] 
+**metrics_averages** | [**List[V1MetricAverage]**](V1MetricAverage.md) | Metrics averages. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_models_comparisons_metrics import V1ModelsComparisonsMetrics
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1ModelsComparisonsMetrics from a JSON string
+v1_models_comparisons_metrics_instance = V1ModelsComparisonsMetrics.from_json(json)
+# print the JSON string representation of the object
+print(V1ModelsComparisonsMetrics.to_json())
+
+# convert the object into a dict
+v1_models_comparisons_metrics_dict = v1_models_comparisons_metrics_instance.to_dict()
+# create an instance of V1ModelsComparisonsMetrics from a dict
+v1_models_comparisons_metrics_from_dict = V1ModelsComparisonsMetrics.from_dict(v1_models_comparisons_metrics_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1ModelsOverview.md

@@ -0,0 +1,34 @@
+# V1ModelsOverview
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**baseline_model_key** | **str** | Baseline model key. | [optional] 
+**current_model_key** | **str** | Current model key. | [optional] 
+**baseline_model_name** | **str** | Baseline model name. | [optional] 
+**baseline_collection_id** | **List[str]** | Baseline collection IDs. | [optional] 
+**current_model_name** | **str** | Current model name. | [optional] 
+**current_collection_id** | **List[str]** | Current collection IDs. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_models_overview import V1ModelsOverview
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1ModelsOverview from a JSON string
+v1_models_overview_instance = V1ModelsOverview.from_json(json)
+# print the JSON string representation of the object
+print(V1ModelsOverview.to_json())
+
+# convert the object into a dict
+v1_models_overview_dict = v1_models_overview_instance.to_dict()
+# create an instance of V1ModelsOverview from a dict
+v1_models_overview_from_dict = V1ModelsOverview.from_dict(v1_models_overview_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1Operation.md

@@ -17,6 +17,7 @@ Name | Type | Description | Notes
 **done** | **bool** | If the value is `false`, it means the operation is still in progress. If `true`, the operation is completed, and either `error` or `response` is available. | [optional] 
 **error** | [**RpcStatus**](RpcStatus.md) |  | [optional] 
 **response** | [**ProtobufAny**](ProtobufAny.md) |  | [optional] 
+**seen_by_creator_time** | **datetime** | Output only. Optional. Timestamp when the creator marked the Operation as seen. Once set, this field cannot be changed. Set via MarkOperationSeenByCreator method. | [optional] [readonly] 
 
 ## Example
 

eval_studio_client/api/docs/V1OperationView.md

@@ -0,0 +1,12 @@
+# V1OperationView
+
+ - OPERATION_VIEW_UNSPECIFIED: Default / unset value. The API will default to the OPERATION_VIEW_FULL.  - OPERATION_VIEW_BASIC: Include basic metadata about the Operation, but not the response.  - OPERATION_VIEW_FULL: Include everything.
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1RetrievedContextDiff.md

@@ -0,0 +1,36 @@
+# V1RetrievedContextDiff
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**chunks** | **List[str]** | Context chunks. | [optional] 
+**chunks_count** | **int** | Chunk count. | [optional] 
+**common_chunks** | **List[str]** | Common chunks between baseline and current. | [optional] 
+**common_count** | **int** | Common chunk count. | [optional] 
+**unique_chunks** | **List[str]** | Unique chunks. | [optional] 
+**unique_count** | **int** | Unique chunk count. | [optional] 
+**identical** | **bool** | Whether contexts are identical. | [optional] 
+**chunk_similarity** | **Dict[str, float]** | Chunk similarity scores. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_retrieved_context_diff import V1RetrievedContextDiff
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1RetrievedContextDiff from a JSON string
+v1_retrieved_context_diff_instance = V1RetrievedContextDiff.from_json(json)
+# print the JSON string representation of the object
+print(V1RetrievedContextDiff.to_json())
+
+# convert the object into a dict
+v1_retrieved_context_diff_dict = v1_retrieved_context_diff_instance.to_dict()
+# create an instance of V1RetrievedContextDiff from a dict
+v1_retrieved_context_diff_from_dict = V1RetrievedContextDiff.from_dict(v1_retrieved_context_diff_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1Stats.md

@@ -9,6 +9,8 @@ Name | Type | Description | Notes
 **topic_modeling_pending_jobs** | **str** | Number of pending jobs in the topic modeling queue. It's marked as optional to always be part of the response, even when the value is zero. | [optional] 
 **test_validation_pending_jobs** | **str** | Number of pending jobs in the test validation queue. It's marked as optional to always be part of the response, even when the value is zero. | [optional] 
 **failure_clustering_pending_jobs** | **str** | Number of pending jobs in the failure clustering queue. It's marked as optional to always be part of the response, even when the value is zero. | [optional] 
+**test_case_import_pending_jobs** | **str** | Number of pending jobs in the test case import queue. It's marked as optional to always be part of the response, even when the value is zero. | [optional] 
+**evaluation_worker_queue_length** | **str** | Number of pending jobs in the evaluation worker queue. It's marked as optional to always be part of the response, even when the value is zero. | [optional] 
 
 ## Example
 

eval_studio_client/api/docs/V1TechnicalMetrics.md

@@ -0,0 +1,30 @@
+# V1TechnicalMetrics
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**baseline** | [**V1TechnicalMetricsDetail**](V1TechnicalMetricsDetail.md) |  | [optional] 
+**current** | [**V1TechnicalMetricsDetail**](V1TechnicalMetricsDetail.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_technical_metrics import V1TechnicalMetrics
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1TechnicalMetrics from a JSON string
+v1_technical_metrics_instance = V1TechnicalMetrics.from_json(json)
+# print the JSON string representation of the object
+print(V1TechnicalMetrics.to_json())
+
+# convert the object into a dict
+v1_technical_metrics_dict = v1_technical_metrics_instance.to_dict()
+# create an instance of V1TechnicalMetrics from a dict
+v1_technical_metrics_from_dict = V1TechnicalMetrics.from_dict(v1_technical_metrics_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1TechnicalMetricsDetail.md

@@ -0,0 +1,33 @@
+# V1TechnicalMetricsDetail
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**cost_sum** | **float** | Sum of costs. | [optional] 
+**duration_sum** | **float** | Sum of durations. | [optional] 
+**duration_min** | **float** | Minimum duration. | [optional] 
+**duration_max** | **float** | Maximum duration. | [optional] 
+**duration_avg** | **float** | Average duration. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_technical_metrics_detail import V1TechnicalMetricsDetail
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1TechnicalMetricsDetail from a JSON string
+v1_technical_metrics_detail_instance = V1TechnicalMetricsDetail.from_json(json)
+# print the JSON string representation of the object
+print(V1TechnicalMetricsDetail.to_json())
+
+# convert the object into a dict
+v1_technical_metrics_detail_dict = v1_technical_metrics_detail_instance.to_dict()
+# create an instance of V1TechnicalMetricsDetail from a dict
+v1_technical_metrics_detail_from_dict = V1TechnicalMetricsDetail.from_dict(v1_technical_metrics_detail_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1TestCaseLeaderboardItem.md

@@ -0,0 +1,31 @@
+# V1TestCaseLeaderboardItem
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**wins** | **int** | Number of wins. | [optional] 
+**question** | **str** | Question text. | [optional] 
+**changed_metrics_count** | **int** | Count of changed metrics. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_test_case_leaderboard_item import V1TestCaseLeaderboardItem
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1TestCaseLeaderboardItem from a JSON string
+v1_test_case_leaderboard_item_instance = V1TestCaseLeaderboardItem.from_json(json)
+# print the JSON string representation of the object
+print(V1TestCaseLeaderboardItem.to_json())
+
+# convert the object into a dict
+v1_test_case_leaderboard_item_dict = v1_test_case_leaderboard_item_instance.to_dict()
+# create an instance of V1TestCaseLeaderboardItem from a dict
+v1_test_case_leaderboard_item_from_dict = V1TestCaseLeaderboardItem.from_dict(v1_test_case_leaderboard_item_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1TestCaseRelationshipInfo.md

@@ -0,0 +1,31 @@
+# V1TestCaseRelationshipInfo
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**type** | **str** | Type of the relationship. | [optional] 
+**target** | **str** | Target of the relationship. | [optional] 
+**target_type** | **str** | Type of the target. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_test_case_relationship_info import V1TestCaseRelationshipInfo
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1TestCaseRelationshipInfo from a JSON string
+v1_test_case_relationship_info_instance = V1TestCaseRelationshipInfo.from_json(json)
+# print the JSON string representation of the object
+print(V1TestCaseRelationshipInfo.to_json())
+
+# convert the object into a dict
+v1_test_case_relationship_info_dict = v1_test_case_relationship_info_instance.to_dict()
+# create an instance of V1TestCaseRelationshipInfo from a dict
+v1_test_case_relationship_info_from_dict = V1TestCaseRelationshipInfo.from_dict(v1_test_case_relationship_info_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1TestCaseResult.md

@@ -0,0 +1,48 @@
+# V1TestCaseResult
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**key** | **str** | Unique key for the test case. | [optional] 
+**input** | **str** | Input text. | [optional] 
+**corpus** | **List[str]** | Corpus URLs. | [optional] 
+**context** | **List[str]** | Context texts. | [optional] 
+**categories** | **List[str]** | Categories. | [optional] 
+**relationships** | [**List[V1TestCaseRelationshipInfo]**](V1TestCaseRelationshipInfo.md) | Relationships. | [optional] 
+**expected_output** | **str** | Expected output. | [optional] 
+**output_constraints** | **List[str]** | Output constraints. | [optional] 
+**output_condition** | **str** | Output condition. | [optional] 
+**actual_output** | **str** | Actual output generated. | [optional] 
+**actual_duration** | **float** | Duration in seconds. | [optional] 
+**cost** | **float** | Cost of evaluation. | [optional] 
+**model_key** | **str** | Model key. | [optional] 
+**test_key** | **str** | Test key. | [optional] 
+**test_case_key** | **str** | Test case key. | [optional] 
+**metrics** | [**List[V1Metric]**](V1Metric.md) | List of metrics. | [optional] 
+**metrics_meta** | **Dict[str, str]** | Metadata for metrics. | [optional] 
+**actual_output_meta** | [**List[V1ActualOutputMeta]**](V1ActualOutputMeta.md) | Actual output metadata. | [optional] 
+**metric_scores** | [**List[V1ComparisonMetricScore]**](V1ComparisonMetricScore.md) | Metric scores. | [optional] 
+**result_error_message** | **str** | Error message if processing resulted in failure. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_test_case_result import V1TestCaseResult
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1TestCaseResult from a JSON string
+v1_test_case_result_instance = V1TestCaseResult.from_json(json)
+# print the JSON string representation of the object
+print(V1TestCaseResult.to_json())
+
+# convert the object into a dict
+v1_test_case_result_dict = v1_test_case_result_instance.to_dict()
+# create an instance of V1TestCaseResult from a dict
+v1_test_case_result_from_dict = V1TestCaseResult.from_dict(v1_test_case_result_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1TextSimilarityMetric.md

@@ -0,0 +1,12 @@
+# V1TextSimilarityMetric
+
+- TEXT_SIMILARITY_METRIC_UNSPECIFIED: Default value - must not be used  - TEXT_SIMILARITY_METRIC_EXACT_MATCH: Exact string matching - sentences must be identical (default)  - TEXT_SIMILARITY_METRIC_COSINE_DISTANCE: Cosine distance of sentence embeddings - semantic similarity  - TEXT_SIMILARITY_METRIC_BERT_SCORE: BERTScore - contextual embeddings similarity using BERT
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1UpdateDashboardTestCaseAnnotationResponse.md

@@ -0,0 +1,29 @@
+# V1UpdateDashboardTestCaseAnnotationResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**dashboard_test_case_annotation** | [**V1DashboardTestCaseAnnotation**](V1DashboardTestCaseAnnotation.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_update_dashboard_test_case_annotation_response import V1UpdateDashboardTestCaseAnnotationResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1UpdateDashboardTestCaseAnnotationResponse from a JSON string
+v1_update_dashboard_test_case_annotation_response_instance = V1UpdateDashboardTestCaseAnnotationResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1UpdateDashboardTestCaseAnnotationResponse.to_json())
+
+# convert the object into a dict
+v1_update_dashboard_test_case_annotation_response_dict = v1_update_dashboard_test_case_annotation_response_instance.to_dict()
+# create an instance of V1UpdateDashboardTestCaseAnnotationResponse from a dict
+v1_update_dashboard_test_case_annotation_response_from_dict = V1UpdateDashboardTestCaseAnnotationResponse.from_dict(v1_update_dashboard_test_case_annotation_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1UpdateLeaderboardTestCaseAnnotationResponse.md

@@ -0,0 +1,29 @@
+# V1UpdateLeaderboardTestCaseAnnotationResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**leaderboard_test_case_annotation** | [**V1LeaderboardTestCaseAnnotation**](V1LeaderboardTestCaseAnnotation.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_update_leaderboard_test_case_annotation_response import V1UpdateLeaderboardTestCaseAnnotationResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1UpdateLeaderboardTestCaseAnnotationResponse from a JSON string
+v1_update_leaderboard_test_case_annotation_response_instance = V1UpdateLeaderboardTestCaseAnnotationResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1UpdateLeaderboardTestCaseAnnotationResponse.to_json())
+
+# convert the object into a dict
+v1_update_leaderboard_test_case_annotation_response_dict = v1_update_leaderboard_test_case_annotation_response_instance.to_dict()
+# create an instance of V1UpdateLeaderboardTestCaseAnnotationResponse from a dict
+v1_update_leaderboard_test_case_annotation_response_from_dict = V1UpdateLeaderboardTestCaseAnnotationResponse.from_dict(v1_update_leaderboard_test_case_annotation_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/WorkflowNodeServiceApi.md

@@ -7,7 +7,7 @@ Method | HTTP request | Description
 [**workflow_node_service_batch_get_workflow_nodes**](WorkflowNodeServiceApi.md#workflow_node_service_batch_get_workflow_nodes) | **GET** /v1/workflows/*/nodes:batchGet | BatchGetWorkflowNodes retrieves all WorkflowNodes with the specified resource names. If any of the WorkflowNodes do not exist an error is returned. Deleted WorkflowNodes are returned without error. The order of resource names in the request and the returned WorkflowNodes might differ.
 [**workflow_node_service_create_workflow_node**](WorkflowNodeServiceApi.md#workflow_node_service_create_workflow_node) | **POST** /v1/{parent}/nodes | CreateWorkflowNode creates a new WorkflowNode.
 [**workflow_node_service_delete_workflow_node**](WorkflowNodeServiceApi.md#workflow_node_service_delete_workflow_node) | **DELETE** /v1/{name_8} | DeleteWorkflowNode deletes a WorkflowNode by name. If the WorkflowNode does not exist an error is returned. The edges are handled in a following way:
-[**workflow_node_service_get_workflow_node**](WorkflowNodeServiceApi.md#workflow_node_service_get_workflow_node) | **GET** /v1/{name_11} | GetWorkflowNode retrieves a WorkflowNode by name. Deleted WorkflowNode is returned without error, it has a delete_time and deleter fields set.
+[**workflow_node_service_get_workflow_node**](WorkflowNodeServiceApi.md#workflow_node_service_get_workflow_node) | **GET** /v1/{name_12} | GetWorkflowNode retrieves a WorkflowNode by name. Deleted WorkflowNode is returned without error, it has a delete_time and deleter fields set.
 [**workflow_node_service_get_workflow_node_prerequisites**](WorkflowNodeServiceApi.md#workflow_node_service_get_workflow_node_prerequisites) | **GET** /v1/{name}:getPrerequisites | GetWorkflowNodePrerequisites retrieves the WorkflowNodes and WorkflowEdges that are the prerequisites of the specified WorkflowNode. The list might be empty. Large data might be stored in storage and not returned in the response. It is client's responsibility to retrieve the data from storage using the content handlers. It is intended to be used by the Eval Studio Workers.
 [**workflow_node_service_init_workflow_node**](WorkflowNodeServiceApi.md#workflow_node_service_init_workflow_node) | **POST** /v1/{name}:init | InitWorkflowNode initializes a WorkflowNode on first access.
 [**workflow_node_service_process_workflow_node**](WorkflowNodeServiceApi.md#workflow_node_service_process_workflow_node) | **POST** /v1/{name}:process | ProcessWorkflowNode processes a WorkflowNode.
@@ -224,7 +224,7 @@ No authorization required
 [[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
 
 # **workflow_node_service_get_workflow_node**
-> V1GetWorkflowNodeResponse workflow_node_service_get_workflow_node(name_11, view=view)
+> V1GetWorkflowNodeResponse workflow_node_service_get_workflow_node(name_12, view=view)
 
 GetWorkflowNode retrieves a WorkflowNode by name. Deleted WorkflowNode is returned without error, it has a delete_time and deleter fields set.
 
@@ -248,12 +248,12 @@ configuration = eval_studio_client.api.Configuration(
 with eval_studio_client.api.ApiClient(configuration) as api_client:
     # Create an instance of the API class
     api_instance = eval_studio_client.api.WorkflowNodeServiceApi(api_client)
-    name_11 = 'name_11_example' # str | Required. The name of the WorkflowNode to retrieve.
+    name_12 = 'name_12_example' # str | Required. The name of the WorkflowNode to retrieve.
     view = 'WORKFLOW_NODE_VIEW_UNSPECIFIED' # str | Optional. The level of detail to include in the response.   - WORKFLOW_NODE_VIEW_UNSPECIFIED: Unspecified view.  - WORKFLOW_NODE_VIEW_BASIC: Basic view. Lacks large data fields. TODO: describe what fields are omitted.  - WORKFLOW_NODE_VIEW_FULL: Full view. Contains all fields. (optional) (default to 'WORKFLOW_NODE_VIEW_UNSPECIFIED')
 
     try:
         # GetWorkflowNode retrieves a WorkflowNode by name. Deleted WorkflowNode is returned without error, it has a delete_time and deleter fields set.
-        api_response = api_instance.workflow_node_service_get_workflow_node(name_11, view=view)
+        api_response = api_instance.workflow_node_service_get_workflow_node(name_12, view=view)
         print("The response of WorkflowNodeServiceApi->workflow_node_service_get_workflow_node:\n")
         pprint(api_response)
     except Exception as e:
@@ -267,7 +267,7 @@ with eval_studio_client.api.ApiClient(configuration) as api_client:
 
 Name | Type | Description  | Notes
 ------------- | ------------- | ------------- | -------------
- **name_11** | **str**| Required. The name of the WorkflowNode to retrieve. | 
+ **name_12** | **str**| Required. The name of the WorkflowNode to retrieve. | 
  **view** | **str**| Optional. The level of detail to include in the response.   - WORKFLOW_NODE_VIEW_UNSPECIFIED: Unspecified view.  - WORKFLOW_NODE_VIEW_BASIC: Basic view. Lacks large data fields. TODO: describe what fields are omitted.  - WORKFLOW_NODE_VIEW_FULL: Full view. Contains all fields. | [optional] [default to 'WORKFLOW_NODE_VIEW_UNSPECIFIED']
 
 ### Return type

eval_studio_client/api/docs/WorkflowServiceApi.md

@@ -10,7 +10,7 @@ Method | HTTP request | Description
 [**workflow_service_delete_workflow**](WorkflowServiceApi.md#workflow_service_delete_workflow) | **DELETE** /v1/{name_9} | DeleteWorkflow deletes a Workflow by name. If the Workflow does not exist an error is returned.
 [**workflow_service_find_workflows_by_collection_id**](WorkflowServiceApi.md#workflow_service_find_workflows_by_collection_id) | **GET** /v1/workflows:findWorkflowByH2OGPTeCollectionID | FindWorkflowByCollectionID finds a Workflow by used H2OGPTe collection ID.
 [**workflow_service_get_guardrails_configuration**](WorkflowServiceApi.md#workflow_service_get_guardrails_configuration) | **GET** /v1/{name}:getGuardrailsConfiguration | 
-[**workflow_service_get_workflow**](WorkflowServiceApi.md#workflow_service_get_workflow) | **GET** /v1/{name_12} | GetWorkflow retrieves a Workflow by name. Deleted Workflow is returned without error, it has a delete_time and deleter fields set.
+[**workflow_service_get_workflow**](WorkflowServiceApi.md#workflow_service_get_workflow) | **GET** /v1/{name_13} | GetWorkflow retrieves a Workflow by name. Deleted Workflow is returned without error, it has a delete_time and deleter fields set.
 [**workflow_service_grant_workflow_access**](WorkflowServiceApi.md#workflow_service_grant_workflow_access) | **POST** /v1/{name_2}:grantAccess | GrantWorkflowAccess grants access to a Workflow to a subject with a specified role.
 [**workflow_service_list_workflow_access**](WorkflowServiceApi.md#workflow_service_list_workflow_access) | **GET** /v1/{name_2}:listAccess | ListWorkflowAccess lists access to a Workflow.
 [**workflow_service_list_workflow_dependencies**](WorkflowServiceApi.md#workflow_service_list_workflow_dependencies) | **GET** /v1/{name}:nodeDependencies | ListWorkflowDependencies lists workflow nodes and map of the node dependencies.
@@ -427,7 +427,7 @@ No authorization required
 [[Back to top]](#) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to Model list]](../README.md#documentation-for-models) [[Back to README]](../README.md)
 
 # **workflow_service_get_workflow**
-> V1GetWorkflowResponse workflow_service_get_workflow(name_12)
+> V1GetWorkflowResponse workflow_service_get_workflow(name_13)
 
 GetWorkflow retrieves a Workflow by name. Deleted Workflow is returned without error, it has a delete_time and deleter fields set.
 
@@ -451,11 +451,11 @@ configuration = eval_studio_client.api.Configuration(
 with eval_studio_client.api.ApiClient(configuration) as api_client:
     # Create an instance of the API class
     api_instance = eval_studio_client.api.WorkflowServiceApi(api_client)
-    name_12 = 'name_12_example' # str | Required. The name of the Workflow to retrieve.
+    name_13 = 'name_13_example' # str | Required. The name of the Workflow to retrieve.
 
     try:
         # GetWorkflow retrieves a Workflow by name. Deleted Workflow is returned without error, it has a delete_time and deleter fields set.
-        api_response = api_instance.workflow_service_get_workflow(name_12)
+        api_response = api_instance.workflow_service_get_workflow(name_13)
         print("The response of WorkflowServiceApi->workflow_service_get_workflow:\n")
         pprint(api_response)
     except Exception as e:
@@ -469,7 +469,7 @@ with eval_studio_client.api.ApiClient(configuration) as api_client:
 
 Name | Type | Description  | Notes
 ------------- | ------------- | ------------- | -------------
- **name_12** | **str**| Required. The name of the Workflow to retrieve. | 
+ **name_13** | **str**| Required. The name of the Workflow to retrieve. | 
 
 ### Return type