eval-studio-client 1.2.4a2__py3-none-any.whl → 1.3.0__py3-none-any.whl

eval_studio_client/api/docs/V1DashboardTestCaseAnnotation.md

@@ -0,0 +1,36 @@
+# V1DashboardTestCaseAnnotation
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**name** | **str** |  | [optional] [readonly] 
+**create_time** | **datetime** | Output only. Timestamp when the DashboardTestCaseAnnotation was created. | [optional] [readonly] 
+**creator** | **str** | Output only. Name of the user or service that requested creation of the DashboardTestCaseAnnotation. | [optional] [readonly] 
+**update_time** | **datetime** | Output only. Optional. Timestamp when the DashboardTestCaseAnnotation was last updated. | [optional] [readonly] 
+**updater** | **str** | Output only. Optional. Name of the user or service that requested update of the DashboardTestCaseAnnotation. | [optional] [readonly] 
+**parent** | **str** | Parent Dashboard Test Case resource name. e.g.: \"dashboards/<UUID>/testCases/<UUID>\". | [optional] 
+**key** | **str** | Immutable. Annotation key. | [optional] 
+**value** | **object** | Annotation value. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_dashboard_test_case_annotation import V1DashboardTestCaseAnnotation
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1DashboardTestCaseAnnotation from a JSON string
+v1_dashboard_test_case_annotation_instance = V1DashboardTestCaseAnnotation.from_json(json)
+# print the JSON string representation of the object
+print(V1DashboardTestCaseAnnotation.to_json())
+
+# convert the object into a dict
+v1_dashboard_test_case_annotation_dict = v1_dashboard_test_case_annotation_instance.to_dict()
+# create an instance of V1DashboardTestCaseAnnotation from a dict
+v1_dashboard_test_case_annotation_from_dict = V1DashboardTestCaseAnnotation.from_dict(v1_dashboard_test_case_annotation_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1DataFragment.md

@@ -0,0 +1,31 @@
+# V1DataFragment
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**text** | **str** | Text content. | [optional] 
+**metrics** | **Dict[str, float]** | Metrics for this fragment. | [optional] 
+**meta** | **Dict[str, str]** | Additional metadata. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_data_fragment import V1DataFragment
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1DataFragment from a JSON string
+v1_data_fragment_instance = V1DataFragment.from_json(json)
+# print the JSON string representation of the object
+print(V1DataFragment.to_json())
+
+# convert the object into a dict
+v1_data_fragment_dict = v1_data_fragment_instance.to_dict()
+# create an instance of V1DataFragment from a dict
+v1_data_fragment_from_dict = V1DataFragment.from_dict(v1_data_fragment_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1DeepCompareLeaderboardsRequest.md

@@ -0,0 +1,33 @@
+# V1DeepCompareLeaderboardsRequest
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**leaderboard_baseline_name** | **str** | Required. The resource name of the baseline leaderboard to compare against. | [optional] 
+**leaderboard_current_name** | **str** | Required. The resource name of the current leaderboard to compare. | [optional] 
+**text_similarity_metric** | [**V1TextSimilarityMetric**](V1TextSimilarityMetric.md) |  | [optional] 
+**llm_model_baseline_name** | **str** | Required. The baseline LLM model name to compare. | [optional] 
+**llm_model_current_name** | **str** | Required. The current LLM model name to compare. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_deep_compare_leaderboards_request import V1DeepCompareLeaderboardsRequest
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1DeepCompareLeaderboardsRequest from a JSON string
+v1_deep_compare_leaderboards_request_instance = V1DeepCompareLeaderboardsRequest.from_json(json)
+# print the JSON string representation of the object
+print(V1DeepCompareLeaderboardsRequest.to_json())
+
+# convert the object into a dict
+v1_deep_compare_leaderboards_request_dict = v1_deep_compare_leaderboards_request_instance.to_dict()
+# create an instance of V1DeepCompareLeaderboardsRequest from a dict
+v1_deep_compare_leaderboards_request_from_dict = V1DeepCompareLeaderboardsRequest.from_dict(v1_deep_compare_leaderboards_request_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1DeepCompareLeaderboardsResponse.md

@@ -0,0 +1,29 @@
+# V1DeepCompareLeaderboardsResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**leaderboard_cmp_report** | [**V1LeaderboardCmpReport**](V1LeaderboardCmpReport.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_deep_compare_leaderboards_response import V1DeepCompareLeaderboardsResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1DeepCompareLeaderboardsResponse from a JSON string
+v1_deep_compare_leaderboards_response_instance = V1DeepCompareLeaderboardsResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1DeepCompareLeaderboardsResponse.to_json())
+
+# convert the object into a dict
+v1_deep_compare_leaderboards_response_dict = v1_deep_compare_leaderboards_response_instance.to_dict()
+# create an instance of V1DeepCompareLeaderboardsResponse from a dict
+v1_deep_compare_leaderboards_response_from_dict = V1DeepCompareLeaderboardsResponse.from_dict(v1_deep_compare_leaderboards_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1DiffItem.md

@@ -0,0 +1,36 @@
+# V1DiffItem
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**diff_key** | **str** | Unique key identifying the diff (format: \"baseline_id|current_id\"). | [optional] 
+**items** | [**List[V1ComparisonItem]**](V1ComparisonItem.md) | List of comparison items. | [optional] 
+**summary** | [**V1ComparisonSummary**](V1ComparisonSummary.md) |  | [optional] 
+**models_overview** | [**V1ModelsOverview**](V1ModelsOverview.md) |  | [optional] 
+**models_comparisons** | [**V1ModelsComparisons**](V1ModelsComparisons.md) |  | [optional] 
+**models_comparisons_metrics** | [**V1ModelsComparisonsMetrics**](V1ModelsComparisonsMetrics.md) |  | [optional] 
+**technical_metrics** | [**V1TechnicalMetrics**](V1TechnicalMetrics.md) |  | [optional] 
+**test_cases_leaderboard** | [**List[V1TestCaseLeaderboardItem]**](V1TestCaseLeaderboardItem.md) | Test cases leaderboard. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_diff_item import V1DiffItem
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1DiffItem from a JSON string
+v1_diff_item_instance = V1DiffItem.from_json(json)
+# print the JSON string representation of the object
+print(V1DiffItem.to_json())
+
+# convert the object into a dict
+v1_diff_item_dict = v1_diff_item_instance.to_dict()
+# create an instance of V1DiffItem from a dict
+v1_diff_item_from_dict = V1DiffItem.from_dict(v1_diff_item_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1EvaluationType.md

@@ -0,0 +1,12 @@
+# V1EvaluationType
+
+ - EVALUATION_TYPE_UNSPECIFIED: Unspecified type.  - EVALUATION_TYPE_LLM: LLM Evaluation, where evaluated model doesn't retrieve any context.  - EVALUATION_TYPE_RAG: RAG Evaluation, where evaluated model retrieves context from a given collection.  - EVALUATION_TYPE_AGENT: Agent Evaluation, where evaluated model is an agent that can interact with tools.
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1FlippedMetric.md

@@ -0,0 +1,31 @@
+# V1FlippedMetric
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**metric_name** | **str** | Metric name. | [optional] 
+**baseline_value** | **float** | Baseline value. | [optional] 
+**current_value** | **float** | Current value. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_flipped_metric import V1FlippedMetric
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1FlippedMetric from a JSON string
+v1_flipped_metric_instance = V1FlippedMetric.from_json(json)
+# print the JSON string representation of the object
+print(V1FlippedMetric.to_json())
+
+# convert the object into a dict
+v1_flipped_metric_dict = v1_flipped_metric_instance.to_dict()
+# create an instance of V1FlippedMetric from a dict
+v1_flipped_metric_from_dict = V1FlippedMetric.from_dict(v1_flipped_metric_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1GetDashboardReportResponse.md

@@ -0,0 +1,29 @@
+# V1GetDashboardReportResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**dashboard_report** | [**V1DashboardReport**](V1DashboardReport.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_get_dashboard_report_response import V1GetDashboardReportResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1GetDashboardReportResponse from a JSON string
+v1_get_dashboard_report_response_instance = V1GetDashboardReportResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1GetDashboardReportResponse.to_json())
+
+# convert the object into a dict
+v1_get_dashboard_report_response_dict = v1_get_dashboard_report_response_instance.to_dict()
+# create an instance of V1GetDashboardReportResponse from a dict
+v1_get_dashboard_report_response_from_dict = V1GetDashboardReportResponse.from_dict(v1_get_dashboard_report_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1HumanDecision.md

@@ -0,0 +1,12 @@
+# V1HumanDecision
+
+HumanDecision represents the human decision on the result.   - HUMAN_DECISION_UNSPECIFIED: Default value, means no decision has been made.  - HUMAN_DECISION_APPROVED: The result was approved by human.  - HUMAN_DECISION_REJECTED: The result was rejected by human.
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1Info.md

@@ -17,6 +17,7 @@ Name | Type | Description | Notes
 **public_instance** | **bool** | If the Eval Studio instance is public. | [optional] 
 **sharing_enabled** | **bool** | Whether the sharing capability is enabled. | [optional] 
 **experimental_features_enabled** | **bool** | Whether the experimental features are enabled. | [optional] 
+**model_type_allowlist** | **List[str]** | Allowlist of model types for UI that can be hosted in Eval Studio. E.g. MODEL_TYPE_H2OGPTE_RAG, MODEL_TYPE_OPENAI_CHAT, MODEL_TYPE_AMAZON_BEDROCK. Use \"*\" to allow all model types. | [optional] 
 
 ## Example
 

eval_studio_client/api/docs/V1Leaderboard.md

@@ -31,6 +31,7 @@ Name | Type | Description | Notes
 **type** | [**V1LeaderboardType**](V1LeaderboardType.md) |  | [optional] 
 **demo** | **bool** | Output only. Whether the Leaderboard is a demo resource or not. Demo resources are read only. | [optional] [readonly] 
 **test_lab** | **str** | Optional. Resource name of the TestLab if Leaderboard was created from a imported TestLab. | [optional] 
+**evaluation_type** | [**V1EvaluationType**](V1EvaluationType.md) |  | [optional] 
 
 ## Example
 

eval_studio_client/api/docs/V1LeaderboardCmpReport.md

@@ -0,0 +1,30 @@
+# V1LeaderboardCmpReport
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**summary** | **str** | Summary of the comparison. | [optional] 
+**comparison_result** | [**V1ComparisonResult**](V1ComparisonResult.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_leaderboard_cmp_report import V1LeaderboardCmpReport
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1LeaderboardCmpReport from a JSON string
+v1_leaderboard_cmp_report_instance = V1LeaderboardCmpReport.from_json(json)
+# print the JSON string representation of the object
+print(V1LeaderboardCmpReport.to_json())
+
+# convert the object into a dict
+v1_leaderboard_cmp_report_dict = v1_leaderboard_cmp_report_instance.to_dict()
+# create an instance of V1LeaderboardCmpReport from a dict
+v1_leaderboard_cmp_report_from_dict = V1LeaderboardCmpReport.from_dict(v1_leaderboard_cmp_report_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1LeaderboardComparisonItem.md

@@ -0,0 +1,31 @@
+# V1LeaderboardComparisonItem
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**wins** | **int** | Number of wins. | [optional] 
+**question** | **str** | Question text. | [optional] 
+**changed_metrics_count** | **int** | Count of changed metrics. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_leaderboard_comparison_item import V1LeaderboardComparisonItem
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1LeaderboardComparisonItem from a JSON string
+v1_leaderboard_comparison_item_instance = V1LeaderboardComparisonItem.from_json(json)
+# print the JSON string representation of the object
+print(V1LeaderboardComparisonItem.to_json())
+
+# convert the object into a dict
+v1_leaderboard_comparison_item_dict = v1_leaderboard_comparison_item_instance.to_dict()
+# create an instance of V1LeaderboardComparisonItem from a dict
+v1_leaderboard_comparison_item_from_dict = V1LeaderboardComparisonItem.from_dict(v1_leaderboard_comparison_item_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1LeaderboardInfo.md

@@ -0,0 +1,30 @@
+# V1LeaderboardInfo
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**key** | **str** | Unique key identifying the leaderboard pair (format: \"baseline_id|current_id\"). | [optional] 
+**items** | [**List[V1LeaderboardComparisonItem]**](V1LeaderboardComparisonItem.md) | List of leaderboard comparison items. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_leaderboard_info import V1LeaderboardInfo
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1LeaderboardInfo from a JSON string
+v1_leaderboard_info_instance = V1LeaderboardInfo.from_json(json)
+# print the JSON string representation of the object
+print(V1LeaderboardInfo.to_json())
+
+# convert the object into a dict
+v1_leaderboard_info_dict = v1_leaderboard_info_instance.to_dict()
+# create an instance of V1LeaderboardInfo from a dict
+v1_leaderboard_info_from_dict = V1LeaderboardInfo.from_dict(v1_leaderboard_info_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1LeaderboardReportActualOutputMeta.md

@@ -1,13 +1,16 @@
 # V1LeaderboardReportActualOutputMeta
 
-ActualOutputMeta represents the metadata about the actual output.
+ActualOutputMeta represents the metadata about the actual output. Each instance can contain any combination of the fields below.
 
 ## Properties
 
 Name | Type | Description | Notes
 ------------ | ------------- | ------------- | -------------
-**tokenization** | **str** | Output only. Actual output data tokenization like sentence_level_punkt. | [optional] [readonly] 
-**data** | [**List[V1LeaderboardReportActualOutputData]**](V1LeaderboardReportActualOutputData.md) | Output only. Actual output data - list of text fragments coupled with the metric values. | [optional] [readonly] 
+**tokenization** | **str** | Optional. Actual output data tokenization like sentence_level_punkt. | [optional] 
+**data** | [**List[V1LeaderboardReportActualOutputData]**](V1LeaderboardReportActualOutputData.md) | Optional. Actual output data - list of text fragments coupled with the metric values. | [optional] 
+**agent_chat_activity_diagram** | [**V1AgentChatActivityDiagram**](V1AgentChatActivityDiagram.md) |  | [optional] 
+**agent_chat_tools_bar_chart** | [**V1AgentChatToolsBarChart**](V1AgentChatToolsBarChart.md) |  | [optional] 
+**agent_chat_scripts_bar_chart** | [**V1AgentChatScriptsBarChart**](V1AgentChatScriptsBarChart.md) |  | [optional] 
 
 ## Example
 

eval_studio_client/api/docs/V1LeaderboardReportResult.md

@@ -7,21 +7,24 @@ Name | Type | Description | Notes
 ------------ | ------------- | ------------- | -------------
 **key** | **str** | Output only. Composite unique key of the result formed by the model key and test case key. | [optional] [readonly] 
 **input** | **str** | Output only. Input prompt or text to be processed. | [optional] [readonly] 
-**corpus** | **List[str]** | Output only. Collection of corpus documents to be used during evaluation. | [optional] [readonly] 
-**context** | **List[str]** | Output only. List of contextual information or references. | [optional] [readonly] 
-**categories** | **List[str]** | Output only. List of categories or labels for classification. | [optional] [readonly] 
-**relationships** | [**List[V1LeaderboardReportResultRelationship]**](V1LeaderboardReportResultRelationship.md) | Output only. List of relationships or associations between entities. | [optional] [readonly] 
+**corpus** | **List[str]** | Output only. Collection of corpus documents to be used during evaluation. Omitted if LEADERBOARD_REPORT_RESULT_VIEW_SUMMARY is used. | [optional] [readonly] 
+**context** | **List[str]** | Output only. List of contextual information or references. Omitted if LEADERBOARD_REPORT_RESULT_VIEW_SUMMARY is used. | [optional] [readonly] 
+**categories** | **List[str]** | Output only. List of categories or labels for classification. Omitted if LEADERBOARD_REPORT_RESULT_VIEW_SUMMARY is used. | [optional] [readonly] 
+**relationships** | [**List[V1LeaderboardReportResultRelationship]**](V1LeaderboardReportResultRelationship.md) | Output only. List of relationships or associations between entities. Omitted if LEADERBOARD_REPORT_RESULT_VIEW_SUMMARY is used. | [optional] [readonly] 
 **expected_output** | **str** | Output only. Expected output or target result. | [optional] [readonly] 
-**output_constraints** | **List[str]** | Output only. List of constraints that should be applied to the output. | [optional] [readonly] 
-**output_condition** | **str** | Output only. Condition that output should satisfy. | [optional] [readonly] 
+**output_constraints** | **List[str]** | Output only. List of constraints that should be applied to the output. Omitted if LEADERBOARD_REPORT_RESULT_VIEW_SUMMARY is used. | [optional] [readonly] 
+**output_condition** | **str** | Output only. Condition that output should satisfy. Omitted if LEADERBOARD_REPORT_RESULT_VIEW_SUMMARY is used. | [optional] [readonly] 
 **actual_output** | **str** | Output only. Actual output produced by the model. | [optional] [readonly] 
-**actual_duration** | **float** | Output only. Duration of processing in seconds. | [optional] [readonly] 
-**cost** | **float** | Output only. Cost of processing in currency units. | [optional] [readonly] 
+**actual_duration** | **float** | Output only. Duration of processing in seconds. Omitted if LEADERBOARD_REPORT_RESULT_VIEW_SUMMARY is used. | [optional] [readonly] 
+**cost** | **float** | Output only. Cost of processing in currency units. Omitted if LEADERBOARD_REPORT_RESULT_VIEW_SUMMARY is used. | [optional] [readonly] 
 **model_key** | **str** | Output only. Unique identifier for the model used. | [optional] [readonly] 
 **test_case_key** | **str** | Output only. Unique identifier for the test case. | [optional] [readonly] 
 **metrics** | [**List[V1MetricScore]**](V1MetricScore.md) | Optional. All metrics values for the result. | [optional] 
 **result_error_message** | **str** | Output only. Error message if processing resulted in failure. | [optional] [readonly] 
 **actual_output_meta** | [**List[V1LeaderboardReportActualOutputMeta]**](V1LeaderboardReportActualOutputMeta.md) | Output only. Additional metadata about the actual output. | [optional] [readonly] 
+**human_decision** | [**V1HumanDecision**](V1HumanDecision.md) |  | [optional] 
+**comment** | **str** | Output only. Optional comment about the result. | [optional] [readonly] 
+**annotations** | **Dict[str, object]** | Output only. Annotations associated with the test case result. | [optional] [readonly] 
 
 ## Example
 

eval_studio_client/api/docs/V1LeaderboardReportResultView.md

@@ -0,0 +1,12 @@
+# V1LeaderboardReportResultView
+
+ - LEADERBOARD_REPORT_RESULT_VIEW_UNSPECIFIED: Default value. The basic view with essential fields.  - LEADERBOARD_REPORT_RESULT_VIEW_FULL: Full view with all fields populated.  - LEADERBOARD_REPORT_RESULT_VIEW_SUMMARY: Summary view with only key fields.
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1LeaderboardTestCaseAnnotation.md

@@ -0,0 +1,36 @@
+# V1LeaderboardTestCaseAnnotation
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**name** | **str** |  | [optional] [readonly] 
+**create_time** | **datetime** | Output only. Timestamp when the LeaderboardTestCaseAnnotation was created. | [optional] [readonly] 
+**creator** | **str** | Output only. Name of the user or service that requested creation of the LeaderboardTestCaseAnnotation. | [optional] [readonly] 
+**update_time** | **datetime** | Output only. Optional. Timestamp when the LeaderboardTestCaseAnnotation was last updated. | [optional] [readonly] 
+**updater** | **str** | Output only. Optional. Name of the user or service that requested update of the LeaderboardTestCaseAnnotation. | [optional] [readonly] 
+**parent** | **str** | Parent Leaderboard Test Case resource name. e.g.: \"leaderboards/<UUID>/testCases/<UUID>\". | [optional] 
+**key** | **str** | Immutable. Annotation key. | [optional] 
+**value** | **object** | Annotation value. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_leaderboard_test_case_annotation import V1LeaderboardTestCaseAnnotation
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1LeaderboardTestCaseAnnotation from a JSON string
+v1_leaderboard_test_case_annotation_instance = V1LeaderboardTestCaseAnnotation.from_json(json)
+# print the JSON string representation of the object
+print(V1LeaderboardTestCaseAnnotation.to_json())
+
+# convert the object into a dict
+v1_leaderboard_test_case_annotation_dict = v1_leaderboard_test_case_annotation_instance.to_dict()
+# create an instance of V1LeaderboardTestCaseAnnotation from a dict
+v1_leaderboard_test_case_annotation_from_dict = V1LeaderboardTestCaseAnnotation.from_dict(v1_leaderboard_test_case_annotation_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1ListDashboardTestCaseAnnotationsResponse.md

@@ -0,0 +1,29 @@
+# V1ListDashboardTestCaseAnnotationsResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**dashboard_test_case_annotations** | [**List[V1DashboardTestCaseAnnotation]**](V1DashboardTestCaseAnnotation.md) | The list of DashboardTestCaseAnnotations. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_list_dashboard_test_case_annotations_response import V1ListDashboardTestCaseAnnotationsResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1ListDashboardTestCaseAnnotationsResponse from a JSON string
+v1_list_dashboard_test_case_annotations_response_instance = V1ListDashboardTestCaseAnnotationsResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1ListDashboardTestCaseAnnotationsResponse.to_json())
+
+# convert the object into a dict
+v1_list_dashboard_test_case_annotations_response_dict = v1_list_dashboard_test_case_annotations_response_instance.to_dict()
+# create an instance of V1ListDashboardTestCaseAnnotationsResponse from a dict
+v1_list_dashboard_test_case_annotations_response_from_dict = V1ListDashboardTestCaseAnnotationsResponse.from_dict(v1_list_dashboard_test_case_annotations_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1ListLeaderboardTestCaseAnnotationsResponse.md

@@ -0,0 +1,29 @@
+# V1ListLeaderboardTestCaseAnnotationsResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**leaderboard_test_case_annotations** | [**List[V1LeaderboardTestCaseAnnotation]**](V1LeaderboardTestCaseAnnotation.md) | The list of LeaderboardTestCaseAnnotations. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_list_leaderboard_test_case_annotations_response import V1ListLeaderboardTestCaseAnnotationsResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1ListLeaderboardTestCaseAnnotationsResponse from a JSON string
+v1_list_leaderboard_test_case_annotations_response_instance = V1ListLeaderboardTestCaseAnnotationsResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1ListLeaderboardTestCaseAnnotationsResponse.to_json())
+
+# convert the object into a dict
+v1_list_leaderboard_test_case_annotations_response_dict = v1_list_leaderboard_test_case_annotations_response_instance.to_dict()
+# create an instance of V1ListLeaderboardTestCaseAnnotationsResponse from a dict
+v1_list_leaderboard_test_case_annotations_response_from_dict = V1ListLeaderboardTestCaseAnnotationsResponse.from_dict(v1_list_leaderboard_test_case_annotations_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1ListOperationsResponse.md

@@ -6,6 +6,7 @@
 Name | Type | Description | Notes
 ------------ | ------------- | ------------- | -------------
 **operations** | [**List[V1Operation]**](V1Operation.md) | The list of Operations. | [optional] 
+**total_size** | **int** | The total number of Operations that match the request, irrespective of pagination. | [optional] 
 
 ## Example
 

eval_studio_client/api/docs/V1ListUnseenOperationsResponse.md

@@ -0,0 +1,30 @@
+# V1ListUnseenOperationsResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**operations** | [**List[V1Operation]**](V1Operation.md) | The list of Operations that the user has not seen. | [optional] 
+**total_size** | **int** | The total number of unseen Operations that match the request, irrespective of pagination. | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_list_unseen_operations_response import V1ListUnseenOperationsResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1ListUnseenOperationsResponse from a JSON string
+v1_list_unseen_operations_response_instance = V1ListUnseenOperationsResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1ListUnseenOperationsResponse.to_json())
+
+# convert the object into a dict
+v1_list_unseen_operations_response_dict = v1_list_unseen_operations_response_instance.to_dict()
+# create an instance of V1ListUnseenOperationsResponse from a dict
+v1_list_unseen_operations_response_from_dict = V1ListUnseenOperationsResponse.from_dict(v1_list_unseen_operations_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1MarkOperationSeenByCreatorResponse.md

@@ -0,0 +1,29 @@
+# V1MarkOperationSeenByCreatorResponse
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**operation** | [**V1Operation**](V1Operation.md) |  | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_mark_operation_seen_by_creator_response import V1MarkOperationSeenByCreatorResponse
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1MarkOperationSeenByCreatorResponse from a JSON string
+v1_mark_operation_seen_by_creator_response_instance = V1MarkOperationSeenByCreatorResponse.from_json(json)
+# print the JSON string representation of the object
+print(V1MarkOperationSeenByCreatorResponse.to_json())
+
+# convert the object into a dict
+v1_mark_operation_seen_by_creator_response_dict = v1_mark_operation_seen_by_creator_response_instance.to_dict()
+# create an instance of V1MarkOperationSeenByCreatorResponse from a dict
+v1_mark_operation_seen_by_creator_response_from_dict = V1MarkOperationSeenByCreatorResponse.from_dict(v1_mark_operation_seen_by_creator_response_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+

eval_studio_client/api/docs/V1Metric.md

@@ -0,0 +1,30 @@
+# V1Metric
+
+
+## Properties
+
+Name | Type | Description | Notes
+------------ | ------------- | ------------- | -------------
+**key** | **str** | Metric key. | [optional] 
+**value** | **float** | Metric value (optional). | [optional] 
+
+## Example
+
+```python
+from eval_studio_client.api.models.v1_metric import V1Metric
+
+# TODO update the JSON string below
+json = "{}"
+# create an instance of V1Metric from a JSON string
+v1_metric_instance = V1Metric.from_json(json)
+# print the JSON string representation of the object
+print(V1Metric.to_json())
+
+# convert the object into a dict
+v1_metric_dict = v1_metric_instance.to_dict()
+# create an instance of V1Metric from a dict
+v1_metric_from_dict = V1Metric.from_dict(v1_metric_dict)
+```
+[[Back to Model list]](../README.md#documentation-for-models) [[Back to API list]](../README.md#documentation-for-api-endpoints) [[Back to README]](../README.md)
+
+