arize 8.0.0a16__tar.gz → 8.0.0a18__tar.gz

{arize-8.0.0a16 → arize-8.0.0a18}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: arize
-Version: 8.0.0a16
+Version: 8.0.0a18
 Summary: A helper library to interact with Arize AI APIs
 Project-URL: Homepage, https://arize.com
 Project-URL: Documentation, https://docs.arize.com/arize
@@ -99,11 +99,24 @@ Description-Content-Type: text/markdown
   - [Operations on Datasets](#operations-on-datasets)
     - [List Datasets](#list-datasets)
     - [Create a Dataset](#create-a-dataset)
-    - [Get Dataset by ID](#get-dataset-by-id)
+    - [Get Dataset](#get-dataset)
     - [Delete a Dataset](#delete-a-dataset)
-- [Configure Logging](#configure-logging)
-  - [In Code](#in-code)
-  - [Via Environment Variables](#via-environment-variables)
+    - [List Dataset Examples](#list-dataset-examples)
+  - [Operations on Experiments](#operations-on-experiments)
+    - [List Experiments](#list-experiments)
+    - [Run an Experiment](#run-an-experiment)
+    - [Create an Experiment](#create-an-experiment)
+    - [Get an Experiment](#get-an-experiment)
+    - [Delete an Experiment](#delete-an-experiment)
+    - [List Experiment runs](#list-experiment-runs)
+- [SDK Configuration](#sdk-configuration)
+  - [Logging](#logging)
+    - [In Code](#in-code)
+    - [Via Environment Variables](#via-environment-variables)
+  - [Caching](#caching)
+    - [In Code](#in-code-1)
+    - [Via Environment Variables](#via-environment-variables-1)
+    - [Clean the cache](#clean-the-cache)
 - [Community](#community)
 
 # Overview
@@ -398,9 +411,9 @@ dataset_list = resp.datasets
 # Get the response as a dictionary
 resp_dict = resp.to_dict()
 # Get the response in JSON format
-resp_dict = resp.to_json()
+resp_json = resp.to_json()
 # Get the response as a pandas dataframe
-resp_dict = resp.to_df()
+resp_df = resp.to_df()
 ```
 
 ### Create a Dataset
@@ -430,9 +443,10 @@ If the number of examples (rows in dataframe, items in list) is too large, the c
 
 ```python
 created_dataset = client.datasets.create(
-    space_i="<target-space-id>",
+    space_id="<target-space-id>",
     name="<your-dataset-name>", # Name must be unique within a space
     examples=..., # List of dictionaries or pandas dataframe
+    # force_http=... # Optionally pass force_http to create datasets via HTTP instead of gRPC, defaults to False
 )
 ```
 
@@ -445,8 +459,7 @@ dataset_dict = create_dataset.to_dict()
 dataset_dict = create_dataset.to_json()
 ```
 
-
-### Get Dataset by ID
+### Get Dataset
 
 To get a dataset by its ID use `client.datasets.get()`, you can optionally also pass the version ID of a particular version of interest of the dataset. The returned type is `Dataset`.
 
@@ -467,9 +480,167 @@ client.datasets.delete(
 )
 ```
 
-# Configure Logging
+### List Dataset Examples
+
+You can list the examples of a given dataset using `client.datasets.list_examples()` and passing the dataset ID and, optionally, the dataset version ID. You can specify the number of examples desired using the `limit` parameter. If you want a large number of examples, consider using the `all=True` parameter, which will make it so the SDK exports the data using Arrow Flight via gRPC, for increased performance.
+
+```python
+resp = client.datasets.list_examples(
+    dataset_id="your-dataset-id>",
+    dataset_version_id="your-dataset-version-id>", # Optional, defaults to latest version
+    limit=... # number of desired examples. Defaults to 100
+    all=... # Whether or not to export all of the examples. Defaults to False
+)
+```
+
+The response is an object of type `DatasetsExamplesList200Response`, and you can access the list of examples via its `examples` attribute. In addition, you can transform the response object to a dictionary, to JSON format, or a pandas dataframe.
+
+```python
+# Get the list of datasets from the response
+examples_list = resp.examples
+# Get the response as a dictionary
+resp_dict = resp.to_dict()
+# Get the response in JSON format
+resp_json = resp.to_json()
+# Get the response as a pandas dataframe
+resp_df = resp.to_df()
+```
+
+## Operations on Experiments
+
+### List Experiments
+
+You can list all experiments that the user has access to using `client.experiments.list()`. You can use the `limit` parameter to specify the maximum number of datasets desired in the response and you can specify the `dataset_id` to target the list operation to a particular dataset.
+
+```python
+resp = client.experiments.list(
+    limit=... # Optional
+    dataset_id=... # Optional
+)
+```
+
+The response is an object of type `ExperimentsList200Response`, and you can access the list of experiments via its `experiments` attribute. In addition, you can transform the response object to a dictionary, to JSON format, or a pandas dataframe.
+
+```python
+# Get the list of datasets from the response
+experiment_list = resp.experiments 
+# Get the response as a dictionary
+resp_dict = resp.to_dict()
+# Get the response in JSON format
+resp_json = resp.to_json()
+# Get the response as a pandas dataframe
+resp_df = resp.to_df()
+```
+
+### Run an Experiment
+
+You can run an experiment on a dataset using `client.experiments.run()` by defining a task, evaluators (optional), and passing the dataset id of the dataset you want to use, together with a name for the experiment. The function will download the entire dataset from Arize (unless cached, see caching section under "SDK Configuration"), execute the task to obtain an output, and perform evaluations (if evaluators were passed). The experiments will also be traced, and these traces will be visible in Arize. The experiment will be created and the data logged into Arize automatically. You can avoid logging to Arize by making `dry_run=True`. The function will return the `Experiment` object (or `None` if `dry_run=True`) together with the dataframe with the experiment data.
+
+```python
+experiment, experiment_df = client.run_experiment(
+    name="<name-your-experiment>",
+    dataset_id="<id-of-dataset-to-use>",
+    task=... # The task to be performed in the experiment.
+    evaluators=... # Optional: The evaluators to use in the experiment.
+    dry_run=..., # If True, the experiment result will not be uploaded to Arize. Defaults to False
+    dry_run_count=..., # Number of examples of the dataset to use in the dry run. Defaults to 10
+    concurrency=..., # The number of concurrent tasks to run. Defaults to 3.
+    set_global_tracer_provider=..., # If True, sets the global tracer provider for the experiment. Defaults to False
+    exit_on_error=..., # If True, the experiment will stop running on first occurrence of an error. Defaults to False
+) 
+```
+
+The `Experiment` object also counts with convenience method similar to `List***` objects:
+
+```python
+# Get the response as a dictionary
+experiment_dict = create_experiment.to_dict()
+# Get the response in JSON format
+experiment_dict = create_experiment.to_json()
+```
+
+### Create an Experiment
+
+It is possible that you have run the experiment yourself without the above function, and hence you already have experiment data that you want to send to Arize. In this case, use the `client.experiments.create()` method by passing the runs data, we currently don't support creating an empty experiment, for instance, these are 2 rows of runs, as a list of dictionaries. You can also pass a pandas dataframe for the runs data.
+
+> NOTE: If you don't have experiment data and want to run experiment, see the `client.experiments.run()` section above.
+
+```python
+# TODO
+runs = [
+]
+```
+
+In addition, you must specify which columns are the `example_id` and the `result`, you can do so by using the `ExperimentTaskResultFieldNames`. Moreover, if you choose to pass evaluation data, you can indicate the evaluation columns using `EvaluationResultFieldNames`:
+
+```python
+# TODO
+```
+
+If the number of runs (rows in dataframe, items in list) is too large, the client SDK will try to send the data via Arrow Flight via gRPC for better performance. If you want to force the data transfer to HTTP you can use the `force_http` flag. The response is an `Experiment` object.
+
+```python
+created_experiment = client.experiments.create(
+    name="<your-experiment-name>", # Name must be unique within a dataset
+    dataset_id="<desired-dataset-id>",
+    experiment_runs=..., # List of dictionaries or pandas dataframe
+    task_fields=ExperimentTaskResultFieldNames(...),
+    evaluator_columns=... # Optional
+    # force_http=... # Optionally pass force_http to create experiments via HTTP instead of gRPC, defaults to False
+)
+```
+
+### Get an Experiment
+
+To get a dataset by its ID use `client.datasets.get()`, you can optionally also pass the version ID of a particular version of interest of the dataset. The returned type is `Dataset`.
+
+```python
+dataset = client.datasets.get(
+    dataset_id=... # The unique identifier of the dataset
+    dataset_version_id=... # The unique identifier of the dataset version
+)
+```
+
+### Delete an Experiment
+
+To delete an experiment by its ID use `client.experiments.delete()`. The call returns `None` if successful deletion took place, error otherwise.
+
+```python
+client.experiments.delete(
+    experiment_id=... # The unique identifier of the experiment
+)
+```
+
+### List Experiment runs
 
-## In Code
+You can list the runs of a given experiment using `client.experiments.list_runs()` and passing the experiment ID. You can specify the number of runs desired using the `limit` parameter. If you want a large number of runs, consider using the `all=True` parameter, which will make it so the SDK exports the data using Arrow Flight via gRPC, for increased performance.
+
+```python
+resp = client.experiments.list_runs(
+    experiment_id="your-experiment-id>",
+    limit=... # number of desired runs. Defaults to 100
+    all=... # Whether or not to export all of the runs. Defaults to False
+)
+```
+
+The response is an object of type `ExperimentsRunsList200Response`, and you can access the list of runs via its `experiment_runs` attribute. In addition, you can transform the response object to a dictionary, to JSON format, or a pandas dataframe.
+
+```python
+# Get the list of datasets from the response
+run_list = resp.experiments_runs
+# Get the response as a dictionary
+resp_dict = resp.to_dict()
+# Get the response in JSON format
+resp_json = resp.to_json()
+# Get the response as a pandas dataframe
+resp_df = resp.to_df()
+```
+
+# SDK Configuration
+
+## Logging
+
+### In Code
 
 You can use `configure_logging` to set up the logging behavior of the Arize package to your needs. 
 
@@ -482,14 +653,14 @@ configure_logging(
 ) 
 ```
 
-## Via Environment Variables
+### Via Environment Variables
 
 Configure the same options as the section above, via:
 
 ```python
 import os
 
-# You can disable logging altogether
+# Whether or not you want to disable logging altogether
 os.environ["ARIZE_LOG_ENABLE"] = "true" 
 # Set up the logging level
 os.environ["ARIZE_LOG_LEVEL"] = "debug" 
@@ -499,6 +670,38 @@ os.environ["ARIZE_LOG_STRUCTURED"] = "false"
 
 The default behavior of Arize's logs is: enabled, `INFO` level, and not structured.
 
+## Caching
+
+When downloading big segments of data from Arize, such as a `Dataset` with all of its examples, the SDK will cache the file in `parquet` format under `~/.arize/datasets/dataset_<updated_at_timestamp>.parquet`.
+
+### In Code
+
+You can disable caching via the `enable_caching` parameter when instantiating the client, and also edit the "arize directory":
+
+```python
+client = ArizeClient(
+    enable_caching=False, # Optional parameter, defaults to True
+    arize_directory="my-desired-directory", # Optional parameter, defaults to ~/.arize
+)
+```
+
+### Via Environment Variables
+
+You can also configure the above via:
+
+```python
+import os
+
+# Whether or not you want to disable caching
+os.environ["ARIZE_ENABLE_CACHING"] = "true"
+# Where you want the SDK to store the files
+os.environ["ARIZE_DIRECTORY"] = "~/.arize"
+```
+
+### Clean the cache
+
+To clean the cache you can directly `rm` the files or directory.
+
 # Community
 
 Join our community to connect with thousands of AI builders.

{arize-8.0.0a16 → arize-8.0.0a18}/README.md

@@ -35,11 +35,24 @@
   - [Operations on Datasets](#operations-on-datasets)
     - [List Datasets](#list-datasets)
     - [Create a Dataset](#create-a-dataset)
-    - [Get Dataset by ID](#get-dataset-by-id)
+    - [Get Dataset](#get-dataset)
     - [Delete a Dataset](#delete-a-dataset)
-- [Configure Logging](#configure-logging)
-  - [In Code](#in-code)
-  - [Via Environment Variables](#via-environment-variables)
+    - [List Dataset Examples](#list-dataset-examples)
+  - [Operations on Experiments](#operations-on-experiments)
+    - [List Experiments](#list-experiments)
+    - [Run an Experiment](#run-an-experiment)
+    - [Create an Experiment](#create-an-experiment)
+    - [Get an Experiment](#get-an-experiment)
+    - [Delete an Experiment](#delete-an-experiment)
+    - [List Experiment runs](#list-experiment-runs)
+- [SDK Configuration](#sdk-configuration)
+  - [Logging](#logging)
+    - [In Code](#in-code)
+    - [Via Environment Variables](#via-environment-variables)
+  - [Caching](#caching)
+    - [In Code](#in-code-1)
+    - [Via Environment Variables](#via-environment-variables-1)
+    - [Clean the cache](#clean-the-cache)
 - [Community](#community)
 
 # Overview
@@ -334,9 +347,9 @@ dataset_list = resp.datasets
 # Get the response as a dictionary
 resp_dict = resp.to_dict()
 # Get the response in JSON format
-resp_dict = resp.to_json()
+resp_json = resp.to_json()
 # Get the response as a pandas dataframe
-resp_dict = resp.to_df()
+resp_df = resp.to_df()
 ```
 
 ### Create a Dataset
@@ -366,9 +379,10 @@ If the number of examples (rows in dataframe, items in list) is too large, the c
 
 ```python
 created_dataset = client.datasets.create(
-    space_i="<target-space-id>",
+    space_id="<target-space-id>",
     name="<your-dataset-name>", # Name must be unique within a space
     examples=..., # List of dictionaries or pandas dataframe
+    # force_http=... # Optionally pass force_http to create datasets via HTTP instead of gRPC, defaults to False
 )
 ```
 
@@ -381,8 +395,7 @@ dataset_dict = create_dataset.to_dict()
 dataset_dict = create_dataset.to_json()
 ```
 
-
-### Get Dataset by ID
+### Get Dataset
 
 To get a dataset by its ID use `client.datasets.get()`, you can optionally also pass the version ID of a particular version of interest of the dataset. The returned type is `Dataset`.
 
@@ -403,9 +416,167 @@ client.datasets.delete(
 )
 ```
 
-# Configure Logging
+### List Dataset Examples
+
+You can list the examples of a given dataset using `client.datasets.list_examples()` and passing the dataset ID and, optionally, the dataset version ID. You can specify the number of examples desired using the `limit` parameter. If you want a large number of examples, consider using the `all=True` parameter, which will make it so the SDK exports the data using Arrow Flight via gRPC, for increased performance.
+
+```python
+resp = client.datasets.list_examples(
+    dataset_id="your-dataset-id>",
+    dataset_version_id="your-dataset-version-id>", # Optional, defaults to latest version
+    limit=... # number of desired examples. Defaults to 100
+    all=... # Whether or not to export all of the examples. Defaults to False
+)
+```
+
+The response is an object of type `DatasetsExamplesList200Response`, and you can access the list of examples via its `examples` attribute. In addition, you can transform the response object to a dictionary, to JSON format, or a pandas dataframe.
+
+```python
+# Get the list of datasets from the response
+examples_list = resp.examples
+# Get the response as a dictionary
+resp_dict = resp.to_dict()
+# Get the response in JSON format
+resp_json = resp.to_json()
+# Get the response as a pandas dataframe
+resp_df = resp.to_df()
+```
+
+## Operations on Experiments
+
+### List Experiments
+
+You can list all experiments that the user has access to using `client.experiments.list()`. You can use the `limit` parameter to specify the maximum number of datasets desired in the response and you can specify the `dataset_id` to target the list operation to a particular dataset.
+
+```python
+resp = client.experiments.list(
+    limit=... # Optional
+    dataset_id=... # Optional
+)
+```
+
+The response is an object of type `ExperimentsList200Response`, and you can access the list of experiments via its `experiments` attribute. In addition, you can transform the response object to a dictionary, to JSON format, or a pandas dataframe.
+
+```python
+# Get the list of datasets from the response
+experiment_list = resp.experiments 
+# Get the response as a dictionary
+resp_dict = resp.to_dict()
+# Get the response in JSON format
+resp_json = resp.to_json()
+# Get the response as a pandas dataframe
+resp_df = resp.to_df()
+```
+
+### Run an Experiment
+
+You can run an experiment on a dataset using `client.experiments.run()` by defining a task, evaluators (optional), and passing the dataset id of the dataset you want to use, together with a name for the experiment. The function will download the entire dataset from Arize (unless cached, see caching section under "SDK Configuration"), execute the task to obtain an output, and perform evaluations (if evaluators were passed). The experiments will also be traced, and these traces will be visible in Arize. The experiment will be created and the data logged into Arize automatically. You can avoid logging to Arize by making `dry_run=True`. The function will return the `Experiment` object (or `None` if `dry_run=True`) together with the dataframe with the experiment data.
+
+```python
+experiment, experiment_df = client.run_experiment(
+    name="<name-your-experiment>",
+    dataset_id="<id-of-dataset-to-use>",
+    task=... # The task to be performed in the experiment.
+    evaluators=... # Optional: The evaluators to use in the experiment.
+    dry_run=..., # If True, the experiment result will not be uploaded to Arize. Defaults to False
+    dry_run_count=..., # Number of examples of the dataset to use in the dry run. Defaults to 10
+    concurrency=..., # The number of concurrent tasks to run. Defaults to 3.
+    set_global_tracer_provider=..., # If True, sets the global tracer provider for the experiment. Defaults to False
+    exit_on_error=..., # If True, the experiment will stop running on first occurrence of an error. Defaults to False
+) 
+```
+
+The `Experiment` object also counts with convenience method similar to `List***` objects:
+
+```python
+# Get the response as a dictionary
+experiment_dict = create_experiment.to_dict()
+# Get the response in JSON format
+experiment_dict = create_experiment.to_json()
+```
+
+### Create an Experiment
+
+It is possible that you have run the experiment yourself without the above function, and hence you already have experiment data that you want to send to Arize. In this case, use the `client.experiments.create()` method by passing the runs data, we currently don't support creating an empty experiment, for instance, these are 2 rows of runs, as a list of dictionaries. You can also pass a pandas dataframe for the runs data.
+
+> NOTE: If you don't have experiment data and want to run experiment, see the `client.experiments.run()` section above.
+
+```python
+# TODO
+runs = [
+]
+```
+
+In addition, you must specify which columns are the `example_id` and the `result`, you can do so by using the `ExperimentTaskResultFieldNames`. Moreover, if you choose to pass evaluation data, you can indicate the evaluation columns using `EvaluationResultFieldNames`:
+
+```python
+# TODO
+```
+
+If the number of runs (rows in dataframe, items in list) is too large, the client SDK will try to send the data via Arrow Flight via gRPC for better performance. If you want to force the data transfer to HTTP you can use the `force_http` flag. The response is an `Experiment` object.
+
+```python
+created_experiment = client.experiments.create(
+    name="<your-experiment-name>", # Name must be unique within a dataset
+    dataset_id="<desired-dataset-id>",
+    experiment_runs=..., # List of dictionaries or pandas dataframe
+    task_fields=ExperimentTaskResultFieldNames(...),
+    evaluator_columns=... # Optional
+    # force_http=... # Optionally pass force_http to create experiments via HTTP instead of gRPC, defaults to False
+)
+```
+
+### Get an Experiment
+
+To get a dataset by its ID use `client.datasets.get()`, you can optionally also pass the version ID of a particular version of interest of the dataset. The returned type is `Dataset`.
+
+```python
+dataset = client.datasets.get(
+    dataset_id=... # The unique identifier of the dataset
+    dataset_version_id=... # The unique identifier of the dataset version
+)
+```
+
+### Delete an Experiment
+
+To delete an experiment by its ID use `client.experiments.delete()`. The call returns `None` if successful deletion took place, error otherwise.
+
+```python
+client.experiments.delete(
+    experiment_id=... # The unique identifier of the experiment
+)
+```
+
+### List Experiment runs
 
-## In Code
+You can list the runs of a given experiment using `client.experiments.list_runs()` and passing the experiment ID. You can specify the number of runs desired using the `limit` parameter. If you want a large number of runs, consider using the `all=True` parameter, which will make it so the SDK exports the data using Arrow Flight via gRPC, for increased performance.
+
+```python
+resp = client.experiments.list_runs(
+    experiment_id="your-experiment-id>",
+    limit=... # number of desired runs. Defaults to 100
+    all=... # Whether or not to export all of the runs. Defaults to False
+)
+```
+
+The response is an object of type `ExperimentsRunsList200Response`, and you can access the list of runs via its `experiment_runs` attribute. In addition, you can transform the response object to a dictionary, to JSON format, or a pandas dataframe.
+
+```python
+# Get the list of datasets from the response
+run_list = resp.experiments_runs
+# Get the response as a dictionary
+resp_dict = resp.to_dict()
+# Get the response in JSON format
+resp_json = resp.to_json()
+# Get the response as a pandas dataframe
+resp_df = resp.to_df()
+```
+
+# SDK Configuration
+
+## Logging
+
+### In Code
 
 You can use `configure_logging` to set up the logging behavior of the Arize package to your needs. 
 
@@ -418,14 +589,14 @@ configure_logging(
 ) 
 ```
 
-## Via Environment Variables
+### Via Environment Variables
 
 Configure the same options as the section above, via:
 
 ```python
 import os
 
-# You can disable logging altogether
+# Whether or not you want to disable logging altogether
 os.environ["ARIZE_LOG_ENABLE"] = "true" 
 # Set up the logging level
 os.environ["ARIZE_LOG_LEVEL"] = "debug" 
@@ -435,6 +606,38 @@ os.environ["ARIZE_LOG_STRUCTURED"] = "false"
 
 The default behavior of Arize's logs is: enabled, `INFO` level, and not structured.
 
+## Caching
+
+When downloading big segments of data from Arize, such as a `Dataset` with all of its examples, the SDK will cache the file in `parquet` format under `~/.arize/datasets/dataset_<updated_at_timestamp>.parquet`.
+
+### In Code
+
+You can disable caching via the `enable_caching` parameter when instantiating the client, and also edit the "arize directory":
+
+```python
+client = ArizeClient(
+    enable_caching=False, # Optional parameter, defaults to True
+    arize_directory="my-desired-directory", # Optional parameter, defaults to ~/.arize
+)
+```
+
+### Via Environment Variables
+
+You can also configure the above via:
+
+```python
+import os
+
+# Whether or not you want to disable caching
+os.environ["ARIZE_ENABLE_CACHING"] = "true"
+# Where you want the SDK to store the files
+os.environ["ARIZE_DIRECTORY"] = "~/.arize"
+```
+
+### Clean the cache
+
+To clean the cache you can directly `rm` the files or directory.
+
 # Community
 
 Join our community to connect with thousands of AI builders.

{arize-8.0.0a16 → arize-8.0.0a18}/src/arize/__init__.py

@@ -87,3 +87,4 @@ def make_to_df(field_name: str):
 models.DatasetsList200Response.to_df = make_to_df("datasets")  # type: ignore[attr-defined]
 models.DatasetsListExamples200Response.to_df = make_to_df("examples")  # type: ignore[attr-defined]
 models.ExperimentsList200Response.to_df = make_to_df("experiments")  # type: ignore[attr-defined]
+models.ExperimentsRunsList200Response.to_df = make_to_df("experiment_runs")  # type: ignore[attr-defined]

{arize-8.0.0a16 → arize-8.0.0a18}/src/arize/_flight/client.py

@@ -25,6 +25,7 @@ from arize.utils.proto import get_pb_schema_tracing
 from arize.version import __version__
 
 if TYPE_CHECKING:
+    import pandas as pd
     import pyarrow as pa
 
 
@@ -260,7 +261,7 @@ class ArizeFlightClient:
         space_id: str,
         dataset_id: str,
         dataset_version_id: str | None = None,
-    ):
+    ) -> pd.DataFrame:
         # TODO(Kiko): Space ID should not be needed,
         # should work on server tech debt to remove this
         doget_request = flight_ing_pb2.DoGetRequest(
@@ -283,6 +284,36 @@ class ArizeFlightClient:
             logger.exception(f"Failed to get dataset id={dataset_id}")
             raise RuntimeError(f"Failed to get dataset id={dataset_id}") from e
 
+    # ---------- experiment methods ----------
+
+    def get_experiment_runs(
+        self,
+        space_id: str,
+        experiment_id: str,
+    ) -> pd.DataFrame:
+        # TODO(Kiko): Space ID should not be needed,
+        # should work on server tech debt to remove this
+        doget_request = flight_ing_pb2.DoGetRequest(
+            get_experiment=flight_ing_pb2.GetExperimentRequest(
+                space_id=space_id,
+                experiment_id=experiment_id,
+            )
+        )
+        descriptor = flight.Ticket(
+            json_format.MessageToJson(doget_request).encode("utf-8")
+        )
+        try:
+            reader = self.do_get(descriptor, options=self.call_options)
+            # read all data into pandas dataframe
+            df = reader.read_all().to_pandas()
+            df = convert_json_str_to_dict(df)
+            return df
+        except Exception as e:
+            logger.exception(f"Failed to get experiment id={experiment_id}")
+            raise RuntimeError(
+                f"Failed to get experiment id={experiment_id}"
+            ) from e
+
     def init_experiment(
         self,
         space_id: str,

{arize-8.0.0a16 → arize-8.0.0a18}/src/arize/client.py

@@ -12,6 +12,14 @@ if TYPE_CHECKING:
     from arize.spans.client import SpansClient
 
 
+# TODO(Kiko): models need to follow resource first pattern
+# -  models.DatasetsList200Response
+# -  models.DatasetsListExamples200Response
+# -  models.ExperimentsList200Response
+# -  models.ExperimentsRunsList200Response
+# TODO(Kiko): Root client should have option to clear caches
+# TODO(Kiko): Document caching behavior
+# TODO(Kiko): Force keyword arguments
 # TODO(Kiko): Protobuf versioning is too old
 # TODO(Kiko): Make sure the client has same options as SDKConfiguration
 # TODO(Kiko): It does not make any sense to require space ID in run_experiment, dataset ID should suffice