kaiko-eva 0.0.0.dev7__tar.gz → 0.0.1__tar.gz

{kaiko_eva-0.0.0.dev7 → kaiko_eva-0.0.1}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: kaiko-eva
-Version: 0.0.0.dev7
+Version: 0.0.1
 Summary: Evaluation Framework for oncology foundation models.
 Keywords: machine-learning evaluation-framework oncology foundation-models
 Author-Email: Ioannis Gatopoulos <ioannis@kaiko.ai>, Nicolas Känzig <nicolas@kaiko.ai>, Roman Moser <roman@kaiko.ai>
@@ -251,26 +251,21 @@ _Oncology FM Evaluation Framework by kaiko.ai_
 [![license](https://img.shields.io/badge/License-Apache%202.0-blue.svg?labelColor=gray)](https://github.com/kaiko-ai/eva#license)
 
 <p align="center">
-  <a href="#installation">Installation</a> •
-  <a href="#how-to-use">How To Use</a> •
+  <a href="https://github.com/kaiko-ai/eva#installation">Installation</a> •
+  <a href="https://github.com/kaiko-ai/eva#how-to-use">How To Use</a> •
   <a href="https://kaiko-ai.github.io/eva/">Documentation</a> •
   <a href="https://kaiko-ai.github.io/eva/dev/datasets/">Datasets</a> •
-  <a href="#benchmarks">Benchmarks</a> <br>
-  <a href="#contributing">Contribute</a> •
-  <a href="#acknowledgements">Acknowledgements</a>
+  <a href="https://github.com/kaiko-ai/eva#benchmarks">Benchmarks</a> <br>
+  <a href="https://github.com/kaiko-ai/eva#contributing">Contribute</a> •
+  <a href="https://github.com/kaiko-ai/eva#acknowledgements">Acknowledgements</a>
 </p>
 
 </div>
 
-### Introduction
-
-_`eva`_ is an evaluation framework for oncology foundation models (FMs) by [kaiko.ai](https://kaiko.ai/). Check out the [documentation](https://kaiko-ai.github.io/eva/) for more information.
-
-<div align="center">
-
-<img src="https://github.com/kaiko-ai/eva/blob/main/docs/images/eva-process.gif?raw=true" width="800">
+<br />
 
-</div>
+_`eva`_ is an evaluation framework for oncology foundation models (FMs) by [kaiko.ai](https://kaiko.ai/).
+Check out the [documentation](https://kaiko-ai.github.io/eva/) for more information.
 
 ### Highlights:
 - Easy and reliable benchmark of Oncology FMs
@@ -294,7 +289,7 @@ pip install 'kaiko-eva[all]'
 
 To install the latest version of the `main` branch:
 ```sh
-pip install "kaiko-eva[vision] @ git+https://github.com/kaiko-ai/eva.git"
+pip install "kaiko-eva[all] @ git+https://github.com/kaiko-ai/eva.git"
 ```
 
 You can verify that the installation was successful by executing:
@@ -309,13 +304,28 @@ _eva_ can be used directly from the terminal as a CLI tool as follows:
 eva {fit,predict,predict_fit} --config url/or/path/to/the/config.yaml 
 ```
 
-For example, to perform a downstream evaluation of DINO ViT-S/16 on the BACH dataset with linear probing by first inferring the embeddings and performing 5 sequential fits, execute:
+When used as a CLI tool, `_eva_` supports configuration files (`.yaml`) as an argument to define its functionality.
+Native supported configs can be found at the [configs](https://github.com/kaiko-ai/eva/tree/main/configs) directory
+of the repo. Apart from cloning the repo, you can download the latest config folder as `.zip` from your browser from
+[here](https://download-directory.github.io/?url=https://github.com/kaiko-ai/eva/tree/main/configs). Alternatively,
+from a specific release the configs can be downloaded from the terminal as follows:
 ```sh
+curl -LO https://github.com/kaiko-ai/eva/releases/download/0.0.1/configs.zip | unzip configs.zip
+```
+
+For example, to perform a downstream evaluation of DINO ViT-S/16 on the BACH dataset with
+linear probing by first inferring the embeddings and performing 5 sequential fits, execute:
+```sh
+# from a locally stored config file
+eva predict_fit --config ./configs/vision/dino_vit/offline/bach.yaml
+
+# from a remote stored config file
 eva predict_fit --config https://raw.githubusercontent.com/kaiko-ai/eva/main/configs/vision/dino_vit/offline/bach.yaml
 ```
 
 > [!NOTE] 
-> All the datasets that support automatic download in the repo have by default the option to automatically download set to false. For automatic download you have to manually set download=true.
+> All the datasets that support automatic download in the repo have by default the option to automatically download set to false.
+> For automatic download you have to manually set download=true.
 
 
 To view all the possibles, execute:
@@ -323,7 +333,8 @@ To view all the possibles, execute:
 eva --help
 ```
 
-For more information, please refer to the [documentation](https://kaiko-ai.github.io/eva/dev/user-guide/tutorials/offline_vs_online/) and [tutorials](https://kaiko-ai.github.io/eva/dev/user-guide/advanced/replicate_evaluations/).
+For more information, please refer to the [documentation](https://kaiko-ai.github.io/eva/dev/user-guide/tutorials/offline_vs_online/)
+and [tutorials](https://kaiko-ai.github.io/eva/dev/user-guide/advanced/replicate_evaluations/).
 
 ## Benchmarks
 
@@ -339,8 +350,8 @@ In this section you will find model benchmarks which were generated with _eva_.
 |--------------------------------------------------|-------|-------|-------|----------|-----------|
 | ViT-S/16 _(random)_	<sup>[1]</sup>               | 0.410 | 0.617 | 0.501 | 0.753    | 0.728     |
 | ViT-S/16 _(ImageNet)_ <sup>[1]</sup>             | 0.695 | 0.935 | 0.831 | 0.864    | 0.849     |
-| ViT-B/8 _(ImageNet)_ <sup>[1]</sup>              | 0.797 | 0.943 | 0.828 | 0.903    | 0.893     |
-| DINO<sub>(p=16)</sub> <sup>[2]</sup>             | 0.710 | 0.935 | 0.814 | 0.870    | 0.856     |
+| ViT-B/8 _(ImageNet)_ <sup>[1]</sup>              | 0.710 | 0.939 | 0.814 | 0.870    | 0.856     |
+| DINO<sub>(p=16)</sub> <sup>[2]</sup>             | 0.801 | 0.934 | 0.768 | 0.889    | 0.895     |
 | Phikon <sup>[3]</sup>                            | 0.725 | 0.935 | 0.777 | 0.912    | 0.915     |
 | ViT-S/16 _(kaiko.ai)_ <sup>[4]</sup>             | 0.797 | 0.943 | 0.828 | 0.903    | 0.893     |
 | ViT-S/8 _(kaiko.ai)_ <sup>[4]</sup>              | 0.834 | 0.946 | 0.832 | 0.897    | 0.887     |
@@ -349,7 +360,7 @@ In this section you will find model benchmarks which were generated with _eva_.
 | ViT-L/14 _(kaiko.ai)_ <sup>[4]</sup>             | 0.870 | 0.930 | 0.809 | 0.908    | 0.898     |
 
 _Table I: Linear probing evaluation of FMs on patch-level downstream datasets.<br> We report averaged balanced accuracy
-over 5 runs_, with an average standard deviation of ±0.003.
+over 5 runs, with an average standard deviation of ±0.003._
 
 </div>
 
@@ -359,11 +370,12 @@ _References_:
 1. _"Emerging properties in self-supervised vision transformers”_
 2. _"Benchmarking self-supervised learning on diverse pathology datasets”_
 3. _"Scaling self-supervised learning for histopathology with masked image modeling”_
-4. _"Towards training Large-Scale Medical Foundation Models: from TCGA to hospital-scale pathology FMs”_
+4. _"Towards Training Large-Scale Pathology Foundation Models: from TCGA to Hospital Scale”_
 
 ## Contributing
 
-_eva_ is an open source project and welcomes contributions of all kinds. Please checkout the [developer](./docs/DEVELOPER_GUIDE.md) and [contributing guide](./docs/CONTRIBUTING.md) for help on how to do so.
+_eva_ is an open source project and welcomes contributions of all kinds. Please checkout the [developer](./docs/DEVELOPER_GUIDE.md)
+and [contributing guide](./docs/CONTRIBUTING.md) for help on how to do so.
 
 All contributors must follow the [code of conduct](./docs/CODE_OF_CONDUCT.md).
 

{kaiko_eva-0.0.0.dev7 → kaiko_eva-0.0.1}/README.md

@@ -11,26 +11,21 @@ _Oncology FM Evaluation Framework by kaiko.ai_
 [![license](https://img.shields.io/badge/License-Apache%202.0-blue.svg?labelColor=gray)](https://github.com/kaiko-ai/eva#license)
 
 <p align="center">
-  <a href="#installation">Installation</a> •
-  <a href="#how-to-use">How To Use</a> •
+  <a href="https://github.com/kaiko-ai/eva#installation">Installation</a> •
+  <a href="https://github.com/kaiko-ai/eva#how-to-use">How To Use</a> •
   <a href="https://kaiko-ai.github.io/eva/">Documentation</a> •
   <a href="https://kaiko-ai.github.io/eva/dev/datasets/">Datasets</a> •
-  <a href="#benchmarks">Benchmarks</a> <br>
-  <a href="#contributing">Contribute</a> •
-  <a href="#acknowledgements">Acknowledgements</a>
+  <a href="https://github.com/kaiko-ai/eva#benchmarks">Benchmarks</a> <br>
+  <a href="https://github.com/kaiko-ai/eva#contributing">Contribute</a> •
+  <a href="https://github.com/kaiko-ai/eva#acknowledgements">Acknowledgements</a>
 </p>
 
 </div>
 
-### Introduction
-
-_`eva`_ is an evaluation framework for oncology foundation models (FMs) by [kaiko.ai](https://kaiko.ai/). Check out the [documentation](https://kaiko-ai.github.io/eva/) for more information.
-
-<div align="center">
-
-<img src="https://github.com/kaiko-ai/eva/blob/main/docs/images/eva-process.gif?raw=true" width="800">
+<br />
 
-</div>
+_`eva`_ is an evaluation framework for oncology foundation models (FMs) by [kaiko.ai](https://kaiko.ai/).
+Check out the [documentation](https://kaiko-ai.github.io/eva/) for more information.
 
 ### Highlights:
 - Easy and reliable benchmark of Oncology FMs
@@ -54,7 +49,7 @@ pip install 'kaiko-eva[all]'
 
 To install the latest version of the `main` branch:
 ```sh
-pip install "kaiko-eva[vision] @ git+https://github.com/kaiko-ai/eva.git"
+pip install "kaiko-eva[all] @ git+https://github.com/kaiko-ai/eva.git"
 ```
 
 You can verify that the installation was successful by executing:
@@ -69,13 +64,28 @@ _eva_ can be used directly from the terminal as a CLI tool as follows:
 eva {fit,predict,predict_fit} --config url/or/path/to/the/config.yaml 
 ```
 
-For example, to perform a downstream evaluation of DINO ViT-S/16 on the BACH dataset with linear probing by first inferring the embeddings and performing 5 sequential fits, execute:
+When used as a CLI tool, `_eva_` supports configuration files (`.yaml`) as an argument to define its functionality.
+Native supported configs can be found at the [configs](https://github.com/kaiko-ai/eva/tree/main/configs) directory
+of the repo. Apart from cloning the repo, you can download the latest config folder as `.zip` from your browser from
+[here](https://download-directory.github.io/?url=https://github.com/kaiko-ai/eva/tree/main/configs). Alternatively,
+from a specific release the configs can be downloaded from the terminal as follows:
 ```sh
+curl -LO https://github.com/kaiko-ai/eva/releases/download/0.0.1/configs.zip | unzip configs.zip
+```
+
+For example, to perform a downstream evaluation of DINO ViT-S/16 on the BACH dataset with
+linear probing by first inferring the embeddings and performing 5 sequential fits, execute:
+```sh
+# from a locally stored config file
+eva predict_fit --config ./configs/vision/dino_vit/offline/bach.yaml
+
+# from a remote stored config file
 eva predict_fit --config https://raw.githubusercontent.com/kaiko-ai/eva/main/configs/vision/dino_vit/offline/bach.yaml
 ```
 
 > [!NOTE] 
-> All the datasets that support automatic download in the repo have by default the option to automatically download set to false. For automatic download you have to manually set download=true.
+> All the datasets that support automatic download in the repo have by default the option to automatically download set to false.
+> For automatic download you have to manually set download=true.
 
 
 To view all the possibles, execute:
@@ -83,7 +93,8 @@ To view all the possibles, execute:
 eva --help
 ```
 
-For more information, please refer to the [documentation](https://kaiko-ai.github.io/eva/dev/user-guide/tutorials/offline_vs_online/) and [tutorials](https://kaiko-ai.github.io/eva/dev/user-guide/advanced/replicate_evaluations/).
+For more information, please refer to the [documentation](https://kaiko-ai.github.io/eva/dev/user-guide/tutorials/offline_vs_online/)
+and [tutorials](https://kaiko-ai.github.io/eva/dev/user-guide/advanced/replicate_evaluations/).
 
 ## Benchmarks
 
@@ -99,8 +110,8 @@ In this section you will find model benchmarks which were generated with _eva_.
 |--------------------------------------------------|-------|-------|-------|----------|-----------|
 | ViT-S/16 _(random)_	<sup>[1]</sup>               | 0.410 | 0.617 | 0.501 | 0.753    | 0.728     |
 | ViT-S/16 _(ImageNet)_ <sup>[1]</sup>             | 0.695 | 0.935 | 0.831 | 0.864    | 0.849     |
-| ViT-B/8 _(ImageNet)_ <sup>[1]</sup>              | 0.797 | 0.943 | 0.828 | 0.903    | 0.893     |
-| DINO<sub>(p=16)</sub> <sup>[2]</sup>             | 0.710 | 0.935 | 0.814 | 0.870    | 0.856     |
+| ViT-B/8 _(ImageNet)_ <sup>[1]</sup>              | 0.710 | 0.939 | 0.814 | 0.870    | 0.856     |
+| DINO<sub>(p=16)</sub> <sup>[2]</sup>             | 0.801 | 0.934 | 0.768 | 0.889    | 0.895     |
 | Phikon <sup>[3]</sup>                            | 0.725 | 0.935 | 0.777 | 0.912    | 0.915     |
 | ViT-S/16 _(kaiko.ai)_ <sup>[4]</sup>             | 0.797 | 0.943 | 0.828 | 0.903    | 0.893     |
 | ViT-S/8 _(kaiko.ai)_ <sup>[4]</sup>              | 0.834 | 0.946 | 0.832 | 0.897    | 0.887     |
@@ -109,7 +120,7 @@ In this section you will find model benchmarks which were generated with _eva_.
 | ViT-L/14 _(kaiko.ai)_ <sup>[4]</sup>             | 0.870 | 0.930 | 0.809 | 0.908    | 0.898     |
 
 _Table I: Linear probing evaluation of FMs on patch-level downstream datasets.<br> We report averaged balanced accuracy
-over 5 runs_, with an average standard deviation of ±0.003.
+over 5 runs, with an average standard deviation of ±0.003._
 
 </div>
 
@@ -119,11 +130,12 @@ _References_:
 1. _"Emerging properties in self-supervised vision transformers”_
 2. _"Benchmarking self-supervised learning on diverse pathology datasets”_
 3. _"Scaling self-supervised learning for histopathology with masked image modeling”_
-4. _"Towards training Large-Scale Medical Foundation Models: from TCGA to hospital-scale pathology FMs”_
+4. _"Towards Training Large-Scale Pathology Foundation Models: from TCGA to Hospital Scale”_
 
 ## Contributing
 
-_eva_ is an open source project and welcomes contributions of all kinds. Please checkout the [developer](./docs/DEVELOPER_GUIDE.md) and [contributing guide](./docs/CONTRIBUTING.md) for help on how to do so.
+_eva_ is an open source project and welcomes contributions of all kinds. Please checkout the [developer](./docs/DEVELOPER_GUIDE.md)
+and [contributing guide](./docs/CONTRIBUTING.md) for help on how to do so.
 
 All contributors must follow the [code of conduct](./docs/CODE_OF_CONDUCT.md).
 

{kaiko_eva-0.0.0.dev7 → kaiko_eva-0.0.1}/pyproject.toml

@@ -6,7 +6,7 @@ build-backend = "pdm.backend"
 
 [project]
 name = "kaiko-eva"
-version = "0.0.0.dev7"
+version = "0.0.1"
 description = "Evaluation Framework for oncology foundation models."
 keywords = [
     "machine-learning",

{kaiko_eva-0.0.0.dev7 → kaiko_eva-0.0.1}/src/eva/core/data/datamodules/call.py

@@ -19,7 +19,7 @@ def call_method_if_exists(objects: Iterable[Any], /, method: str) -> None:
 
 
 def _recursive_iter(objects: Iterable[Any], /) -> Iterable[datasets_lib.TorchDataset]:
-    """Iterates thought an iterable of objects and their respective iterable values.
+    """Iterates through an iterable of objects and their respective iterable values.
 
     Args:
         objects: The objects to iterate from.

{kaiko_eva-0.0.0.dev7 → kaiko_eva-0.0.1}/src/eva/core/trainers/_logging.py

@@ -11,8 +11,9 @@ from loguru import logger
 def generate_session_id() -> str:
     """Generates and returns a unique string ID of an experiment.
 
-    The ID is composed of the run timestamp and a its config hash. If the
-    configuration hash is an empty string, it will use only the timestamp.
+    The ID is composed of the run timestamp and a hash based on th used
+    config. If the configuration hash is an empty string, it will use
+    only the timestamp.
     """
     timestamp = _generate_timestamp_hash()
     config_hash = _generate_config_hash()
@@ -34,8 +35,8 @@ def _generate_config_hash(max_hash_len: int = 8) -> str:
     config_path = _fetch_config_path()
     if config_path is None:
         logger.warning(
-            "No or multiple configuration file found from command line arguments. "
-            "No configuration hash code will created for this experiment."
+            "No or multiple configuration files found from command line arguments. "
+            "No configuration hash code will be created for this experiment."
         )
         return ""
 

{kaiko_eva-0.0.0.dev7 → kaiko_eva-0.0.1}/src/eva/core/trainers/trainer.py

@@ -78,7 +78,7 @@ class Trainer(pl_trainer.Trainer):
         model: modules.ModelModule,
         datamodule: datamodules.DataModule,
     ) -> None:
-        """Runs a evaluation session out-of-place.
+        """Runs an evaluation session out-of-place.
 
         It performs an evaluation run (fit and evaluate) the model
         `self._n_run` times. Note that the input `base_model` would

{kaiko_eva-0.0.0.dev7 → kaiko_eva-0.0.1}/src/eva/vision/__init__.py

@@ -7,7 +7,7 @@ except ImportError as e:
     msg = (
         "eva vision requirements are not installed.\n\n"
         "Please pip install as follows:\n"
-        '  python -m pip install "eva[vision]" --upgrade'
+        '  python -m pip install "kaiko-eva[vision]" --upgrade'
     )
     raise ImportError(str(e) + "\n\n" + msg) from e
 

{kaiko_eva-0.0.0.dev7 → kaiko_eva-0.0.1}/src/eva/vision/data/datasets/_validators.py

@@ -1,5 +1,7 @@
 """Dataset validation related functions."""
 
+import os
+
 from typing_extensions import List, Tuple
 
 from eva.vision.data.datasets import vision
@@ -18,7 +20,7 @@ def check_dataset_integrity(
     """Verifies the datasets integrity.
 
     Raise:
-        ValuesError: If the input dataset's values do not
+        ValueError: If the input dataset's values do not
             match the expected ones.
     """
     if len(dataset) != length:
@@ -42,3 +44,16 @@ def check_dataset_integrity(
             f"({(dataset_classes[0], dataset_classes[-1])}) does not match the expected "
             f"ones ({first_and_last_labels}). {_SUFFIX_ERROR_MESSAGE}"
         )
+
+
+def check_dataset_exists(dataset_dir: str, download_available: bool) -> None:
+    """Verifies that the dataset folder exists.
+
+    Raise:
+        FileNotFoundError: If the dataset folder does not exist.
+    """
+    if not os.path.isdir(dataset_dir):
+        error_message = f"Dataset not found at '{dataset_dir}'."
+        if download_available:
+            error_message += " You can set `download=True` to download the dataset automatically."
+        raise FileNotFoundError(error_message)

{kaiko_eva-0.0.0.dev7 → kaiko_eva-0.0.1}/src/eva/vision/data/datasets/classification/bach.py

@@ -96,24 +96,25 @@ class BACH(base.ImageClassification):
         return {"Benign": 0, "InSitu": 1, "Invasive": 2, "Normal": 3}
 
     @property
-    def dataset_path(self) -> str:
+    def _dataset_path(self) -> str:
         """Returns the path of the image data of the dataset."""
         return os.path.join(self._root, "ICIAR2018_BACH_Challenge", "Photos")
 
     @override
     def filename(self, index: int) -> str:
         image_path, _ = self._samples[self._indices[index]]
-        return os.path.relpath(image_path, self.dataset_path)
+        return os.path.relpath(image_path, self._dataset_path)
 
     @override
     def prepare_data(self) -> None:
         if self._download:
             self._download_dataset()
+        _validators.check_dataset_exists(self._root, True)
 
     @override
     def configure(self) -> None:
         self._samples = folder.make_dataset(
-            directory=self.dataset_path,
+            directory=self._dataset_path,
             class_to_idx=self.class_to_idx,
             extensions=(".tif"),
         )
@@ -145,7 +146,7 @@ class BACH(base.ImageClassification):
     def _download_dataset(self) -> None:
         """Downloads the dataset."""
         for resource in self._resources:
-            if os.path.isdir(self.dataset_path):
+            if os.path.isdir(self._dataset_path):
                 continue
 
             self._print_license()

{kaiko_eva-0.0.0.dev7 → kaiko_eva-0.0.1}/src/eva/vision/data/datasets/classification/crc.py

@@ -95,12 +95,13 @@ class CRC(base.ImageClassification):
     @override
     def filename(self, index: int) -> str:
         image_path, *_ = self._samples[index]
-        return os.path.relpath(image_path, self._dataset_dir)
+        return os.path.relpath(image_path, self._dataset_path)
 
     @override
     def prepare_data(self) -> None:
         if self._download:
             self._download_dataset()
+        _validators.check_dataset_exists(self._root, True)
 
     @override
     def configure(self) -> None:
@@ -135,7 +136,7 @@ class CRC(base.ImageClassification):
         return len(self._samples)
 
     @property
-    def _dataset_dir(self) -> str:
+    def _dataset_path(self) -> str:
         """Returns the full path of dataset directory."""
         dataset_dirs = {
             "train": os.path.join(self._root, "NCT-CRC-HE-100K"),
@@ -150,7 +151,7 @@ class CRC(base.ImageClassification):
     def _make_dataset(self) -> List[Tuple[str, int]]:
         """Builds the dataset for the specified split."""
         dataset = folder.make_dataset(
-            directory=self._dataset_dir,
+            directory=self._dataset_path,
             class_to_idx=self.class_to_idx,
             extensions=(".tif"),
         )

{kaiko_eva-0.0.0.dev7 → kaiko_eva-0.0.1}/src/eva/vision/data/datasets/classification/mhist.py

@@ -56,6 +56,10 @@ class MHIST(base.ImageClassification):
         image_filename, _ = self._samples[index]
         return image_filename
 
+    @override
+    def prepare_data(self) -> None:
+        _validators.check_dataset_exists(self._root, False)
+
     @override
     def configure(self) -> None:
         self._samples = self._make_dataset()

{kaiko_eva-0.0.0.dev7 → kaiko_eva-0.0.1}/src/eva/vision/data/datasets/classification/patch_camelyon.py

@@ -114,6 +114,7 @@ class PatchCamelyon(base.ImageClassification):
     def prepare_data(self) -> None:
         if self._download:
             self._download_dataset()
+        _validators.check_dataset_exists(self._root, True)
 
     @override
     def validate(self) -> None:

{kaiko_eva-0.0.0.dev7 → kaiko_eva-0.0.1}/src/eva/vision/data/datasets/classification/total_segmentator.py

@@ -108,6 +108,7 @@ class TotalSegmentatorClassification(base.ImageClassification):
     def prepare_data(self) -> None:
         if self._download:
             self._download_dataset()
+        _validators.check_dataset_exists(self._root, True)
 
     @override
     def configure(self) -> None:

kaiko_eva-0.0.1/tests/eva/assets/core/datasets/embeddings/embeddings/tensor_0_shape_8.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:16cee08e989efd1bfb9d353ad9c017767a86f47658f0958a09b74310d81ed40c
+size 1225

kaiko_eva-0.0.1/tests/eva/assets/core/datasets/embeddings/embeddings/tensor_1_shape_8.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c653b9c209d51f18b08352d3cec7cc7479870a329af315de5c19d3565e786801
+size 1225

kaiko_eva-0.0.1/tests/eva/assets/core/datasets/embeddings/embeddings/tensor_2_shape_8.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:998be8c190a910135c2ea2722543c2750ddc070280427b7ab211db3da59ee9b8
+size 1225

kaiko_eva-0.0.1/tests/eva/assets/core/datasets/embeddings/embeddings/tensor_3_shape_8.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:998be8c190a910135c2ea2722543c2750ddc070280427b7ab211db3da59ee9b8
+size 1225

kaiko_eva-0.0.1/tests/eva/assets/core/datasets/embeddings/embeddings/tensor_4_shape_1x8.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:85c2a3fe8ded76eda86274f0066d8f34445a88d1e90c23e2b598194d2bd6542c
+size 1235

kaiko_eva-0.0.1/tests/eva/assets/core/datasets/embeddings/embeddings/tensor_5_shape_1x8.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d35ad2419c480d72c445799962c7972f4ad4671dd06448bb6d253af0fd65c2c3
+size 1235

kaiko_eva-0.0.1/tests/eva/assets/core/datasets/embeddings/embeddings/tensor_6_shape_1x8.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:85c2a3fe8ded76eda86274f0066d8f34445a88d1e90c23e2b598194d2bd6542c
+size 1235

kaiko_eva-0.0.1/tests/eva/assets/core/datasets/embeddings/embeddings/tensor_7_shape_1x8.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:85c2a3fe8ded76eda86274f0066d8f34445a88d1e90c23e2b598194d2bd6542c
+size 1235

kaiko_eva-0.0.1/tests/eva/assets/core/datasets/embeddings/manifest.csv

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0fc8758e7b95dfb048d9cfba4c64667f553c9980dde874066ed795382980b2d0
+size 337

kaiko_eva-0.0.1/tests/eva/assets/core/datasets/multi-embeddings/embeddings/tensor_0_shape_6x8.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6ea1a6a0588de18e5ca1e744a6d7e2cd933773cdae280a92985e78eca06a7c62
+size 1427

kaiko_eva-0.0.1/tests/eva/assets/core/datasets/multi-embeddings/embeddings/tensor_1_shape_3x8.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a6b0b86fe86263e7b945536c775fcfc030f8f2bef6a3b3f271d7e27e58c358e7
+size 1299

kaiko_eva-0.0.1/tests/eva/assets/core/datasets/multi-embeddings/embeddings/tensor_2_shape_1x8.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e7a7f391ab7f206a92cca08d630538a430c0d5cadf3eaadb3d3f845724d76692
+size 1235

kaiko_eva-0.0.1/tests/eva/assets/core/datasets/multi-embeddings/embeddings/tensor_3_shape_2x8.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d730238ef61f0dc4b98719e72ecff2fcee0f3c69b5c634554429828792f6a251
+size 1299

kaiko_eva-0.0.1/tests/eva/assets/core/datasets/multi-embeddings/embeddings/tensor_4_shape_5x8.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6ad0657aaa9a8d0521ce9f51ae2fcc748eaf4c94a7e27845b32d9587542b98de
+size 1363

kaiko_eva-0.0.1/tests/eva/assets/core/datasets/multi-embeddings/embeddings/tensor_5_shape_3x8.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a6b0b86fe86263e7b945536c775fcfc030f8f2bef6a3b3f271d7e27e58c358e7
+size 1299

kaiko_eva-0.0.1/tests/eva/assets/core/datasets/multi-embeddings/embeddings/tensor_6_shape_1x8.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e7a7f391ab7f206a92cca08d630538a430c0d5cadf3eaadb3d3f845724d76692
+size 1235

kaiko_eva-0.0.1/tests/eva/assets/core/datasets/multi-embeddings/embeddings/tensor_7_shape_6x8.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6ea1a6a0588de18e5ca1e744a6d7e2cd933773cdae280a92985e78eca06a7c62
+size 1427

kaiko_eva-0.0.1/tests/eva/assets/core/datasets/multi-embeddings/embeddings/tensor_8_shape_2x8.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d730238ef61f0dc4b98719e72ecff2fcee0f3c69b5c634554429828792f6a251
+size 1299

kaiko_eva-0.0.1/tests/eva/assets/core/datasets/multi-embeddings/embeddings/tensor_9_shape_5x8.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6ad0657aaa9a8d0521ce9f51ae2fcc748eaf4c94a7e27845b32d9587542b98de
+size 1363

kaiko_eva-0.0.1/tests/eva/assets/core/datasets/multi-embeddings/manifest.csv

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5e884b93aa81257148dbb73564d734045ffe110463f60a6064814bf95aa82044
+size 514

kaiko_eva-0.0.1/tests/eva/assets/images/random_bgr_32x32.png

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ce27159dbe509150b2663cbaaee35c5a044d62c637cb205e5d8b83d9331e76d2
+size 3172

kaiko_eva-0.0.1/tests/eva/assets/images/random_grayscale_32x32.png

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:666e148b2c065ce478736dd9f391f1e07fc8129d337caeafc1cb6caca19539de
+size 1124

kaiko_eva-0.0.1/tests/eva/assets/vision/datasets/bach/ICIAR2018_BACH_Challenge/Photos/Benign/b001.tif

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2e5011a7e6caf906db9786e895b781f71c0e417bd388ba17c1a99a6f75e8f220
+size 908

kaiko_eva-0.0.1/tests/eva/assets/vision/datasets/bach/ICIAR2018_BACH_Challenge/Photos/Benign/b002.tif

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:68c0df9c053ebc859fda569ff3a25f1e06d3b0fddf8a0aa0232d641994e932d1
+size 908

kaiko_eva-0.0.1/tests/eva/assets/vision/datasets/bach/ICIAR2018_BACH_Challenge/Photos/Benign/b003.tif

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:93e9ce8a893a1bae2ae6437a411f3cd897c1b0e9d2c63ece18e3496c8066153a
+size 908

kaiko_eva-0.0.1/tests/eva/assets/vision/datasets/bach/ICIAR2018_BACH_Challenge/Photos/Benign/b004.tif

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a9d90a10a07d235b51b16535509e9d80c463edd6714134461641c315fb1d7906
+size 908

kaiko_eva-0.0.1/tests/eva/assets/vision/datasets/bach/ICIAR2018_BACH_Challenge/Photos/Benign/b005.tif

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f5a59092688fd94dcdb6859e44d2e6b84266d871d658cf35a7421f1e0248598e
+size 908

kaiko_eva-0.0.1/tests/eva/assets/vision/datasets/bach/ICIAR2018_BACH_Challenge/Photos/Benign/b006.tif

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f5a59092688fd94dcdb6859e44d2e6b84266d871d658cf35a7421f1e0248598e
+size 908

kaiko_eva-0.0.1/tests/eva/assets/vision/datasets/bach/ICIAR2018_BACH_Challenge/Photos/InSitu/is001.tif

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5d9cda32b512d90f92b23f064fa361c9130e7b1ad5ff8774d787b89e94c6d937
+size 908

kaiko_eva-0.0.1/tests/eva/assets/vision/datasets/bach/ICIAR2018_BACH_Challenge/Photos/InSitu/is002.tif

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:74e43265d7c65af781dd3c0b14e2a783c5db7be25ecf1dc41be22adf3f8feb6b
+size 908

kaiko_eva-0.0.1/tests/eva/assets/vision/datasets/bach/ICIAR2018_BACH_Challenge/Photos/InSitu/is003.tif

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c9b99687c2640b56a9b628508015bc3a7e2f3d9e4847496d16cec0eafc1a9164
+size 908

kaiko_eva-0.0.1/tests/eva/assets/vision/datasets/bach/ICIAR2018_BACH_Challenge/Photos/InSitu/is004.tif

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2156adc411ab5623dea4e9b56f527dcd40f81d3480630d30df4f57d437d8e247
+size 908

kaiko_eva-0.0.1/tests/eva/assets/vision/datasets/bach/ICIAR2018_BACH_Challenge/Photos/InSitu/is005.tif

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3a99490f9f011d70eb7a3d1e09c9b3391a589ccab5f2161e97bed2016e600040
+size 908