hafnia 0.1.27__py3-none-any.whl → 0.2.1__py3-none-any.whl

{hafnia-0.1.27.dist-info → hafnia-0.2.1.dist-info}/METADATA

@@ -1,22 +1,27 @@
 Metadata-Version: 2.4
 Name: hafnia
-Version: 0.1.27
+Version: 0.2.1
 Summary: Python SDK for communication with Hafnia platform.
 Author-email: Milestone Systems <hafniaplatform@milestone.dk>
 License-File: LICENSE
 Requires-Python: >=3.10
 Requires-Dist: boto3>=1.35.91
 Requires-Dist: click>=8.1.8
-Requires-Dist: datasets>=3.2.0
 Requires-Dist: emoji>=2.14.1
 Requires-Dist: flatten-dict>=0.4.2
+Requires-Dist: more-itertools>=10.7.0
+Requires-Dist: opencv-python-headless>=4.11.0.86
 Requires-Dist: pathspec>=0.12.1
 Requires-Dist: pillow>=11.1.0
+Requires-Dist: polars>=1.30.0
 Requires-Dist: pyarrow>=18.1.0
+Requires-Dist: pycocotools>=2.0.10
 Requires-Dist: pydantic>=2.10.4
 Requires-Dist: rich>=13.9.4
+Requires-Dist: s5cmd>=0.2.0
 Requires-Dist: seedir>=0.5.0
 Requires-Dist: tqdm>=4.67.1
+Requires-Dist: xxhash>=3.5.0
 Description-Content-Type: text/markdown
 
 # Hafnia
@@ -28,8 +33,8 @@ The package includes the following interfaces:
 
 - `cli`: A Command Line Interface (CLI) to 1) configure/connect to Hafnia's [Training-aaS](https://hafnia.readme.io/docs/training-as-a-service) and 2) create and 
 launch recipe scripts.
-- `hafnia`: A python package with helper functions to load and interact with sample datasets and an experiment
- tracker (`HafniaLogger`). 
+- `hafnia`: A python package including `HafniaDataset` to manage datasets and `HafniaLogger` to do 
+experiment tracking.
 
 
 ## The Concept: Training as a Service (Training-aaS)
@@ -76,7 +81,7 @@ Copy the key and save it for later use.
 1. Download `mnist` from terminal to verify that your configuration is working.  
 
     ```bash
-    hafnia data download mnist --force
+    hafnia dataset download mnist --force
     ```
 
 ## Getting started: Loading datasets samples
@@ -84,115 +89,220 @@ With Hafnia configured on your local machine, it is now possible to download
 and explore the dataset sample with a python script:
 
 ```python
-from hafnia.data import load_dataset
+from hafnia.data import load_dataset, get_dataset_path
+from hafnia.dataset.hafnia_dataset import HafniaDataset
 
-dataset_splits = load_dataset("mnist")
+# To download the sample dataset use:
+path_dataset = get_dataset_path("midwest-vehicle-detection")
 ```
 
-### Dataset Format
-The returned sample dataset is a [hugging face dataset](https://huggingface.co/docs/datasets/index) 
-and contains train, validation and test splits. 
+This will download the dataset sample `midwest-vehicle-detection` to the local `.data/datasets/` folder
+in a human readable format. 
+
+Images are stored in the `data` folder, general dataset information is stored in `dataset_info.json`  
+and annotations are stored as both `annotations.jsonl`(jsonl) and `annotations.parquet`.
+
+```bash
+$ cd .data/datasets/
+$ tree midwest-vehicle-detection
+midwest-vehicle-detection
+└── sample
+    ├── annotations.jsonl
+    ├── annotations.parquet
+    ├── data
+    │   ├── video_0026a86b-2f43-49f2-a17c-59244d10a585_1fps_mp4_frame_00000.png
+    │   ....
+    │   ├── video_ff17d777-e783-44e2-9bff-a4adac73de4b_1fps_mp4_frame_00000.png
+    │   └── video_ff17d777-e783-44e2-9bff-a4adac73de4b_1fps_mp4_frame_00100.png
+    └── dataset_info.json
+
+3 directories, 217 files
+```
+
+You can interact with data as you want, but we also provide `HafniaDataset`
+for loading/saving, managing and interacting with the dataset.
+
+We recommend to visit and potentially execute the example script [examples/example_hafnia_dataset.py](examples/example_hafnia_dataset.py) 
+to see how to use the `HafniaDataset` class and its methods.
+
+Below is a short introduction to the `HafniaDataset` class.
+
+```python
+from hafnia.dataset.hafnia_dataset import HafniaDataset, Sample
+
+# Load dataset
+dataset = HafniaDataset.read_from_path(path_dataset)
+
+# Alternatively, you can use the 'load_dataset' function to download and load dataset in one go.
+# dataset = load_dataset("midwest-vehicle-detection")
+
+# Print dataset information
+dataset.print_stats()
+
+# Create a dataset split for training
+dataset_train = dataset.create_split_dataset("train")
+```
+
+The `HafniaDataset` object provides a convenient way to interact with the dataset, including methods for 
+creating splits, accessing samples, printing statistics, saving to and loading from disk.
+
+In essence, the `HafniaDataset` class contains `dataset.info` with dataset information 
+and `dataset.samples` with annotations as a polars DataFrame
 
 ```python
-print(dataset_splits)
-
-# Output:
->>> DatasetDict({
-    train: Dataset({
-        features: ['image_id', 'image', 'height', 'width', 'objects', 'Weather', 'Surface Conditions'],
-        num_rows: 172
-    })
-    validation: Dataset({
-        features: ['image_id', 'image', 'height', 'width', 'objects', 'Weather', 'Surface Conditions'],
-        num_rows: 21
-    })
-    test: Dataset({
-        features: ['image_id', 'image', 'height', 'width', 'objects', 'Weather', 'Surface Conditions'],
-        num_rows: 21
-    })
-})
+# Annotations are stored in a polars DataFrame
+print(dataset.samples.head(2))
+shape: (2, 14)
+┌──────────────┬─────────────────────────────────┬────────┬───────┬───┬─────────────────────────────────┬──────────┬──────────┬─────────────────────────────────┐
+│ sample_index ┆ file_name                       ┆ height ┆ width ┆ … ┆ objects                         ┆ bitmasks ┆ polygons ┆ meta                            │
+│ ---          ┆ ---                             ┆ ---    ┆ ---   ┆   ┆ ---                             ┆ ---      ┆ ---      ┆ ---                             │
+│ u32          ┆ str                             ┆ i64    ┆ i64   ┆   ┆ list[struct[11]]                ┆ null     ┆ null     ┆ struct[5]                       │
+╞══════════════╪═════════════════════════════════╪════════╪═══════╪═══╪═════════════════════════════════╪══════════╪══════════╪═════════════════════════════════╡
+│ 0            ┆ /home/ubuntu/code/hafnia/.data… ┆ 1080   ┆ 1920  ┆ … ┆ [{0.0492,0.0357,0.2083,0.23,"V… ┆ null     ┆ null     ┆ {120.0,1.0,"2024-07-10T18:30:0… │
+│ 100          ┆ /home/ubuntu/code/hafnia/.data… ┆ 1080   ┆ 1920  ┆ … ┆ [{0.146382,0.078704,0.42963,0.… ┆ null     ┆ null     ┆ {120.0,1.0,"2024-07-10T18:30:0… │
+└──────────────┴─────────────────────────────────┴────────┴───────┴───┴─────────────────────────────────┴──────────┴──────────┴─────────────────────────────────┘
+```
 
+```python
+# General dataset information is stored in `dataset.info`
+rich.print(dataset.info)
+DatasetInfo(
+    dataset_name='midwest-vehicle-detection',
+    version='1.0.0',
+    tasks=[
+        TaskInfo(
+            primitive=<class 'hafnia.dataset.primitives.Bbox'>,
+            class_names=[
+                'Person',
+                'Vehicle.Bicycle',
+                'Vehicle.Motorcycle',
+                'Vehicle.Car',
+                'Vehicle.Van',
+                'Vehicle.RV',
+                'Vehicle.Single_Truck',
+                'Vehicle.Combo_Truck',
+                'Vehicle.Pickup_Truck',
+                'Vehicle.Trailer',
+                'Vehicle.Emergency_Vehicle',
+                'Vehicle.Bus',
+                'Vehicle.Heavy_Duty_Vehicle'
+            ],
+            name='bboxes'
+        ),
+        TaskInfo(primitive=<class 'hafnia.dataset.primitives.Classification'>, class_names=['Clear', 'Foggy'], name='Weather'),
+        TaskInfo(primitive=<class 'hafnia.dataset.primitives.Classification'>, class_names=['Dry', 'Wet'], name='Surface Conditions')
+    ],
+    meta={
+        'n_videos': 109,
+        'n_cameras': 20,
+        'duration': 13080.0,
+        'duration_average': 120.0,
+        ...
+    }
+)
 ```
 
-A Hugging Face dataset is a dictionary with splits, where each split is a `Dataset` object.
-Each `Dataset` is structured as a table with a set of columns (also called features) and a row for each sample.
+You can iterate and access samples in the dataset using the `HafniaDataset` object.
+Each sample contain image and annotations information. 
 
-The features of the dataset can be viewed with the `features` attribute.
 ```python
-# View features of the train split
-pprint.pprint(dataset["train"].features)
-{'Surface Conditions': ClassLabel(names=['Dry', 'Wet'], id=None),
- 'Weather': ClassLabel(names=['Clear', 'Foggy'], id=None),
- 'height': Value(dtype='int64', id=None),
- 'image': Image(mode=None, decode=True, id=None),
- 'image_id': Value(dtype='int64', id=None),
- 'objects': Sequence(feature={'bbox': Sequence(feature=Value(dtype='int64',
-                                                             id=None),
-                                               length=-1,
-                                               id=None),
-                              'class_idx': ClassLabel(names=['Vehicle.Bicycle',
-                                                             'Vehicle.Motorcycle',
-                                                             'Vehicle.Car',
-                                                             'Vehicle.Van',
-                                                             'Vehicle.RV',
-                                                             'Vehicle.Single_Truck',
-                                                             'Vehicle.Combo_Truck',
-                                                             'Vehicle.Pickup_Truck',
-                                                             'Vehicle.Trailer',
-                                                             'Vehicle.Emergency_Vehicle',
-                                                             'Vehicle.Bus',
-                                                             'Vehicle.Heavy_Duty_Vehicle'],
-                                                      id=None),
-                              'class_name': Value(dtype='string', id=None),
-                              'id': Value(dtype='string', id=None)},
-                     length=-1,
-                     id=None),
- 'width': Value(dtype='int64', id=None)}
+from hafnia.dataset.hafnia_dataset import HafniaDataset, Sample
+# Access the first sample in the dataset either by index or by iterating over the dataset
+sample_dict = dataset[0]
+
+for sample_dict in dataset:
+    sample = Sample(**sample_dict)
+    print(sample.sample_id, sample.objects)
+    break
 ```
+Not that it is possible to create a `Sample` object from the sample dictionary.
+This is useful for accessing the image and annotations in a structured way.
 
-View the first sample in the training set:
 ```python
-# Print sample from the training set
-pprint.pprint(dataset["train"][0])
-
-{'image': <PIL.PngImagePlugin.PngImageFile image mode=RGB size=1920x1080 at 0x79D6292C5ED0>,
- 'image_id': 4920,
- 'height': 1080,
- 'Weather': 0,
- 'Surface Conditions': 0,
- 'objects': {'bbox': [[441, 180, 121, 126],
-                      [549, 151, 131, 103],
-                      [1845, 722, 68, 130],
-                      [1810, 571, 110, 149]],
-             'class_idx': [7, 7, 2, 2],
-             'class_name': ['Vehicle.Pickup_Truck',
-                            'Vehicle.Pickup_Truck',
-                            'Vehicle.Car',
-                            'Vehicle.Car'],
-             'id': ['HW6WiLAJ', 'T/ccFpRi', 'CS0O8B6W', 'DKrJGzjp']},
- 'width': 1920}
+# By unpacking the sample dictionary, you can create a `Sample` object.
+sample = Sample(**sample_dict)
+
+# Use the `Sample` object to easily read image and draw annotations
+image = sample.read_image()
+image_annotations = sample.draw_annotations()
+```
 
+Note that the `Sample` object contains all information about the sample, including image and metadata.
+It also contain annotations as primitive types such as `Bbox`, `Classification`. 
+
+```python
+rich.print(sample)
+Sample(
+    sample_index=120,
+    file_name='/home/ubuntu/code/hafnia/.data/datasets/midwest-vehicle-detection/data/343403325f27e390.png',
+    height=1080,
+    width=1920,
+    split='train',
+    is_sample=True,
+    collection_index=None,
+    collection_id=None,
+    remote_path='s3://mdi-production-midwest-vehicle-detection/sample/data/343403325f27e390.png',
+    classifications=[
+        Classification(
+            class_name='Clear',
+            class_idx=0,
+            object_id=None,
+            confidence=None,
+            ground_truth=True,
+            task_name='Weather',
+            meta=None
+        ),
+        Classification(
+            class_name='Day',
+            class_idx=3,
+            object_id=None,
+            confidence=None,
+            ground_truth=True,
+            task_name='Time of Day',
+            meta=None
+        ),
+        ...
+    ],
+    objects=[
+        Bbox(
+            height=0.0492,
+            width=0.0357,
+            top_left_x=0.2083,
+            top_left_y=0.23,
+            class_name='Vehicle.Car',
+            class_idx=3,
+            object_id='cXT4NRVu',
+            confidence=None,
+            ground_truth=True,
+            task_name='bboxes',
+            meta=None
+        ),
+        Bbox(
+            height=0.0457,
+            width=0.0408,
+            top_left_x=0.2521,
+            top_left_y=0.2153,
+            class_name='Vehicle.Car',
+            class_idx=3,
+            object_id='MelbIIDU',
+            confidence=None,
+            ground_truth=True,
+            task_name='bboxes',
+            meta=None
+        ),
+        ...
+    ],
+    bitmasks=None,  # Optional a list of Bitmask objects List[Bitmask]
+    polygons=None,  # Optional a list of Polygon objects List[Polygon]
+    meta={
+        'video.data_duration': 120.0,
+        'video.data_fps': 1.0,
+        ...
+    }
+)
 ```
 
-For hafnia based datasets, we want to standardized how a dataset and dataset tasks are represented.
-We have defined a set of features that are common across all datasets in the Hafnia data library.
-
-- `image`: The image itself, stored as a PIL image
-- `height`: The height of the image in pixels
-- `width`: The width of the image in pixels
-- `[IMAGE_CLASSIFICATION_TASK]`: [Optional] Image classification tasks are top-level `ClassLabel` feature. 
-  `ClassLabel` is a Hugging Face feature that maps class indices to class names. 
-  In above example we have two classification tasks:
-  - `Weather`: Classifies the weather conditions in the image, with possible values `Clear` and `Foggy`
-  - `Surface Conditions`: Classifies the surface conditions in the image, with possible values `Dry` and `Wet`
-- `objects`: A dictionary containing information about objects in the image, including:
-  - `bbox`: Bounding boxes for each object, represented with a list of bounding box coordinates 
-  `[xmin, ymin, bbox_width, bbox_height]`. Each bounding box is defined with a top-left corner coordinate 
-  `(xmin, ymin)` and bounding box width and height `(bbox_width, bbox_height)` in pixels.
-  - `class_idx`: Class indices for each detected object. This is a
-  `ClassLabel` feature that maps to the `class_name` feature.
-  - `class_name`: Class names for each detected object
-  - `id`: Unique identifiers for each detected object
+To learn more, view and potentially execute the example script [examples/example_hafnia_dataset.py](examples/example_hafnia_dataset.py). 
 
 ### Dataset Locally vs. Training-aaS
 An important feature of `load_dataset` is that it will return the full dataset 
@@ -354,7 +464,7 @@ curl -LsSf https://astral.sh/uv/install.sh | sh
 Create virtual environment and install python dependencies
 
 ```bash
-uv sync
+uv sync --dev
 ```
 
  Run tests:

hafnia-0.2.1.dist-info/RECORD

@@ -0,0 +1,50 @@
+cli/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+cli/__main__.py,sha256=pKYvJOk0toACDMrgEeUYT3P5EQPFmXdMRIQuLZLd3dc,1603
+cli/config.py,sha256=-BTdljjC42hXHb1P0yewea9knzgSBFsb909qJ5DEkCo,5531
+cli/consts.py,sha256=sj0MRwbbCT2Yl77FPddck1VWkFxp7QY6I9l1o75j_aE,963
+cli/dataset_cmds.py,sha256=VUMhnHGYPtNNJUK9aobKTx2zpVzLex4gTMmyQXuzCVw,1623
+cli/experiment_cmds.py,sha256=L-k_ZJ4B7I4cA8OvHcheSwXM6nx9aTF9G7eKBzAcOzQ,1961
+cli/profile_cmds.py,sha256=-HQcFgYI6Rqaefi0Nj-91KhiqPKUj7zOaiJWbHx_bac,3196
+cli/recipe_cmds.py,sha256=qnMfF-te47HXNkgyA0hm9X3etDQsqMnrVEGDCrzVjZU,1462
+cli/runc_cmds.py,sha256=QqhQe2sd7tK1Bl2aGfIWRyJjpP6F7Tducg7HULrHsZ4,4958
+hafnia/__init__.py,sha256=Zphq-cQoX95Z11zm4lkrU-YiAJxddR7IBfwDkxeHoDE,108
+hafnia/helper_testing.py,sha256=GnaNhXdY81arjCT9M2RUAmvn2-aIzRqlCtbWwGbOIaY,3901
+hafnia/http.py,sha256=HoPB03IL6e-nglTrw1NGT6sDx1T8VNas5HjTT1QZHnU,3035
+hafnia/log.py,sha256=sWF8tz78yBtwZ9ddzm19L1MBSBJ3L4G704IGeT1_OEU,784
+hafnia/torch_helpers.py,sha256=ho65B0WIu_SjbaKPRL4wabDNrnVumWH8QSXVH4r7NAY,11605
+hafnia/utils.py,sha256=aTZaeHldXn4Jx_AR2BYATxtLCRrBKBjjDFmpSZTSvV4,5138
+hafnia/data/__init__.py,sha256=o9QjiGbEcNa6r-qDmwwmxPXf-1UitNl5-WxFNcujqsg,111
+hafnia/data/factory.py,sha256=OY6l6c9UKk6OUDhG4Akb2VgcSaTRLHlbSndAe1HuW2U,813
+hafnia/dataset/dataset_helpers.py,sha256=WVCpbUfNbHy7MZJqJ3OyJF8k1hSObo3kScxpXT17Sj8,3510
+hafnia/dataset/dataset_names.py,sha256=mp7A_TOqgoqHUEBCPC4ReKNJ93cxwQB451owoCqD6yM,2120
+hafnia/dataset/dataset_upload_helper.py,sha256=D1BGaeEar4McpUvXj4Yy8nk1tr12IEVhP_Ma47OoWmU,21150
+hafnia/dataset/hafnia_dataset.py,sha256=4SJUq7pAqLkcFzgnOUUx8ERraE_sABctOAsONBJExME,27664
+hafnia/dataset/dataset_recipe/dataset_recipe.py,sha256=DbPLlmshF6DC98Cwko04XtBaXgSg966LZKR6JXD_9Sg,13632
+hafnia/dataset/dataset_recipe/recipe_transforms.py,sha256=wh1y2XyX0PwOwfuzJ3_17KKng2Rk0zLlgdfSHfS1SyM,1305
+hafnia/dataset/dataset_recipe/recipe_types.py,sha256=6LxfanhX9ihof1gGSonoC-56zSWsI8k2aS4Uw_QgXoM,5176
+hafnia/dataset/operations/dataset_stats.py,sha256=tSHPmkXt4WNgjf5-j3jIrsSy1Ajld3619AkUHaesXb4,445
+hafnia/dataset/operations/dataset_transformations.py,sha256=4ibC11upEtRGJgoFLv8lUnglv2xANZVfNdsvI1BMvfM,2960
+hafnia/dataset/operations/table_transformations.py,sha256=kCLbLRdiFSx1JG0IWtaKkhWcMtM7hy8zgm0Ehz0zO_g,7639
+hafnia/dataset/primitives/__init__.py,sha256=LAdTeK5GgmaF1se8f0Yj1lOTNqplXGL87kLeOnv1D8Q,627
+hafnia/dataset/primitives/bbox.py,sha256=HXYYy5BLNZwh-bO7aiAWg3z0OurUev8ISa-vYey8b8A,6055
+hafnia/dataset/primitives/bitmask.py,sha256=mq_wchMqGupJDc-a-mJh9uBO_mjHcXpLH49g591doAM,7619
+hafnia/dataset/primitives/classification.py,sha256=7UmePtrf3imfU56YUro21JvHGoktomMous1vTVKLjHU,2341
+hafnia/dataset/primitives/point.py,sha256=JCRwb-E4sDafodkg6wqyuAS1Yj-yaJbwiD8aB69_Ros,635
+hafnia/dataset/primitives/polygon.py,sha256=vhPrYHv6TqQZMTAyv9r3NV8Hu6YRSSD0srB0wOCIwQ4,4289
+hafnia/dataset/primitives/primitive.py,sha256=7jxcyFADVGf95pjeQHEOqAnR9eucLpxA2h8Blz3ppXI,1253
+hafnia/dataset/primitives/segmentation.py,sha256=jUMjOmYr9j4An3YSCw5CJC1W8ihXAbus3CXaTOpc7Xw,1905
+hafnia/dataset/primitives/utils.py,sha256=3gT1as-xXEj8CamoIuBb9gQwUN9Ae9qnqtqF_uEe0zo,1993
+hafnia/experiment/__init__.py,sha256=OEFE6HqhO5zcTCLZcPcPVjIg7wMFFnvZ1uOtAVhRz7M,85
+hafnia/experiment/hafnia_logger.py,sha256=dnV3VPzJK7DSeUh0g4Hk9w1g-eSXcVqJD9If0h2d2GE,6885
+hafnia/platform/__init__.py,sha256=zJsR6Hy_0iUcC9xL-lBnqR0mLfF4EUr_VXa_XQA7SlA,455
+hafnia/platform/builder.py,sha256=_g8ykQWETz5Y4Np9QU1a6wIzbbJwXCkbiOCA6JcF5Rc,5742
+hafnia/platform/datasets.py,sha256=J252hrejrBWUdS6hY4lRc9_SbYy7CMD92068lLHjPC8,6953
+hafnia/platform/download.py,sha256=oJzdxSIDTuw1an7maC6I7A5nZvDaZPhUkuAmyRwN9Kc,6843
+hafnia/platform/experiment.py,sha256=-nAfTmn1c8sE6pHDCTNZvWDTopkXndarJAPIGvsnk60,2389
+hafnia/visualizations/colors.py,sha256=003eAJVnBal4abaYIIpsrT7erIOIjTUHHYVJ1Tj1CDc,5226
+hafnia/visualizations/image_visualizations.py,sha256=RuFFj2fJCm9dxl2Lq0MumJHF81ZnX-IsDsTxm8ZFV9A,7313
+hafnia-0.2.1.dist-info/METADATA,sha256=A1_OEYNslARBFGoYBPm7_-3YivfUeA8adwUUbsM3UsY,19040
+hafnia-0.2.1.dist-info/WHEEL,sha256=qtCwoSJWgHk21S1Kb4ihdzI2rlJ1ZKaIurTj_ngOhyQ,87
+hafnia-0.2.1.dist-info/entry_points.txt,sha256=FCJVIQ8GP2VE9I3eeGVF5eLxVDNW_01pOJCpG_CGnMM,45
+hafnia-0.2.1.dist-info/licenses/LICENSE,sha256=wLZw1B7_mod_CO1H8LXqQgfqlWD6QceJR8--LJYRZGE,1078
+hafnia-0.2.1.dist-info/RECORD,,

cli/data_cmds.py

@@ -1,53 +0,0 @@
-from pathlib import Path
-from typing import Optional
-
-import click
-from rich import print as rprint
-
-import cli.consts as consts
-from cli.config import Config
-
-
-@click.group()
-def data():
-    """Manage data interaction"""
-    pass
-
-
-@data.command("get")
-@click.argument("url")
-@click.argument("destination")
-@click.pass_obj
-def data_get(cfg: Config, url: str, destination: click.Path) -> None:
-    """Download resource from Hafnia platform"""
-
-    from hafnia.platform import download_resource
-
-    try:
-        result = download_resource(resource_url=url, destination=str(destination), api_key=cfg.api_key)
-    except Exception:
-        raise click.ClickException(consts.ERROR_GET_RESOURCE)
-
-    rprint(result)
-
-
-@data.command("download")
-@click.argument("dataset_name")
-@click.argument("destination", default=None, required=False)
-@click.option("--force", is_flag=True, default=False, help="Force download")
-@click.pass_obj
-def data_download(cfg: Config, dataset_name: str, destination: Optional[click.Path], force: bool) -> Path:
-    """Download dataset from Hafnia platform"""
-
-    from hafnia.data.factory import download_or_get_dataset_path
-
-    try:
-        path_dataset = download_or_get_dataset_path(
-            dataset_name=dataset_name,
-            cfg=cfg,
-            output_dir=destination,
-            force_redownload=force,
-        )
-    except Exception:
-        raise click.ClickException(consts.ERROR_GET_RESOURCE)
-    return path_dataset

hafnia-0.1.27.dist-info/RECORD

@@ -1,27 +0,0 @@
-cli/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-cli/__main__.py,sha256=MX0RT1BP3t59rzCvdUqfw39Kw05HOF4OEtjDTwIU9h8,1594
-cli/config.py,sha256=R9w0NKIOtIxRKNs7ieeUrIKwRkrTlK5PqOVjc5VYljE,4923
-cli/consts.py,sha256=sj0MRwbbCT2Yl77FPddck1VWkFxp7QY6I9l1o75j_aE,963
-cli/data_cmds.py,sha256=BQiythAPwAwudgdUa68v50a345uw5flrcDiBHLGp9lo,1460
-cli/experiment_cmds.py,sha256=L-k_ZJ4B7I4cA8OvHcheSwXM6nx9aTF9G7eKBzAcOzQ,1961
-cli/profile_cmds.py,sha256=-HQcFgYI6Rqaefi0Nj-91KhiqPKUj7zOaiJWbHx_bac,3196
-cli/recipe_cmds.py,sha256=qnMfF-te47HXNkgyA0hm9X3etDQsqMnrVEGDCrzVjZU,1462
-cli/runc_cmds.py,sha256=6fHMi_dEd8g3Cx9PEfU4gJMZf5-G0IUPDcZh6DNq8Mw,4953
-hafnia/__init__.py,sha256=Zphq-cQoX95Z11zm4lkrU-YiAJxddR7IBfwDkxeHoDE,108
-hafnia/http.py,sha256=psCWdNKfKYiBrYD6bezat1AeHh77JJtJrPePiUAjTIk,2948
-hafnia/log.py,sha256=sWF8tz78yBtwZ9ddzm19L1MBSBJ3L4G704IGeT1_OEU,784
-hafnia/torch_helpers.py,sha256=P_Jl4IwqUebKVCOXNe6iTorJZA3S-3d92HV274UHIko,7456
-hafnia/utils.py,sha256=mJ5aOjSVSOrrQnpmaKLK71ld5jYpmtd3HciTIk_Wk88,4659
-hafnia/data/__init__.py,sha256=Pntmo_1fst8OhyrHB60jQ8mhJJ4hL38tdjLvt0YXEJo,73
-hafnia/data/factory.py,sha256=4fZDkWNyOK1QNCmsxsXfSztPJkJW_HBIa_PTdGCYHCM,2551
-hafnia/experiment/__init__.py,sha256=OEFE6HqhO5zcTCLZcPcPVjIg7wMFFnvZ1uOtAVhRz7M,85
-hafnia/experiment/hafnia_logger.py,sha256=usL5pl7XLJP-g1vZrwvbky5YiD6Bg-rOODYYAX5z43I,6830
-hafnia/platform/__init__.py,sha256=I-VIVXDxwBAUzxx8Zx0g_wykyDdFGTsjb_mYLmvxk2Y,443
-hafnia/platform/builder.py,sha256=_g8ykQWETz5Y4Np9QU1a6wIzbbJwXCkbiOCA6JcF5Rc,5742
-hafnia/platform/download.py,sha256=t055axPNHlXTYCQgZHOS2YMQt1I2_bc4G8dltsOKttY,4760
-hafnia/platform/experiment.py,sha256=-nAfTmn1c8sE6pHDCTNZvWDTopkXndarJAPIGvsnk60,2389
-hafnia-0.1.27.dist-info/METADATA,sha256=zClGBhUHMs5pW19BX5avM5tBWvF5KAQxmAvEwRKNeSw,14990
-hafnia-0.1.27.dist-info/WHEEL,sha256=qtCwoSJWgHk21S1Kb4ihdzI2rlJ1ZKaIurTj_ngOhyQ,87
-hafnia-0.1.27.dist-info/entry_points.txt,sha256=FCJVIQ8GP2VE9I3eeGVF5eLxVDNW_01pOJCpG_CGnMM,45
-hafnia-0.1.27.dist-info/licenses/LICENSE,sha256=wLZw1B7_mod_CO1H8LXqQgfqlWD6QceJR8--LJYRZGE,1078
-hafnia-0.1.27.dist-info/RECORD,,