juniper-data-client 0.3.0__tar.gz → 0.4.0__tar.gz

{juniper_data_client-0.3.0 → juniper_data_client-0.4.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: juniper-data-client
-Version: 0.3.0
+Version: 0.4.0
 Summary: HTTP client for the JuniperData dataset generation service
 Author: Paul Calnon
 License-Expression: MIT
@@ -8,20 +8,19 @@ Project-URL: Homepage, https://github.com/pcalnon/juniper-data-client
 Project-URL: Repository, https://github.com/pcalnon/juniper-data-client
 Project-URL: Documentation, https://github.com/pcalnon/juniper-data-client#readme
 Project-URL: Issues, https://github.com/pcalnon/juniper-data-client/issues
-Keywords: juniper,dataset,machine-learning,api-client
+Keywords: juniper,juniper-ml,juniper-ai,artificial-intelligence,dataset,machine-learning,api-client
 Classifier: Development Status :: 4 - Beta
 Classifier: Intended Audience :: Developers
 Classifier: Intended Audience :: Science/Research
 Classifier: Operating System :: OS Independent
 Classifier: Programming Language :: Python :: 3
-Classifier: Programming Language :: Python :: 3.11
 Classifier: Programming Language :: Python :: 3.12
 Classifier: Programming Language :: Python :: 3.13
 Classifier: Programming Language :: Python :: 3.14
 Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
 Classifier: Topic :: Software Development :: Libraries :: Python Modules
 Classifier: Typing :: Typed
-Requires-Python: >=3.11
+Requires-Python: >=3.12
 Description-Content-Type: text/markdown
 License-File: LICENSE
 Requires-Dist: numpy>=1.24.0
@@ -47,7 +46,16 @@ Python client library for the JuniperData REST API.
 
 ## Overview
 
-`juniper-data-client` provides a simple, robust client for interacting with the JuniperData dataset generation service. It is the official client library used by both JuniperCascor (neural network backend) and JuniperCanopy (web dashboard).
+`juniper-data-client` provides a simple, robust client for interacting with the JuniperData dataset generation service. It is the official client library used by both JuniperCascor (neural network backend) and juniper-canopy (web dashboard).
+
+## Ecosystem Compatibility
+
+This package is part of the [Juniper](https://github.com/pcalnon/juniper-ml) ecosystem.
+Compatible with:
+
+| juniper-data | juniper-cascor | juniper-canopy |
+|---|---|---|
+| 0.4.x | 0.3.x | 0.2.x |
 
 ## Installation
 
@@ -198,6 +206,12 @@ y_train = torch.from_numpy(arrays["y_train"])  # torch.float32
 | `download_artifact_bytes(id)`       | Download raw NPZ bytes                 |
 | `get_preview(id, n)`                | Get JSON preview of samples            |
 | `delete_dataset(id)`                | Delete a dataset                       |
+| `list_versions(name)`              | List version history for a dataset     |
+| `get_latest(name)`                 | Get latest version by name             |
+| `batch_delete(dataset_ids)`        | Delete multiple datasets               |
+| `batch_create(datasets)`           | Create multiple datasets               |
+| `batch_update_tags(dataset_ids, add_tags, remove_tags)` | Update tags on multiple datasets |
+| `batch_export(dataset_ids)`        | Export multiple datasets as ZIP        |
 | `close()`                           | Close the client session               |
 
 ### Exceptions
@@ -234,7 +248,7 @@ Downloaded artifacts contain the following numpy arrays (all `float32`):
 
 ## Requirements
 
-- Python >=3.11
+- Python >=3.12
 - numpy >=1.24.0
 - requests >=2.28.0
 - urllib3 >=2.0.0
@@ -243,8 +257,12 @@ Downloaded artifacts contain the following numpy arrays (all `float32`):
 
 MIT License - Copyright (c) 2024-2026 Paul Calnon
 
-## See Also
+## Juniper Ecosystem
+
+This package is part of the Juniper Cascade Correlation Neural Network Research Platform.
 
-- [JuniperData](https://github.com/pcalnon/Juniper/tree/main/JuniperData)
-- [JuniperCascor](https://github.com/pcalnon/Juniper/tree/main/JuniperCascor)
-- [JuniperCanopy](https://github.com/pcalnon/Juniper/tree/main/JuniperCanopy)
+| Package | Description | Install |
+|---------|-------------|---------|
+| [juniper-data-client](https://github.com/pcalnon/juniper-data-client) | Dataset service client (this package) | `pip install juniper-data-client` |
+| [juniper-cascor-client](https://github.com/pcalnon/juniper-cascor-client) | Neural network service client | `pip install juniper-cascor-client` |
+| [juniper-cascor-worker](https://github.com/pcalnon/juniper-cascor-worker) | Distributed training worker | `pip install juniper-cascor-worker` |

{juniper_data_client-0.3.0 → juniper_data_client-0.4.0}/README.md

@@ -4,7 +4,16 @@ Python client library for the JuniperData REST API.
 
 ## Overview
 
-`juniper-data-client` provides a simple, robust client for interacting with the JuniperData dataset generation service. It is the official client library used by both JuniperCascor (neural network backend) and JuniperCanopy (web dashboard).
+`juniper-data-client` provides a simple, robust client for interacting with the JuniperData dataset generation service. It is the official client library used by both JuniperCascor (neural network backend) and juniper-canopy (web dashboard).
+
+## Ecosystem Compatibility
+
+This package is part of the [Juniper](https://github.com/pcalnon/juniper-ml) ecosystem.
+Compatible with:
+
+| juniper-data | juniper-cascor | juniper-canopy |
+|---|---|---|
+| 0.4.x | 0.3.x | 0.2.x |
 
 ## Installation
 
@@ -155,6 +164,12 @@ y_train = torch.from_numpy(arrays["y_train"])  # torch.float32
 | `download_artifact_bytes(id)`       | Download raw NPZ bytes                 |
 | `get_preview(id, n)`                | Get JSON preview of samples            |
 | `delete_dataset(id)`                | Delete a dataset                       |
+| `list_versions(name)`              | List version history for a dataset     |
+| `get_latest(name)`                 | Get latest version by name             |
+| `batch_delete(dataset_ids)`        | Delete multiple datasets               |
+| `batch_create(datasets)`           | Create multiple datasets               |
+| `batch_update_tags(dataset_ids, add_tags, remove_tags)` | Update tags on multiple datasets |
+| `batch_export(dataset_ids)`        | Export multiple datasets as ZIP        |
 | `close()`                           | Close the client session               |
 
 ### Exceptions
@@ -191,7 +206,7 @@ Downloaded artifacts contain the following numpy arrays (all `float32`):
 
 ## Requirements
 
-- Python >=3.11
+- Python >=3.12
 - numpy >=1.24.0
 - requests >=2.28.0
 - urllib3 >=2.0.0
@@ -200,8 +215,12 @@ Downloaded artifacts contain the following numpy arrays (all `float32`):
 
 MIT License - Copyright (c) 2024-2026 Paul Calnon
 
-## See Also
+## Juniper Ecosystem
+
+This package is part of the Juniper Cascade Correlation Neural Network Research Platform.
 
-- [JuniperData](https://github.com/pcalnon/Juniper/tree/main/JuniperData)
-- [JuniperCascor](https://github.com/pcalnon/Juniper/tree/main/JuniperCascor)
-- [JuniperCanopy](https://github.com/pcalnon/Juniper/tree/main/JuniperCanopy)
+| Package | Description | Install |
+|---------|-------------|---------|
+| [juniper-data-client](https://github.com/pcalnon/juniper-data-client) | Dataset service client (this package) | `pip install juniper-data-client` |
+| [juniper-cascor-client](https://github.com/pcalnon/juniper-cascor-client) | Neural network service client | `pip install juniper-cascor-client` |
+| [juniper-cascor-worker](https://github.com/pcalnon/juniper-cascor-worker) | Distributed training worker | `pip install juniper-cascor-worker` |

{juniper_data_client-0.3.0 → juniper_data_client-0.4.0}/juniper_data_client/__init__.py

@@ -1,20 +1,13 @@
 """JuniperData Client - Python client library for the JuniperData REST API.
 
 This package provides a simple, robust client for interacting with the JuniperData
-dataset generation service, used by both JuniperCascor and JuniperCanopy.
+dataset generation service, used by both JuniperCascor and juniper-canopy.
 """
 
 from juniper_data_client.client import JuniperDataClient
-from juniper_data_client.exceptions import (
-    JuniperDataClientError,
-    JuniperDataConfigurationError,
-    JuniperDataConnectionError,
-    JuniperDataNotFoundError,
-    JuniperDataTimeoutError,
-    JuniperDataValidationError,
-)
+from juniper_data_client.exceptions import JuniperDataClientError, JuniperDataConfigurationError, JuniperDataConnectionError, JuniperDataNotFoundError, JuniperDataTimeoutError, JuniperDataValidationError
 
-__version__ = "0.3.0"
+__version__ = "0.4.0"
 
 __all__ = [
     "JuniperDataClient",

{juniper_data_client-0.3.0 → juniper_data_client-0.4.0}/juniper_data_client/client.py

@@ -1,7 +1,7 @@
 """REST API client for JuniperData service integration.
 
 Provides dataset creation, artifact download, and preview functionality
-for JuniperCascor and JuniperCanopy applications.
+for JuniperCascor and juniper-canopy applications.
 """
 
 import io
@@ -15,13 +15,7 @@ import requests
 from requests.adapters import HTTPAdapter
 from urllib3.util.retry import Retry
 
-from juniper_data_client.exceptions import (
-    JuniperDataClientError,
-    JuniperDataConnectionError,
-    JuniperDataNotFoundError,
-    JuniperDataTimeoutError,
-    JuniperDataValidationError,
-)
+from juniper_data_client.exceptions import JuniperDataClientError, JuniperDataConnectionError, JuniperDataNotFoundError, JuniperDataTimeoutError, JuniperDataValidationError
 
 
 class JuniperDataClient:
@@ -104,7 +98,7 @@ class JuniperDataClient:
             total=self.retries,
             backoff_factor=self.backoff_factor,
             status_forcelist=[429, 500, 502, 503, 504],
-            allowed_methods=["HEAD", "GET", "POST", "DELETE"],
+            allowed_methods=["HEAD", "GET", "POST", "PATCH", "DELETE"],
         )
 
         adapter = HTTPAdapter(
@@ -233,7 +227,16 @@ class JuniperDataClient:
         response = self._request("GET", f"/v1/generators/{name}/schema")
         return response.json()
 
-    def create_dataset(self, generator: str, params: Dict[str, Any], persist: bool = True) -> Dict[str, Any]:
+    def create_dataset(
+        self,
+        generator: str,
+        params: Dict[str, Any],
+        persist: bool = True,
+        name: Optional[str] = None,
+        description: Optional[str] = None,
+        created_by: Optional[str] = None,
+        parent_dataset_id: Optional[str] = None,
+    ) -> Dict[str, Any]:
         """Create a new dataset via the JuniperData API.
 
         If a dataset with the same parameters already exists, the existing
@@ -243,6 +246,11 @@ class JuniperDataClient:
             generator: Name of the dataset generator to use (e.g., "spiral")
             params: Parameters to pass to the generator
             persist: Whether to persist the dataset (default: True)
+            name: Optional dataset name for versioning. When provided, the service
+                automatically assigns an incrementing version number.
+            description: Optional human-readable description of the dataset.
+            created_by: Optional identifier for the creator (user or system).
+            parent_dataset_id: Optional ID of the parent dataset this was derived from.
 
         Returns:
             Parsed JSON response containing dataset_id, generator, meta, and artifact_url
@@ -251,15 +259,50 @@ class JuniperDataClient:
             JuniperDataValidationError: If parameters are invalid
             JuniperDataNotFoundError: If generator not found
         """
-        payload = {
+        payload: Dict[str, Any] = {
             "generator": generator,
             "params": params,
             "persist": persist,
         }
+        if name is not None:
+            payload["name"] = name
+        if description is not None:
+            payload["description"] = description
+        if created_by is not None:
+            payload["created_by"] = created_by
+        if parent_dataset_id is not None:
+            payload["parent_dataset_id"] = parent_dataset_id
 
         response = self._request("POST", "/v1/datasets", json=payload)
         return response.json()
 
+    def list_versions(self, name: str) -> Dict[str, Any]:
+        """List all versions of a named dataset.
+
+        Args:
+            name: Dataset name to list versions for.
+
+        Returns:
+            Dict with dataset_name, versions list, total count, and latest_version.
+        """
+        response = self._request("GET", "/v1/datasets/versions", params={"name": name})
+        return response.json()
+
+    def get_latest(self, name: str) -> Dict[str, Any]:
+        """Get the latest version of a named dataset.
+
+        Args:
+            name: Dataset name to get latest version of.
+
+        Returns:
+            Dataset metadata for the latest version.
+
+        Raises:
+            JuniperDataNotFoundError: If no versions exist for the given name.
+        """
+        response = self._request("GET", "/v1/datasets/latest", params={"name": name})
+        return response.json()
+
     def list_datasets(self, limit: int = 100, offset: int = 0) -> List[str]:
         """List dataset IDs.
 
@@ -394,6 +437,74 @@ class JuniperDataClient:
 
         return self.create_dataset("spiral", params)
 
+    # ─── Batch Operations ────────────────────────────────────────────────
+
+    def batch_delete(self, dataset_ids: List[str]) -> Dict[str, Any]:
+        """Delete multiple datasets in a single request.
+
+        Args:
+            dataset_ids: List of dataset IDs to delete (1-100).
+
+        Returns:
+            Dictionary with deleted, not_found, and total_deleted.
+        """
+        response = self._request("POST", "/v1/datasets/batch-delete", json={"dataset_ids": dataset_ids})
+        return response.json()
+
+    def batch_create(self, datasets: List[Dict[str, Any]]) -> Dict[str, Any]:
+        """Create multiple datasets in a single request.
+
+        Each item should have 'generator' and 'params' keys, and optionally
+        'persist', 'tags', and 'ttl_seconds'.
+
+        Args:
+            datasets: List of dataset specifications (1-50).
+
+        Returns:
+            Dictionary with results, total_created, and total_failed.
+        """
+        response = self._request("POST", "/v1/datasets/batch-create", json={"datasets": datasets})
+        return response.json()
+
+    def batch_update_tags(
+        self,
+        dataset_ids: List[str],
+        add_tags: Optional[List[str]] = None,
+        remove_tags: Optional[List[str]] = None,
+    ) -> Dict[str, Any]:
+        """Add or remove tags from multiple datasets.
+
+        Args:
+            dataset_ids: List of dataset IDs to update (1-100).
+            add_tags: Tags to add to all specified datasets.
+            remove_tags: Tags to remove from all specified datasets.
+
+        Returns:
+            Dictionary with updated, not_found, and total_updated.
+        """
+        payload: Dict[str, Any] = {"dataset_ids": dataset_ids}
+        if add_tags:
+            payload["add_tags"] = add_tags
+        if remove_tags:
+            payload["remove_tags"] = remove_tags
+        response = self._request("PATCH", "/v1/datasets/batch-tags", json=payload)
+        return response.json()
+
+    def batch_export(self, dataset_ids: List[str]) -> bytes:
+        """Export multiple datasets as a ZIP archive of NPZ files.
+
+        Args:
+            dataset_ids: List of dataset IDs to export (1-50).
+
+        Returns:
+            Raw bytes of the ZIP archive.
+
+        Raises:
+            JuniperDataNotFoundError: If none of the datasets exist.
+        """
+        response = self._request("POST", "/v1/datasets/batch-export", json={"dataset_ids": dataset_ids})
+        return response.content
+
     def close(self) -> None:
         """Close the client session and release resources."""
         self.session.close()

juniper_data_client-0.4.0/juniper_data_client/testing/__init__.py

@@ -0,0 +1,45 @@
+#####################################################################################################################################################################################################
+# Project:       Juniper
+# Sub-Project:   juniper-data-client
+# Application:   juniper_data_client
+# File Name:     __init__.py
+# Author:        Paul Calnon
+# Version:       0.4.0
+#
+# Date Created:  2026-02-27
+# Last Modified: 2026-02-27
+#
+# License:       MIT License
+# Copyright:     Copyright (c) 2024-2026 Paul Calnon
+#
+# Description:
+#    Testing submodule for juniper-data-client. Provides FakeDataClient,
+#    a drop-in replacement for JuniperDataClient that generates synthetic
+#    datasets in-memory without requiring a running JuniperData service.
+#####################################################################################################################################################################################################
+
+"""Testing utilities for juniper-data-client.
+
+Provides :class:`FakeDataClient` for use in unit tests of consumers
+like JuniperCascor and juniper-canopy, as well as standalone synthetic
+dataset generators.
+
+Usage::
+
+    from juniper_data_client.testing import FakeDataClient
+
+    with FakeDataClient() as client:
+        result = client.create_spiral_dataset(n_spirals=2, seed=42)
+        arrays = client.download_artifact_npz(result["dataset_id"])
+"""
+
+from juniper_data_client.testing.fake_client import FakeDataClient
+from juniper_data_client.testing.generators import generate_circle, generate_moon, generate_spiral, generate_xor
+
+__all__ = [
+    "FakeDataClient",
+    "generate_circle",
+    "generate_moon",
+    "generate_spiral",
+    "generate_xor",
+]