zenml-nightly 0.70.0.dev20241205__tar.gz → 0.71.0.dev20241207__tar.gz

{zenml_nightly-0.70.0.dev20241205 → zenml_nightly-0.71.0.dev20241207}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: zenml-nightly
-Version: 0.70.0.dev20241205
+Version: 0.71.0.dev20241207
 Summary: ZenML: Write production-ready ML code.
 Home-page: https://zenml.io
 License: Apache-2.0
@@ -288,7 +288,7 @@ Or, through our CLI command:
 zenml stack deploy --provider aws
 ```
 
-Alternatively, if the necessary pieces of infrastructure is already deployed, you can register a cloud stack seamlessly through the stack wizard:
+Alternatively, if the necessary pieces of infrastructure are already deployed, you can register a cloud stack seamlessly through the stack wizard:
 
 ```bash
 zenml stack register <STACK_NAME> --provider aws
@@ -336,9 +336,9 @@ def trainer(training_df: pd.DataFrame) -> Annotated["model", torch.nn.Module]:
 
 ![Exploring ZenML Models](/docs/book/.gitbook/assets/readme_mcp.gif)
 
-### Purpose built for machine learning with integration to you favorite tools
+### Purpose built for machine learning with integrations to your favorite tools
 
-While ZenML brings a lot of value of the box, it also integrates into your existing tooling and infrastructure without you having to be locked in.
+While ZenML brings a lot of value out of the box, it also integrates into your existing tooling and infrastructure without you having to be locked in.
 
 ```python
 from bentoml._internal.bento import bento
@@ -474,7 +474,7 @@ the Apache License Version 2.0.
     <a href="https://github.com/zenml-io/zenml-projects">Projects Showcase</a>
     <br />
     <br />
-    🎉 Version 0.70.0 is out. Check out the release notes
+    🎉 Version 0.71.0 is out. Check out the release notes
     <a href="https://github.com/zenml-io/zenml/releases">here</a>.
     <br />
     🖥️ Download our VS Code Extension <a href="https://marketplace.visualstudio.com/items?itemName=ZenML.zenml-vscode">here</a>.

{zenml_nightly-0.70.0.dev20241205 → zenml_nightly-0.71.0.dev20241207}/README.md

@@ -147,7 +147,7 @@ Or, through our CLI command:
 zenml stack deploy --provider aws
 ```
 
-Alternatively, if the necessary pieces of infrastructure is already deployed, you can register a cloud stack seamlessly through the stack wizard:
+Alternatively, if the necessary pieces of infrastructure are already deployed, you can register a cloud stack seamlessly through the stack wizard:
 
 ```bash
 zenml stack register <STACK_NAME> --provider aws
@@ -195,9 +195,9 @@ def trainer(training_df: pd.DataFrame) -> Annotated["model", torch.nn.Module]:
 
 ![Exploring ZenML Models](/docs/book/.gitbook/assets/readme_mcp.gif)
 
-### Purpose built for machine learning with integration to you favorite tools
+### Purpose built for machine learning with integrations to your favorite tools
 
-While ZenML brings a lot of value of the box, it also integrates into your existing tooling and infrastructure without you having to be locked in.
+While ZenML brings a lot of value out of the box, it also integrates into your existing tooling and infrastructure without you having to be locked in.
 
 ```python
 from bentoml._internal.bento import bento
@@ -333,7 +333,7 @@ the Apache License Version 2.0.
     <a href="https://github.com/zenml-io/zenml-projects">Projects Showcase</a>
     <br />
     <br />
-    🎉 Version 0.70.0 is out. Check out the release notes
+    🎉 Version 0.71.0 is out. Check out the release notes
     <a href="https://github.com/zenml-io/zenml/releases">here</a>.
     <br />
     🖥️ Download our VS Code Extension <a href="https://marketplace.visualstudio.com/items?itemName=ZenML.zenml-vscode">here</a>.

{zenml_nightly-0.70.0.dev20241205 → zenml_nightly-0.71.0.dev20241207}/RELEASE_NOTES.md

@@ -1,5 +1,117 @@
 <!-- markdown-link-check-disable -->
 
+# 0.71.0
+
+ZenML version 0.71.0 delivers a new Modal step operator integration as its 
+core feature, enabling efficient cloud execution for ML pipelines with granular 
+hardware configuration options. The release strengthens enterprise capabilities 
+through improved token management and dashboard features, while expanding 
+artifact handling with dynamic naming and enhanced visualization support. 
+Additionally, it includes various infrastructure improvements and bug fixes 
+that enhance the platform's stability and usability, particularly around 
+Docker connectivity, Kubernetes management, and service connector operations.
+
+## New Feature: Modal Step Operator Integration
+
+ZenML now [integrates with Modal](https://modal.com/), bringing lightning-fast 
+cloud execution capabilities to your ML pipelines. This new step operator[ 
+https://docs.zenml.io/stack-components/step-operators/modal] allows you to 
+execute individual pipeline steps on Modal's specialized compute instances, 
+offering notable speed particularly for Docker image building and hardware 
+provisioning. With simple configuration options, you can precisely specify 
+hardware requirements like GPU type, CPU count, and memory for each step, 
+making it ideal for resource-intensive ML workloads.
+
+## Other Highlights
+
+- **Workload API Token Management:** Refactored token management for improved 
+security with a generic API token dispenser.
+- **Dashboard Enhancements:** 
+  - Introduced service account management capabilities.
+  - Added API key creation and integration features.
+- **Dynamic Artifact Naming:** Introduced capability to dynamically name 
+artifacts.
+- **Visualization Enhancements:** Made dictionaries and lists visualizable, 
+added JSON visualization type.
+
+## Additional Features and Improvements
+
+- Improved error messages for Docker daemon connectivity
+- Enhanced SageMaker URL handling
+- Simplified model version artifact linkage
+- Added testing for pipeline templates
+- Improved Kubernetes pod and label length management
+- Allowed skipping type annotations for step inputs
+- Enabled using feature service instances instead of just names
+
+## Bug Fixes
+
+- Fixed issues with getting out of an inaccessible active stack
+- Fixed race conditions in the service connector type registry
+- Resolved migration test complications
+- Corrected documentation links
+- Fixed artifact store and artifact URI handling
+- Addressed various scalability and compatibility issues
+
+## Documentation Updates
+
+- Added documentation redirects
+- Updated PyTorch documentation links
+- Improved service connector documentation
+
+## What's Changed
+* Refactored workload API token management for better security and implemented generic API token dispenser by @stefannica in https://github.com/zenml-io/zenml/pull/3154
+* Add 0.70.0 to the migration tests by @avishniakov in https://github.com/zenml-io/zenml/pull/3190
+* Adjustments to the PR template by @bcdurak in https://github.com/zenml-io/zenml/pull/3194
+* [docs] Fix links in the how-to section of docs by @wjayesh in https://github.com/zenml-io/zenml/pull/3196
+* Fixing sagemaker urls to take the settings into consideration by @bcdurak in https://github.com/zenml-io/zenml/pull/3195
+* Add cached run into testing of migrations by @avishniakov in https://github.com/zenml-io/zenml/pull/3199
+* Fix service connector type registry race conditions by @stefannica in https://github.com/zenml-io/zenml/pull/3202
+* Refactor container resource configuration in Vertex Orchestrator test by @avishniakov in https://github.com/zenml-io/zenml/pull/3203
+* [docs] Add missing redirects by @wjayesh in https://github.com/zenml-io/zenml/pull/3200
+* Add links to `uv` new PyTorch documentation by @strickvl in https://github.com/zenml-io/zenml/pull/3204
+* Fix broken docs link by @strickvl in https://github.com/zenml-io/zenml/pull/3208
+* Bugfix for getting out of an inaccessible active stack with no permissions by @bcdurak in https://github.com/zenml-io/zenml/pull/3198
+* Simplify model version artifact linkage by @schustmi in https://github.com/zenml-io/zenml/pull/3175
+* Reenable macos testing by @avishniakov in https://github.com/zenml-io/zenml/pull/3205
+* Various fixes and improvements by @stefannica in https://github.com/zenml-io/zenml/pull/3211
+* Pass config path during zenml pipeline build by @schustmi in https://github.com/zenml-io/zenml/pull/3212
+* Add test for running templates by @schustmi in https://github.com/zenml-io/zenml/pull/3192
+* Fix service connector docstring by @schustmi in https://github.com/zenml-io/zenml/pull/3216
+* Improve error message when docker daemon is not reachable by @schustmi in https://github.com/zenml-io/zenml/pull/3214
+* Don't run migration for empty updates by @schustmi in https://github.com/zenml-io/zenml/pull/3210
+* Remove `--check` from format script and fix naming by @safoinme in https://github.com/zenml-io/zenml/pull/3218
+* More scalability improvements by @schustmi in https://github.com/zenml-io/zenml/pull/3206
+* Use correct keyword for artifact store open by @schustmi in https://github.com/zenml-io/zenml/pull/3220
+* Fix passing of some sagemaker settings by @schustmi in https://github.com/zenml-io/zenml/pull/3221
+* Add hint when trying to connect with api key by @schustmi in https://github.com/zenml-io/zenml/pull/3222
+* Allow passing None values as parameter for optional complex types by @schustmi in https://github.com/zenml-io/zenml/pull/3215
+* Limit kubernetes pod and label length by @schustmi in https://github.com/zenml-io/zenml/pull/3217
+* Updating the quickstart example to use the new `log_metadata` by @bcdurak in https://github.com/zenml-io/zenml/pull/3188
+* Allow skipping type annotations for step inputs by @schustmi in https://github.com/zenml-io/zenml/pull/3223
+* Modal Step Operator by @strickvl in https://github.com/zenml-io/zenml/pull/2948
+* Add dynamic artifacts naming, documentation and tests by @avishniakov in https://github.com/zenml-io/zenml/pull/3201
+* Run template CLI command and bugfix by @schustmi in https://github.com/zenml-io/zenml/pull/3225
+* Make dicts/lists visualizable and add JSON as viz type by @wjayesh in https://github.com/zenml-io/zenml/pull/2882
+* Instances of the `FeatureService`s are now used instead of only the names of the FeatureServices.  by @aiakide in https://github.com/zenml-io/zenml/pull/3209
+* Quickstart fixes by @schustmi in https://github.com/zenml-io/zenml/pull/3227
+* Add missing docs by @schustmi in https://github.com/zenml-io/zenml/pull/3226
+* Misc cleanup by @schustmi in https://github.com/zenml-io/zenml/pull/3229
+* Fix input resolution for steps with dynamic artifact names by @schustmi in https://github.com/zenml-io/zenml/pull/3228
+* Follow-up on the `run_metadata` changes by @bcdurak in https://github.com/zenml-io/zenml/pull/3193
+* Fixed broken links by @htahir1 in https://github.com/zenml-io/zenml/pull/3232
+* Fixed wandb login problem in Quickstart by @htahir1 in https://github.com/zenml-io/zenml/pull/3233
+* Misc bugfixes by @schustmi in https://github.com/zenml-io/zenml/pull/3234
+* Add additional way to fetch docker repo digest by @schustmi in https://github.com/zenml-io/zenml/pull/3231
+* AWS Image Builder implementation by @stefannica in https://github.com/zenml-io/zenml/pull/2904
+* Disable client-side caching for some orchestrators by @schustmi in https://github.com/zenml-io/zenml/pull/3235
+* Fix artifact uris for artifacts with name placeholders by @schustmi in https://github.com/zenml-io/zenml/pull/3237
+* Materializer test fix on Windows by @bcdurak in https://github.com/zenml-io/zenml/pull/3238
+* Fix GET step run endpoint to return unhydrated response if requested by @schustmi in https://github.com/zenml-io/zenml/pull/3240
+* Pipeline run API token fixes and improvements by @stefannica in https://github.com/zenml-io/zenml/pull/3242
+
+**Full Changelog**: https://github.com/zenml-io/zenml/compare/0.70.0...0.71.0
+
 # 0.70.0
 
 The **ZenML 0.70.0** release includes a significant number of database schema changes and migrations, which means upgrading to this version will require extra caution. As always, please make sure to make a copy of your production database before upgrading.

{zenml_nightly-0.70.0.dev20241205 → zenml_nightly-0.71.0.dev20241207}/pyproject.toml

@@ -1,6 +1,6 @@
 [tool.poetry]
 name = "zenml-nightly"
-version = "0.70.0.dev20241205"
+version = "0.71.0.dev20241207"
 packages = [{ include = "zenml", from = "src" }]
 description = "ZenML: Write production-ready ML code."
 authors = ["ZenML GmbH <info@zenml.io>"]

zenml_nightly-0.71.0.dev20241207/src/zenml/VERSION

@@ -0,0 +1 @@
+0.71.0.dev20241207

{zenml_nightly-0.70.0.dev20241205 → zenml_nightly-0.71.0.dev20241207}/src/zenml/integrations/wandb/flavors/wandb_experiment_tracker_flavor.py

@@ -23,7 +23,7 @@ from typing import (
     cast,
 )
 
-from pydantic import field_validator
+from pydantic import field_validator, BaseModel
 
 from zenml.config.base_settings import BaseSettings
 from zenml.experiment_trackers.base_experiment_tracker import (
@@ -60,18 +60,26 @@ class WandbExperimentTrackerSettings(BaseSettings):
         Args:
             value: The settings.
 
+        Raises:
+            ValueError: If converting the settings failed.
+
         Returns:
             Dict representation of the settings.
         """
         import wandb
 
         if isinstance(value, wandb.Settings):
-            # Depending on the wandb version, either `make_static` or `to_dict`
-            # is available to convert the settings to a dictionary
-            if hasattr(value, "make_static"):
+            # Depending on the wandb version, either `model_dump`, 
+            # `make_static` or `to_dict` is available to convert the settings 
+            # to a dictionary
+            if isinstance(value, BaseModel):
+                return value.model_dump()
+            elif hasattr(value, "make_static"):
                 return cast(Dict[str, Any], value.make_static())
-            else:
+            elif hasattr(value, "to_dict"):
                 return value.to_dict()
+            else:
+                raise ValueError("Unable to convert wandb settings to dict.")
         else:
             return value
 

{zenml_nightly-0.70.0.dev20241205 → zenml_nightly-0.71.0.dev20241207}/src/zenml/zen_server/auth.py

@@ -413,10 +413,7 @@ def authenticate_credentials(
                 logger.error(error)
                 raise CredentialsNotValid(error)
 
-            if pipeline_run_status in [
-                ExecutionStatus.FAILED,
-                ExecutionStatus.COMPLETED,
-            ]:
+            if pipeline_run_status.is_finished:
                 error = (
                     f"The execution of pipeline run "
                     f"{decoded_token.pipeline_run_id} has already concluded and "
@@ -461,10 +458,7 @@ def authenticate_credentials(
                 logger.error(error)
                 raise CredentialsNotValid(error)
 
-            if step_run_status in [
-                ExecutionStatus.FAILED,
-                ExecutionStatus.COMPLETED,
-            ]:
+            if step_run_status.is_finished:
                 error = (
                     f"The execution of step run "
                     f"{decoded_token.step_run_id} has already concluded and "

{zenml_nightly-0.70.0.dev20241205 → zenml_nightly-0.71.0.dev20241207}/src/zenml/zen_server/deploy/helm/Chart.yaml

@@ -1,6 +1,6 @@
 apiVersion: v2
 name: zenml
-version: "0.70.0"
+version: "0.71.0"
 description: Open source MLOps framework for portable production ready ML pipelines
 keywords:
 - mlops

{zenml_nightly-0.70.0.dev20241205 → zenml_nightly-0.71.0.dev20241207}/src/zenml/zen_server/deploy/helm/README.md

@@ -20,8 +20,8 @@ ZenML is an open-source MLOps framework designed to help you create robust, main
 To install the ZenML chart directly from Amazon ECR, use the following command:
 
 ```bash
-# example command for version 0.70.0
-helm install my-zenml oci://public.ecr.aws/zenml/zenml --version 0.70.0
+# example command for version 0.71.0
+helm install my-zenml oci://public.ecr.aws/zenml/zenml --version 0.71.0
 ```
 
 Note: Ensure you have OCI support enabled in your Helm client and that you are authenticated with Amazon ECR.

{zenml_nightly-0.70.0.dev20241205 → zenml_nightly-0.71.0.dev20241207}/src/zenml/zen_server/routers/auth_endpoints.py

@@ -41,7 +41,6 @@ from zenml.constants import (
 from zenml.enums import (
     APITokenType,
     AuthScheme,
-    ExecutionStatus,
     OAuthDeviceStatus,
     OAuthGrantTypes,
 )
@@ -589,10 +588,7 @@ def api_token(
                 "security reasons."
             )
 
-        if pipeline_run.status in [
-            ExecutionStatus.FAILED,
-            ExecutionStatus.COMPLETED,
-        ]:
+        if pipeline_run.status.is_finished:
             raise ValueError(
                 f"The execution of pipeline run {pipeline_run_id} has already "
                 "concluded and API tokens can no longer be generated for it "
@@ -609,10 +605,7 @@ def api_token(
                 "be generated for non-existent step runs for security reasons."
             )
 
-        if step_run.status in [
-            ExecutionStatus.FAILED,
-            ExecutionStatus.COMPLETED,
-        ]:
+        if step_run.status.is_finished:
             raise ValueError(
                 f"The execution of step run {step_run_id} has already "
                 "concluded and API tokens can no longer be generated for it "

zenml_nightly-0.71.0.dev20241207/src/zenml/zen_stores/migrations/versions/0.71.0_release.py

@@ -0,0 +1,23 @@
+"""Release [0.71.0].
+
+Revision ID: 0.71.0
+Revises: cc269488e5a9
+Create Date: 2024-12-04 20:44:19.316139
+
+"""
+
+# revision identifiers, used by Alembic.
+revision = "0.71.0"
+down_revision = "cc269488e5a9"
+branch_labels = None
+depends_on = None
+
+
+def upgrade() -> None:
+    """Upgrade database schema and/or data, creating a new revision."""
+    pass
+
+
+def downgrade() -> None:
+    """Downgrade database schema and/or data back to the previous revision."""
+    pass

zenml_nightly-0.70.0.dev20241205/src/zenml/VERSION

@@ -1 +0,0 @@
-0.70.0.dev20241205