snowflake-ml-python 1.7.2__py3-none-any.whl → 1.7.4__py3-none-any.whl

snowflake/ml/registry/registry.py

@@ -117,41 +117,49 @@ class Registry:
         options: Optional[model_types.ModelSaveOption] = None,
     ) -> ModelVersion:
         """
-        Log a model with various parameters and metadata.
+        Log a model with various parameters and metadata, or a ModelVersion object.
 
         Args:
-            model: Model object of supported types such as Scikit-learn, XGBoost, LightGBM, Snowpark ML,
-                PyTorch, TorchScript, Tensorflow, Tensorflow Keras, MLFlow, HuggingFace Pipeline,
-                Sentence Transformers, or Custom Model.
-            model_name: Name to identify the model.
+            model: Supported model or ModelVersion object.
+                - Supported model: Model object of supported types such as Scikit-learn, XGBoost, LightGBM, Snowpark ML,
+                PyTorch, TorchScript, Tensorflow, Tensorflow Keras, MLFlow, HuggingFace Pipeline, Sentence Transformers,
+                or Custom Model.
+                - ModelVersion: Source ModelVersion object used to create the new ModelVersion object.
+            model_name: Name to identify the model. This must be a valid Snowflake SQL Identifier. Alphanumeric
+                characters and underscores are permitted.
+                See https://docs.snowflake.com/en/sql-reference/identifiers-syntax for more.
             version_name: Version identifier for the model. Combination of model_name and version_name must be unique.
                 If not specified, a random name will be generated.
             comment: Comment associated with the model version. Defaults to None.
             metrics: A JSON serializable dictionary containing metrics linked to the model version. Defaults to None.
-            signatures: Model data signatures for inputs and outputs for various target methods. If it is None,
-                sample_input_data would be used to infer the signatures for those models that cannot automatically
-                infer the signature. Defaults to None.
-            sample_input_data: Sample input data to infer model signatures from.
-                It would also be used as background data in explanation and to capture data lineage. Defaults to None.
             conda_dependencies: List of Conda package specifications. Use "[channel::]package [operator version]" syntax
                 to specify a dependency. It is a recommended way to specify your dependencies using conda. When channel
                 is not specified, Snowflake Anaconda Channel will be used. Defaults to None.
             pip_requirements: List of Pip package specifications. Defaults to None.
-                Currently it is not supported since Model can only executed in Snowflake Warehouse where all
-                dependencies are required to be retrieved from Snowflake Anaconda Channel.
+                Models with pip requirements are currently only runnable in Snowpark Container Services.
+                See https://docs.snowflake.com/en/developer-guide/snowflake-ml/model-registry/container for more.
+                Models with pip requirements specified will not be executable in Snowflake Warehouse where all
+                dependencies must be retrieved from Snowflake Anaconda Channel.
             target_platforms: List of target platforms to run the model. The only acceptable inputs are a combination of
                 {"WAREHOUSE", "SNOWPARK_CONTAINER_SERVICES"}. Defaults to None.
             python_version: Python version in which the model is run. Defaults to None.
+            signatures: Model data signatures for inputs and outputs for various target methods. If it is None,
+                sample_input_data would be used to infer the signatures for those models that cannot automatically
+                infer the signature. If not None, sample_input_data should not be specified. Defaults to None.
+            sample_input_data: Sample input data to infer model signatures from.
+                It would also be used as background data in explanation and to capture data lineage. Defaults to None.
             code_paths: List of directories containing code to import. Defaults to None.
             ext_modules: List of external modules to pickle with the model object.
                 Only supported when logging the following types of model:
                 Scikit-learn, Snowpark ML, PyTorch, TorchScript and Custom Model. Defaults to None.
             options (Dict[str, Any], optional): Additional model saving options.
+
                 Model Saving Options include:
+
                 - embed_local_ml_library: Embed local Snowpark ML into the code directory or folder.
                     Override to True if the local Snowpark ML version is not available in the Snowflake Anaconda
                     Channel. Otherwise, defaults to False
-                - relax_version: Whether or not relax the version constraints of the dependencies when running in the
+                - relax_version: Whether to relax the version constraints of the dependencies when running in the
                     Warehouse. It detects any ==x.y.z in specifiers and replaced with >=x.y, <(x+1). Defaults to True.
                 - function_type: Set the method function type globally. To set method function types individually see
                   function_type in model_options.
@@ -163,7 +171,10 @@ class Registry:
                     - max_batch_size: Maximum batch size that the method could accept in the Snowflake Warehouse.
                         Defaults to None, determined automatically by Snowflake.
                     - function_type: One of supported model method function types (FUNCTION or TABLE_FUNCTION).
+        Returns:
+            ModelVersion: ModelVersion object corresponding to the model just logged.
         """
+
         ...
 
     @overload
@@ -214,6 +225,7 @@ class Registry:
         python_version: Optional[str] = None,
         signatures: Optional[Dict[str, model_signature.ModelSignature]] = None,
         sample_input_data: Optional[model_types.SupportedDataType] = None,
+        user_files: Optional[Dict[str, List[str]]] = None,
         code_paths: Optional[List[str]] = None,
         ext_modules: Optional[List[ModuleType]] = None,
         task: model_types.Task = model_types.Task.UNKNOWN,
@@ -228,25 +240,31 @@ class Registry:
                 PyTorch, TorchScript, Tensorflow, Tensorflow Keras, MLFlow, HuggingFace Pipeline, Sentence Transformers,
                 or Custom Model.
                 - ModelVersion: Source ModelVersion object used to create the new ModelVersion object.
-            model_name: Name to identify the model.
+            model_name: Name to identify the model. This must be a valid Snowflake SQL Identifier. Alphanumeric
+                characters and underscores are permitted.
+                See https://docs.snowflake.com/en/sql-reference/identifiers-syntax for more.
             version_name: Version identifier for the model. Combination of model_name and version_name must be unique.
                 If not specified, a random name will be generated.
             comment: Comment associated with the model version. Defaults to None.
             metrics: A JSON serializable dictionary containing metrics linked to the model version. Defaults to None.
-            signatures: Model data signatures for inputs and outputs for various target methods. If it is None,
-                sample_input_data would be used to infer the signatures for those models that cannot automatically
-                infer the signature. If not None, sample_input_data should not be specified. Defaults to None.
-            sample_input_data: Sample input data to infer model signatures from.
-                It would also be used as background data in explanation and to capture data lineage. Defaults to None.
             conda_dependencies: List of Conda package specifications. Use "[channel::]package [operator version]" syntax
                 to specify a dependency. It is a recommended way to specify your dependencies using conda. When channel
                 is not specified, Snowflake Anaconda Channel will be used. Defaults to None.
             pip_requirements: List of Pip package specifications. Defaults to None.
-                Currently it is not supported since Model can only executed in Snowflake Warehouse where all
-                dependencies are required to be retrieved from Snowflake Anaconda Channel.
+                Models with pip requirements are currently only runnable in Snowpark Container Services.
+                See https://docs.snowflake.com/en/developer-guide/snowflake-ml/model-registry/container for more.
+                Models with pip requirements specified will not be executable in Snowflake Warehouse where all
+                dependencies must be retrieved from Snowflake Anaconda Channel.
             target_platforms: List of target platforms to run the model. The only acceptable inputs are a combination of
                 {"WAREHOUSE", "SNOWPARK_CONTAINER_SERVICES"}. Defaults to None.
             python_version: Python version in which the model is run. Defaults to None.
+            signatures: Model data signatures for inputs and outputs for various target methods. If it is None,
+                sample_input_data would be used to infer the signatures for those models that cannot automatically
+                infer the signature. If not None, sample_input_data should not be specified. Defaults to None.
+            sample_input_data: Sample input data to infer model signatures from.
+                It would also be used as background data in explanation and to capture data lineage. Defaults to None.
+            user_files: Dictionary where the keys are subdirectories, and values are lists of local file name
+                strings. The local file name strings can include wildcards (? or *) for matching multiple files.
             code_paths: List of directories containing code to import. Defaults to None.
             ext_modules: List of external modules to pickle with the model object.
                 Only supported when logging the following types of model:
@@ -261,7 +279,7 @@ class Registry:
                 - embed_local_ml_library: Embed local Snowpark ML into the code directory or folder.
                     Override to True if the local Snowpark ML version is not available in the Snowflake Anaconda
                     Channel. Otherwise, defaults to False
-                - relax_version: Whether or not relax the version constraints of the dependencies when running in the
+                - relax_version: Whether to relax the version constraints of the dependencies when running in the
                     Warehouse. It detects any ==x.y.z in specifiers and replaced with >=x.y, <(x+1). Defaults to True.
                 - function_type: Set the method function type globally. To set method function types individually see
                   function_type in model_options.
@@ -301,6 +319,7 @@ class Registry:
             python_version=python_version,
             signatures=signatures,
             sample_input_data=sample_input_data,
+            user_files=user_files,
             code_paths=code_paths,
             ext_modules=ext_modules,
             task=task,

snowflake/ml/version.py

@@ -1 +1 @@
-VERSION="1.7.2"
+VERSION="1.7.4"

{snowflake_ml_python-1.7.2.dist-info → snowflake_ml_python-1.7.4.dist-info}/METADATA

@@ -1,6 +1,6 @@
-Metadata-Version: 2.1
+Metadata-Version: 2.2
 Name: snowflake-ml-python
-Version: 1.7.2
+Version: 1.7.4
 Summary: The machine learning client library that is used for interacting with Snowflake to build machine learning solutions.
 Author-email: "Snowflake, Inc" <support@snowflake.com>
 License: 
@@ -233,11 +233,11 @@ Requires-Python: <3.12,>=3.9
 Description-Content-Type: text/markdown
 License-File: LICENSE.txt
 Requires-Dist: absl-py<2,>=0.15
-Requires-Dist: anyio<4,>=3.5.0
+Requires-Dist: anyio<5,>=3.5.0
 Requires-Dist: cachetools<6,>=3.1.1
 Requires-Dist: cloudpickle>=2.0.0
 Requires-Dist: cryptography
-Requires-Dist: fsspec[http]<2024,>=2022.11
+Requires-Dist: fsspec[http]<2026,>=2024.6.1
 Requires-Dist: importlib_resources<7,>=6.1.1
 Requires-Dist: numpy<2,>=1.23
 Requires-Dist: packaging<25,>=20.9
@@ -247,23 +247,24 @@ Requires-Dist: pyjwt<3,>=2.0.0
 Requires-Dist: pytimeparse<2,>=1.1.8
 Requires-Dist: pyyaml<7,>=6.0
 Requires-Dist: retrying<2,>=1.3.3
-Requires-Dist: s3fs<2024,>=2022.11
+Requires-Dist: s3fs<2026,>=2024.6.1
 Requires-Dist: scikit-learn<1.6,>=1.4
 Requires-Dist: scipy<2,>=1.9
 Requires-Dist: snowflake-connector-python[pandas]<4,>=3.5.0
-Requires-Dist: snowflake-snowpark-python<2,>=1.17.0
+Requires-Dist: snowflake-snowpark-python!=1.26.0,<2,>=1.17.0
 Requires-Dist: sqlparse<1,>=0.4
 Requires-Dist: typing-extensions<5,>=4.1.0
 Requires-Dist: xgboost<3,>=1.7.3
 Provides-Extra: all
 Requires-Dist: catboost<2,>=1.2.0; extra == "all"
+Requires-Dist: huggingface_hub<0.26; extra == "all"
 Requires-Dist: lightgbm<5,>=4.1.0; extra == "all"
-Requires-Dist: mlflow<2.4,>=2.1.0; extra == "all"
+Requires-Dist: mlflow<3,>=2.16.0; extra == "all"
 Requires-Dist: peft<1,>=0.5.0; extra == "all"
 Requires-Dist: sentence-transformers<3,>=2.2.2; extra == "all"
 Requires-Dist: sentencepiece<1,>=0.1.95; extra == "all"
 Requires-Dist: shap<1,>=0.46.0; extra == "all"
-Requires-Dist: tensorflow<3,>=2.10; extra == "all"
+Requires-Dist: tensorflow<3,>=2.12.0; extra == "all"
 Requires-Dist: tokenizers<1,>=0.10; extra == "all"
 Requires-Dist: torch<2.3.0,>=2.0.1; extra == "all"
 Requires-Dist: torchdata<1,>=0.4; extra == "all"
@@ -275,15 +276,16 @@ Requires-Dist: lightgbm<5,>=4.1.0; extra == "lightgbm"
 Provides-Extra: llm
 Requires-Dist: peft<1,>=0.5.0; extra == "llm"
 Provides-Extra: mlflow
-Requires-Dist: mlflow<2.4,>=2.1.0; extra == "mlflow"
+Requires-Dist: mlflow<3,>=2.16.0; extra == "mlflow"
 Provides-Extra: shap
 Requires-Dist: shap<1,>=0.46.0; extra == "shap"
 Provides-Extra: tensorflow
-Requires-Dist: tensorflow<3,>=2.10; extra == "tensorflow"
+Requires-Dist: tensorflow<3,>=2.12.0; extra == "tensorflow"
 Provides-Extra: torch
 Requires-Dist: torch<2.3.0,>=2.0.1; extra == "torch"
 Requires-Dist: torchdata<1,>=0.4; extra == "torch"
 Provides-Extra: transformers
+Requires-Dist: huggingface_hub<0.26; extra == "transformers"
 Requires-Dist: sentence-transformers<3,>=2.2.2; extra == "transformers"
 Requires-Dist: sentencepiece<1,>=0.1.95; extra == "transformers"
 Requires-Dist: tokenizers<1,>=0.10; extra == "transformers"
@@ -397,19 +399,67 @@ NOTE: Version 1.7.0 is used as example here. Please choose the the latest versio
 
 # Release History
 
-## 1.7.2
+## 1.7.4
+
+- FileSet: The `snowflake.ml.fileset.FileSet` has been deprecated and will be removed in a future version.
+  Use [snowflake.ml.dataset.Dataset](https://docs.snowflake.com/en/developer-guide/snowflake-ml/dataset) and
+  [snowflake.ml.data.DataConnector](https://docs.snowflake.com/en/developer-guide/snowpark-ml/reference/latest/api/data/snowflake.ml.data.data_connector.DataConnector)
+  instead.
 
 ### Bug Fixes
 
-- Model Explainability: Fix issue that explain is enabled for scikit-learn pipeline
-whose task is UNKNOWN and fails later when invoked.
+- Registry: Fixed an issue that the hugging face pipeline is loaded using incorrect dtype.
+- Registry: Fixed an issue that only 1 row is used when infer the model signature in the modeling model.
 
 ### Behavior Changes
 
+- Registry: `ModelVersion.run` on a service would require redeploying the service once account opts into nested function.
+
+### New Features
+
+- Add new `snowflake.ml.jobs` preview API for running headless workloads on SPCS using
+  [Container Runtime for ML](https://docs.snowflake.com/en/developer-guide/snowflake-ml/container-runtime-ml)
+- Added `guardrails` option to Cortex `complete` function, enabling
+  [Cortex Guard](https://docs.snowflake.com/en/user-guide/snowflake-cortex/llm-functions#cortex-guard) support
+
+## 1.7.3 (2025-01-08)
+
+- Added lowercase versions of Cortex functions, added deprecation warning to Capitalized versions.
+- Bumped the requirements of `fsspec` and `s3fs` to `>=2024.6.1,<2026`
+- Bumped the requirement of `mlflow` to `>=2.16.0, <3`
+- Registry: Support 500+ features for model registry
+
+### Bug Fixes
+
+- Registry: Fixed a bug when providing non-range index pandas DataFrame as the input to a `ModelVersion.run`.
+- Registry: Improved random model version name generation to prevent collisions.
+- Registry: Fix an issue when inferring signature or running inference with Snowpark data that has a column whose type
+  is `ARRAY` and contains `NULL` value.
+- Registry: `ModelVersion.run` now accepts fully qualified service name.
+- Monitoring: Fix issue in SDK with creating monitors using fully qualified names.
+- Registry: Fix error in log_model for any sklearn models with only data pre-processing including pre-processing only
+  pipeline models due to default explainability enablement.
+
+### New Features
+
+- Added `user_files` argument to `Registry.log_model` for including images or any extra file with the model.
+- Registry: Added support for handling Hugging Face model configurations with auto-mapping functionality
+- DataConnector: Add new `DataConnector.from_sql()` constructor
+- Registry: Provided new arguments to `snowflake.ml.model.model_signature.infer_signature` method to specify rows limit
+  to be used when inferring the signature.
+
+## 1.7.2 (2024-11-21)
+
+### Bug Fixes
+
+- Model Explainability: Fix issue that explain is enabled for scikit-learn pipeline
+whose task is UNKNOWN and fails later when invoked.
+
 ### New Features
 
 - Registry: Support asynchronous model inference service creation with the `block` option
   in `ModelVersion.create_service()` set to True by default.
+- Registry: Allow specify `batch_size` when inferencing using sentence-transformers model.
 
 ## 1.7.1 (2024-11-05)
 
@@ -424,8 +474,6 @@ signature inference.
 - Dataset: Fix missing `snowflake.ml.dataset.*` module exports in wheel.
 - Registry: Fix the issue that `tf_keras.Model` is not recognized as keras model when logging.
 
-### Behavior Changes
-
 ### New Features
 
 - Registry: Option to `enable_monitoring` set to False by default.  This will gate access to preview features of Model Monitoring.
@@ -674,10 +722,6 @@ data from explainablity and data lineage.
 - Modeling: Quick fix `import snowflake.ml.modeling.parameters.enable_anonymous_sproc` cannot be imported due to package
   dependency error.
 
-### Behavior Changes
-
-### New Features
-
 ## 1.5.1 (05-22-2024)
 
 ### Bug Fixes