snowflake-ml-python 1.53.0__tar.gz → 2.0.0__tar.gz

{snowflake_ml_python-1.53.0 → snowflake_ml_python-2.0.0}/CHANGELOG.md

@@ -1,6 +1,115 @@
 # Release History
 
-## 1.53.0
+## 2.0.0
+
+Release candidate for the `snowflake-ml-python` 2.0 major release. This is a breaking
+release that removes deprecated APIs and slims down the default install footprint.
+
+### New Features
+
+* Feature Store: added `alter_online_service(size=...)`, which changes the size of an existing Online Service. The
+  call returns as soon as the request is recorded; the change runs in the background and can take hours on a large
+  Online Service, which keeps serving online reads and stream ingestion throughout. Poll
+  `get_online_service_status()` until `status` is `RUNNING` at the requested size.
+
+### Bug Fixes
+
+* Feature Store: `delete_feature_view` now drops the online feature table before the
+  offline dynamic table or view, so a dependent FeatureGroup (error 099940) does not
+  leave an orphaned offline object.
+
+### Behavior Changes
+
+* Registry: Models logged from a Snowflake Container Runtime notebook without an explicit
+  `target_platforms` now default to both Warehouse and Snowpark Container Services instead of
+  Snowpark Container Services only. Warehouse is no longer dropped from the default target
+  platforms.
+* Dependencies: `scikit-learn`, `xgboost`, and `shap` are no longer required dependencies of
+  `snowflake-ml-python`. They are now optional extras. Install them with
+  `pip install snowflake-ml-python[scikit-learn]`, `[xgboost]`, `[shap]`, or `[all]` when using
+  the corresponding functionality. Extras are independent: `[xgboost]` and `[lightgbm]` install
+  only those libraries, not `scikit-learn`. Native XGBoost or LightGBM models (for example
+  logging to the Model Registry) only need `[xgboost]` or `[lightgbm]`.
+  `snowflake.ml.modeling` estimators always require `scikit-learn`, so the XGBoost and LightGBM
+  wrappers need `pip install "snowflake-ml-python[xgboost,scikit-learn]"` or
+  `"snowflake-ml-python[lightgbm,scikit-learn]"`.
+* Feature Store: Added an optional `feature_store` extra. Install `snowflake-ml-python[feature_store]`
+  to pull in `httpx`, which is required for online feature serving reads. `httpx` is not installed by
+  the default `snowflake-ml-python` install. Conda users still need to install `httpx` separately
+  (for example `conda install httpx`) to use the online Feature Store.
+* Modeling: Importing a `snowflake.ml.modeling` subpackage (for example
+  `snowflake.ml.modeling.linear_model`, `snowflake.ml.modeling.xgboost`,
+  `snowflake.ml.modeling.lightgbm`, or `snowflake.ml.modeling.preprocessing`) without the optional
+  dependencies it needs now raises an actionable `ImportError` that names only the missing
+  package(s), instead of a confusing missing-attribute error.
+  `scikit-learn` and `xgboost` are attributed to the 2.0 dependency change; `lightgbm` was
+  already an optional extra before 2.0.
+
+### Deprecations
+
+* Modeling: The `snowflake.ml.modeling` estimators and preprocessing transformers are deprecated and
+  will be removed in a future release. Importing a `snowflake.ml.modeling` subpackage now emits a
+  `DeprecationWarning`. Train models with the native scikit-learn, XGBoost, or LightGBM estimators
+  and log them to the Snowflake Model Registry (`snowflake.ml.registry`) instead.
+
+### Breaking Changes
+
+* Generic: Require python >= 3.10. Python 3.9 is no longer supported.
+* Removed the deprecated `snowflake.ml.utils.connection_params.SnowflakeLoginOptions` public API
+  (deprecated since 1.8.5).
+* Registry: `ModelVersion.run_batch` now runs on `EXECUTE INFERENCE JOB SERVICE`. The single
+  `job_spec` argument is replaced by the `resources_spec`, `inference_spec`, and `image_build_spec`
+  blocks, and input may be supplied as either a DataFrame (`X`) or an existing stage path
+  (`input_stage_location`). `output_spec.stage_location` is treated as a base: results are written
+  under a per-job subdirectory, `<stage_location>/<job_name>/`. `output_spec.base_stage_location`,
+  `job_spec.job_name_prefix`, and `job_spec.block` no longer exist.
+* Registry: Removed the `snowflake.ml.model.batch` module. Use `snowflake.ml.model.batch_inference`,
+  which exports `BatchInferenceTask` alongside the input, output, resources, inference, and image
+  build spec classes.
+* Feature Store: Feature views created before 1.42.0 that use the `last_distinct_n` or
+  `first_distinct_n` aggregation function can no longer be read offline. `generate_dataset`,
+  `generate_training_set`, `retrieve_feature_values`, and `read_feature_view` now raise a
+  `ValueError` for such feature views. Re-create the feature view to restore offline reads.
+* Dependencies: `snowflake-snowpark-python` must now be `>=1.37.0`. Earlier releases import
+  `pkg_resources`, which `setuptools` removed in 82.0.0, so they fail to import in environments
+  with a current `setuptools`.
+
+## 1.54.0 (2026-08-31)
+
+### New Features
+
+* Registry: `log_model(..., options={"case_sensitive": True})` and
+  `options={"max_batch_size": N}` apply those settings to all methods. Per-method
+  `method_options` still override the global values.
+
+* Feature Store: `create_online_service` accepts a `size` kwarg naming the size to provision the Online
+  Service at, one of `"XS"`, `"S"`, `"M"`, `"L"`, `"XL"`, `"2XL"`, `"3XL"` (case-insensitive). When
+  omitted, the server-side default applies; accounts that cap the available size provision at their
+  cap. `get_online_service_status()` now reports the provisioned `size`, which is `None` for services
+  created before sizes were recorded.
+
+* Experiment Tracking: Source provenance now also records the id of the enclosing ML job when a run is created from
+  inside one.
+* ML Jobs: `submit_file`, `submit_directory`, `submit_from_stage`, and `@remote` accept a `comment` kwarg, attached as
+  the comment on the job service. When omitted, the comment defaults to the `application` name configured on the
+  session, so jobs submitted by a tool or partner integration remain attributable after the fact.
+
+### Bug Fixes
+
+* Feature Store: Feature View metadata tags carrying unknown keys (including a legacy `refresh_mode`)
+  no longer fail to deserialize; unknown keys are ignored on read and the tag still does not persist
+  `refresh_mode`.
+* Registry: Fixed `ModelVersion.load()` failing with `ValueError: ... is not a valid SQL identifier`
+  when the model's owner role is a quoted identifier.
+* Feature Store: Fixed FeatureStore.update_feature_view() failing with `SQL compilation error:
+  invalid value 'ADAPTIVE' for property 'REFRESH_MODE'` when enabling online storage for an existing
+  feature view.
+
+### Behavior Changes
+
+### Deprecations
+
+## 1.53.0 (2026-08-24)
 
 ### New Features
 
@@ -29,6 +138,10 @@
 
 ### Bug Fixes
 
+* Feature Store: online feature reads and stream ingestion no longer fail while the Online Service is
+  changing size (status `UPDATING_SIZE`). The service serves reads and writes throughout a size
+  change, which can take hours, so it is now treated as serviceable like `UPDATING` already was.
+
 ### Behavior Changes
 
 * Feature Store: `register_feature_view` now records `FV_SOURCE_REFS` metadata for managed batch

{snowflake_ml_python-1.53.0 → snowflake_ml_python-2.0.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: snowflake-ml-python
-Version: 1.53.0
+Version: 2.0.0
 Summary: The machine learning client library that is used for interacting with Snowflake to build machine learning solutions.
 Author-email: "Snowflake, Inc" <support@snowflake.com>
 License: 
@@ -220,7 +220,6 @@ Classifier: Intended Audience :: Information Technology
 Classifier: Intended Audience :: System Administrators
 Classifier: License :: OSI Approved :: Apache Software License
 Classifier: Operating System :: OS Independent
-Classifier: Programming Language :: Python :: 3.9
 Classifier: Programming Language :: Python :: 3.10
 Classifier: Programming Language :: Python :: 3.11
 Classifier: Programming Language :: Python :: 3.12
@@ -230,14 +229,13 @@ Classifier: Topic :: Software Development :: Libraries
 Classifier: Topic :: Software Development :: Libraries :: Application Frameworks
 Classifier: Topic :: Software Development :: Libraries :: Python Modules
 Classifier: Topic :: Scientific/Engineering :: Information Analysis
-Requires-Python: <3.14,>=3.9
+Requires-Python: <3.14,>=3.10
 Description-Content-Type: text/markdown
 License-File: LICENSE.txt
 Requires-Dist: anyio<5,>=3.5.0
 Requires-Dist: cachetools>=3.1.1
 Requires-Dist: cloudpickle>=2.0.0
 Requires-Dist: fsspec[http]<2026,>=2024.6.1
-Requires-Dist: h2<5,>=4.3.0
 Requires-Dist: importlib_resources<7,>=6.1.1
 Requires-Dist: jinja2<4,>=3.1.0
 Requires-Dist: numpy<3,>=1.23
@@ -250,34 +248,39 @@ Requires-Dist: pyjwt<3,>=2.0.0
 Requires-Dist: pytimeparse<2,>=1.1.8
 Requires-Dist: pyyaml<7,>=6.0
 Requires-Dist: retrying<2,>=1.3.3
-Requires-Dist: scikit-learn<1.9
 Requires-Dist: scipy<2,>=1.9
-Requires-Dist: shap<1,>=0.46.0
 Requires-Dist: snowflake-connector-python[pandas]<5,>=3.17.3
-Requires-Dist: snowflake-snowpark-python!=1.26.0,<2,>=1.17.0
+Requires-Dist: snowflake-snowpark-python<2,>=1.37.0
 Requires-Dist: sqlparse<1,>=0.4
 Requires-Dist: tqdm<5
 Requires-Dist: typing-extensions<5,>=4.1.0
-Requires-Dist: xgboost<4
 Provides-Extra: all
 Requires-Dist: altair<7,>=5; extra == "all"
 Requires-Dist: catboost<2,>=1.2.0; extra == "all"
+Requires-Dist: h2<5,>=4.3.0; extra == "all"
+Requires-Dist: httpx<1,>=0.28.1; extra == "all"
 Requires-Dist: keras<4,>=2.0.0; extra == "all"
 Requires-Dist: lightgbm<5,>=4.1.0; extra == "all"
 Requires-Dist: mlflow<4,>=2.16.0; extra == "all"
 Requires-Dist: prophet<2,>=1.1.0; extra == "all"
+Requires-Dist: scikit-learn<1.9; extra == "all"
 Requires-Dist: sentence-transformers<6,>=2.7.0; extra == "all"
 Requires-Dist: sentencepiece<0.3,>=0.1.95; extra == "all"
+Requires-Dist: shap<1,>=0.46.0; extra == "all"
 Requires-Dist: streamlit<2,>=1.30.0; extra == "all"
 Requires-Dist: tensorflow<3,>=2.17.0; extra == "all"
 Requires-Dist: tokenizers<1,>=0.15.1; extra == "all"
 Requires-Dist: torch<3,>=2.0.1; extra == "all"
 Requires-Dist: torchdata<1,>=0.4; extra == "all"
 Requires-Dist: transformers!=4.51.3,<6,>=4.39.3; extra == "all"
+Requires-Dist: xgboost<4; extra == "all"
 Provides-Extra: altair
 Requires-Dist: altair<7,>=5; extra == "altair"
 Provides-Extra: catboost
 Requires-Dist: catboost<2,>=1.2.0; extra == "catboost"
+Provides-Extra: feature-store
+Requires-Dist: h2<5,>=4.3.0; extra == "feature-store"
+Requires-Dist: httpx<1,>=0.28.1; extra == "feature-store"
 Provides-Extra: keras
 Requires-Dist: keras<4,>=2.0.0; extra == "keras"
 Requires-Dist: tensorflow<3,>=2.17.0; extra == "keras"
@@ -296,6 +299,10 @@ Provides-Extra: mlflow
 Requires-Dist: mlflow<4,>=2.16.0; extra == "mlflow"
 Provides-Extra: prophet
 Requires-Dist: prophet<2,>=1.1.0; extra == "prophet"
+Provides-Extra: scikit-learn
+Requires-Dist: scikit-learn<1.9; extra == "scikit-learn"
+Provides-Extra: shap
+Requires-Dist: shap<1,>=0.46.0; extra == "shap"
 Provides-Extra: streamlit
 Requires-Dist: streamlit<2,>=1.30.0; extra == "streamlit"
 Provides-Extra: tensorflow
@@ -309,6 +316,8 @@ Requires-Dist: sentencepiece<0.3,>=0.1.95; extra == "transformers"
 Requires-Dist: tokenizers<1,>=0.15.1; extra == "transformers"
 Requires-Dist: torch<3,>=2.0.1; extra == "transformers"
 Requires-Dist: transformers!=4.51.3,<6,>=4.39.3; extra == "transformers"
+Provides-Extra: xgboost
+Requires-Dist: xgboost<4; extra == "xgboost"
 Dynamic: license-file
 
 # Snowflake ML Python
@@ -370,7 +379,7 @@ In Snowflake Warehouse notebook environments, snowflake-ml-python can be install
 Follow the [installation instructions](https://docs.snowflake.com/en/developer-guide/snowpark-ml/index#installing-snowpark-ml)
 in the Snowflake documentation.
 
-Python versions 3.9 to 3.12 are supported. You can use [miniconda](https://docs.conda.io/en/latest/miniconda.html) or
+Python versions 3.10 to 3.13 are supported. You can use [miniconda](https://docs.conda.io/en/latest/miniconda.html) or
 [anaconda](https://www.anaconda.com/) to create a Conda environment (recommended),
 or [virtualenv](https://docs.python.org/3/tutorial/venv.html) to create a virtual environment.
 
@@ -416,7 +425,116 @@ NOTE: Version 1.7.0 is used as example here. Please choose the the latest versio
 
 # Release History
 
-## 1.53.0
+## 2.0.0
+
+Release candidate for the `snowflake-ml-python` 2.0 major release. This is a breaking
+release that removes deprecated APIs and slims down the default install footprint.
+
+### New Features
+
+* Feature Store: added `alter_online_service(size=...)`, which changes the size of an existing Online Service. The
+  call returns as soon as the request is recorded; the change runs in the background and can take hours on a large
+  Online Service, which keeps serving online reads and stream ingestion throughout. Poll
+  `get_online_service_status()` until `status` is `RUNNING` at the requested size.
+
+### Bug Fixes
+
+* Feature Store: `delete_feature_view` now drops the online feature table before the
+  offline dynamic table or view, so a dependent FeatureGroup (error 099940) does not
+  leave an orphaned offline object.
+
+### Behavior Changes
+
+* Registry: Models logged from a Snowflake Container Runtime notebook without an explicit
+  `target_platforms` now default to both Warehouse and Snowpark Container Services instead of
+  Snowpark Container Services only. Warehouse is no longer dropped from the default target
+  platforms.
+* Dependencies: `scikit-learn`, `xgboost`, and `shap` are no longer required dependencies of
+  `snowflake-ml-python`. They are now optional extras. Install them with
+  `pip install snowflake-ml-python[scikit-learn]`, `[xgboost]`, `[shap]`, or `[all]` when using
+  the corresponding functionality. Extras are independent: `[xgboost]` and `[lightgbm]` install
+  only those libraries, not `scikit-learn`. Native XGBoost or LightGBM models (for example
+  logging to the Model Registry) only need `[xgboost]` or `[lightgbm]`.
+  `snowflake.ml.modeling` estimators always require `scikit-learn`, so the XGBoost and LightGBM
+  wrappers need `pip install "snowflake-ml-python[xgboost,scikit-learn]"` or
+  `"snowflake-ml-python[lightgbm,scikit-learn]"`.
+* Feature Store: Added an optional `feature_store` extra. Install `snowflake-ml-python[feature_store]`
+  to pull in `httpx`, which is required for online feature serving reads. `httpx` is not installed by
+  the default `snowflake-ml-python` install. Conda users still need to install `httpx` separately
+  (for example `conda install httpx`) to use the online Feature Store.
+* Modeling: Importing a `snowflake.ml.modeling` subpackage (for example
+  `snowflake.ml.modeling.linear_model`, `snowflake.ml.modeling.xgboost`,
+  `snowflake.ml.modeling.lightgbm`, or `snowflake.ml.modeling.preprocessing`) without the optional
+  dependencies it needs now raises an actionable `ImportError` that names only the missing
+  package(s), instead of a confusing missing-attribute error.
+  `scikit-learn` and `xgboost` are attributed to the 2.0 dependency change; `lightgbm` was
+  already an optional extra before 2.0.
+
+### Deprecations
+
+* Modeling: The `snowflake.ml.modeling` estimators and preprocessing transformers are deprecated and
+  will be removed in a future release. Importing a `snowflake.ml.modeling` subpackage now emits a
+  `DeprecationWarning`. Train models with the native scikit-learn, XGBoost, or LightGBM estimators
+  and log them to the Snowflake Model Registry (`snowflake.ml.registry`) instead.
+
+### Breaking Changes
+
+* Generic: Require python >= 3.10. Python 3.9 is no longer supported.
+* Removed the deprecated `snowflake.ml.utils.connection_params.SnowflakeLoginOptions` public API
+  (deprecated since 1.8.5).
+* Registry: `ModelVersion.run_batch` now runs on `EXECUTE INFERENCE JOB SERVICE`. The single
+  `job_spec` argument is replaced by the `resources_spec`, `inference_spec`, and `image_build_spec`
+  blocks, and input may be supplied as either a DataFrame (`X`) or an existing stage path
+  (`input_stage_location`). `output_spec.stage_location` is treated as a base: results are written
+  under a per-job subdirectory, `<stage_location>/<job_name>/`. `output_spec.base_stage_location`,
+  `job_spec.job_name_prefix`, and `job_spec.block` no longer exist.
+* Registry: Removed the `snowflake.ml.model.batch` module. Use `snowflake.ml.model.batch_inference`,
+  which exports `BatchInferenceTask` alongside the input, output, resources, inference, and image
+  build spec classes.
+* Feature Store: Feature views created before 1.42.0 that use the `last_distinct_n` or
+  `first_distinct_n` aggregation function can no longer be read offline. `generate_dataset`,
+  `generate_training_set`, `retrieve_feature_values`, and `read_feature_view` now raise a
+  `ValueError` for such feature views. Re-create the feature view to restore offline reads.
+* Dependencies: `snowflake-snowpark-python` must now be `>=1.37.0`. Earlier releases import
+  `pkg_resources`, which `setuptools` removed in 82.0.0, so they fail to import in environments
+  with a current `setuptools`.
+
+## 1.54.0 (2026-08-31)
+
+### New Features
+
+* Registry: `log_model(..., options={"case_sensitive": True})` and
+  `options={"max_batch_size": N}` apply those settings to all methods. Per-method
+  `method_options` still override the global values.
+
+* Feature Store: `create_online_service` accepts a `size` kwarg naming the size to provision the Online
+  Service at, one of `"XS"`, `"S"`, `"M"`, `"L"`, `"XL"`, `"2XL"`, `"3XL"` (case-insensitive). When
+  omitted, the server-side default applies; accounts that cap the available size provision at their
+  cap. `get_online_service_status()` now reports the provisioned `size`, which is `None` for services
+  created before sizes were recorded.
+
+* Experiment Tracking: Source provenance now also records the id of the enclosing ML job when a run is created from
+  inside one.
+* ML Jobs: `submit_file`, `submit_directory`, `submit_from_stage`, and `@remote` accept a `comment` kwarg, attached as
+  the comment on the job service. When omitted, the comment defaults to the `application` name configured on the
+  session, so jobs submitted by a tool or partner integration remain attributable after the fact.
+
+### Bug Fixes
+
+* Feature Store: Feature View metadata tags carrying unknown keys (including a legacy `refresh_mode`)
+  no longer fail to deserialize; unknown keys are ignored on read and the tag still does not persist
+  `refresh_mode`.
+* Registry: Fixed `ModelVersion.load()` failing with `ValueError: ... is not a valid SQL identifier`
+  when the model's owner role is a quoted identifier.
+* Feature Store: Fixed FeatureStore.update_feature_view() failing with `SQL compilation error:
+  invalid value 'ADAPTIVE' for property 'REFRESH_MODE'` when enabling online storage for an existing
+  feature view.
+
+### Behavior Changes
+
+### Deprecations
+
+## 1.53.0 (2026-08-24)
 
 ### New Features
 
@@ -445,6 +563,10 @@ NOTE: Version 1.7.0 is used as example here. Please choose the the latest versio
 
 ### Bug Fixes
 
+* Feature Store: online feature reads and stream ingestion no longer fail while the Online Service is
+  changing size (status `UPDATING_SIZE`). The service serves reads and writes throughout a size
+  change, which can take hours, so it is now treated as serviceable like `UPDATING` already was.
+
 ### Behavior Changes
 
 * Feature Store: `register_feature_view` now records `FV_SOURCE_REFS` metadata for managed batch

{snowflake_ml_python-1.53.0 → snowflake_ml_python-2.0.0}/README.md

@@ -57,7 +57,7 @@ In Snowflake Warehouse notebook environments, snowflake-ml-python can be install
 Follow the [installation instructions](https://docs.snowflake.com/en/developer-guide/snowpark-ml/index#installing-snowpark-ml)
 in the Snowflake documentation.
 
-Python versions 3.9 to 3.12 are supported. You can use [miniconda](https://docs.conda.io/en/latest/miniconda.html) or
+Python versions 3.10 to 3.13 are supported. You can use [miniconda](https://docs.conda.io/en/latest/miniconda.html) or
 [anaconda](https://www.anaconda.com/) to create a Conda environment (recommended),
 or [virtualenv](https://docs.python.org/3/tutorial/venv.html) to create a virtual environment.
 

{snowflake_ml_python-1.53.0 → snowflake_ml_python-2.0.0}/pyproject.toml

@@ -5,10 +5,10 @@ build-backend = "setuptools.build_meta"
 [project]
 name = "snowflake-ml-python"
 description = "The machine learning client library that is used for interacting with Snowflake to build machine learning solutions."
-classifiers = [ "Development Status :: 5 - Production/Stable", "Environment :: Console", "Environment :: Other Environment", "Intended Audience :: Developers", "Intended Audience :: Education", "Intended Audience :: Information Technology", "Intended Audience :: System Administrators", "License :: OSI Approved :: Apache Software License", "Operating System :: OS Independent", "Programming Language :: Python :: 3.9", "Programming Language :: Python :: 3.10", "Programming Language :: Python :: 3.11", "Programming Language :: Python :: 3.12", "Topic :: Database", "Topic :: Software Development", "Topic :: Software Development :: Libraries", "Topic :: Software Development :: Libraries :: Application Frameworks", "Topic :: Software Development :: Libraries :: Python Modules", "Topic :: Scientific/Engineering :: Information Analysis",]
-requires-python = ">=3.9, <3.14"
+classifiers = [ "Development Status :: 5 - Production/Stable", "Environment :: Console", "Environment :: Other Environment", "Intended Audience :: Developers", "Intended Audience :: Education", "Intended Audience :: Information Technology", "Intended Audience :: System Administrators", "License :: OSI Approved :: Apache Software License", "Operating System :: OS Independent", "Programming Language :: Python :: 3.10", "Programming Language :: Python :: 3.11", "Programming Language :: Python :: 3.12", "Topic :: Database", "Topic :: Software Development", "Topic :: Software Development :: Libraries", "Topic :: Software Development :: Libraries :: Application Frameworks", "Topic :: Software Development :: Libraries :: Python Modules", "Topic :: Scientific/Engineering :: Information Analysis",]
+requires-python = ">=3.10, <3.14"
 dynamic = [ "version", "readme",]
-dependencies = [ "anyio>=3.5.0,<5", "cachetools>=3.1.1", "cloudpickle>=2.0.0", "fsspec[http]>=2024.6.1,<2026", "h2>=4.3.0,<5", "importlib_resources>=6.1.1, <7", "jinja2>=3.1.0,<4", "numpy>=1.23,<3", "packaging>=20.9,<26", "pandas>=2.1.4,<3", "platformdirs<5", "pyarrow", "pydantic>=2.8.2, <3", "pyjwt>=2.0.0, <3", "pytimeparse>=1.1.8,<2", "pyyaml>=6.0,<7", "retrying>=1.3.3,<2", "scikit-learn<1.9", "scipy>=1.9,<2", "shap>=0.46.0,<1", "snowflake-connector-python[pandas]>=3.17.3,<5", "snowflake-snowpark-python>=1.17.0,<2,!=1.26.0", "sqlparse>=0.4,<1", "tqdm<5", "typing-extensions>=4.1.0,<5", "xgboost<4",]
+dependencies = [ "anyio>=3.5.0,<5", "cachetools>=3.1.1", "cloudpickle>=2.0.0", "fsspec[http]>=2024.6.1,<2026", "importlib_resources>=6.1.1, <7", "jinja2>=3.1.0,<4", "numpy>=1.23,<3", "packaging>=20.9,<26", "pandas>=2.1.4,<3", "platformdirs<5", "pyarrow", "pydantic>=2.8.2, <3", "pyjwt>=2.0.0, <3", "pytimeparse>=1.1.8,<2", "pyyaml>=6.0,<7", "retrying>=1.3.3,<2", "scipy>=1.9,<2", "snowflake-connector-python[pandas]>=3.17.3,<5", "snowflake-snowpark-python>=1.37.0,<2", "sqlparse>=0.4,<1", "tqdm<5", "typing-extensions>=4.1.0,<5",]
 [[project.authors]]
 name = "Snowflake, Inc"
 email = "support@snowflake.com"
@@ -24,18 +24,22 @@ Issues = "https://github.com/snowflakedb/snowflake-ml-python/issues"
 Changelog = "https://github.com/snowflakedb/snowflake-ml-python/blob/master/CHANGELOG.md"
 
 [project.optional-dependencies]
-all = [ "altair>=5,<7", "catboost>=1.2.0, <2", "keras>=2.0.0,<4", "lightgbm>=4.1.0, <5", "mlflow>=2.16.0, <4", "prophet>=1.1.0, <2", "sentence-transformers>=2.7.0,<6", "sentencepiece>=0.1.95,<0.3", "streamlit>=1.30.0,<2", "tensorflow>=2.17.0,<3", "tokenizers>=0.15.1,<1", "torch>=2.0.1,<3", "torchdata>=0.4,<1", "transformers>=4.39.3,!=4.51.3,<6",]
+all = [ "altair>=5,<7", "catboost>=1.2.0, <2", "h2>=4.3.0,<5", "httpx>=0.28.1,<1", "keras>=2.0.0,<4", "lightgbm>=4.1.0, <5", "mlflow>=2.16.0, <4", "prophet>=1.1.0, <2", "scikit-learn<1.9", "sentence-transformers>=2.7.0,<6", "sentencepiece>=0.1.95,<0.3", "shap>=0.46.0,<1", "streamlit>=1.30.0,<2", "tensorflow>=2.17.0,<3", "tokenizers>=0.15.1,<1", "torch>=2.0.1,<3", "torchdata>=0.4,<1", "transformers>=4.39.3,!=4.51.3,<6", "xgboost<4",]
 altair = [ "altair>=5,<7",]
 catboost = [ "catboost>=1.2.0, <2",]
+feature_store = [ "h2>=4.3.0,<5", "httpx>=0.28.1,<1",]
 keras = [ "keras>=2.0.0,<4", "tensorflow>=2.17.0,<3", "torch>=2.0.1,<3",]
 lightgbm = [ "lightgbm>=4.1.0, <5",]
 llm = [ "mlflow>=2.16.0, <4", "sentence-transformers>=2.7.0,<6", "sentencepiece>=0.1.95,<0.3", "tokenizers>=0.15.1,<1", "torch>=2.0.1,<3", "torchdata>=0.4,<1", "transformers>=4.39.3,!=4.51.3,<6",]
 mlflow = [ "mlflow>=2.16.0, <4",]
 prophet = [ "prophet>=1.1.0, <2",]
+scikit-learn = [ "scikit-learn<1.9",]
+shap = [ "shap>=0.46.0,<1",]
 streamlit = [ "streamlit>=1.30.0,<2",]
 tensorflow = [ "tensorflow>=2.17.0,<3",]
 torch = [ "torch>=2.0.1,<3", "torchdata>=0.4,<1",]
 transformers = [ "sentence-transformers>=2.7.0,<6", "sentencepiece>=0.1.95,<0.3", "tokenizers>=0.15.1,<1", "torch>=2.0.1,<3", "transformers>=4.39.3,!=4.51.3,<6",]
+xgboost = [ "xgboost<4",]
 
 [tool.setuptools.package-data]
 "*" = [ "*",]

{snowflake_ml_python-1.53.0 → snowflake_ml_python-2.0.0}/snowflake/ml/_internal/env_utils.py

@@ -689,22 +689,30 @@ def save_requirements_file(
     path: pathlib.Path,
     pip_deps: list[requirements.Requirement],
     cuda_version: Optional[str] = None,
-) -> None:
+) -> list[str]:
     """Generate Python requirements.txt file in the given directory path.
 
     Args:
         path: Path to the requirements.txt file.
         pip_deps: List of dependencies after validation.
         cuda_version: Optional CUDA version for GPU models. If provided and torch is in
-            dependencies, adds PyTorch CUDA index URL and pins torch to CUDA variant.
+            dependencies, pins torch to CUDA variant.
+
+    Returns:
+        List of extra pip index URLs (e.g. ``["https://download.pytorch.org/whl/cu124"]``)
+        that were NOT written to requirements.txt because SPCS rejects non-PEP-508 lines.
+        Callers should persist these via model metadata so the build step can apply them.
     """
     assert path.suffix in [".txt"], "PIP requirement file should have extension of txt."
     path.parent.mkdir(parents=True, exist_ok=True)
 
     lines: list[str] = []
+    pip_extra_index_urls: list[str] = []
 
     if cuda_version and _has_torch_dependency(pip_deps):
-        lines.append(_get_pytorch_cuda_index_url(cuda_version))
+        # Strip the "--extra-index-url " prefix to store just the URL.
+        raw = _get_pytorch_cuda_index_url(cuda_version)
+        pip_extra_index_urls.append(raw.removeprefix("--extra-index-url "))
         pip_deps = _pin_torch_to_cuda_variant(pip_deps, cuda_version)
 
     lines.extend(map(str, pip_deps))
@@ -712,6 +720,8 @@ def save_requirements_file(
     with open(path, "w", encoding="utf-8") as out:
         out.write("\n".join(lines))
 
+    return pip_extra_index_urls
+
 
 def load_conda_env_file(
     path: pathlib.Path,

{snowflake_ml_python-1.53.0 → snowflake_ml_python-2.0.0}/snowflake/ml/_internal/platform_capabilities.py

@@ -84,7 +84,7 @@ class PlatformCapabilities:
         return self._get_bool_feature(LIVE_COMMIT_PARAMETER, False)
 
     def is_hidden_live_commit_enabled(self) -> bool:
-        return False
+        return self._get_bool_feature(HIDDEN_LIVE_COMMIT_PARAMETER, False)
 
     def is_model_method_signature_parameters_enabled(self) -> bool:
         return self._get_bool_feature(ENABLE_MODEL_METHOD_SIGNATURE_PARAMETERS, False)

{snowflake_ml_python-1.53.0 → snowflake_ml_python-2.0.0}/snowflake/ml/_internal/telemetry.py

@@ -9,7 +9,8 @@ import sys
 import time
 import traceback
 import types
-from typing import Any, Callable, Iterable, Mapping, Optional, TypeVar, Union, cast
+from collections.abc import Iterable, Mapping
+from typing import Any, Callable, Optional, TypeVar, Union, cast
 
 from typing_extensions import ParamSpec
 
@@ -119,6 +120,7 @@ class TelemetryField(enum.Enum):
     TYPE_FUNCTION_USAGE = "function_usage"
     TYPE_SNOWML_SPCS_USAGE = "snowml_spcs_usage"
     TYPE_SNOWML_PIPELINE_USAGE = "snowml_pipeline_usage"
+    TYPE_SNOWML_LOADED_MODEL_USAGE = "snowml_loaded_model_usage"
     # message keys for telemetry
     KEY_PROJECT = "project"
     KEY_SUBPROJECT = "subproject"
@@ -717,6 +719,12 @@ def _extract_arg_value(field: str, sig: inspect.Signature, args: Any, kwargs: An
         Tuple: First value indicates if `field` exists.
         Second value is the extracted value if existed.
     """
+    # Check keyword arguments first. The field may have no named parameter of its own and instead be
+    # absorbed by a variadic keyword parameter (**kwargs), in which case the signature lookup below
+    # would not find it even though the caller passed a value.
+    if field in kwargs:
+        return True, kwargs[field]
+
     if field not in sig.parameters:
         return False, None
 
@@ -729,10 +737,6 @@ def _extract_arg_value(field: str, sig: inspect.Signature, args: Any, kwargs: An
         if idx < len(args):
             return True, args[idx]
 
-    # Check if value was passed as keyword argument
-    if field in kwargs:
-        return True, kwargs[field]
-
     # Fall back to default value if available
     if param.default is not inspect.Parameter.empty:
         return True, param.default

{snowflake_ml_python-1.53.0 → snowflake_ml_python-2.0.0}/snowflake/ml/experiment/_source_info.py

@@ -44,6 +44,11 @@ _SNOWFLAKE_FILE_DOMAIN_TYPE_ENV = "SNOWFLAKE_FILE_DOMAIN_TYPE"
 _SNOWFLAKE_FILE_DOMAIN_NAME_ENV = "SNOWFLAKE_FILE_DOMAIN_NAME"
 _SNOWFLAKE_MAIN_FILE_PATH_ENV = "SNOWFLAKE_MAIN_FILE_PATH"
 
+# Environment variable Snowflake injects into an ML job's container, carrying the
+# job's fully-qualified id. Its presence is how we recognize that the run was
+# created from inside an ML job.
+_ML_JOB_ID_ENV = "MLRS_JOB_ID"
+
 
 @dataclasses.dataclass(frozen=True)
 class GitInfo:
@@ -72,6 +77,9 @@ class SourceInfo:
     # ``entry_point``, not duplicated here.
     snowflake_file_domain_type: Optional[str] = None
     snowflake_file_domain_name: Optional[str] = None
+    # The fully-qualified id of the ML job this run was created from, taken from
+    # the environment. ``None`` when not running inside an ML job.
+    ml_job_id: Optional[str] = None
 
     def is_empty(self) -> bool:
         """Return True when there is nothing useful to send."""
@@ -80,6 +88,7 @@ class SourceInfo:
             and (self.git is None or self.git.is_empty())
             and self.snowflake_file_domain_type is None
             and self.snowflake_file_domain_name is None
+            and self.ml_job_id is None
         )
 
     def to_json_dict(self) -> dict[str, Any]:
@@ -92,8 +101,9 @@ class SourceInfo:
 
         Returns:
             A JSON-serializable dict whose keys (``entry_point``, ``git``,
-            ``snowflake_file_domain_type``, ``snowflake_file_domain_name``) are
-            included only when resolved. May be empty when nothing was collected.
+            ``snowflake_file_domain_type``, ``snowflake_file_domain_name``,
+            ``ml_job_id``) are included only when resolved. May be empty when
+            nothing was collected.
         """
         out: dict[str, Any] = {}
         if self.entry_point is not None and "$$" not in self.entry_point:
@@ -110,6 +120,8 @@ class SourceInfo:
             out["snowflake_file_domain_type"] = self.snowflake_file_domain_type
         if self.snowflake_file_domain_name is not None and "$$" not in self.snowflake_file_domain_name:
             out["snowflake_file_domain_name"] = self.snowflake_file_domain_name
+        if self.ml_job_id is not None and "$$" not in self.ml_job_id:
+            out["ml_job_id"] = self.ml_job_id
         return out
 
     @classmethod
@@ -121,24 +133,39 @@ class SourceInfo:
             be resolved or collection failed.
         """
         try:
+            # An ML job id is orthogonal to how the entry point is described, so
+            # it is resolved once and attached to whichever shape is returned.
+            ml_job_id = _collect_ml_job_id()
+
             # Snowflake-managed files (notebooks or .py workspace files) describe
             # the running file via environment variables rather than a resolvable
             # local path, so they are handled first and independently of the
             # git/notebook-path machinery.
             snowflake_file = _collect_snowflake_file()
             if snowflake_file is not None:
-                return snowflake_file
+                return dataclasses.replace(snowflake_file, ml_job_id=ml_job_id)
 
             # Resolve the notebook once so entry-point and git agree on the same file.
             notebook_path = _resolve_notebook_path() if _in_ipython_kernel() else None
             return cls(
                 entry_point=_detect_entry_point(notebook_path),
                 git=_collect_git(notebook_path),
+                ml_job_id=ml_job_id,
             )
         except Exception:
             return cls()
 
 
+def _collect_ml_job_id() -> Optional[str]:
+    """Collect the fully-qualified id of the enclosing ML job.
+
+    Returns:
+        The ML job id from the environment, or ``None`` when not running inside
+        an ML job (or when the server does not expose the id).
+    """
+    return os.environ.get(_ML_JOB_ID_ENV) or None
+
+
 def _collect_snowflake_file() -> Optional[SourceInfo]:
     """Collect source info when running inside a Snowflake-managed file.
 

{snowflake_ml_python-1.53.0 → snowflake_ml_python-2.0.0}/snowflake/ml/experiment/experiment_tracking.py

@@ -63,9 +63,10 @@ class ExperimentTracking:
             schema_name: The name of the schema. If None, the current schema of the session
                 will be used. If there is no active schema, the PUBLIC schema will be used. Defaults to None.
             capture_source_info: If True, each new run records best-effort source provenance — the
-                entry-point filename and any surrounding git commit, branch, and remote URL. Set to
-                False to skip collection entirely. Collection is always non-fatal and never blocks
-                run creation. Defaults to True.
+                entry-point filename, any surrounding git commit, branch, and remote URL, and the id
+                of the enclosing ML job when running inside one. Set to False to skip collection
+                entirely. Collection is always non-fatal and never blocks run creation. Defaults to
+                True.
 
         Raises:
             ValueError: If no database is provided and no active database exists in the session.