snowflake-ml-python 1.29.0__tar.gz → 1.31.0__tar.gz

{snowflake_ml_python-1.29.0 → snowflake_ml_python-1.31.0}/CHANGELOG.md

@@ -1,6 +1,67 @@
 # Release History
 
-## 1.29.0
+## 1.31.0
+
+### New Features
+
+### Bug Fixes
+
+* Registry: Fixed custom model handler to explicitly persist `PARTITIONED=False` in model metadata for
+  `@inference_api` methods. Previously, custom models using `@inference_api` with `TABLE_FUNCTION` type
+  were incorrectly reported as partitioned.
+* Registry: Fixed sklearn and SnowML model handlers to explicitly persist `PARTITIONED=False` metadata for
+  the `explain` method, preventing it from being incorrectly reported as partitioned at read time.
+* Registry: Fixed inconsistent `infer_signature` for columns containing NaN values. Previously,
+  the inferred dtype (`DOUBLE` vs `INT64`) depended on whether NaN rows survived truncation, causing
+  downstream validation failures. Now, the original pandas column dtype is respected during `infer_signature`,
+  so columns with mix of integer and `np.nan` or `None` are consistently inferred as `DOUBLE` regardless of NaN position.
+* Registry: Fixed a bug where invalid parameter types (e.g., passing a string to an integer parameter)
+  were silently coerced instead of raising an error. Parameters are now strictly validated against their
+  declared types before inference. This may break code that relied on the silent coercion behavior
+  (e.g., `model.run(max_tokens="100")` or `model.run(some_int_param=True)`).
+* ML Job: Fixed explicitly named `MLJobDefinition` objects so they can be overwritten in place and invoked
+  repeatedly without job name collisions; the `generate_suffix` argument has been removed.
+* Experiment Tracking live logging (PrPr): Fixed a bug that generated too many lines of log that consist entirely of
+  whitespace.
+
+### Behavior Changes
+
+* Registry: Warehouse partitioned model inference no longer includes non-partition input columns (which were always
+  NULL) in the output. The output now contains only the model's output columns and the partition column.
+
+### Deprecations
+
+## 1.30.0
+
+### New Features
+
+* Experiment Tracking live logging (PrPr): In SPCS, call `set_live_logging_status(True)` to automatically capture and
+  persist outputs to stdout and stderr while a run is active. The captured logs can be viewed from the Experiments UI.
+* Registry: Support logging MLflow models created via `mlflow.*.save_model()` to the Snowflake Model
+  Registry. Previously, only models logged through `mlflow.*.log_model()` were supported. This also
+  enables logging custom `mlflow.pyfunc.PythonModel` subclasses saved locally.
+
+### Bug Fixes
+
+* Registry: Fixed Prophet model handler to correctly mark the `predict` method as partitioned, ensuring it
+  uses a partitioned `TABLE_FUNCTION` when deployed to Snowflake.
+* Registry: Support `text-generation` models without chat template. The model will have signatures to automatically take
+  plain strings as input without needing to specify the signatures in `log_model`.
+  The signature can be overridden if the user chooses to.
+
+### Behavior Changes
+
+* Registry: Huggingface models with task `text-generation` that do not have chat templates will be logged with signature
+  that supports plain text (string) as input.
+
+### Deprecations
+
+* Registry: Removed support for logging Hugging Face Pipelines in config-only mode. Config-only
+  models could not run in warehouse and required an External Access Integration (EAI) with egress
+  to Hugging Face hosts. Use remote logging or local download instead — these approaches support
+  warehouse execution and store model weights at log time, enabling fully air-gapped services.
+
+## 1.29.0 (2026-02-24)
 
 ### New Features
 
@@ -289,6 +350,10 @@ mv = registry.log_model(
 * Registry: Added support for `image-text-to-text` task type in `huggingface.TransformersPipeline`.
   Note: Requires vLLM inference engine while creating the service.
 
+* ML Job: Added support for custom command entrypoints. The `entrypoint` parameter now accepts a
+  `list[str]` (e.g., `["arctic_training", "run_causal.yml"]`), which is executed directly as a
+  command rather than being treated as a Python script.
+
 ### Bug Fixes
 
 ### Behavior Changes

{snowflake_ml_python-1.29.0/snowflake_ml_python.egg-info → snowflake_ml_python-1.31.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: snowflake-ml-python
-Version: 1.29.0
+Version: 1.31.0
 Summary: The machine learning client library that is used for interacting with Snowflake to build machine learning solutions.
 Author-email: "Snowflake, Inc" <support@snowflake.com>
 License: 
@@ -416,7 +416,68 @@ NOTE: Version 1.7.0 is used as example here. Please choose the the latest versio
 
 # Release History
 
-## 1.29.0
+## 1.31.0
+
+### New Features
+
+### Bug Fixes
+
+* Registry: Fixed custom model handler to explicitly persist `PARTITIONED=False` in model metadata for
+  `@inference_api` methods. Previously, custom models using `@inference_api` with `TABLE_FUNCTION` type
+  were incorrectly reported as partitioned.
+* Registry: Fixed sklearn and SnowML model handlers to explicitly persist `PARTITIONED=False` metadata for
+  the `explain` method, preventing it from being incorrectly reported as partitioned at read time.
+* Registry: Fixed inconsistent `infer_signature` for columns containing NaN values. Previously,
+  the inferred dtype (`DOUBLE` vs `INT64`) depended on whether NaN rows survived truncation, causing
+  downstream validation failures. Now, the original pandas column dtype is respected during `infer_signature`,
+  so columns with mix of integer and `np.nan` or `None` are consistently inferred as `DOUBLE` regardless of NaN position.
+* Registry: Fixed a bug where invalid parameter types (e.g., passing a string to an integer parameter)
+  were silently coerced instead of raising an error. Parameters are now strictly validated against their
+  declared types before inference. This may break code that relied on the silent coercion behavior
+  (e.g., `model.run(max_tokens="100")` or `model.run(some_int_param=True)`).
+* ML Job: Fixed explicitly named `MLJobDefinition` objects so they can be overwritten in place and invoked
+  repeatedly without job name collisions; the `generate_suffix` argument has been removed.
+* Experiment Tracking live logging (PrPr): Fixed a bug that generated too many lines of log that consist entirely of
+  whitespace.
+
+### Behavior Changes
+
+* Registry: Warehouse partitioned model inference no longer includes non-partition input columns (which were always
+  NULL) in the output. The output now contains only the model's output columns and the partition column.
+
+### Deprecations
+
+## 1.30.0
+
+### New Features
+
+* Experiment Tracking live logging (PrPr): In SPCS, call `set_live_logging_status(True)` to automatically capture and
+  persist outputs to stdout and stderr while a run is active. The captured logs can be viewed from the Experiments UI.
+* Registry: Support logging MLflow models created via `mlflow.*.save_model()` to the Snowflake Model
+  Registry. Previously, only models logged through `mlflow.*.log_model()` were supported. This also
+  enables logging custom `mlflow.pyfunc.PythonModel` subclasses saved locally.
+
+### Bug Fixes
+
+* Registry: Fixed Prophet model handler to correctly mark the `predict` method as partitioned, ensuring it
+  uses a partitioned `TABLE_FUNCTION` when deployed to Snowflake.
+* Registry: Support `text-generation` models without chat template. The model will have signatures to automatically take
+  plain strings as input without needing to specify the signatures in `log_model`.
+  The signature can be overridden if the user chooses to.
+
+### Behavior Changes
+
+* Registry: Huggingface models with task `text-generation` that do not have chat templates will be logged with signature
+  that supports plain text (string) as input.
+
+### Deprecations
+
+* Registry: Removed support for logging Hugging Face Pipelines in config-only mode. Config-only
+  models could not run in warehouse and required an External Access Integration (EAI) with egress
+  to Hugging Face hosts. Use remote logging or local download instead — these approaches support
+  warehouse execution and store model weights at log time, enabling fully air-gapped services.
+
+## 1.29.0 (2026-02-24)
 
 ### New Features
 
@@ -705,6 +766,10 @@ mv = registry.log_model(
 * Registry: Added support for `image-text-to-text` task type in `huggingface.TransformersPipeline`.
   Note: Requires vLLM inference engine while creating the service.
 
+* ML Job: Added support for custom command entrypoints. The `entrypoint` parameter now accepts a
+  `list[str]` (e.g., `["arctic_training", "run_causal.yml"]`), which is executed directly as a
+  command rather than being treated as a Python script.
+
 ### Bug Fixes
 
 ### Behavior Changes

{snowflake_ml_python-1.29.0 → snowflake_ml_python-1.31.0}/snowflake/ml/_internal/file_utils.py

@@ -281,6 +281,38 @@ def _retry_on_sql_error(exception: Exception) -> bool:
     return isinstance(exception, snowpark_exceptions.SnowparkSQLException)
 
 
+def _resolve_stage_dir_path(
+    stage_path: Union[pathlib.PurePosixPath, parse.ParseResult],
+    relative_path: pathlib.PurePosixPath,
+) -> str:
+    """Resolve the stage directory path for a file upload.
+
+    Combines the base stage path with the relative file path and returns the
+    parent directory. Uses PurePosixPath for cross-platform compatibility
+    (PosixPath cannot be instantiated on Windows).
+
+    Args:
+        stage_path: Base stage path, either a PurePosixPath or a parsed URL.
+        relative_path: POSIX-style relative path of the file within the local directory.
+
+    Returns:
+        The resolved stage directory path as a string (or unparsed URL).
+    """
+    if isinstance(stage_path, parse.ParseResult):
+        relative_stage_path = (pathlib.PurePosixPath(stage_path.path) / relative_path).parent
+        new_url = parse.ParseResult(
+            scheme=stage_path.scheme,
+            netloc=stage_path.netloc,
+            path=str(relative_stage_path),
+            params=stage_path.params,
+            query=stage_path.query,
+            fragment=stage_path.fragment,
+        )
+        return parse.urlunparse(new_url)
+    else:
+        return str((stage_path / relative_path).parent)
+
+
 def upload_directory_to_stage(
     session: snowpark.Session,
     local_path: pathlib.Path,
@@ -305,20 +337,7 @@ def upload_directory_to_stage(
         for filename in filenames:
             local_file_path = root_path / filename
             relative_path = pathlib.PurePosixPath(local_file_path.relative_to(local_path).as_posix())
-
-            if isinstance(stage_path, parse.ParseResult):
-                relative_stage_path = (pathlib.PosixPath(stage_path.path) / relative_path).parent
-                new_url = parse.ParseResult(
-                    scheme=stage_path.scheme,
-                    netloc=stage_path.netloc,
-                    path=str(relative_stage_path),
-                    params=stage_path.params,
-                    query=stage_path.query,
-                    fragment=stage_path.fragment,
-                )
-                stage_dir_path = parse.urlunparse(new_url)
-            else:
-                stage_dir_path = str((stage_path / relative_path).parent)
+            stage_dir_path = _resolve_stage_dir_path(stage_path, relative_path)
 
             retrying.retry(
                 retry_on_exception=_retry_on_sql_error,

{snowflake_ml_python-1.29.0 → snowflake_ml_python-1.31.0}/snowflake/ml/_internal/lineage/lineage_utils.py

@@ -72,6 +72,7 @@ def patch_dataframe(
     # Instance-level monkey-patches
     funcs = [
         "_with_plan",
+        "_copy_without_ast",
         "_lateral",
         "group_by",
         "group_by_grouping_sets",

snowflake_ml_python-1.31.0/snowflake/ml/_internal/utils/tee.py

@@ -0,0 +1,85 @@
+import io
+from typing import Any, Iterable, Iterator, Optional, TextIO
+
+
+class OutputTee(TextIO):
+    """A class that duplicates string writes to multiple file-like objects."""
+
+    def __init__(self, *streams: TextIO) -> None:
+        """Initialize the OutputTee with a list of output streams."""
+        super().__init__()
+        self.streams = streams
+        if not self.writable():
+            raise ValueError("All inputs to OutputTee must be writable.")
+
+    def close(self) -> None:
+        """Does not do anything. It is implemented this way because some of the streams may be in use elsewhere.
+        It is the responsibility of the caller to close any streams that need to be closed."""
+        pass
+
+    def fileno(self) -> int:
+        raise io.UnsupportedOperation("OutputTee does not support fileno")
+
+    def flush(self) -> None:
+        """Flush all streams."""
+        for stream in self.streams:
+            stream.flush()
+
+    def isatty(self) -> bool:
+        return False
+
+    def read(self, n: int = -1) -> str:
+        raise io.UnsupportedOperation("OutputTee does not support reading")
+
+    def readable(self) -> bool:
+        """OutputTee is not readable."""
+        return False
+
+    def readline(self, limit: int = -1) -> str:
+        raise io.UnsupportedOperation("OutputTee does not support reading")
+
+    def readlines(self, hint: int = -1) -> list[str]:
+        raise io.UnsupportedOperation("OutputTee does not support reading")
+
+    def seek(self, offset: int, whence: int = 0) -> int:
+        raise io.UnsupportedOperation("OutputTee does not support seek")
+
+    def seekable(self) -> bool:
+        """OutputTee is not seekable."""
+        return False
+
+    def tell(self) -> int:
+        raise io.UnsupportedOperation("OutputTee does not support tell")
+
+    def truncate(self, size: Optional[int] = None) -> int:
+        raise io.UnsupportedOperation("OutputTee does not support truncate")
+
+    def writable(self) -> bool:
+        """OutputTee is writable if and only if all streams are writable."""
+        return all(stream.writable() for stream in self.streams)
+
+    def write(self, data: str) -> int:
+        """Write to all streams."""
+        for stream in self.streams:
+            stream.write(data)
+        return len(data)
+
+    def writelines(self, lines: Iterable[str]) -> None:
+        """Write lines to all streams."""
+        lines_list = list(lines)
+        for stream in self.streams:
+            stream.writelines(lines_list)
+
+    def __enter__(self) -> "OutputTee":
+        """Enter context manager."""
+        return self
+
+    def __exit__(self, exc_type: Any, exc_val: Any, exc_tb: Any) -> None:
+        """Exit context manager."""
+        self.close()
+
+    def __iter__(self) -> Iterator[str]:
+        raise io.UnsupportedOperation("OutputTee does not support reading")
+
+    def __next__(self) -> str:
+        raise io.UnsupportedOperation("OutputTee does not support reading")

{snowflake_ml_python-1.29.0 → snowflake_ml_python-1.31.0}/snowflake/ml/data/data_connector.py

@@ -29,7 +29,7 @@ if TYPE_CHECKING:
 
     # This module can't actually depend on dataset to avoid a circular dependency
     # Dataset -> DatasetReader -> DataConnector -!-> Dataset
-    from snowflake.ml import dataset
+    from snowflake.ml import dataset  # type: ignore[attr-defined, unused-ignore]
 
 _PROJECT = "DataConnector"
 

{snowflake_ml_python-1.29.0 → snowflake_ml_python-1.31.0}/snowflake/ml/experiment/_client/experiment_tracking_sql_client.py

@@ -40,6 +40,23 @@ class ExperimentTrackingSQLClient(_base._BaseSQLClient):
             self._session, f"CREATE EXPERIMENT {if_not_exists_sql} {experiment_fqn}"
         ).has_dimensions(expected_rows=1, expected_cols=1).validate()
 
+    @telemetry.send_api_usage_telemetry(project=telemetry.TelemetryProject.EXPERIMENT_TRACKING.value)
+    def get_experiment_id(
+        self,
+        experiment_name: sql_identifier.SqlIdentifier,
+    ) -> int:
+        experiment_fqn = self.fully_qualified_object_name(self._database_name, self._schema_name, experiment_name)
+
+        result = (
+            query_result_checker.SqlResultValidator(
+                self._session,
+                f"CALL SYSTEM$RESOLVE_EXPERIMENT_ID('{experiment_fqn}')",
+            )
+            .has_dimensions(expected_rows=1, expected_cols=1)
+            .validate()
+        )
+        return int(result[0][0])
+
     @telemetry.send_api_usage_telemetry(project=telemetry.TelemetryProject.EXPERIMENT_TRACKING.value)
     def drop_experiment(
         self,
@@ -72,6 +89,23 @@ class ExperimentTrackingSQLClient(_base._BaseSQLClient):
             self._session, f"ALTER EXPERIMENT {experiment_fqn} COMMIT RUN {run_name}"
         ).has_dimensions(expected_rows=1, expected_cols=1).validate()
 
+    def get_run_id(
+        self,
+        experiment_name: sql_identifier.SqlIdentifier,
+        run_name: sql_identifier.SqlIdentifier,
+    ) -> int:
+        experiment_fqn = self.fully_qualified_object_name(self._database_name, self._schema_name, experiment_name)
+
+        result = (
+            query_result_checker.SqlResultValidator(
+                self._session,
+                f"CALL SYSTEM$RESOLVE_EXPERIMENT_RUN_ID('{experiment_fqn}', '{run_name}')",
+            )
+            .has_dimensions(expected_rows=1, expected_cols=1)
+            .validate()
+        )
+        return int(result[0][0])
+
     @telemetry.send_api_usage_telemetry(project=telemetry.TelemetryProject.EXPERIMENT_TRACKING.value)
     def drop_run(
         self, *, experiment_name: sql_identifier.SqlIdentifier, run_name: sql_identifier.SqlIdentifier

snowflake_ml_python-1.31.0/snowflake/ml/experiment/_logging/__init__.py

@@ -0,0 +1,6 @@
+from snowflake.ml.experiment._logging.experiment_logger import ExperimentLogger
+from snowflake.ml.experiment._logging.experiment_logging_context import (
+    ExperimentLoggingContext,
+)
+
+__all__ = ["ExperimentLogger", "ExperimentLoggingContext"]

snowflake_ml_python-1.31.0/snowflake/ml/experiment/_logging/experiment_logger.py

@@ -0,0 +1,101 @@
+import io
+import json
+import os
+from typing import Any, Iterable, Iterator, TextIO
+
+
+class ExperimentLogger(TextIO):
+    OUTPUT_DIRECTORY = "/var/log/services/external/experiment_tracking"
+
+    def __init__(
+        self,
+        exp_id: int,
+        run_id: int,
+        stream: str,
+    ) -> None:
+        super().__init__()
+        filepath = os.path.join(self.OUTPUT_DIRECTORY, str(exp_id), str(run_id), f"{stream}.log")
+        os.makedirs(os.path.dirname(filepath), exist_ok=True)
+        self.file = open(filepath, "a", buffering=1)  # Line buffering
+        self.exp_id = exp_id
+        self.run_id = run_id
+        self.stream = stream
+        self._buffer = ""  # Buffer to store incomplete lines
+
+    def _write_line(self, line: str) -> None:
+        log_message = {
+            "body": line,
+            "attributes": {
+                "snow.experiment.id": self.exp_id,
+                "snow.experiment.run.id": self.run_id,
+                "snow.experiment.stream": self.stream,
+            },
+        }
+        json_data = json.dumps(log_message)
+        self.file.write(json_data + "\n")
+
+    def close(self) -> None:
+        self.flush()
+        self.file.close()
+
+    def fileno(self) -> int:
+        return self.file.fileno()
+
+    def flush(self) -> None:
+        if self._buffer:
+            self._write_line(self._buffer)
+            self._buffer = ""
+        self.file.flush()
+
+    def isatty(self) -> bool:
+        return False
+
+    def readable(self) -> bool:
+        return False
+
+    def read(self, n: int = -1) -> str:
+        raise io.UnsupportedOperation("read")
+
+    def readline(self, limit: int = -1) -> str:
+        raise io.UnsupportedOperation("readline")
+
+    def readlines(self, hint: int = -1) -> list[str]:
+        raise io.UnsupportedOperation("readlines")
+
+    def seekable(self) -> bool:
+        return False
+
+    def seek(self, offset: int, whence: int = 0) -> int:
+        raise io.UnsupportedOperation("seek")
+
+    def tell(self) -> int:
+        raise io.UnsupportedOperation("tell")
+
+    def truncate(self, size: int | None = None) -> int:
+        raise io.UnsupportedOperation("truncate")
+
+    def writable(self) -> bool:
+        return True
+
+    def write(self, data: str) -> int:
+        self._buffer += data
+        while "\n" in self._buffer:
+            line, self._buffer = self._buffer.split("\n", 1)
+            self._write_line(line)
+        return len(data)
+
+    def writelines(self, lines: Iterable[str]) -> None:
+        for line in lines:
+            self.write(line)
+
+    def __enter__(self) -> "ExperimentLogger":
+        return self
+
+    def __exit__(self, exc_type: Any, exc_val: Any, exc_tb: Any) -> None:
+        self.close()
+
+    def __iter__(self) -> Iterator[str]:
+        raise io.UnsupportedOperation("__iter__")
+
+    def __next__(self) -> str:
+        raise io.UnsupportedOperation("__next__")

snowflake_ml_python-1.31.0/snowflake/ml/experiment/_logging/experiment_logging_context.py

@@ -0,0 +1,13 @@
+import contextlib
+from dataclasses import dataclass
+
+from snowflake.ml._internal.utils import tee
+from snowflake.ml.experiment._logging.experiment_logger import ExperimentLogger
+
+
+@dataclass(frozen=True)
+class ExperimentLoggingContext:
+    stdout_logger: ExperimentLogger
+    stderr_logger: ExperimentLogger
+    stdout_ctx: contextlib.redirect_stdout[tee.OutputTee]
+    stderr_ctx: contextlib.redirect_stderr[tee.OutputTee]