databricks-sdk 0.69.0__tar.gz → 0.71.0__tar.gz

{databricks_sdk-0.69.0 → databricks_sdk-0.71.0}/CHANGELOG.md

@@ -1,5 +1,56 @@
 # Version changelog
 
+## Release v0.71.0
+
+### Bug Fixes
+
+- Fix the issue where `FilesExt.upload`'s second parameter was changed from `contents` to `content` unintentionally. Now the interface is backward compatible to versions previous than 0.69.0.
+
+### API Changes
+* Add `instance_profile_arn` field for `databricks.sdk.service.compute.InstancePoolAwsAttributes`.
+* Add `continuous`, `sliding` and `tumbling` fields for `databricks.sdk.service.ml.TimeWindow`.
+* Add `usage_policy_id` field for `databricks.sdk.service.pipelines.CreatePipeline`.
+* Add `usage_policy_id` field for `databricks.sdk.service.pipelines.EditPipeline`.
+* Add `usage_policy_id` field for `databricks.sdk.service.pipelines.PipelineSpec`.
+* Add `read_files_bytes` field for `databricks.sdk.service.sql.QueryMetrics`.
+* Add `select` enum value for `databricks.sdk.service.apps.AppManifestAppResourceUcSecurableSpecUcSecurablePermission`.
+* Add `table` enum value for `databricks.sdk.service.apps.AppManifestAppResourceUcSecurableSpecUcSecurableType`.
+* Add `decommission_started` and `decommission_ended` enum values for `databricks.sdk.service.compute.EventType`.
+* Add `dbr_image_resolution_failure` enum value for `databricks.sdk.service.compute.TerminationReasonCode`.
+* Add `dbr_image_resolution_failure` enum value for `databricks.sdk.service.sql.TerminationReasonCode`.
+* [Breaking] Change `offline_store_config` and `online_store_config` fields for `databricks.sdk.service.ml.MaterializedFeature` to no longer be required.
+* Change `offline_store_config` and `online_store_config` fields for `databricks.sdk.service.ml.MaterializedFeature` to no longer be required.
+* [Breaking] Change `lifecycle_state` field for `databricks.sdk.service.sql.AlertV2` to type `databricks.sdk.service.sql.AlertLifecycleState` dataclass.
+* [Breaking] Remove `table` field for `databricks.sdk.service.jobs.TriggerSettings`.
+* [Breaking] Remove `duration` and `offset` fields for `databricks.sdk.service.ml.TimeWindow`.
+
+
+## Release v0.70.0
+
+### Bug Fixes
+- Improving the error message that is shown when the unsupported `dbutils.credentials.getServiceCredentialsProvider` method is used. This method can only be used inside of a notebook.
+
+### API Changes
+* Add `create_materialized_feature()`, `delete_materialized_feature()`, `get_materialized_feature()`, `list_materialized_features()` and `update_materialized_feature()` methods for [w.feature_engineering](https://databricks-sdk-py.readthedocs.io/en/latest/workspace/ml/feature_engineering.html) workspace-level service.
+* Add `filter_condition` field for `databricks.sdk.service.ml.Feature`.
+* Add `absolute_session_lifetime_in_minutes` and `enable_single_use_refresh_tokens` fields for `databricks.sdk.service.oauth2.TokenAccessPolicy`.
+* Add `network_connectivity_config_id` field for `databricks.sdk.service.provisioning.CreateWorkspaceRequest`.
+* Add `oauth_mtls` enum value for `databricks.sdk.service.catalog.CredentialType`.
+* Add `network_check_nic_failure_due_to_misconfig`, `network_check_dns_server_failure_due_to_misconfig`, `network_check_storage_failure_due_to_misconfig`, `network_check_metadata_endpoint_failure_due_to_misconfig`, `network_check_control_plane_failure_due_to_misconfig` and `network_check_multiple_components_failure_due_to_misconfig` enum values for `databricks.sdk.service.compute.TerminationReasonCode`.
+* Add `creating` and `create_failed` enum values for `databricks.sdk.service.settings.NccPrivateEndpointRulePrivateLinkConnectionState`.
+* Add `network_check_nic_failure_due_to_misconfig`, `network_check_dns_server_failure_due_to_misconfig`, `network_check_storage_failure_due_to_misconfig`, `network_check_metadata_endpoint_failure_due_to_misconfig`, `network_check_control_plane_failure_due_to_misconfig` and `network_check_multiple_components_failure_due_to_misconfig` enum values for `databricks.sdk.service.sql.TerminationReasonCode`.
+* [Breaking] Change `display_name`, `evaluation`, `query_text`, `schedule` and `warehouse_id` fields for `databricks.sdk.service.sql.AlertV2` to be required.
+* Change `display_name`, `evaluation`, `query_text`, `schedule` and `warehouse_id` fields for `databricks.sdk.service.sql.AlertV2` to be required.
+* Change `comparison_operator` and `source` fields for `databricks.sdk.service.sql.AlertV2Evaluation` to be required.
+* [Breaking] Change `comparison_operator` and `source` fields for `databricks.sdk.service.sql.AlertV2Evaluation` to be required.
+* Change `name` field for `databricks.sdk.service.sql.AlertV2OperandColumn` to be required.
+* [Breaking] Change `name` field for `databricks.sdk.service.sql.AlertV2OperandColumn` to be required.
+* [Breaking] Change `quartz_cron_schedule` and `timezone_id` fields for `databricks.sdk.service.sql.CronSchedule` to be required.
+* Change `quartz_cron_schedule` and `timezone_id` fields for `databricks.sdk.service.sql.CronSchedule` to be required.
+* [Breaking] Remove `update()` method for [w.recipient_federation_policies](https://databricks-sdk-py.readthedocs.io/en/latest/workspace/sharing/recipient_federation_policies.html) workspace-level service.
+* [Breaking] Remove `results` field for `databricks.sdk.service.sql.ListAlertsV2Response`.
+
+
 ## Release v0.69.0
 
 ### New Features and Improvements

{databricks_sdk-0.69.0 → databricks_sdk-0.71.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: databricks-sdk
-Version: 0.69.0
+Version: 0.71.0
 Summary: Databricks SDK for Python (Beta)
 Project-URL: Documentation, https://databricks-sdk-py.readthedocs.io
 Keywords: databricks,sdk

{databricks_sdk-0.69.0 → databricks_sdk-0.71.0}/databricks/sdk/dbutils.py

@@ -281,10 +281,17 @@ def get_local_notebook_path():
     return value
 
 
+def not_supported_method_err_msg(methodName):
+    return f"Method '{methodName}' is not supported in the SDK version of DBUtils"
+
+
 class _OverrideProxyUtil:
 
     @classmethod
     def new(cls, path: str):
+        if path in cls.not_supported_override_paths:
+            raise ValueError(cls.not_supported_override_paths[path])
+
         if len(cls.__get_matching_overrides(path)) > 0:
             return _OverrideProxyUtil(path)
         return None
@@ -301,6 +308,16 @@ class _OverrideProxyUtil:
         "notebook.entry_point.getDbutils().notebook().getContext().notebookPath().get()": get_local_notebook_path,
     }
 
+    # These paths work the same as 'proxy_override_paths' but instead of using a local implementation we raise an exception.
+    not_supported_override_paths = {
+        # The object returned by 'credentials.getServiceCredentialProvider()' can't be serialized to JSON.
+        # Without this override, the command would fail with an error 'TypeError: Object of type Session is not JSON serializable'.
+        # We override it to show a better error message
+        "credentials.getServiceCredentialsProvider": not_supported_method_err_msg(
+            "credentials.getServiceCredentialsProvider"
+        ),
+    }
+
     @classmethod
     def __get_matching_overrides(cls, path: str):
         return [x for x in cls.proxy_override_paths.keys() if x.startswith(path)]

{databricks_sdk-0.69.0 → databricks_sdk-0.71.0}/databricks/sdk/mixins/files.py

@@ -1064,7 +1064,7 @@ class FilesExt(files.FilesAPI):
     def upload(
         self,
         file_path: str,
-        content: BinaryIO,
+        contents: BinaryIO,
         *,
         overwrite: Optional[bool] = None,
         part_size: Optional[int] = None,
@@ -1076,7 +1076,7 @@ class FilesExt(files.FilesAPI):
 
         :param file_path: str
             The absolute remote path of the target file, e.g. /Volumes/path/to/your/file
-        :param content: BinaryIO
+        :param contents: BinaryIO
             The contents of the file to upload. This must be a BinaryIO stream.
         :param overwrite: bool (optional)
             If true, an existing file will be overwritten. When not specified, assumed True.
@@ -1096,7 +1096,7 @@ class FilesExt(files.FilesAPI):
 
         if self._config.disable_experimental_files_api_client:
             _LOG.info("Disable experimental files API client, will use the original upload method.")
-            super().upload(file_path=file_path, contents=content, overwrite=overwrite)
+            super().upload(file_path=file_path, contents=contents, overwrite=overwrite)
             return UploadStreamResult()
 
         _LOG.debug(f"Uploading file from BinaryIO stream")
@@ -1107,12 +1107,12 @@ class FilesExt(files.FilesAPI):
 
         # Determine content length if the stream is seekable
         content_length = None
-        if content.seekable():
+        if contents.seekable():
             _LOG.debug(f"Uploading using seekable mode")
             # If the stream is seekable, we can read its size.
-            content.seek(0, os.SEEK_END)
-            content_length = content.tell()
-            content.seek(0)
+            contents.seek(0, os.SEEK_END)
+            content_length = contents.tell()
+            contents.seek(0)
 
         # Get optimized part size and batch size based on content length and provided part size
         optimized_part_size, optimized_batch_size = self._get_optimized_performance_parameters_for_upload(
@@ -1135,17 +1135,17 @@ class FilesExt(files.FilesAPI):
         )
 
         if ctx.use_parallel:
-            self._parallel_upload_from_stream(ctx, content)
+            self._parallel_upload_from_stream(ctx, contents)
             return UploadStreamResult()
         elif ctx.content_length is not None:
-            self._upload_single_thread_with_known_size(ctx, content)
+            self._upload_single_thread_with_known_size(ctx, contents)
             return UploadStreamResult()
         else:
             _LOG.debug(f"Uploading using non-seekable mode")
             # If the stream is not seekable, we cannot determine its size.
             # We will use a multipart upload.
             _LOG.debug(f"Using multipart upload for non-seekable input stream of unknown size for file {file_path}")
-            self._single_thread_multipart_upload(ctx, content)
+            self._single_thread_multipart_upload(ctx, contents)
             return UploadStreamResult()
 
     def upload_from(

{databricks_sdk-0.69.0 → databricks_sdk-0.71.0}/databricks/sdk/service/agentbricks.py

@@ -238,6 +238,7 @@ class AgentBricksAPI:
 
         :returns: :class:`CustomLlm`
         """
+
         body = {}
         if agent_artifact_path is not None:
             body["agent_artifact_path"] = agent_artifact_path
@@ -328,6 +329,7 @@ class AgentBricksAPI:
 
         :returns: :class:`CustomLlm`
         """
+
         body = {}
         if custom_llm is not None:
             body["custom_llm"] = custom_llm.as_dict()

{databricks_sdk-0.69.0 → databricks_sdk-0.71.0}/databricks/sdk/service/apps.py

@@ -790,11 +790,13 @@ class AppManifestAppResourceUcSecurableSpecUcSecurablePermission(Enum):
 
     MANAGE = "MANAGE"
     READ_VOLUME = "READ_VOLUME"
+    SELECT = "SELECT"
     WRITE_VOLUME = "WRITE_VOLUME"
 
 
 class AppManifestAppResourceUcSecurableSpecUcSecurableType(Enum):
 
+    TABLE = "TABLE"
     VOLUME = "VOLUME"
 
 
@@ -1867,6 +1869,7 @@ class AppsAPI:
           Long-running operation waiter for :class:`App`.
           See :method:wait_get_app_active for more details.
         """
+
         body = app.as_dict()
         query = {}
         if no_compute is not None:
@@ -1903,6 +1906,7 @@ class AppsAPI:
           Long-running operation waiter for :class:`AppUpdate`.
           See :method:wait_get_update_app_succeeded for more details.
         """
+
         body = {}
         if app is not None:
             body["app"] = app.as_dict()
@@ -1949,6 +1953,7 @@ class AppsAPI:
           Long-running operation waiter for :class:`AppDeployment`.
           See :method:wait_get_deployment_app_succeeded for more details.
         """
+
         body = app_deployment.as_dict()
         headers = {
             "Accept": "application/json",
@@ -2124,6 +2129,7 @@ class AppsAPI:
 
         :returns: :class:`AppPermissions`
         """
+
         body = {}
         if access_control_list is not None:
             body["access_control_list"] = [v.as_dict() for v in access_control_list]
@@ -2189,6 +2195,7 @@ class AppsAPI:
 
         :returns: :class:`App`
         """
+
         body = app.as_dict()
         headers = {
             "Accept": "application/json",
@@ -2209,6 +2216,7 @@ class AppsAPI:
 
         :returns: :class:`AppPermissions`
         """
+
         body = {}
         if access_control_list is not None:
             body["access_control_list"] = [v.as_dict() for v in access_control_list]
@@ -2234,6 +2242,7 @@ class AppsSettingsAPI:
 
         :returns: :class:`CustomTemplate`
         """
+
         body = template.as_dict()
         headers = {
             "Accept": "application/json",
@@ -2316,6 +2325,7 @@ class AppsSettingsAPI:
 
         :returns: :class:`CustomTemplate`
         """
+
         body = template.as_dict()
         headers = {
             "Accept": "application/json",

{databricks_sdk-0.69.0 → databricks_sdk-0.71.0}/databricks/sdk/service/billing.py

@@ -3,6 +3,7 @@
 from __future__ import annotations
 
 import logging
+import uuid
 from dataclasses import dataclass
 from enum import Enum
 from typing import Any, BinaryIO, Dict, Iterator, List, Optional
@@ -1067,9 +1068,6 @@ class LogDeliveryConfiguration:
     [Configuring audit logs]: https://docs.databricks.com/administration-guide/account-settings/audit-logs.html
     [View billable usage]: https://docs.databricks.com/administration-guide/account-settings/usage.html"""
 
-    account_id: str
-    """Databricks account ID."""
-
     credentials_id: str
     """The ID for a method:credentials/create that represents the AWS IAM role with policy and trust
     relationship as described in the main billable usage documentation page. See [Configure billable
@@ -1083,6 +1081,9 @@ class LogDeliveryConfiguration:
     
     [Configure billable usage delivery]: https://docs.databricks.com/administration-guide/account-settings/billable-usage-delivery.html"""
 
+    account_id: Optional[str] = None
+    """Databricks account ID."""
+
     config_id: Optional[str] = None
     """The unique UUID of log delivery configuration"""
 
@@ -1565,6 +1566,9 @@ class BudgetPolicyAPI:
 
         :returns: :class:`BudgetPolicy`
         """
+
+        if request_id is None or request_id == "":
+            request_id = str(uuid.uuid4())
         body = {}
         if policy is not None:
             body["policy"] = policy.as_dict()
@@ -1679,6 +1683,7 @@ class BudgetPolicyAPI:
 
         :returns: :class:`BudgetPolicy`
         """
+
         body = policy.as_dict()
         query = {}
         if limit_config is not None:
@@ -1715,6 +1720,7 @@ class BudgetsAPI:
 
         :returns: :class:`CreateBudgetConfigurationResponse`
         """
+
         body = {}
         if budget is not None:
             body["budget"] = budget.as_dict()
@@ -1797,6 +1803,7 @@ class BudgetsAPI:
 
         :returns: :class:`UpdateBudgetConfigurationResponse`
         """
+
         body = {}
         if budget is not None:
             body["budget"] = budget.as_dict()
@@ -1895,6 +1902,7 @@ class LogDeliveryAPI:
 
         :returns: :class:`WrappedLogDeliveryConfiguration`
         """
+
         body = {}
         if log_delivery_configuration is not None:
             body["log_delivery_configuration"] = log_delivery_configuration.as_dict()
@@ -1989,6 +1997,7 @@ class LogDeliveryAPI:
 
 
         """
+
         body = {}
         if status is not None:
             body["status"] = status.value
@@ -2026,6 +2035,7 @@ class UsageDashboardsAPI:
 
         :returns: :class:`CreateBillingUsageDashboardResponse`
         """
+
         body = {}
         if dashboard_type is not None:
             body["dashboard_type"] = dashboard_type.value