apache-airflow-providers-databricks 4.2.0rc2__tar.gz → 4.3.0rc1__tar.gz

{apache-airflow-providers-databricks-4.2.0rc2/apache_airflow_providers_databricks.egg-info → apache-airflow-providers-databricks-4.3.0rc1}/PKG-INFO

@@ -1,13 +1,13 @@
 Metadata-Version: 2.1
 Name: apache-airflow-providers-databricks
-Version: 4.2.0rc2
+Version: 4.3.0rc1
 Summary: Provider for Apache Airflow. Implements apache-airflow-providers-databricks package
 Home-page: https://airflow.apache.org/
 Download-URL: https://archive.apache.org/dist/airflow/providers
 Author: Apache Software Foundation
 Author-email: dev@airflow.apache.org
 License: Apache License 2.0
-Project-URL: Documentation, https://airflow.apache.org/docs/apache-airflow-providers-databricks/4.2.0/
+Project-URL: Documentation, https://airflow.apache.org/docs/apache-airflow-providers-databricks/4.3.0/
 Project-URL: Bug Tracker, https://github.com/apache/airflow/issues
 Project-URL: Source Code, https://github.com/apache/airflow
 Project-URL: Slack Chat, https://s.apache.org/airflow-slack
@@ -21,12 +21,12 @@ Classifier: Intended Audience :: System Administrators
 Classifier: Framework :: Apache Airflow
 Classifier: Framework :: Apache Airflow :: Provider
 Classifier: License :: OSI Approved :: Apache Software License
-Classifier: Programming Language :: Python :: 3.7
 Classifier: Programming Language :: Python :: 3.8
 Classifier: Programming Language :: Python :: 3.9
 Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
 Classifier: Topic :: System :: Monitoring
-Requires-Python: ~=3.7
+Requires-Python: ~=3.8
 Description-Content-Type: text/x-rst
 Provides-Extra: common.sql
 License-File: LICENSE
@@ -53,7 +53,7 @@ License-File: NOTICE
 
 Package ``apache-airflow-providers-databricks``
 
-Release: ``4.2.0rc2``
+Release: ``4.3.0rc1``
 
 
 `Databricks <https://databricks.com/>`__
@@ -66,7 +66,7 @@ This is a provider package for ``databricks`` provider. All classes for this pro
 are in ``airflow.providers.databricks`` python package.
 
 You can find package information and changelog for the provider
-in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-databricks/4.2.0/>`_.
+in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-databricks/4.3.0/>`_.
 
 
 Installation
@@ -76,7 +76,7 @@ You can install this package on top of an existing Airflow 2 installation (see `
 for the minimum Airflow version supported) via
 ``pip install apache-airflow-providers-databricks``
 
-The package supports the following python versions: 3.7,3.8,3.9,3.10
+The package supports the following python versions: 3.8,3.9,3.10,3.11
 
 Requirements
 ------------
@@ -136,6 +136,36 @@ Dependent package
 Changelog
 ---------
 
+4.3.0
+.....
+
+.. note::
+  This release dropped support for Python 3.7
+
+Features
+~~~~~~~~
+
+* ``add a return when the event is yielded in a loop to stop the execution (#31985)``
+
+Bug Fixes
+~~~~~~~~~
+
+* ``Fix type annotation (#31888)``
+* ``Fix Databricks SQL operator serialization (#31780)``
+* ``Making Databricks run related multi-query string in one session again (#31898) (#31899)``
+
+Misc
+~~~~
+* ``Remove return statement after yield from triggers class (#31703)``
+* ``Remove Python 3.7 support (#30963)``
+
+.. Below changes are excluded from the changelog. Move them to
+   appropriate section above if needed. Do not delete the lines(!):
+   * ``Improve docstrings in providers (#31681)``
+   * ``Add discoverability for triggers in provider.yaml (#31576)``
+   * ``Add D400 pydocstyle check - Providers (#31427)``
+   * ``Add note about dropping Python 3.7 for providers (#32015)``
+
 4.2.0
 .....
 

{apache-airflow-providers-databricks-4.2.0rc2 → apache-airflow-providers-databricks-4.3.0rc1}/README.rst

@@ -19,7 +19,7 @@
 
 Package ``apache-airflow-providers-databricks``
 
-Release: ``4.2.0rc2``
+Release: ``4.3.0rc1``
 
 
 `Databricks <https://databricks.com/>`__
@@ -32,7 +32,7 @@ This is a provider package for ``databricks`` provider. All classes for this pro
 are in ``airflow.providers.databricks`` python package.
 
 You can find package information and changelog for the provider
-in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-databricks/4.2.0/>`_.
+in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-databricks/4.3.0/>`_.
 
 
 Installation
@@ -42,7 +42,7 @@ You can install this package on top of an existing Airflow 2 installation (see `
 for the minimum Airflow version supported) via
 ``pip install apache-airflow-providers-databricks``
 
-The package supports the following python versions: 3.7,3.8,3.9,3.10
+The package supports the following python versions: 3.8,3.9,3.10,3.11
 
 Requirements
 ------------
@@ -102,6 +102,36 @@ Dependent package
 Changelog
 ---------
 
+4.3.0
+.....
+
+.. note::
+  This release dropped support for Python 3.7
+
+Features
+~~~~~~~~
+
+* ``add a return when the event is yielded in a loop to stop the execution (#31985)``
+
+Bug Fixes
+~~~~~~~~~
+
+* ``Fix type annotation (#31888)``
+* ``Fix Databricks SQL operator serialization (#31780)``
+* ``Making Databricks run related multi-query string in one session again (#31898) (#31899)``
+
+Misc
+~~~~
+* ``Remove return statement after yield from triggers class (#31703)``
+* ``Remove Python 3.7 support (#30963)``
+
+.. Below changes are excluded from the changelog. Move them to
+   appropriate section above if needed. Do not delete the lines(!):
+   * ``Improve docstrings in providers (#31681)``
+   * ``Add discoverability for triggers in provider.yaml (#31576)``
+   * ``Add D400 pydocstyle check - Providers (#31427)``
+   * ``Add note about dropping Python 3.7 for providers (#32015)``
+
 4.2.0
 .....
 

{apache-airflow-providers-databricks-4.2.0rc2 → apache-airflow-providers-databricks-4.3.0rc1}/airflow/providers/databricks/__init__.py

@@ -28,7 +28,7 @@ import packaging.version
 
 __all__ = ["__version__"]
 
-__version__ = "4.2.0"
+__version__ = "4.3.0"
 
 try:
     from airflow import __version__ as airflow_version

{apache-airflow-providers-databricks-4.2.0rc2 → apache-airflow-providers-databricks-4.3.0rc1}/airflow/providers/databricks/get_provider_info.py

@@ -29,6 +29,7 @@ def get_provider_info():
         "description": "`Databricks <https://databricks.com/>`__\n",
         "suspended": False,
         "versions": [
+            "4.3.0",
             "4.2.0",
             "4.1.0",
             "4.0.1",
@@ -121,9 +122,7 @@ def get_provider_info():
         "triggers": [
             {
                 "integration-name": "Databricks",
-                "class-names": [
-                    "airflow.providers.databricks.triggers.databricks.DatabricksExecutionTrigger"
-                ],
+                "python-modules": ["airflow.providers.databricks.triggers.databricks"],
             }
         ],
         "sensors": [

{apache-airflow-providers-databricks-4.2.0rc2 → apache-airflow-providers-databricks-4.3.0rc1}/airflow/providers/databricks/hooks/databricks.py

@@ -85,7 +85,7 @@ class RunState:
 
     @property
     def is_successful(self) -> bool:
-        """True if the result state is SUCCESS"""
+        """True if the result state is SUCCESS."""
         return self.result_state == "SUCCESS"
 
     def __eq__(self, other: object) -> bool:
@@ -223,6 +223,7 @@ class DatabricksHook(BaseDatabricksHook):
     async def a_get_run_page_url(self, run_id: int) -> str:
         """
         Async version of `get_run_page_url()`.
+
         :param run_id: id of the run
         :return: URL of the run page
         """
@@ -264,6 +265,7 @@ class DatabricksHook(BaseDatabricksHook):
     async def a_get_run_state(self, run_id: int) -> RunState:
         """
         Async version of `get_run_state()`.
+
         :param run_id: id of the run
         :return: state of the run
         """
@@ -309,7 +311,7 @@ class DatabricksHook(BaseDatabricksHook):
 
     def get_run_state_lifecycle(self, run_id: int) -> str:
         """
-        Returns the lifecycle state of the run
+        Returns the lifecycle state of the run.
 
         :param run_id: id of the run
         :return: string with lifecycle state
@@ -318,7 +320,7 @@ class DatabricksHook(BaseDatabricksHook):
 
     def get_run_state_result(self, run_id: int) -> str:
         """
-        Returns the resulting state of the run
+        Returns the resulting state of the run.
 
         :param run_id: id of the run
         :return: string with resulting state
@@ -327,7 +329,7 @@ class DatabricksHook(BaseDatabricksHook):
 
     def get_run_state_message(self, run_id: int) -> str:
         """
-        Returns the state message for the run
+        Returns the state message for the run.
 
         :param run_id: id of the run
         :return: string with state message
@@ -426,7 +428,7 @@ class DatabricksHook(BaseDatabricksHook):
 
     def update_repo(self, repo_id: str, json: dict[str, Any]) -> dict:
         """
-        Updates given Databricks Repos
+        Updates given Databricks Repos.
 
         :param repo_id: ID of Databricks Repos
         :param json: payload
@@ -437,7 +439,7 @@ class DatabricksHook(BaseDatabricksHook):
 
     def delete_repo(self, repo_id: str):
         """
-        Deletes given Databricks Repos
+        Deletes given Databricks Repos.
 
         :param repo_id: ID of Databricks Repos
         :return:
@@ -447,7 +449,7 @@ class DatabricksHook(BaseDatabricksHook):
 
     def create_repo(self, json: dict[str, Any]) -> dict:
         """
-        Creates a Databricks Repos
+        Creates a Databricks Repos.
 
         :param json: payload
         :return:
@@ -472,7 +474,7 @@ class DatabricksHook(BaseDatabricksHook):
         return None
 
     def test_connection(self) -> tuple[bool, str]:
-        """Test the Databricks connectivity from UI"""
+        """Test the Databricks connectivity from UI."""
         hook = DatabricksHook(databricks_conn_id=self.databricks_conn_id)
         try:
             hook._do_api_call(endpoint_info=SPARK_VERSIONS_ENDPOINT).get("versions")

{apache-airflow-providers-databricks-4.2.0rc2 → apache-airflow-providers-databricks-4.3.0rc1}/airflow/providers/databricks/hooks/databricks_base.py

@@ -27,6 +27,7 @@ from __future__ import annotations
 import copy
 import platform
 import time
+from functools import cached_property
 from typing import Any
 from urllib.parse import urlsplit
 
@@ -45,7 +46,6 @@ from tenacity import (
 )
 
 from airflow import __version__
-from airflow.compat.functools import cached_property
 from airflow.exceptions import AirflowException
 from airflow.hooks.base import BaseHook
 from airflow.models import Connection
@@ -197,6 +197,7 @@ class BaseDatabricksHook(BaseHook):
     def _get_retry_object(self) -> Retrying:
         """
         Instantiate a retry object.
+
         :return: instance of Retrying class
         """
         return Retrying(**self.retry_args)
@@ -204,6 +205,7 @@ class BaseDatabricksHook(BaseHook):
     def _a_get_retry_object(self) -> AsyncRetrying:
         """
         Instantiate an async retry object.
+
         :return: instance of AsyncRetrying class
         """
         return AsyncRetrying(**self.retry_args)
@@ -278,6 +280,7 @@ class BaseDatabricksHook(BaseHook):
     async def _a_get_aad_token(self, resource: str) -> str:
         """
         Async version of `_get_aad_token()`.
+
         :param resource: resource to issue token to
         :return: AAD token, or raise an exception
         """
@@ -344,6 +347,7 @@ class BaseDatabricksHook(BaseHook):
     def _get_aad_headers(self) -> dict:
         """
         Fill AAD headers if necessary (SPN is outside of the workspace).
+
         :return: dictionary with filled AAD headers
         """
         headers = {}
@@ -358,6 +362,7 @@ class BaseDatabricksHook(BaseHook):
     async def _a_get_aad_headers(self) -> dict:
         """
         Async version of `_get_aad_headers()`.
+
         :return: dictionary with filled AAD headers
         """
         headers = {}
@@ -386,6 +391,7 @@ class BaseDatabricksHook(BaseHook):
     def _check_azure_metadata_service() -> None:
         """
         Check for Azure Metadata Service.
+
         https://docs.microsoft.com/en-us/azure/virtual-machines/linux/instance-metadata-service
         """
         try:

{apache-airflow-providers-databricks-4.2.0rc2 → apache-airflow-providers-databricks-4.3.0rc1}/airflow/providers/databricks/hooks/databricks_sql.py

@@ -31,8 +31,7 @@ LIST_SQL_ENDPOINTS_ENDPOINT = ("GET", "api/2.0/sql/endpoints")
 
 
 class DatabricksSqlHook(BaseDatabricksHook, DbApiHook):
-    """
-    Hook to interact with Databricks SQL.
+    """Hook to interact with Databricks SQL.
 
     :param databricks_conn_id: Reference to the
         :ref:`Databricks connection <howto/connection:databricks>`.
@@ -95,7 +94,7 @@ class DatabricksSqlHook(BaseDatabricksHook, DbApiHook):
         return lst[0]
 
     def get_conn(self) -> Connection:
-        """Returns a Databricks SQL connection object"""
+        """Returns a Databricks SQL connection object."""
         if not self._http_path:
             if self._sql_endpoint_name:
                 endpoint = self._get_sql_endpoint_by_name(self._sql_endpoint_name)
@@ -148,10 +147,10 @@ class DatabricksSqlHook(BaseDatabricksHook, DbApiHook):
         split_statements: bool = True,
         return_last: bool = True,
     ) -> Any | list[Any] | None:
-        """
-        Runs a command or a list of commands. Pass a list of sql
-        statements to the sql parameter to get them to execute
-        sequentially.
+        """Runs a command or a list of commands.
+
+        Pass a list of SQL statements to the SQL parameter to get them to
+        execute sequentially.
 
         :param sql: the sql statement to be executed (str) or a list of
             sql statements to execute
@@ -180,10 +179,12 @@ class DatabricksSqlHook(BaseDatabricksHook, DbApiHook):
         else:
             raise ValueError("List of SQL statements is empty")
 
+        conn = None
         results = []
         for sql_statement in sql_list:
             # when using AAD tokens, it could expire if previous query run longer than token lifetime
-            with closing(self.get_conn()) as conn:
+            conn = self.get_conn()
+            with closing(conn.cursor()) as cur:
                 self.set_autocommit(conn, autocommit)
 
                 with closing(conn.cursor()) as cur:
@@ -196,7 +197,8 @@ class DatabricksSqlHook(BaseDatabricksHook, DbApiHook):
                         else:
                             results.append(result)
                             self.descriptions.append(cur.description)
-
+        if conn:
+            conn.close()
             self._sql_conn = None
 
         if handler is None:

{apache-airflow-providers-databricks-4.2.0rc2 → apache-airflow-providers-databricks-4.3.0rc1}/airflow/providers/databricks/operators/databricks.py

@@ -20,10 +20,10 @@ from __future__ import annotations
 
 import time
 import warnings
+from functools import cached_property
 from logging import Logger
 from typing import TYPE_CHECKING, Any, Sequence
 
-from airflow.compat.functools import cached_property
 from airflow.exceptions import AirflowException, AirflowProviderDeprecationWarning
 from airflow.models import BaseOperator, BaseOperatorLink, XCom
 from airflow.providers.databricks.hooks.databricks import DatabricksHook, RunState
@@ -42,7 +42,7 @@ XCOM_RUN_PAGE_URL_KEY = "run_page_url"
 
 def _handle_databricks_operator_execution(operator, hook, log, context) -> None:
     """
-    Handles the Airflow + Databricks lifecycle logic for a Databricks operator
+    Handles the Airflow + Databricks lifecycle logic for a Databricks operator.
 
     :param operator: Databricks operator being handled
     :param context: Airflow context
@@ -100,7 +100,7 @@ def _handle_databricks_operator_execution(operator, hook, log, context) -> None:
 
 def _handle_deferrable_databricks_operator_execution(operator, hook, log, context) -> None:
     """
-    Handles the Airflow + Databricks lifecycle logic for deferrable Databricks operators
+    Handles the Airflow + Databricks lifecycle logic for deferrable Databricks operators.
 
     :param operator: Databricks async operator being handled
     :param context: Airflow context
@@ -303,7 +303,7 @@ class DatabricksSubmitRunOperator(BaseOperator):
         dbt_task: dict[str, str | list[str]] | None = None,
         new_cluster: dict[str, object] | None = None,
         existing_cluster_id: str | None = None,
-        libraries: list[dict[str, str]] | None = None,
+        libraries: list[dict[str, Any]] | None = None,
         run_name: str | None = None,
         timeout_seconds: int | None = None,
         databricks_conn_id: str = "databricks_default",
@@ -404,7 +404,7 @@ class DatabricksSubmitRunOperator(BaseOperator):
 
 
 class DatabricksSubmitRunDeferrableOperator(DatabricksSubmitRunOperator):
-    """Deferrable version of ``DatabricksSubmitRunOperator``"""
+    """Deferrable version of ``DatabricksSubmitRunOperator``."""
 
     def __init__(self, *args, **kwargs):
         warnings.warn(
@@ -683,7 +683,7 @@ class DatabricksRunNowOperator(BaseOperator):
 
 
 class DatabricksRunNowDeferrableOperator(DatabricksRunNowOperator):
-    """Deferrable version of ``DatabricksRunNowOperator``"""
+    """Deferrable version of ``DatabricksRunNowOperator``."""
 
     def __init__(self, *args, **kwargs):
         warnings.warn(

{apache-airflow-providers-databricks-4.2.0rc2 → apache-airflow-providers-databricks-4.3.0rc1}/airflow/providers/databricks/operators/databricks_repos.py

@@ -19,10 +19,10 @@
 from __future__ import annotations
 
 import re
+from functools import cached_property
 from typing import TYPE_CHECKING, Sequence
 from urllib.parse import urlsplit
 
-from airflow.compat.functools import cached_property
 from airflow.exceptions import AirflowException
 from airflow.models import BaseOperator
 from airflow.providers.databricks.hooks.databricks import DatabricksHook
@@ -129,7 +129,7 @@ class DatabricksReposCreateOperator(BaseOperator):
 
     def execute(self, context: Context):
         """
-        Creates a Databricks Repo
+        Creates a Databricks Repo.
 
         :param context: context
         :return: Repo ID

{apache-airflow-providers-databricks-4.2.0rc2 → apache-airflow-providers-databricks-4.3.0rc1}/airflow/providers/databricks/operators/databricks_sql.py

@@ -22,6 +22,7 @@ import csv
 import json
 from typing import TYPE_CHECKING, Any, Sequence
 
+from databricks.sql.types import Row
 from databricks.sql.utils import ParamEscaper
 
 from airflow.exceptions import AirflowException
@@ -33,9 +34,13 @@ if TYPE_CHECKING:
     from airflow.utils.context import Context
 
 
+def make_serializable(val: Row):
+    return tuple(val)
+
+
 class DatabricksSqlOperator(SQLExecuteQueryOperator):
     """
-    Executes SQL code in a Databricks SQL endpoint or a Databricks cluster
+    Executes SQL code in a Databricks SQL endpoint or a Databricks cluster.
 
     .. seealso::
         For more information on how to use this operator, take a look at the guide:
@@ -125,7 +130,7 @@ class DatabricksSqlOperator(SQLExecuteQueryOperator):
 
     def _process_output(self, results: list[Any], descriptions: list[Sequence[Sequence] | None]) -> list[Any]:
         if not self._output_path:
-            return list(zip(descriptions, results))
+            return list(zip(descriptions, [[make_serializable(row) for row in res] for res in results]))
         if not self._output_format:
             raise AirflowException("Output format should be specified!")
         # Output to a file only the result of last query
@@ -158,7 +163,7 @@ class DatabricksSqlOperator(SQLExecuteQueryOperator):
                     file.write("\n")
         else:
             raise AirflowException(f"Unsupported output format: '{self._output_format}'")
-        return list(zip(descriptions, results))
+        return list(zip(descriptions, [[make_serializable(row) for row in res] for res in results]))
 
 
 COPY_INTO_APPROVED_FORMATS = ["CSV", "JSON", "AVRO", "ORC", "PARQUET", "TEXT", "BINARYFILE"]

{apache-airflow-providers-databricks-4.2.0rc2 → apache-airflow-providers-databricks-4.3.0rc1}/airflow/providers/databricks/sensors/databricks_partition.py

@@ -21,11 +21,11 @@
 from __future__ import annotations
 
 from datetime import datetime
+from functools import cached_property
 from typing import TYPE_CHECKING, Any, Callable, Sequence
 
 from databricks.sql.utils import ParamEscaper
 
-from airflow.compat.functools import cached_property
 from airflow.exceptions import AirflowException
 from airflow.providers.common.sql.hooks.sql import fetch_all_handler
 from airflow.providers.databricks.hooks.databricks_sql import DatabricksSqlHook

{apache-airflow-providers-databricks-4.2.0rc2 → apache-airflow-providers-databricks-4.3.0rc1}/airflow/providers/databricks/sensors/databricks_sql.py

@@ -20,9 +20,9 @@
 
 from __future__ import annotations
 
+from functools import cached_property
 from typing import TYPE_CHECKING, Any, Callable, Iterable, Sequence
 
-from airflow.compat.functools import cached_property
 from airflow.exceptions import AirflowException
 from airflow.providers.common.sql.hooks.sql import fetch_all_handler
 from airflow.providers.databricks.hooks.databricks_sql import DatabricksSqlHook

{apache-airflow-providers-databricks-4.2.0rc2 → apache-airflow-providers-databricks-4.3.0rc1}/airflow/providers/databricks/utils/databricks.py

@@ -57,7 +57,7 @@ def normalise_json_content(content, json_path: str = "json") -> str | bool | lis
 def validate_trigger_event(event: dict):
     """
     Validates correctness of the event
-    received from :class:`~airflow.providers.databricks.triggers.databricks.DatabricksExecutionTrigger`
+    received from :class:`~airflow.providers.databricks.triggers.databricks.DatabricksExecutionTrigger`.
     """
     keys_to_check = ["run_id", "run_page_url", "run_state"]
     for key in keys_to_check:

{apache-airflow-providers-databricks-4.2.0rc2 → apache-airflow-providers-databricks-4.3.0rc1/apache_airflow_providers_databricks.egg-info}/PKG-INFO

@@ -1,13 +1,13 @@
 Metadata-Version: 2.1
 Name: apache-airflow-providers-databricks
-Version: 4.2.0rc2
+Version: 4.3.0rc1
 Summary: Provider for Apache Airflow. Implements apache-airflow-providers-databricks package
 Home-page: https://airflow.apache.org/
 Download-URL: https://archive.apache.org/dist/airflow/providers
 Author: Apache Software Foundation
 Author-email: dev@airflow.apache.org
 License: Apache License 2.0
-Project-URL: Documentation, https://airflow.apache.org/docs/apache-airflow-providers-databricks/4.2.0/
+Project-URL: Documentation, https://airflow.apache.org/docs/apache-airflow-providers-databricks/4.3.0/
 Project-URL: Bug Tracker, https://github.com/apache/airflow/issues
 Project-URL: Source Code, https://github.com/apache/airflow
 Project-URL: Slack Chat, https://s.apache.org/airflow-slack
@@ -21,12 +21,12 @@ Classifier: Intended Audience :: System Administrators
 Classifier: Framework :: Apache Airflow
 Classifier: Framework :: Apache Airflow :: Provider
 Classifier: License :: OSI Approved :: Apache Software License
-Classifier: Programming Language :: Python :: 3.7
 Classifier: Programming Language :: Python :: 3.8
 Classifier: Programming Language :: Python :: 3.9
 Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
 Classifier: Topic :: System :: Monitoring
-Requires-Python: ~=3.7
+Requires-Python: ~=3.8
 Description-Content-Type: text/x-rst
 Provides-Extra: common.sql
 License-File: LICENSE
@@ -53,7 +53,7 @@ License-File: NOTICE
 
 Package ``apache-airflow-providers-databricks``
 
-Release: ``4.2.0rc2``
+Release: ``4.3.0rc1``
 
 
 `Databricks <https://databricks.com/>`__
@@ -66,7 +66,7 @@ This is a provider package for ``databricks`` provider. All classes for this pro
 are in ``airflow.providers.databricks`` python package.
 
 You can find package information and changelog for the provider
-in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-databricks/4.2.0/>`_.
+in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-databricks/4.3.0/>`_.
 
 
 Installation
@@ -76,7 +76,7 @@ You can install this package on top of an existing Airflow 2 installation (see `
 for the minimum Airflow version supported) via
 ``pip install apache-airflow-providers-databricks``
 
-The package supports the following python versions: 3.7,3.8,3.9,3.10
+The package supports the following python versions: 3.8,3.9,3.10,3.11
 
 Requirements
 ------------
@@ -136,6 +136,36 @@ Dependent package
 Changelog
 ---------
 
+4.3.0
+.....
+
+.. note::
+  This release dropped support for Python 3.7
+
+Features
+~~~~~~~~
+
+* ``add a return when the event is yielded in a loop to stop the execution (#31985)``
+
+Bug Fixes
+~~~~~~~~~
+
+* ``Fix type annotation (#31888)``
+* ``Fix Databricks SQL operator serialization (#31780)``
+* ``Making Databricks run related multi-query string in one session again (#31898) (#31899)``
+
+Misc
+~~~~
+* ``Remove return statement after yield from triggers class (#31703)``
+* ``Remove Python 3.7 support (#30963)``
+
+.. Below changes are excluded from the changelog. Move them to
+   appropriate section above if needed. Do not delete the lines(!):
+   * ``Improve docstrings in providers (#31681)``
+   * ``Add discoverability for triggers in provider.yaml (#31576)``
+   * ``Add D400 pydocstyle check - Providers (#31427)``
+   * ``Add note about dropping Python 3.7 for providers (#32015)``
+
 4.2.0
 .....
 

{apache-airflow-providers-databricks-4.2.0rc2 → apache-airflow-providers-databricks-4.3.0rc1}/pyproject.toml

@@ -26,6 +26,9 @@ target-version = ['py37', 'py38', 'py39', 'py310']
 requires = ['setuptools==67.2.0']
 build-backend = "setuptools.build_meta"
 
+[project]
+requires-python = ">=3.8"
+
 [tool.ruff]
 typing-modules = ["airflow.typing_compat"]
 line-length = 110
@@ -35,12 +38,10 @@ extend-exclude = [
     "airflow/providers/google/ads/_vendor/*",
     # The files generated by stubgen aren't 100% valid syntax it turns out, and we don't ship them, so we can
     # ignore them in ruff
-    "airflow/providers/common/sql/*/*.pyi"
+    "airflow/providers/common/sql/*/*.pyi",
+    "airflow/migrations/versions/*.py"
 ]
 
-# TODO: Bump to Python 3.8 when support for Python 3.7 is dropped in Airflow.
-target-version = "py37"
-
 extend-select = [
     "I", # Missing required import (auto-fixable)
     "UP", # Pyupgrade
@@ -53,7 +54,7 @@ extend-select = [
     "D106",
     "D2",
     "D3",
-    # "D400", WIP: see #31135
+    "D400",
     # "D401", # Not enabled by ruff, but we don't want it
     "D402",
     "D403",

{apache-airflow-providers-databricks-4.2.0rc2 → apache-airflow-providers-databricks-4.3.0rc1}/setup.cfg

@@ -21,13 +21,13 @@ classifiers =
 	Framework :: Apache Airflow
 	Framework :: Apache Airflow :: Provider
 	License :: OSI Approved :: Apache Software License
-	Programming Language :: Python :: 3.7
 	Programming Language :: Python :: 3.8
 	Programming Language :: Python :: 3.9
 	Programming Language :: Python :: 3.10
+	Programming Language :: Python :: 3.11
 	Topic :: System :: Monitoring
 project_urls = 
-	Documentation=https://airflow.apache.org/docs/apache-airflow-providers-databricks/4.2.0/
+	Documentation=https://airflow.apache.org/docs/apache-airflow-providers-databricks/4.3.0/
 	Bug Tracker=https://github.com/apache/airflow/issues
 	Source Code=https://github.com/apache/airflow
 	Slack Chat=https://s.apache.org/airflow-slack
@@ -40,7 +40,7 @@ python_tag = py3
 [options]
 zip_safe = False
 include_package_data = True
-python_requires = ~=3.7
+python_requires = ~=3.8
 packages = find:
 setup_requires = 
 	setuptools
@@ -60,6 +60,6 @@ apache_airflow_provider =
 packages = airflow.providers.databricks
 
 [egg_info]
-tag_build = rc2
+tag_build = rc1
 tag_date = 0
 

{apache-airflow-providers-databricks-4.2.0rc2 → apache-airflow-providers-databricks-4.3.0rc1}/setup.py

@@ -26,7 +26,7 @@
 
 from setuptools import find_namespace_packages, setup
 
-version = "4.2.0"
+version = "4.3.0"
 
 
 def do_setup():