apache-airflow-providers-common-sql 1.27.0rc1__tar.gz → 1.27.1rc1__tar.gz

{apache_airflow_providers_common_sql-1.27.0rc1 → apache_airflow_providers_common_sql-1.27.1rc1}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: apache-airflow-providers-common-sql
-Version: 1.27.0rc1
+Version: 1.27.1rc1
 Summary: Provider package apache-airflow-providers-common-sql for Apache Airflow
 Keywords: airflow-provider,common.sql,airflow,integration
 Author-email: Apache Software Foundation <dev@airflow.apache.org>
@@ -28,8 +28,8 @@ Requires-Dist: apache-airflow-providers-openlineage ; extra == "openlineage"
 Requires-Dist: pandas>=2.1.2,<2.2 ; extra == "pandas"
 Requires-Dist: polars>=1.26.0 ; extra == "polars"
 Project-URL: Bug Tracker, https://github.com/apache/airflow/issues
-Project-URL: Changelog, https://airflow.apache.org/docs/apache-airflow-providers-common-sql/1.27.0/changelog.html
-Project-URL: Documentation, https://airflow.apache.org/docs/apache-airflow-providers-common-sql/1.27.0
+Project-URL: Changelog, https://airflow.staged.apache.org/docs/apache-airflow-providers-common-sql/1.27.1/changelog.html
+Project-URL: Documentation, https://airflow.staged.apache.org/docs/apache-airflow-providers-common-sql/1.27.1
 Project-URL: Mastodon, https://fosstodon.org/@airflow
 Project-URL: Slack Chat, https://s.apache.org/airflow-slack
 Project-URL: Source Code, https://github.com/apache/airflow
@@ -63,7 +63,7 @@ Provides-Extra: polars
 
 Package ``apache-airflow-providers-common-sql``
 
-Release: ``1.27.0``
+Release: ``1.27.1``
 
 
 `Common SQL Provider <https://en.wikipedia.org/wiki/SQL>`__
@@ -76,7 +76,7 @@ This is a provider package for ``common.sql`` provider. All classes for this pro
 are in ``airflow.providers.common.sql`` python package.
 
 You can find package information and changelog for the provider
-in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-common-sql/1.27.0/>`_.
+in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-common-sql/1.27.1/>`_.
 
 Installation
 ------------
@@ -119,5 +119,5 @@ Dependent package
 ==============================================================================================================  ===============
 
 The changelog for the provider package can be found in the
-`changelog <https://airflow.apache.org/docs/apache-airflow-providers-common-sql/1.27.0/changelog.html>`_.
+`changelog <https://airflow.apache.org/docs/apache-airflow-providers-common-sql/1.27.1/changelog.html>`_.
 

{apache_airflow_providers_common_sql-1.27.0rc1 → apache_airflow_providers_common_sql-1.27.1rc1}/README.rst

@@ -23,7 +23,7 @@
 
 Package ``apache-airflow-providers-common-sql``
 
-Release: ``1.27.0``
+Release: ``1.27.1``
 
 
 `Common SQL Provider <https://en.wikipedia.org/wiki/SQL>`__
@@ -36,7 +36,7 @@ This is a provider package for ``common.sql`` provider. All classes for this pro
 are in ``airflow.providers.common.sql`` python package.
 
 You can find package information and changelog for the provider
-in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-common-sql/1.27.0/>`_.
+in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-common-sql/1.27.1/>`_.
 
 Installation
 ------------
@@ -79,4 +79,4 @@ Dependent package
 ==============================================================================================================  ===============
 
 The changelog for the provider package can be found in the
-`changelog <https://airflow.apache.org/docs/apache-airflow-providers-common-sql/1.27.0/changelog.html>`_.
+`changelog <https://airflow.apache.org/docs/apache-airflow-providers-common-sql/1.27.1/changelog.html>`_.

{apache_airflow_providers_common_sql-1.27.0rc1 → apache_airflow_providers_common_sql-1.27.1rc1}/docs/changelog.rst

@@ -25,6 +25,20 @@
 Changelog
 ---------
 
+1.27.1
+......
+
+Misc
+~~~~
+
+* ``Update deprecated functions to use stable functions (#50275)``
+* ``Update type to follow newest tpying spec (#50229)``
+
+.. Below changes are excluded from the changelog. Move them to
+   appropriate section above if needed. Do not delete the lines(!):
+   * ``Update description of provider.yaml dependencies (#50231)``
+   * ``Add test for  overload (#50200)``
+
 1.27.0
 ......
 

{apache_airflow_providers_common_sql-1.27.0rc1 → apache_airflow_providers_common_sql-1.27.1rc1}/docs/index.rst

@@ -79,7 +79,7 @@ apache-airflow-providers-common-sql package
 `Common SQL Provider <https://en.wikipedia.org/wiki/SQL>`__
 
 
-Release: 1.27.0
+Release: 1.27.1
 
 Provider package
 ----------------
@@ -133,5 +133,5 @@ Downloading official packages
 You can download officially released packages and verify their checksums and signatures from the
 `Official Apache Download site <https://downloads.apache.org/airflow/providers/>`_
 
-* `The apache-airflow-providers-common-sql 1.27.0 sdist package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_common_sql-1.27.0.tar.gz>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_common_sql-1.27.0.tar.gz.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_common_sql-1.27.0.tar.gz.sha512>`__)
-* `The apache-airflow-providers-common-sql 1.27.0 wheel package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_common_sql-1.27.0-py3-none-any.whl>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_common_sql-1.27.0-py3-none-any.whl.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_common_sql-1.27.0-py3-none-any.whl.sha512>`__)
+* `The apache-airflow-providers-common-sql 1.27.1 sdist package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_common_sql-1.27.1.tar.gz>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_common_sql-1.27.1.tar.gz.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_common_sql-1.27.1.tar.gz.sha512>`__)
+* `The apache-airflow-providers-common-sql 1.27.1 wheel package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_common_sql-1.27.1-py3-none-any.whl>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_common_sql-1.27.1-py3-none-any.whl.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_common_sql-1.27.1-py3-none-any.whl.sha512>`__)

{apache_airflow_providers_common_sql-1.27.0rc1 → apache_airflow_providers_common_sql-1.27.1rc1}/provider.yaml

@@ -22,9 +22,13 @@ description: |
     `Common SQL Provider <https://en.wikipedia.org/wiki/SQL>`__
 
 state: ready
-source-date-epoch: 1746344573
-# note that those versions are maintained by release manager - do not update them manually
+source-date-epoch: 1747132237
+# Note that those versions are maintained by release manager - do not update them manually
+# with the exception of case where other provider in sources has >= new provider version.
+# In such case adding >= NEW_VERSION and bumping to NEW_VERSION in a provider have
+# to be done in the same PR
 versions:
+  - 1.27.1
   - 1.27.0
   - 1.26.0
   - 1.25.0

{apache_airflow_providers_common_sql-1.27.0rc1 → apache_airflow_providers_common_sql-1.27.1rc1}/pyproject.toml

@@ -25,7 +25,7 @@ build-backend = "flit_core.buildapi"
 
 [project]
 name = "apache-airflow-providers-common-sql"
-version = "1.27.0rc1"
+version = "1.27.1rc1"
 description = "Provider package apache-airflow-providers-common-sql for Apache Airflow"
 readme = "README.rst"
 authors = [
@@ -122,8 +122,8 @@ apache-airflow-providers-common-sql = {workspace = true}
 apache-airflow-providers-standard = {workspace = true}
 
 [project.urls]
-"Documentation" = "https://airflow.apache.org/docs/apache-airflow-providers-common-sql/1.27.0"
-"Changelog" = "https://airflow.apache.org/docs/apache-airflow-providers-common-sql/1.27.0/changelog.html"
+"Documentation" = "https://airflow.staged.apache.org/docs/apache-airflow-providers-common-sql/1.27.1"
+"Changelog" = "https://airflow.staged.apache.org/docs/apache-airflow-providers-common-sql/1.27.1/changelog.html"
 "Bug Tracker" = "https://github.com/apache/airflow/issues"
 "Source Code" = "https://github.com/apache/airflow"
 "Slack Chat" = "https://s.apache.org/airflow-slack"

{apache_airflow_providers_common_sql-1.27.0rc1 → apache_airflow_providers_common_sql-1.27.1rc1}/src/airflow/providers/common/sql/__init__.py

@@ -29,7 +29,7 @@ from airflow import __version__ as airflow_version
 
 __all__ = ["__version__"]
 
-__version__ = "1.27.0"
+__version__ = "1.27.1"
 
 if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
     "2.10.0"

{apache_airflow_providers_common_sql-1.27.0rc1 → apache_airflow_providers_common_sql-1.27.1rc1}/src/airflow/providers/common/sql/hooks/sql.py

@@ -54,7 +54,7 @@ from airflow.providers.common.sql.hooks import handlers
 from airflow.utils.module_loading import import_string
 
 if TYPE_CHECKING:
-    from pandas import DataFrame
+    from pandas import DataFrame as PandasDataFrame
     from polars import DataFrame as PolarsDataFrame
     from sqlalchemy.engine import URL, Engine, Inspector
 
@@ -391,7 +391,7 @@ class DbApiHook(BaseHook):
         sql,
         parameters: list | tuple | Mapping[str, Any] | None = None,
         **kwargs,
-    ) -> DataFrame:
+    ) -> PandasDataFrame:
         """
         Execute the sql and returns a pandas dataframe.
 
@@ -399,7 +399,7 @@ class DbApiHook(BaseHook):
         :param parameters: The parameters to render the SQL query with.
         :param kwargs: (optional) passed into pandas.io.sql.read_sql method
         """
-        return self._get_pandas_df(sql, parameters, **kwargs)
+        return self.get_df(sql, parameters, df_type="pandas", **kwargs)
 
     @deprecated(
         reason="Replaced by function `get_df_by_chunks`.",
@@ -413,17 +413,37 @@ class DbApiHook(BaseHook):
         *,
         chunksize: int,
         **kwargs,
-    ) -> Generator[DataFrame, None, None]:
-        return self._get_pandas_df_by_chunks(sql, parameters, chunksize=chunksize, **kwargs)
+    ) -> Generator[PandasDataFrame, None, None]:
+        return self.get_df_by_chunks(sql, parameters, chunksize=chunksize, df_type="pandas", **kwargs)
 
+    @overload
     def get_df(
         self,
-        sql,
+        sql: str | list[str],
+        parameters: list | tuple | Mapping[str, Any] | None = None,
+        *,
+        df_type: Literal["pandas"] = "pandas",
+        **kwargs: Any,
+    ) -> PandasDataFrame: ...
+
+    @overload
+    def get_df(
+        self,
+        sql: str | list[str],
+        parameters: list | tuple | Mapping[str, Any] | None = None,
+        *,
+        df_type: Literal["polars"],
+        **kwargs: Any,
+    ) -> PolarsDataFrame: ...
+
+    def get_df(
+        self,
+        sql: str | list[str],
         parameters: list | tuple | Mapping[str, Any] | None = None,
         *,
         df_type: Literal["pandas", "polars"] = "pandas",
         **kwargs,
-    ) -> DataFrame | PolarsDataFrame:
+    ) -> PandasDataFrame | PolarsDataFrame:
         """
         Execute the sql and returns a dataframe.
 
@@ -442,7 +462,7 @@ class DbApiHook(BaseHook):
         sql,
         parameters: list | tuple | Mapping[str, Any] | None = None,
         **kwargs,
-    ) -> DataFrame:
+    ) -> PandasDataFrame:
         """
         Execute the sql and returns a pandas dataframe.
 
@@ -492,15 +512,37 @@ class DbApiHook(BaseHook):
 
             return pl.read_database(sql, connection=conn, execute_options=execute_options, **kwargs)
 
+    @overload
     def get_df_by_chunks(
         self,
-        sql,
+        sql: str | list[str],
+        parameters: list | tuple | Mapping[str, Any] | None = None,
+        *,
+        chunksize: int,
+        df_type: Literal["pandas"] = "pandas",
+        **kwargs,
+    ) -> Generator[PandasDataFrame, None, None]: ...
+
+    @overload
+    def get_df_by_chunks(
+        self,
+        sql: str | list[str],
+        parameters: list | tuple | Mapping[str, Any] | None = None,
+        *,
+        chunksize: int,
+        df_type: Literal["polars"],
+        **kwargs,
+    ) -> Generator[PolarsDataFrame, None, None]: ...
+
+    def get_df_by_chunks(
+        self,
+        sql: str | list[str],
         parameters: list | tuple | Mapping[str, Any] | None = None,
         *,
         chunksize: int,
         df_type: Literal["pandas", "polars"] = "pandas",
         **kwargs,
-    ) -> Generator[DataFrame | PolarsDataFrame, None, None]:
+    ) -> Generator[PandasDataFrame | PolarsDataFrame, None, None]:
         """
         Execute the sql and return a generator.
 
@@ -522,7 +564,7 @@ class DbApiHook(BaseHook):
         *,
         chunksize: int,
         **kwargs,
-    ) -> Generator[DataFrame, None, None]:
+    ) -> Generator[PandasDataFrame, None, None]:
         """
         Execute the sql and return a generator.
 

{apache_airflow_providers_common_sql-1.27.0rc1 → apache_airflow_providers_common_sql-1.27.1rc1}/src/airflow/providers/common/sql/hooks/sql.pyi

@@ -34,13 +34,11 @@ isort:skip_file
 
 from collections.abc import Generator, Iterable, Mapping, MutableMapping, Sequence
 from functools import cached_property as cached_property
-from typing import Any, Callable, Protocol, TypeVar, overload
+from typing import Any, Protocol, TypeVar
 
 from _typeshed import Incomplete as Incomplete
 from pandas import DataFrame as PandasDataFrame
-from polars import DataFrame as PolarsDataFrame
 from sqlalchemy.engine import URL as URL, Engine as Engine, Inspector as Inspector
-from typing_extensions import Literal
 
 from airflow.hooks.base import BaseHook as BaseHook
 from airflow.models import Connection as Connection
@@ -111,61 +109,6 @@ class DbApiHook(BaseHook):
     def get_pandas_df_by_chunks(
         self, sql, parameters: list | tuple | Mapping[str, Any] | None = None, *, chunksize: int, **kwargs
     ) -> Generator[PandasDataFrame, None, None]: ...
-    @overload
-    def get_df(
-        self,
-        sql: str | list[str],
-        parameters: list | tuple | Mapping[str, Any] | None = None,
-        *,
-        df_type: Literal["pandas"] = "pandas",
-        **kwargs: Any,
-    ) -> PandasDataFrame: ...
-    @overload
-    def get_df(
-        self,
-        sql: str | list[str],
-        parameters: list | tuple | Mapping[str, Any] | None = None,
-        *,
-        df_type: Literal["polars"] = "polars",
-        **kwargs: Any,
-    ) -> PolarsDataFrame: ...
-    @overload
-    def get_df(  # fallback overload
-        self,
-        sql: str | list[str],
-        parameters: list | tuple | Mapping[str, Any] | None = None,
-        *,
-        df_type: Literal["pandas", "polars"] = "pandas",
-    ) -> PandasDataFrame | PolarsDataFrame: ...
-    @overload
-    def get_df_by_chunks(
-        self,
-        sql,
-        parameters: list | tuple | Mapping[str, Any] | None = None,
-        *,
-        chunksize: int,
-        df_type: Literal["pandas"] = "pandas",
-        **kwargs,
-    ) -> Generator[PandasDataFrame, None, None]: ...
-    @overload
-    def get_df_by_chunks(
-        self,
-        sql,
-        parameters: list | tuple | Mapping[str, Any] | None = None,
-        *,
-        chunksize: int,
-        df_type: Literal["polars"],
-        **kwargs,
-    ) -> Generator[PolarsDataFrame, None, None]: ...
-    @overload
-    def get_df_by_chunks(  # fallback overload
-        self,
-        sql,
-        parameters: list | tuple | Mapping[str, Any] | None = None,
-        *,
-        chunksize: int,
-        df_type: Literal["pandas", "polars"] = "pandas",
-    ) -> Generator[PandasDataFrame | PolarsDataFrame, None, None]: ...
     def get_records(
         self, sql: str | list[str], parameters: Iterable | Mapping[str, Any] | None = None
     ) -> Any: ...
@@ -178,26 +121,6 @@ class DbApiHook(BaseHook):
     def split_sql_string(sql: str, strip_semicolon: bool = False) -> list[str]: ...
     @property
     def last_description(self) -> Sequence[Sequence] | None: ...
-    @overload
-    def run(
-        self,
-        sql: str | Iterable[str],
-        autocommit: bool = ...,
-        parameters: Iterable | Mapping[str, Any] | None = ...,
-        handler: None = ...,
-        split_statements: bool = ...,
-        return_last: bool = ...,
-    ) -> None: ...
-    @overload
-    def run(
-        self,
-        sql: str | Iterable[str],
-        autocommit: bool = ...,
-        parameters: Iterable | Mapping[str, Any] | None = ...,
-        handler: Callable[[Any], T] = ...,
-        split_statements: bool = ...,
-        return_last: bool = ...,
-    ) -> tuple | list[tuple] | list[list[tuple] | tuple] | None: ...
     def set_autocommit(self, conn, autocommit) -> None: ...
     def get_autocommit(self, conn) -> bool: ...
     def get_cursor(self) -> Any: ...

{apache_airflow_providers_common_sql-1.27.0rc1 → apache_airflow_providers_common_sql-1.27.1rc1}/tests/unit/common/sql/hooks/test_sql.py

@@ -23,6 +23,8 @@ import logging
 import logging.config
 from unittest.mock import MagicMock
 
+import pandas as pd
+import polars as pl
 import pytest
 
 from airflow.config_templates.airflow_local_settings import DEFAULT_LOGGING_CONFIG
@@ -306,3 +308,21 @@ class TestDbApiHook:
     def test_uri_with_schema(self):
         dbapi_hook = mock_db_hook(DbApiHook, conn_params={"schema": "other_schema"})
         assert dbapi_hook.get_uri() == "//login:password@host:1234/other_schema"
+
+    @pytest.mark.db_test
+    @pytest.mark.parametrize(
+        "df_type, expected_type",
+        [
+            ("test_default_df_type", pd.DataFrame),
+            ("pandas", pd.DataFrame),
+            ("polars", pl.DataFrame),
+        ],
+    )
+    def test_get_df_with_df_type(db, df_type, expected_type):
+        dbapi_hook = mock_db_hook(DbApiHook)
+        if df_type == "test_default_df_type":
+            df = dbapi_hook.get_df("SQL")
+            assert isinstance(df, pd.DataFrame)
+        else:
+            df = dbapi_hook.get_df("SQL", df_type=df_type)
+            assert isinstance(df, expected_type)