apache-airflow-providers-postgres 6.2.1rc1__tar.gz → 6.2.2rc1__tar.gz

{apache_airflow_providers_postgres-6.2.1rc1 → apache_airflow_providers_postgres-6.2.2rc1}/PKG-INFO

@@ -1,11 +1,11 @@
 Metadata-Version: 2.4
 Name: apache-airflow-providers-postgres
-Version: 6.2.1rc1
+Version: 6.2.2rc1
 Summary: Provider package apache-airflow-providers-postgres for Apache Airflow
 Keywords: airflow-provider,postgres,airflow,integration
 Author-email: Apache Software Foundation <dev@airflow.apache.org>
 Maintainer-email: Apache Software Foundation <dev@airflow.apache.org>
-Requires-Python: ~=3.10
+Requires-Python: >=3.10
 Description-Content-Type: text/x-rst
 Classifier: Development Status :: 5 - Production/Stable
 Classifier: Environment :: Console
@@ -18,22 +18,29 @@ Classifier: License :: OSI Approved :: Apache Software License
 Classifier: Programming Language :: Python :: 3.10
 Classifier: Programming Language :: Python :: 3.11
 Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
 Classifier: Topic :: System :: Monitoring
 Requires-Dist: apache-airflow>=2.10.0rc1
 Requires-Dist: apache-airflow-providers-common-sql>=1.23.0rc1
-Requires-Dist: psycopg2-binary>=2.9.9
+Requires-Dist: psycopg2-binary>=2.9.9; python_version < '3.13'
+Requires-Dist: psycopg2-binary>=2.9.10; python_version >= '3.13'
 Requires-Dist: asyncpg>=0.30.0
 Requires-Dist: apache-airflow-providers-amazon>=2.6.0rc1 ; extra == "amazon"
 Requires-Dist: apache-airflow-providers-openlineage ; extra == "openlineage"
+Requires-Dist: pandas>=2.1.2 ; extra == "pandas" and ( python_version <"3.13")
+Requires-Dist: pandas>=2.2.3 ; extra == "pandas" and ( python_version >="3.13")
+Requires-Dist: polars>=1.26.0 ; extra == "polars"
 Project-URL: Bug Tracker, https://github.com/apache/airflow/issues
-Project-URL: Changelog, https://airflow.staged.apache.org/docs/apache-airflow-providers-postgres/6.2.1/changelog.html
-Project-URL: Documentation, https://airflow.staged.apache.org/docs/apache-airflow-providers-postgres/6.2.1
+Project-URL: Changelog, https://airflow.staged.apache.org/docs/apache-airflow-providers-postgres/6.2.2/changelog.html
+Project-URL: Documentation, https://airflow.staged.apache.org/docs/apache-airflow-providers-postgres/6.2.2
 Project-URL: Mastodon, https://fosstodon.org/@airflow
 Project-URL: Slack Chat, https://s.apache.org/airflow-slack
 Project-URL: Source Code, https://github.com/apache/airflow
 Project-URL: YouTube, https://www.youtube.com/channel/UCSXwxpWZQ7XZ1WL3wqevChA/
 Provides-Extra: amazon
 Provides-Extra: openlineage
+Provides-Extra: pandas
+Provides-Extra: polars
 
 
 .. Licensed to the Apache Software Foundation (ASF) under one
@@ -60,8 +67,9 @@ Provides-Extra: openlineage
 
 Package ``apache-airflow-providers-postgres``
 
-Release: ``6.2.1``
+Release: ``6.2.2``
 
+Release Date: ``|PypiReleaseDate|``
 
 `PostgreSQL <https://www.postgresql.org/>`__
 
@@ -73,7 +81,7 @@ This is a provider package for ``postgres`` provider. All classes for this provi
 are in ``airflow.providers.postgres`` python package.
 
 You can find package information and changelog for the provider
-in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-postgres/6.2.1/>`_.
+in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-postgres/6.2.2/>`_.
 
 Installation
 ------------
@@ -82,19 +90,20 @@ You can install this package on top of an existing Airflow 2 installation (see `
 for the minimum Airflow version supported) via
 ``pip install apache-airflow-providers-postgres``
 
-The package supports the following python versions: 3.10,3.11,3.12
+The package supports the following python versions: 3.10,3.11,3.12,3.13
 
 Requirements
 ------------
 
-=======================================  ==================
+=======================================  ======================================
 PIP package                              Version required
-=======================================  ==================
+=======================================  ======================================
 ``apache-airflow``                       ``>=2.10.0``
 ``apache-airflow-providers-common-sql``  ``>=1.23.0``
-``psycopg2-binary``                      ``>=2.9.9``
+``psycopg2-binary``                      ``>=2.9.9; python_version < "3.13"``
+``psycopg2-binary``                      ``>=2.9.10; python_version >= "3.13"``
 ``asyncpg``                              ``>=0.30.0``
-=======================================  ==================
+=======================================  ======================================
 
 Cross provider package dependencies
 -----------------------------------
@@ -118,5 +127,5 @@ Dependent package
 ==============================================================================================================  ===============
 
 The changelog for the provider package can be found in the
-`changelog <https://airflow.apache.org/docs/apache-airflow-providers-postgres/6.2.1/changelog.html>`_.
+`changelog <https://airflow.apache.org/docs/apache-airflow-providers-postgres/6.2.2/changelog.html>`_.
 

{apache_airflow_providers_postgres-6.2.1rc1 → apache_airflow_providers_postgres-6.2.2rc1}/README.rst

@@ -23,8 +23,9 @@
 
 Package ``apache-airflow-providers-postgres``
 
-Release: ``6.2.1``
+Release: ``6.2.2``
 
+Release Date: ``|PypiReleaseDate|``
 
 `PostgreSQL <https://www.postgresql.org/>`__
 
@@ -36,7 +37,7 @@ This is a provider package for ``postgres`` provider. All classes for this provi
 are in ``airflow.providers.postgres`` python package.
 
 You can find package information and changelog for the provider
-in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-postgres/6.2.1/>`_.
+in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-postgres/6.2.2/>`_.
 
 Installation
 ------------
@@ -45,19 +46,20 @@ You can install this package on top of an existing Airflow 2 installation (see `
 for the minimum Airflow version supported) via
 ``pip install apache-airflow-providers-postgres``
 
-The package supports the following python versions: 3.10,3.11,3.12
+The package supports the following python versions: 3.10,3.11,3.12,3.13
 
 Requirements
 ------------
 
-=======================================  ==================
+=======================================  ======================================
 PIP package                              Version required
-=======================================  ==================
+=======================================  ======================================
 ``apache-airflow``                       ``>=2.10.0``
 ``apache-airflow-providers-common-sql``  ``>=1.23.0``
-``psycopg2-binary``                      ``>=2.9.9``
+``psycopg2-binary``                      ``>=2.9.9; python_version < "3.13"``
+``psycopg2-binary``                      ``>=2.9.10; python_version >= "3.13"``
 ``asyncpg``                              ``>=0.30.0``
-=======================================  ==================
+=======================================  ======================================
 
 Cross provider package dependencies
 -----------------------------------
@@ -81,4 +83,4 @@ Dependent package
 ==============================================================================================================  ===============
 
 The changelog for the provider package can be found in the
-`changelog <https://airflow.apache.org/docs/apache-airflow-providers-postgres/6.2.1/changelog.html>`_.
+`changelog <https://airflow.apache.org/docs/apache-airflow-providers-postgres/6.2.2/changelog.html>`_.

{apache_airflow_providers_postgres-6.2.1rc1 → apache_airflow_providers_postgres-6.2.2rc1}/docs/changelog.rst

@@ -27,6 +27,26 @@
 Changelog
 ---------
 
+6.2.2
+.....
+
+Bug Fixes
+~~~~~~~~~
+
+* ``fix(postgres/hooks): ensure get_df uses SQLAlchemy engine to avoid pandas warning (#52224)``
+
+Misc
+~~~~
+
+* ``Add Python 3.13 support for Airflow. (#46891)``
+* ``Cleanup type ignores in postgres provider where possible (#53275)``
+* ``Remove type ignore across codebase after mypy upgrade (#53243)``
+* ``Remove upper-binding for "python-requires" (#52980)``
+* ``Temporarily switch to use >=,< pattern instead of '~=' (#52967)``
+
+.. Below changes are excluded from the changelog. Move them to
+   appropriate section above if needed. Do not delete the lines(!):
+
 6.2.1
 .....
 

{apache_airflow_providers_postgres-6.2.1rc1 → apache_airflow_providers_postgres-6.2.2rc1}/docs/index.rst

@@ -77,7 +77,9 @@ apache-airflow-providers-postgres package
 `PostgreSQL <https://www.postgresql.org/>`__
 
 
-Release: 6.2.1
+Release: 6.2.2
+
+Release Date: ``|PypiReleaseDate|``
 
 Provider package
 ----------------
@@ -97,14 +99,15 @@ Requirements
 
 The minimum Apache Airflow version supported by this provider distribution is ``2.10.0``.
 
-=======================================  ==================
+=======================================  ======================================
 PIP package                              Version required
-=======================================  ==================
+=======================================  ======================================
 ``apache-airflow``                       ``>=2.10.0``
 ``apache-airflow-providers-common-sql``  ``>=1.23.0``
-``psycopg2-binary``                      ``>=2.9.9``
+``psycopg2-binary``                      ``>=2.9.9; python_version < "3.13"``
+``psycopg2-binary``                      ``>=2.9.10; python_version >= "3.13"``
 ``asyncpg``                              ``>=0.30.0``
-=======================================  ==================
+=======================================  ======================================
 
 Cross provider package dependencies
 -----------------------------------
@@ -133,5 +136,5 @@ Downloading official packages
 You can download officially released packages and verify their checksums and signatures from the
 `Official Apache Download site <https://downloads.apache.org/airflow/providers/>`_
 
-* `The apache-airflow-providers-postgres 6.2.1 sdist package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_postgres-6.2.1.tar.gz>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_postgres-6.2.1.tar.gz.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_postgres-6.2.1.tar.gz.sha512>`__)
-* `The apache-airflow-providers-postgres 6.2.1 wheel package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_postgres-6.2.1-py3-none-any.whl>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_postgres-6.2.1-py3-none-any.whl.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_postgres-6.2.1-py3-none-any.whl.sha512>`__)
+* `The apache-airflow-providers-postgres 6.2.2 sdist package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_postgres-6.2.2.tar.gz>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_postgres-6.2.2.tar.gz.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_postgres-6.2.2.tar.gz.sha512>`__)
+* `The apache-airflow-providers-postgres 6.2.2 wheel package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_postgres-6.2.2-py3-none-any.whl>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_postgres-6.2.2-py3-none-any.whl.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_postgres-6.2.2-py3-none-any.whl.sha512>`__)

{apache_airflow_providers_postgres-6.2.1rc1 → apache_airflow_providers_postgres-6.2.2rc1}/provider.yaml

@@ -22,12 +22,13 @@ description: |
   `PostgreSQL <https://www.postgresql.org/>`__
 
 state: ready
-source-date-epoch: 1751474070
+source-date-epoch: 1753691797
 # Note that those versions are maintained by release manager - do not update them manually
 # with the exception of case where other provider in sources has >= new provider version.
 # In such case adding >= NEW_VERSION and bumping to NEW_VERSION in a provider have
 # to be done in the same PR
 versions:
+  - 6.2.2
   - 6.2.1
   - 6.2.0
   - 6.1.3

{apache_airflow_providers_postgres-6.2.1rc1 → apache_airflow_providers_postgres-6.2.2rc1}/pyproject.toml

@@ -25,7 +25,7 @@ build-backend = "flit_core.buildapi"
 
 [project]
 name = "apache-airflow-providers-postgres"
-version = "6.2.1rc1"
+version = "6.2.2rc1"
 description = "Provider package apache-airflow-providers-postgres for Apache Airflow"
 readme = "README.rst"
 authors = [
@@ -47,9 +47,10 @@ classifiers = [
     "Programming Language :: Python :: 3.10",
     "Programming Language :: Python :: 3.11",
     "Programming Language :: Python :: 3.12",
+    "Programming Language :: Python :: 3.13",
     "Topic :: System :: Monitoring",
 ]
-requires-python = "~=3.10"
+requires-python = ">=3.10"
 
 # The dependencies should be modified in place in the generated file.
 # Any change in the dependencies is preserved when the file is regenerated
@@ -58,7 +59,8 @@ requires-python = "~=3.10"
 dependencies = [
     "apache-airflow>=2.10.0rc1",
     "apache-airflow-providers-common-sql>=1.23.0rc1",
-    "psycopg2-binary>=2.9.9",
+    "psycopg2-binary>=2.9.9; python_version < '3.13'",
+    "psycopg2-binary>=2.9.10; python_version >= '3.13'",
     "asyncpg>=0.30.0",
 ]
 
@@ -71,6 +73,13 @@ dependencies = [
 "openlineage" = [
     "apache-airflow-providers-openlineage"
 ]
+"pandas" = [
+    'pandas>=2.1.2; python_version <"3.13"',
+    'pandas>=2.2.3; python_version >="3.13"',
+]
+"polars" = [
+    "polars>=1.26.0"
+]
 
 [dependency-groups]
 dev = [
@@ -81,6 +90,8 @@ dev = [
     "apache-airflow-providers-common-sql",
     "apache-airflow-providers-openlineage",
     # Additional devel dependencies (do not remove this line and add extra development dependencies)
+    "apache-airflow-providers-common-sql[pandas]",
+    "apache-airflow-providers-common-sql[polars]",
 ]
 
 # To build docs:
@@ -109,8 +120,8 @@ apache-airflow-providers-common-sql = {workspace = true}
 apache-airflow-providers-standard = {workspace = true}
 
 [project.urls]
-"Documentation" = "https://airflow.staged.apache.org/docs/apache-airflow-providers-postgres/6.2.1"
-"Changelog" = "https://airflow.staged.apache.org/docs/apache-airflow-providers-postgres/6.2.1/changelog.html"
+"Documentation" = "https://airflow.staged.apache.org/docs/apache-airflow-providers-postgres/6.2.2"
+"Changelog" = "https://airflow.staged.apache.org/docs/apache-airflow-providers-postgres/6.2.2/changelog.html"
 "Bug Tracker" = "https://github.com/apache/airflow/issues"
 "Source Code" = "https://github.com/apache/airflow"
 "Slack Chat" = "https://s.apache.org/airflow-slack"

{apache_airflow_providers_postgres-6.2.1rc1 → apache_airflow_providers_postgres-6.2.2rc1}/src/airflow/__init__.py

@@ -14,4 +14,4 @@
 # KIND, either express or implied.  See the License for the
 # specific language governing permissions and limitations
 # under the License.
-__path__ = __import__("pkgutil").extend_path(__path__, __name__)  # type: ignore
+__path__ = __import__("pkgutil").extend_path(__path__, __name__)

{apache_airflow_providers_postgres-6.2.1rc1/tests/system → apache_airflow_providers_postgres-6.2.2rc1/src/airflow/providers}/__init__.py

@@ -14,4 +14,4 @@
 # KIND, either express or implied.  See the License for the
 # specific language governing permissions and limitations
 # under the License.
-__path__ = __import__("pkgutil").extend_path(__path__, __name__)  # type: ignore
+__path__ = __import__("pkgutil").extend_path(__path__, __name__)

{apache_airflow_providers_postgres-6.2.1rc1 → apache_airflow_providers_postgres-6.2.2rc1}/src/airflow/providers/postgres/__init__.py

@@ -29,7 +29,7 @@ from airflow import __version__ as airflow_version
 
 __all__ = ["__version__"]
 
-__version__ = "6.2.1"
+__version__ = "6.2.2"
 
 if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
     "2.10.0"

{apache_airflow_providers_postgres-6.2.1rc1 → apache_airflow_providers_postgres-6.2.2rc1}/src/airflow/providers/postgres/hooks/postgres.py

@@ -18,9 +18,10 @@
 from __future__ import annotations
 
 import os
+from collections.abc import Mapping
 from contextlib import closing
 from copy import deepcopy
-from typing import TYPE_CHECKING, Any, TypeAlias, cast
+from typing import TYPE_CHECKING, Any, Literal, TypeAlias, cast, overload
 
 import psycopg2
 import psycopg2.extensions
@@ -28,11 +29,16 @@ import psycopg2.extras
 from psycopg2.extras import DictCursor, Json, NamedTupleCursor, RealDictCursor
 from sqlalchemy.engine import URL
 
-from airflow.exceptions import AirflowException
+from airflow.exceptions import (
+    AirflowException,
+    AirflowOptionalProviderFeatureException,
+)
 from airflow.providers.common.sql.hooks.sql import DbApiHook
 from airflow.providers.postgres.dialects.postgres import PostgresDialect
 
 if TYPE_CHECKING:
+    from pandas import DataFrame as PandasDataFrame
+    from polars import DataFrame as PolarsDataFrame
     from psycopg2.extensions import connection
 
     from airflow.providers.common.sql.dialects.dialect import Dialect
@@ -177,6 +183,62 @@ class PostgresHook(DbApiHook):
         self.conn = psycopg2.connect(**conn_args)
         return self.conn
 
+    @overload
+    def get_df(
+        self,
+        sql: str | list[str],
+        parameters: list | tuple | Mapping[str, Any] | None = None,
+        *,
+        df_type: Literal["pandas"] = "pandas",
+        **kwargs: Any,
+    ) -> PandasDataFrame: ...
+
+    @overload
+    def get_df(
+        self,
+        sql: str | list[str],
+        parameters: list | tuple | Mapping[str, Any] | None = None,
+        *,
+        df_type: Literal["polars"] = ...,
+        **kwargs: Any,
+    ) -> PolarsDataFrame: ...
+
+    def get_df(
+        self,
+        sql: str | list[str],
+        parameters: list | tuple | Mapping[str, Any] | None = None,
+        *,
+        df_type: Literal["pandas", "polars"] = "pandas",
+        **kwargs: Any,
+    ) -> PandasDataFrame | PolarsDataFrame:
+        """
+        Execute the sql and returns a dataframe.
+
+        :param sql: the sql statement to be executed (str) or a list of sql statements to execute
+        :param parameters: The parameters to render the SQL query with.
+        :param df_type: Type of dataframe to return, either "pandas" or "polars"
+        :param kwargs: (optional) passed into `pandas.io.sql.read_sql` or `polars.read_database` method
+        :return: A pandas or polars DataFrame containing the query results.
+        """
+        if df_type == "pandas":
+            try:
+                from pandas.io import sql as psql
+            except ImportError:
+                raise AirflowOptionalProviderFeatureException(
+                    "pandas library not installed, run: pip install "
+                    "'apache-airflow-providers-common-sql[pandas]'."
+                )
+
+            engine = self.get_sqlalchemy_engine()
+            with engine.connect() as conn:
+                return psql.read_sql(sql, con=conn, params=parameters, **kwargs)
+
+        elif df_type == "polars":
+            return self._get_polars_df(sql, parameters, **kwargs)
+
+        else:
+            raise ValueError(f"Unsupported df_type: {df_type}")
+
     def copy_expert(self, sql: str, filename: str) -> None:
         """
         Execute SQL using psycopg2's ``copy_expert`` method.
@@ -315,9 +377,7 @@ class PostgresHook(DbApiHook):
         if is_redshift:
             authority = self._get_openlineage_redshift_authority_part(connection)
         else:
-            authority = DbApiHook.get_openlineage_authority_part(  # type: ignore[attr-defined]
-                connection, default_port=5432
-            )
+            authority = DbApiHook.get_openlineage_authority_part(connection, default_port=5432)
 
         return DatabaseInfo(
             scheme="postgres" if not is_redshift else "redshift",

{apache_airflow_providers_postgres-6.2.1rc1/src/airflow/providers → apache_airflow_providers_postgres-6.2.2rc1/tests/system}/__init__.py

@@ -14,4 +14,4 @@
 # KIND, either express or implied.  See the License for the
 # specific language governing permissions and limitations
 # under the License.
-__path__ = __import__("pkgutil").extend_path(__path__, __name__)  # type: ignore
+__path__ = __import__("pkgutil").extend_path(__path__, __name__)

{apache_airflow_providers_postgres-6.2.1rc1 → apache_airflow_providers_postgres-6.2.2rc1}/tests/unit/__init__.py

@@ -14,4 +14,4 @@
 # KIND, either express or implied.  See the License for the
 # specific language governing permissions and limitations
 # under the License.
-__path__ = __import__("pkgutil").extend_path(__path__, __name__)  # type: ignore
+__path__ = __import__("pkgutil").extend_path(__path__, __name__)

{apache_airflow_providers_postgres-6.2.1rc1 → apache_airflow_providers_postgres-6.2.2rc1}/tests/unit/postgres/hooks/test_postgres.py

@@ -22,6 +22,8 @@ import logging
 import os
 from unittest import mock
 
+import pandas as pd
+import polars as pl
 import psycopg2.extras
 import pytest
 import sqlalchemy
@@ -33,6 +35,8 @@ from airflow.providers.postgres.dialects.postgres import PostgresDialect
 from airflow.providers.postgres.hooks.postgres import PostgresHook
 from airflow.utils.types import NOTSET
 
+from tests_common.test_utils.common_sql import mock_db_hook
+
 INSERT_SQL_STATEMENT = "INSERT INTO connection (id, conn_id, conn_type, description, host, {}, login, password, port, is_encrypted, is_extra_encrypted, extra) VALUES (%s,%s,%s,%s,%s,%s,%s,%s,%s,%s,%s,%s)"
 
 
@@ -517,6 +521,36 @@ class TestPostgresHook:
         else:
             assert expected_serialized == raw_cell
 
+    @pytest.mark.parametrize(
+        "df_type, expected_type",
+        [
+            ("pandas", pd.DataFrame),
+            ("polars", pl.DataFrame),
+        ],
+    )
+    @mock.patch("airflow.providers.postgres.hooks.postgres.PostgresHook._get_polars_df")
+    @mock.patch("pandas.io.sql.read_sql")
+    @mock.patch("airflow.providers.postgres.hooks.postgres.PostgresHook.get_sqlalchemy_engine")
+    def test_get_df_with_df_type(
+        self, mock_get_engine, mock_read_sql, mock_polars_df, df_type, expected_type
+    ):
+        hook = mock_db_hook(PostgresHook)
+        mock_read_sql.return_value = pd.DataFrame()
+        mock_polars_df.return_value = pl.DataFrame()
+        sql = "SELECT * FROM table"
+        if df_type == "pandas":
+            mock_conn = mock.MagicMock()
+            mock_engine = mock.MagicMock()
+            mock_engine.connect.return_value.__enter__.return_value = mock_conn
+            mock_get_engine.return_value = mock_engine
+            df = hook.get_df(sql, df_type="pandas")
+            mock_read_sql.assert_called_once_with(sql, con=mock_conn, params=None)
+            assert isinstance(df, expected_type)
+        elif df_type == "polars":
+            df = hook.get_df(sql, df_type="polars")
+            mock_polars_df.assert_called_once_with(sql, None)
+            assert isinstance(df, expected_type)
+
     def test_insert_rows(self):
         table = "table"
         rows = [("hello",), ("world",)]