apache-airflow-providers-postgres 6.2.3rc1__tar.gz → 6.3.0__tar.gz

{apache_airflow_providers_postgres-6.2.3rc1 → apache_airflow_providers_postgres-6.3.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: apache-airflow-providers-postgres
-Version: 6.2.3rc1
+Version: 6.3.0
 Summary: Provider package apache-airflow-providers-postgres for Apache Airflow
 Keywords: airflow-provider,postgres,airflow,integration
 Author-email: Apache Software Foundation <dev@airflow.apache.org>
@@ -20,19 +20,20 @@ Classifier: Programming Language :: Python :: 3.11
 Classifier: Programming Language :: Python :: 3.12
 Classifier: Programming Language :: Python :: 3.13
 Classifier: Topic :: System :: Monitoring
-Requires-Dist: apache-airflow>=2.10.0rc1
-Requires-Dist: apache-airflow-providers-common-sql>=1.23.0rc1
+Requires-Dist: apache-airflow>=2.10.0
+Requires-Dist: apache-airflow-providers-common-sql>=1.23.0
 Requires-Dist: psycopg2-binary>=2.9.9; python_version < '3.13'
 Requires-Dist: psycopg2-binary>=2.9.10; python_version >= '3.13'
 Requires-Dist: asyncpg>=0.30.0
-Requires-Dist: apache-airflow-providers-amazon>=2.6.0rc1 ; extra == "amazon"
+Requires-Dist: apache-airflow-providers-amazon>=2.6.0 ; extra == "amazon"
 Requires-Dist: apache-airflow-providers-openlineage ; extra == "openlineage"
 Requires-Dist: pandas>=2.1.2 ; extra == "pandas" and ( python_version <"3.13")
 Requires-Dist: pandas>=2.2.3 ; extra == "pandas" and ( python_version >="3.13")
 Requires-Dist: polars>=1.26.0 ; extra == "polars"
+Requires-Dist: psycopg[binary]>=3.2.9 ; extra == "psycopg"
 Project-URL: Bug Tracker, https://github.com/apache/airflow/issues
-Project-URL: Changelog, https://airflow.staged.apache.org/docs/apache-airflow-providers-postgres/6.2.3/changelog.html
-Project-URL: Documentation, https://airflow.staged.apache.org/docs/apache-airflow-providers-postgres/6.2.3
+Project-URL: Changelog, https://airflow.apache.org/docs/apache-airflow-providers-postgres/6.3.0/changelog.html
+Project-URL: Documentation, https://airflow.apache.org/docs/apache-airflow-providers-postgres/6.3.0
 Project-URL: Mastodon, https://fosstodon.org/@airflow
 Project-URL: Slack Chat, https://s.apache.org/airflow-slack
 Project-URL: Source Code, https://github.com/apache/airflow
@@ -41,6 +42,7 @@ Provides-Extra: amazon
 Provides-Extra: openlineage
 Provides-Extra: pandas
 Provides-Extra: polars
+Provides-Extra: psycopg
 
 
 .. Licensed to the Apache Software Foundation (ASF) under one
@@ -67,9 +69,8 @@ Provides-Extra: polars
 
 Package ``apache-airflow-providers-postgres``
 
-Release: ``6.2.3``
+Release: ``6.3.0``
 
-Release Date: ``|PypiReleaseDate|``
 
 `PostgreSQL <https://www.postgresql.org/>`__
 
@@ -81,12 +82,12 @@ This is a provider package for ``postgres`` provider. All classes for this provi
 are in ``airflow.providers.postgres`` python package.
 
 You can find package information and changelog for the provider
-in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-postgres/6.2.3/>`_.
+in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-postgres/6.3.0/>`_.
 
 Installation
 ------------
 
-You can install this package on top of an existing Airflow 2 installation (see ``Requirements`` below
+You can install this package on top of an existing Airflow installation (see ``Requirements`` below
 for the minimum Airflow version supported) via
 ``pip install apache-airflow-providers-postgres``
 
@@ -127,5 +128,5 @@ Dependent package
 ==============================================================================================================  ===============
 
 The changelog for the provider package can be found in the
-`changelog <https://airflow.apache.org/docs/apache-airflow-providers-postgres/6.2.3/changelog.html>`_.
+`changelog <https://airflow.apache.org/docs/apache-airflow-providers-postgres/6.3.0/changelog.html>`_.
 

{apache_airflow_providers_postgres-6.2.3rc1 → apache_airflow_providers_postgres-6.3.0}/README.rst

@@ -23,9 +23,8 @@
 
 Package ``apache-airflow-providers-postgres``
 
-Release: ``6.2.3``
+Release: ``6.3.0``
 
-Release Date: ``|PypiReleaseDate|``
 
 `PostgreSQL <https://www.postgresql.org/>`__
 
@@ -37,12 +36,12 @@ This is a provider package for ``postgres`` provider. All classes for this provi
 are in ``airflow.providers.postgres`` python package.
 
 You can find package information and changelog for the provider
-in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-postgres/6.2.3/>`_.
+in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-postgres/6.3.0/>`_.
 
 Installation
 ------------
 
-You can install this package on top of an existing Airflow 2 installation (see ``Requirements`` below
+You can install this package on top of an existing Airflow installation (see ``Requirements`` below
 for the minimum Airflow version supported) via
 ``pip install apache-airflow-providers-postgres``
 
@@ -83,4 +82,4 @@ Dependent package
 ==============================================================================================================  ===============
 
 The changelog for the provider package can be found in the
-`changelog <https://airflow.apache.org/docs/apache-airflow-providers-postgres/6.2.3/changelog.html>`_.
+`changelog <https://airflow.apache.org/docs/apache-airflow-providers-postgres/6.3.0/changelog.html>`_.

{apache_airflow_providers_postgres-6.2.3rc1 → apache_airflow_providers_postgres-6.3.0}/docs/changelog.rst

@@ -27,6 +27,41 @@
 Changelog
 ---------
 
+6.3.0
+.....
+
+
+Release Date: ``|PypiReleaseDate|``
+
+Features
+~~~~~~~~
+
+* ``Added specialized insert_rows in PostgresHook which uses faster psycopg execute_batch method (#54988)``
+* ``Add rudimentary support for psycopg3 (#52976)``
+* ``Implemented native get_column_names in PostgresDialect to become SQLAlchemy independent (#54437)``
+
+Bug Fixes
+~~~~~~~~~
+
+* ``PostgresDialect should use index instead of name in get_column_names and get_primary_keys (#54832)``
+
+Misc
+~~~~
+
+* ``Add CI support for SQLAlchemy 2.0 (#52233)``
+
+Doc-only
+~~~~~~~~
+
+* ``Make term Dag consistent in providers docs (#55101)``
+
+.. Below changes are excluded from the changelog. Move them to
+   appropriate section above if needed. Do not delete the lines(!):
+   * ``Switch pre-commit to prek (#54258)``
+
+.. Review and move the new changes to one of the sections above:
+   * ``Fix Airflow 2 reference in README/index of providers (#55240)``
+
 6.2.3
 .....
 

{apache_airflow_providers_postgres-6.2.3rc1 → apache_airflow_providers_postgres-6.3.0}/docs/connections/postgres.rst

@@ -75,6 +75,7 @@ Extra (optional)
       - ``namedtuplecursor``: Returns query results as named tuples using ``psycopg2.extras.NamedTupleCursor``.
 
       For more information, refer to the psycopg2 documentation on `connection and cursor subclasses <https://www.psycopg.org/docs/extras.html#connection-and-cursor-subclasses>`_.
+      If using psycopg (v3), refer to the documentation on `connection classes <https://www.psycopg.org/psycopg3/docs/api/connections.html>`_.
 
     More details on all Postgres parameters supported can be found in
     `Postgres documentation <https://www.postgresql.org/docs/current/static/libpq-connect.html#LIBPQ-CONNSTRING>`_.

{apache_airflow_providers_postgres-6.2.3rc1 → apache_airflow_providers_postgres-6.3.0}/docs/index.rst

@@ -56,7 +56,7 @@
     :maxdepth: 1
     :caption: Resources
 
-    Example DAGs <https://github.com/apache/airflow/tree/providers-postgres/|version|/providers/postgres/tests/system/postgres>
+    Example Dags <https://github.com/apache/airflow/tree/providers-postgres/|version|/providers/postgres/tests/system/postgres>
     PyPI Repository <https://pypi.org/project/apache-airflow-providers-postgres/>
     Installing from sources <installing-providers-from-sources>
 
@@ -77,9 +77,7 @@ apache-airflow-providers-postgres package
 `PostgreSQL <https://www.postgresql.org/>`__
 
 
-Release: 6.2.3
-
-Release Date: ``|PypiReleaseDate|``
+Release: 6.3.0
 
 Provider package
 ----------------
@@ -90,7 +88,7 @@ All classes for this package are included in the ``airflow.providers.postgres``
 Installation
 ------------
 
-You can install this package on top of an existing Airflow 2 installation via
+You can install this package on top of an existing Airflow installation via
 ``pip install apache-airflow-providers-postgres``.
 For the minimum Airflow version supported, see ``Requirements`` below.
 
@@ -136,5 +134,5 @@ Downloading official packages
 You can download officially released packages and verify their checksums and signatures from the
 `Official Apache Download site <https://downloads.apache.org/airflow/providers/>`_
 
-* `The apache-airflow-providers-postgres 6.2.3 sdist package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_postgres-6.2.3.tar.gz>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_postgres-6.2.3.tar.gz.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_postgres-6.2.3.tar.gz.sha512>`__)
-* `The apache-airflow-providers-postgres 6.2.3 wheel package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_postgres-6.2.3-py3-none-any.whl>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_postgres-6.2.3-py3-none-any.whl.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_postgres-6.2.3-py3-none-any.whl.sha512>`__)
+* `The apache-airflow-providers-postgres 6.3.0 sdist package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_postgres-6.3.0.tar.gz>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_postgres-6.3.0.tar.gz.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_postgres-6.3.0.tar.gz.sha512>`__)
+* `The apache-airflow-providers-postgres 6.3.0 wheel package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_postgres-6.3.0-py3-none-any.whl>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_postgres-6.3.0-py3-none-any.whl.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_postgres-6.3.0-py3-none-any.whl.sha512>`__)

{apache_airflow_providers_postgres-6.2.3rc1 → apache_airflow_providers_postgres-6.3.0}/docs/operators.rst

@@ -53,7 +53,7 @@ The code snippets below are based on Airflow-2.0
 
 Dumping SQL statements into your operator isn't quite appealing and will create maintainability pains somewhere
 down to the road. To prevent this, Airflow offers an elegant solution. This is how it works: you simply create
-a directory inside the DAG folder called ``sql`` and then put all the SQL files containing your SQL queries inside it.
+a directory inside the Dag folder called ``sql`` and then put all the SQL files containing your SQL queries inside it.
 
 Your ``dags/sql/pet_schema.sql`` should like this:
 
@@ -68,7 +68,7 @@ Your ``dags/sql/pet_schema.sql`` should like this:
           OWNER VARCHAR NOT NULL);
 
 
-Now let's refactor ``create_pet_table`` in our DAG:
+Now let's refactor ``create_pet_table`` in our Dag:
 
 .. code-block:: python
 
@@ -187,10 +187,10 @@ sent to the server at connection start.
     :end-before: [END postgres_sql_execute_query_operator_howto_guide_get_birth_date]
 
 
-The complete Postgres Operator DAG
+The complete Postgres Operator Dag
 ----------------------------------
 
-When we put everything together, our DAG should look like this:
+When we put everything together, our Dag should look like this:
 
 .. exampleinclude:: /../../postgres/tests/system/postgres/example_postgres.py
     :language: python

{apache_airflow_providers_postgres-6.2.3rc1 → apache_airflow_providers_postgres-6.3.0}/provider.yaml

@@ -22,12 +22,13 @@ description: |
   `PostgreSQL <https://www.postgresql.org/>`__
 
 state: ready
-source-date-epoch: 1754503423
+source-date-epoch: 1756877337
 # Note that those versions are maintained by release manager - do not update them manually
 # with the exception of case where other provider in sources has >= new provider version.
 # In such case adding >= NEW_VERSION and bumping to NEW_VERSION in a provider have
 # to be done in the same PR
 versions:
+  - 6.3.0
   - 6.2.3
   - 6.2.2
   - 6.2.1

{apache_airflow_providers_postgres-6.2.3rc1 → apache_airflow_providers_postgres-6.3.0}/pyproject.toml

@@ -25,7 +25,7 @@ build-backend = "flit_core.buildapi"
 
 [project]
 name = "apache-airflow-providers-postgres"
-version = "6.2.3rc1"
+version = "6.3.0"
 description = "Provider package apache-airflow-providers-postgres for Apache Airflow"
 readme = "README.rst"
 authors = [
@@ -54,11 +54,11 @@ requires-python = ">=3.10"
 
 # The dependencies should be modified in place in the generated file.
 # Any change in the dependencies is preserved when the file is regenerated
-# Make sure to run ``breeze static-checks --type update-providers-dependencies --all-files``
+# Make sure to run ``prek update-providers-dependencies --all-files``
 # After you modify the dependencies, and rebuild your Breeze CI image with ``breeze ci-image build``
 dependencies = [
-    "apache-airflow>=2.10.0rc1",
-    "apache-airflow-providers-common-sql>=1.23.0rc1",
+    "apache-airflow>=2.10.0",
+    "apache-airflow-providers-common-sql>=1.23.0",
     "psycopg2-binary>=2.9.9; python_version < '3.13'",
     "psycopg2-binary>=2.9.10; python_version >= '3.13'",
     "asyncpg>=0.30.0",
@@ -68,7 +68,7 @@ dependencies = [
 # Any change in the dependencies is preserved when the file is regenerated
 [project.optional-dependencies]
 "amazon" = [
-    "apache-airflow-providers-amazon>=2.6.0rc1",
+    "apache-airflow-providers-amazon>=2.6.0",
 ]
 "openlineage" = [
     "apache-airflow-providers-openlineage"
@@ -80,6 +80,9 @@ dependencies = [
 "polars" = [
     "polars>=1.26.0"
 ]
+"psycopg" = [
+    "psycopg[binary]>=3.2.9",
+]
 
 [dependency-groups]
 dev = [
@@ -92,6 +95,7 @@ dev = [
     # Additional devel dependencies (do not remove this line and add extra development dependencies)
     "apache-airflow-providers-common-sql[pandas]",
     "apache-airflow-providers-common-sql[polars]",
+    "psycopg[binary]>=3.2.9",
 ]
 
 # To build docs:
@@ -120,8 +124,8 @@ apache-airflow-providers-common-sql = {workspace = true}
 apache-airflow-providers-standard = {workspace = true}
 
 [project.urls]
-"Documentation" = "https://airflow.staged.apache.org/docs/apache-airflow-providers-postgres/6.2.3"
-"Changelog" = "https://airflow.staged.apache.org/docs/apache-airflow-providers-postgres/6.2.3/changelog.html"
+"Documentation" = "https://airflow.apache.org/docs/apache-airflow-providers-postgres/6.3.0"
+"Changelog" = "https://airflow.apache.org/docs/apache-airflow-providers-postgres/6.3.0/changelog.html"
 "Bug Tracker" = "https://github.com/apache/airflow/issues"
 "Source Code" = "https://github.com/apache/airflow"
 "Slack Chat" = "https://s.apache.org/airflow-slack"

{apache_airflow_providers_postgres-6.2.3rc1 → apache_airflow_providers_postgres-6.3.0}/src/airflow/providers/postgres/__init__.py

@@ -29,7 +29,7 @@ from airflow import __version__ as airflow_version
 
 __all__ = ["__version__"]
 
-__version__ = "6.2.3"
+__version__ = "6.3.0"
 
 if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
     "2.10.0"

{apache_airflow_providers_postgres-6.2.3rc1 → apache_airflow_providers_postgres-6.3.0}/src/airflow/providers/postgres/dialects/postgres.py

@@ -16,9 +16,11 @@
 # under the License.
 from __future__ import annotations
 
+from collections.abc import Callable
+
 from methodtools import lru_cache
 
-from airflow.providers.common.sql.dialects.dialect import Dialect
+from airflow.providers.common.sql.dialects.dialect import Dialect, T
 
 
 class PostgresDialect(Dialect):
@@ -39,22 +41,71 @@ class PostgresDialect(Dialect):
         """
         if schema is None:
             table, schema = self.extract_schema_from_table(table)
-        sql = """
-            select kcu.column_name
-            from information_schema.table_constraints tco
-                    join information_schema.key_column_usage kcu
-                        on kcu.constraint_name = tco.constraint_name
-                            and kcu.constraint_schema = tco.constraint_schema
-                            and kcu.constraint_name = tco.constraint_name
-            where tco.constraint_type = 'PRIMARY KEY'
-            and kcu.table_schema = %s
-            and kcu.table_name = %s
-        """
         pk_columns = [
-            row[0] for row in self.get_records(sql, (self.unescape_word(schema), self.unescape_word(table)))
+            row[0]
+            for row in self.get_records(
+                """
+                  select kcu.column_name
+                  from information_schema.table_constraints tco
+                           join information_schema.key_column_usage kcu
+                                on kcu.constraint_name = tco.constraint_name
+                                    and kcu.constraint_schema = tco.constraint_schema
+                                    and kcu.constraint_name = tco.constraint_name
+                  where tco.constraint_type = 'PRIMARY KEY'
+                    and kcu.table_schema = %s
+                    and kcu.table_name = %s
+                  order by kcu.ordinal_position
+                  """,
+                (self.unescape_word(schema), self.unescape_word(table)),
+            )
         ]
         return pk_columns or None
 
+    @staticmethod
+    def _to_row(row):
+        return {
+            "name": row[0],
+            "type": row[1],
+            "nullable": row[2].casefold() == "yes",
+            "default": row[3],
+            "autoincrement": row[4].casefold() == "always",
+            "identity": row[5].casefold() == "yes",
+        }
+
+    @lru_cache(maxsize=None)
+    def get_column_names(
+        self, table: str, schema: str | None = None, predicate: Callable[[T], bool] = lambda column: True
+    ) -> list[str] | None:
+        if schema is None:
+            table, schema = self.extract_schema_from_table(table)
+
+        column_names = list(
+            row["name"]
+            for row in filter(
+                predicate,
+                map(
+                    self._to_row,
+                    self.get_records(
+                        """
+                        select column_name,
+                               data_type,
+                               is_nullable,
+                               column_default,
+                               is_generated,
+                               is_identity
+                        from information_schema.columns
+                        where table_schema = %s
+                          and table_name = %s
+                        order by ordinal_position
+                        """,
+                        (self.unescape_word(schema), self.unescape_word(table)),
+                    ),
+                ),
+            )
+        )
+        self.log.debug("Column names for table '%s': %s", table, column_names)
+        return column_names
+
     def generate_replace_sql(self, table, values, target_fields, **kwargs) -> str:
         """
         Generate the REPLACE SQL statement.