apache-airflow-providers-teradata 3.2.3rc1__tar.gz → 3.3.0rc1__tar.gz

{apache_airflow_providers_teradata-3.2.3rc1 → apache_airflow_providers_teradata-3.3.0rc1}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: apache-airflow-providers-teradata
-Version: 3.2.3rc1
+Version: 3.3.0rc1
 Summary: Provider package apache-airflow-providers-teradata for Apache Airflow
 Keywords: airflow-provider,teradata,airflow,integration
 Author-email: Apache Software Foundation <dev@airflow.apache.org>
@@ -22,7 +22,7 @@ Classifier: Programming Language :: Python :: 3.13
 Classifier: Topic :: System :: Monitoring
 License-File: LICENSE
 License-File: NOTICE
-Requires-Dist: apache-airflow>=2.10.0rc1
+Requires-Dist: apache-airflow>=2.11.0rc1
 Requires-Dist: apache-airflow-providers-common-compat>=1.8.0rc1
 Requires-Dist: apache-airflow-providers-common-sql>=1.20.0rc1
 Requires-Dist: teradatasqlalchemy>=17.20.0.0
@@ -31,8 +31,8 @@ Requires-Dist: apache-airflow-providers-amazon ; extra == "amazon"
 Requires-Dist: apache-airflow-providers-microsoft-azure ; extra == "microsoft-azure"
 Requires-Dist: apache-airflow-providers-ssh ; extra == "ssh"
 Project-URL: Bug Tracker, https://github.com/apache/airflow/issues
-Project-URL: Changelog, https://airflow.staged.apache.org/docs/apache-airflow-providers-teradata/3.2.3/changelog.html
-Project-URL: Documentation, https://airflow.staged.apache.org/docs/apache-airflow-providers-teradata/3.2.3
+Project-URL: Changelog, https://airflow.staged.apache.org/docs/apache-airflow-providers-teradata/3.3.0/changelog.html
+Project-URL: Documentation, https://airflow.staged.apache.org/docs/apache-airflow-providers-teradata/3.3.0
 Project-URL: Mastodon, https://fosstodon.org/@airflow
 Project-URL: Slack Chat, https://s.apache.org/airflow-slack
 Project-URL: Source Code, https://github.com/apache/airflow
@@ -66,7 +66,7 @@ Provides-Extra: ssh
 
 Package ``apache-airflow-providers-teradata``
 
-Release: ``3.2.3``
+Release: ``3.3.0``
 
 
 `Teradata <https://www.teradata.com/>`__
@@ -79,7 +79,7 @@ This is a provider package for ``teradata`` provider. All classes for this provi
 are in ``airflow.providers.teradata`` python package.
 
 You can find package information and changelog for the provider
-in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-teradata/3.2.3/>`_.
+in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-teradata/3.3.0/>`_.
 
 Installation
 ------------
@@ -96,7 +96,7 @@ Requirements
 ==========================================  ==================
 PIP package                                 Version required
 ==========================================  ==================
-``apache-airflow``                          ``>=2.10.0``
+``apache-airflow``                          ``>=2.11.0``
 ``apache-airflow-providers-common-compat``  ``>=1.8.0``
 ``apache-airflow-providers-common-sql``     ``>=1.20.0``
 ``teradatasqlalchemy``                      ``>=17.20.0.0``
@@ -138,5 +138,5 @@ Extra                Dependencies
 ===================  ============================================
 
 The changelog for the provider package can be found in the
-`changelog <https://airflow.apache.org/docs/apache-airflow-providers-teradata/3.2.3/changelog.html>`_.
+`changelog <https://airflow.apache.org/docs/apache-airflow-providers-teradata/3.3.0/changelog.html>`_.
 

{apache_airflow_providers_teradata-3.2.3rc1 → apache_airflow_providers_teradata-3.3.0rc1}/README.rst

@@ -23,7 +23,7 @@
 
 Package ``apache-airflow-providers-teradata``
 
-Release: ``3.2.3``
+Release: ``3.3.0``
 
 
 `Teradata <https://www.teradata.com/>`__
@@ -36,7 +36,7 @@ This is a provider package for ``teradata`` provider. All classes for this provi
 are in ``airflow.providers.teradata`` python package.
 
 You can find package information and changelog for the provider
-in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-teradata/3.2.3/>`_.
+in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-teradata/3.3.0/>`_.
 
 Installation
 ------------
@@ -53,7 +53,7 @@ Requirements
 ==========================================  ==================
 PIP package                                 Version required
 ==========================================  ==================
-``apache-airflow``                          ``>=2.10.0``
+``apache-airflow``                          ``>=2.11.0``
 ``apache-airflow-providers-common-compat``  ``>=1.8.0``
 ``apache-airflow-providers-common-sql``     ``>=1.20.0``
 ``teradatasqlalchemy``                      ``>=17.20.0.0``
@@ -95,4 +95,4 @@ Extra                Dependencies
 ===================  ============================================
 
 The changelog for the provider package can be found in the
-`changelog <https://airflow.apache.org/docs/apache-airflow-providers-teradata/3.2.3/changelog.html>`_.
+`changelog <https://airflow.apache.org/docs/apache-airflow-providers-teradata/3.3.0/changelog.html>`_.

{apache_airflow_providers_teradata-3.2.3rc1 → apache_airflow_providers_teradata-3.3.0rc1}/docs/changelog.rst

@@ -25,6 +25,26 @@
 Changelog
 ---------
 
+3.3.0
+.....
+
+.. note::
+    This release of provider is only available for Airflow 2.11+ as explained in the
+    Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>_.
+
+Features
+~~~~~~~~
+
+* ``Add DdlOperator to execute Data Definition Language (DDL) statements on Teradata databases using TTU tbuild utility (#56675)``
+
+Misc
+~~~~
+
+* ``Bump minimum Airflow version in providers to Airflow 2.11.0 (#58612)``
+
+.. Below changes are excluded from the changelog. Move them to
+   appropriate section above if needed. Do not delete the lines(!):
+
 3.2.3
 .....
 

{apache_airflow_providers_teradata-3.2.3rc1 → apache_airflow_providers_teradata-3.3.0rc1}/docs/index.rst

@@ -77,7 +77,7 @@ apache-airflow-providers-teradata package
 `Teradata <https://www.teradata.com/>`__
 
 
-Release: 3.2.3
+Release: 3.3.0
 
 Provider package
 ----------------
@@ -95,12 +95,12 @@ For the minimum Airflow version supported, see ``Requirements`` below.
 Requirements
 ------------
 
-The minimum Apache Airflow version supported by this provider distribution is ``2.10.0``.
+The minimum Apache Airflow version supported by this provider distribution is ``2.11.0``.
 
 ==========================================  ==================
 PIP package                                 Version required
 ==========================================  ==================
-``apache-airflow``                          ``>=2.10.0``
+``apache-airflow``                          ``>=2.11.0``
 ``apache-airflow-providers-common-compat``  ``>=1.8.0``
 ``apache-airflow-providers-common-sql``     ``>=1.20.0``
 ``teradatasqlalchemy``                      ``>=17.20.0.0``
@@ -136,5 +136,5 @@ Downloading official packages
 You can download officially released packages and verify their checksums and signatures from the
 `Official Apache Download site <https://downloads.apache.org/airflow/providers/>`_
 
-* `The apache-airflow-providers-teradata 3.2.3 sdist package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_teradata-3.2.3.tar.gz>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_teradata-3.2.3.tar.gz.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_teradata-3.2.3.tar.gz.sha512>`__)
-* `The apache-airflow-providers-teradata 3.2.3 wheel package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_teradata-3.2.3-py3-none-any.whl>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_teradata-3.2.3-py3-none-any.whl.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_teradata-3.2.3-py3-none-any.whl.sha512>`__)
+* `The apache-airflow-providers-teradata 3.3.0 sdist package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_teradata-3.3.0.tar.gz>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_teradata-3.3.0.tar.gz.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_teradata-3.3.0.tar.gz.sha512>`__)
+* `The apache-airflow-providers-teradata 3.3.0 wheel package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_teradata-3.3.0-py3-none-any.whl>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_teradata-3.3.0-py3-none-any.whl.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_teradata-3.3.0-py3-none-any.whl.sha512>`__)

apache_airflow_providers_teradata-3.3.0rc1/docs/operators/tpt.rst

@@ -0,0 +1,180 @@
+ .. Licensed to the Apache Software Foundation (ASF) under one
+    or more contributor license agreements.  See the NOTICE file
+    distributed with this work for additional information
+    regarding copyright ownership.  The ASF licenses this file
+    to you under the Apache License, Version 2.0 (the
+    "License"); you may not use this file except in compliance
+    with the License.  You may obtain a copy of the License at
+
+ ..   http://www.apache.org/licenses/LICENSE-2.0
+
+ .. Unless required by applicable law or agreed to in writing,
+    software distributed under the License is distributed on an
+    "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+    KIND, either express or implied.  See the License for the
+    specific language governing permissions and limitations
+    under the License.
+
+.. _howto/operator:DdlOperator:
+
+DdlOperator
+===========
+
+The ``DdlOperator`` is an Airflow operator designed to execute Data Definition Language (DDL) statements on Teradata databases. It provides a robust way to create, alter, or drop database objects as part of your data pipelines.
+
+.. note::
+
+    The ``DdlOperator`` requires the ``Teradata Parallel Transporter (TPT)`` package from Teradata Tools and Utilities (TTU)
+    to be installed on the machine where the ``tbuild`` command will run (either local or remote).
+    Ensure that the ``tbuild`` executable is available in the system's ``PATH``.
+    Refer to the official Teradata documentation for installation, configuration, and security best practices.
+
+**Key Features:**
+
+- Executes DDL SQL statements (CREATE, ALTER, DROP, etc.)
+- Works with single statements or batches of multiple DDL operations
+- Integrates with Airflow's connection management for secure database access
+- Provides comprehensive logging of execution results
+- Supports both local and remote execution via SSH
+
+When you need to manage database schema changes, create temporary tables, or clean up data structures as part of your workflow, the ``DdlOperator`` offers a streamlined approach that integrates seamlessly with your Airflow DAGs.
+
+Prerequisite
+------------
+
+Make sure your Teradata Airflow connection is defined with the required fields:
+
+- ``host``
+- ``login``
+- ``password``
+
+You can define a remote host with a separate SSH connection using the ``ssh_conn_id``.
+
+Ensure that the ``Teradata Parallel Transporter (TPT)`` package is installed on the machine where TdLoadOperator will execute commands. This can be:
+
+- The **local machine** where Airflow runs the task, for local execution.
+- A **remote host** accessed via SSH, for remote execution.
+
+If executing remotely, ensure that an SSH server (e.g., ``sshd``) is running and accessible on the remote machine, and that the ``tbuild`` executable is available in the system's ``PATH``.
+
+.. note::
+
+    For improved security, it is **highly recommended** to use
+    **private key-based SSH authentication** (SSH key pairs) instead of username/password
+    for the SSH connection.
+
+    This avoids password exposure, enables seamless automated execution, and enhances security.
+
+    See the Airflow SSH Connection documentation for details on configuring SSH keys:
+    https://airflow.apache.org/docs/apache-airflow/stable/howto/connection/ssh.html
+
+
+To execute DDL operations in a Teradata database, use the
+:class:`~airflow.providers.teradata.operators.ddl.DdlOperator`.
+
+Handling Escape Sequences for Embedded Quotes
+----------------------------------------------
+
+When working with DDL statements that contain embedded quotes, it's important to understand how escape sequences are handled differently between the DAG definition and the SQL execution:
+
+**In DAG Definition (Python):**
+- Use backslash escape sequences: ``\"`` for double quotes, ``\'`` for single quotes
+- Python string literals require backslash escaping
+
+**In SQL Execution (Teradata):**
+- SQL standard requires doubling quotes when enclosed within the same quote type
+- Single quotes in single-quoted strings: ``'Don''t'``
+- Double quotes in double-quoted identifiers: ``"My""Table"``
+
+**Example:**
+
+.. code-block:: python
+
+    # In your DAG - use Python escape sequences
+    ddl_with_quotes = DdlOperator(
+        task_id="create_table_with_quotes",
+        ddl=[
+            "CREATE TABLE test_table (col1 VARCHAR(50) DEFAULT '\"quoted_value\"')",
+            "INSERT INTO test_table VALUES ('It''s a test')",  # Note the doubled single quotes
+        ],
+        teradata_conn_id="teradata_default",
+    )
+
+**Key Points:**
+- When defining DDL statements in Python strings, use standard Python escape sequences
+- The operator automatically handles the conversion for TPT script generation
+- For SQL string literals containing quotes, follow SQL standards (double the quotes)
+- Test your DDL statements carefully when they contain complex quoting
+
+Key Operation Examples with DdlOperator
+---------------------------------------
+
+Dropping tables in Teradata
+---------------------------
+You can use the DdlOperator to drop tables in Teradata. The following example demonstrates how to drop multiple tables:
+
+.. exampleinclude:: /../../teradata/tests/system/teradata/example_tpt.py
+    :language: python
+    :dedent: 4
+    :start-after: [START ddl_operator_howto_guide_drop_table]
+    :end-before: [END ddl_operator_howto_guide_drop_table]
+
+Creating tables in Teradata
+---------------------------
+You can use the DdlOperator to create tables in Teradata. The following example demonstrates how to create multiple tables:
+
+.. exampleinclude:: /../../teradata/tests/system/teradata/example_tpt.py
+    :language: python
+    :dedent: 4
+    :start-after: [START ddl_operator_howto_guide_create_table]
+    :end-before: [END ddl_operator_howto_guide_create_table]
+
+Creating an index on a Teradata table
+-------------------------------------
+You can use the DdlOperator to create an index on a Teradata table. The following example demonstrates how to create an index:
+
+.. exampleinclude:: /../../teradata/tests/system/teradata/example_tpt.py
+    :language: python
+    :dedent: 4
+    :start-after: [START ddl_operator_howto_guide_create_index]
+    :end-before: [END ddl_operator_howto_guide_create_index]
+
+Renaming a table in Teradata
+----------------------------
+You can use the DdlOperator to rename a table in Teradata. The following example demonstrates how to rename a table:
+
+.. exampleinclude:: /../../teradata/tests/system/teradata/example_tpt.py
+    :language: python
+    :dedent: 4
+    :start-after: [START ddl_operator_howto_guide_rename_table]
+    :end-before: [END ddl_operator_howto_guide_rename_table]
+
+Dropping an index in Teradata
+-----------------------------
+You can use the DdlOperator to drop an index in Teradata. The following example demonstrates how to drop an index:
+
+.. exampleinclude:: /../../teradata/tests/system/teradata/example_tpt.py
+    :language: python
+    :dedent: 4
+    :start-after: [START ddl_operator_howto_guide_drop_index]
+    :end-before: [END ddl_operator_howto_guide_drop_index]
+
+Altering a table in Teradata
+----------------------------
+You can use the DdlOperator to alter a table in Teradata. The following example demonstrates how to add a column:
+
+.. exampleinclude:: /../../teradata/tests/system/teradata/example_tpt.py
+    :language: python
+    :dedent: 4
+    :start-after: [START ddl_operator_howto_guide_alter_table]
+    :end-before: [END ddl_operator_howto_guide_alter_table]
+
+The complete Teradata Operator DAG
+----------------------------------
+
+When we put everything together, our DAG should look like this:
+
+.. exampleinclude:: /../../teradata/tests/system/teradata/example_tpt.py
+    :language: python
+    :start-after: [START ddl_operator_howto_guide]
+    :end-before: [END ddl_operator_howto_guide]

{apache_airflow_providers_teradata-3.2.3rc1 → apache_airflow_providers_teradata-3.3.0rc1}/provider.yaml

@@ -22,12 +22,13 @@ description: |
     `Teradata <https://www.teradata.com/>`__
 
 state: ready
-source-date-epoch: 1763070578
+source-date-epoch: 1764110710
 # Note that those versions are maintained by release manager - do not update them manually
 # with the exception of case where other provider in sources has >= new provider version.
 # In such case adding >= NEW_VERSION and bumping to NEW_VERSION in a provider have
 # to be done in the same PR
 versions:
+  - 3.3.0
   - 3.2.3
   - 3.2.2
   - 3.2.1
@@ -68,6 +69,13 @@ integrations:
     logo: /docs/integration-logos/Teradata.png
     tags: [software]
 
+  - integration-name: Tpt
+    external-doc-url: https://www.teradata.com/
+    how-to-guide:
+      - /docs/apache-airflow-providers-teradata/operators/tpt.rst
+    logo: /docs/integration-logos/Teradata.png
+    tags: [software]
+
 operators:
   - integration-name: Teradata
     python-modules:
@@ -76,6 +84,9 @@ operators:
   - integration-name: Bteq
     python-modules:
       - airflow.providers.teradata.operators.bteq
+  - integration-name: Tpt
+    python-modules:
+      - airflow.providers.teradata.operators.tpt
 
 hooks:
   - integration-name: Teradata
@@ -87,6 +98,9 @@ hooks:
   - integration-name: Bteq
     python-modules:
       - airflow.providers.teradata.hooks.bteq
+  - integration-name: Tpt
+    python-modules:
+      - airflow.providers.teradata.hooks.tpt
 
 transfers:
   - source-integration-name: Teradata

{apache_airflow_providers_teradata-3.2.3rc1 → apache_airflow_providers_teradata-3.3.0rc1}/pyproject.toml

@@ -25,7 +25,7 @@ build-backend = "flit_core.buildapi"
 
 [project]
 name = "apache-airflow-providers-teradata"
-version = "3.2.3rc1"
+version = "3.3.0rc1"
 description = "Provider package apache-airflow-providers-teradata for Apache Airflow"
 readme = "README.rst"
 license = "Apache-2.0"
@@ -58,7 +58,7 @@ requires-python = ">=3.10"
 # Make sure to run ``prek update-providers-dependencies --all-files``
 # After you modify the dependencies, and rebuild your Breeze CI image with ``breeze ci-image build``
 dependencies = [
-    "apache-airflow>=2.10.0rc1",
+    "apache-airflow>=2.11.0rc1",
     "apache-airflow-providers-common-compat>=1.8.0rc1",
     "apache-airflow-providers-common-sql>=1.20.0rc1",
     "teradatasqlalchemy>=17.20.0.0",
@@ -117,8 +117,8 @@ apache-airflow-providers-common-sql = {workspace = true}
 apache-airflow-providers-standard = {workspace = true}
 
 [project.urls]
-"Documentation" = "https://airflow.staged.apache.org/docs/apache-airflow-providers-teradata/3.2.3"
-"Changelog" = "https://airflow.staged.apache.org/docs/apache-airflow-providers-teradata/3.2.3/changelog.html"
+"Documentation" = "https://airflow.staged.apache.org/docs/apache-airflow-providers-teradata/3.3.0"
+"Changelog" = "https://airflow.staged.apache.org/docs/apache-airflow-providers-teradata/3.3.0/changelog.html"
 "Bug Tracker" = "https://github.com/apache/airflow/issues"
 "Source Code" = "https://github.com/apache/airflow"
 "Slack Chat" = "https://s.apache.org/airflow-slack"

{apache_airflow_providers_teradata-3.2.3rc1 → apache_airflow_providers_teradata-3.3.0rc1}/src/airflow/providers/teradata/__init__.py

@@ -29,11 +29,11 @@ from airflow import __version__ as airflow_version
 
 __all__ = ["__version__"]
 
-__version__ = "3.2.3"
+__version__ = "3.3.0"
 
 if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
-    "2.10.0"
+    "2.11.0"
 ):
     raise RuntimeError(
-        f"The package `apache-airflow-providers-teradata:{__version__}` needs Apache Airflow 2.10.0+"
+        f"The package `apache-airflow-providers-teradata:{__version__}` needs Apache Airflow 2.11.0+"
     )

{apache_airflow_providers_teradata-3.2.3rc1 → apache_airflow_providers_teradata-3.3.0rc1}/src/airflow/providers/teradata/get_provider_info.py

@@ -50,6 +50,13 @@ def get_provider_info():
                 "logo": "/docs/integration-logos/Teradata.png",
                 "tags": ["software"],
             },
+            {
+                "integration-name": "Tpt",
+                "external-doc-url": "https://www.teradata.com/",
+                "how-to-guide": ["/docs/apache-airflow-providers-teradata/operators/tpt.rst"],
+                "logo": "/docs/integration-logos/Teradata.png",
+                "tags": ["software"],
+            },
         ],
         "operators": [
             {
@@ -60,11 +67,13 @@ def get_provider_info():
                 ],
             },
             {"integration-name": "Bteq", "python-modules": ["airflow.providers.teradata.operators.bteq"]},
+            {"integration-name": "Tpt", "python-modules": ["airflow.providers.teradata.operators.tpt"]},
         ],
         "hooks": [
             {"integration-name": "Teradata", "python-modules": ["airflow.providers.teradata.hooks.teradata"]},
             {"integration-name": "Ttu", "python-modules": ["airflow.providers.teradata.hooks.ttu"]},
             {"integration-name": "Bteq", "python-modules": ["airflow.providers.teradata.hooks.bteq"]},
+            {"integration-name": "Tpt", "python-modules": ["airflow.providers.teradata.hooks.tpt"]},
         ],
         "transfers": [
             {