apache-airflow-providers-amazon 9.8.0rc1__tar.gz → 9.9.0__tar.gz

{apache_airflow_providers_amazon-9.8.0rc1 → apache_airflow_providers_amazon-9.9.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: apache-airflow-providers-amazon
-Version: 9.8.0rc1
+Version: 9.9.0
 Summary: Provider package apache-airflow-providers-amazon for Apache Airflow
 Keywords: airflow-provider,amazon,airflow,integration
 Author-email: Apache Software Foundation <dev@airflow.apache.org>
@@ -20,12 +20,12 @@ Classifier: Programming Language :: Python :: 3.10
 Classifier: Programming Language :: Python :: 3.11
 Classifier: Programming Language :: Python :: 3.12
 Classifier: Topic :: System :: Monitoring
-Requires-Dist: apache-airflow>=2.10.0rc1
-Requires-Dist: apache-airflow-providers-common-compat>=1.6.1rc1
-Requires-Dist: apache-airflow-providers-common-sql>=1.27.0rc1
+Requires-Dist: apache-airflow>=2.10.0
+Requires-Dist: apache-airflow-providers-common-compat>=1.6.1
+Requires-Dist: apache-airflow-providers-common-sql>=1.27.0
 Requires-Dist: apache-airflow-providers-http
-Requires-Dist: boto3>=1.37.0
-Requires-Dist: botocore>=1.37.0
+Requires-Dist: boto3>=1.37.2
+Requires-Dist: botocore>=1.37.2
 Requires-Dist: inflection>=0.5.1
 Requires-Dist: watchtower>=3.3.1,<4
 Requires-Dist: jsonpath_ng>=1.5.3
@@ -33,15 +33,12 @@ Requires-Dist: redshift_connector>=2.1.3
 Requires-Dist: asgiref>=2.3.0
 Requires-Dist: PyAthena>=3.10.0
 Requires-Dist: jmespath>=0.7.0
-Requires-Dist: python3-saml>=1.16.0
-Requires-Dist: xmlsec!=1.3.15,>=1.3.14
-Requires-Dist: lxml<5.4.0,>=5.3.2
 Requires-Dist: sagemaker-studio>=1.0.9
 Requires-Dist: marshmallow>=3
 Requires-Dist: aiobotocore[boto3]>=2.21.1 ; extra == "aiobotocore"
 Requires-Dist: apache-airflow-providers-apache-hive ; extra == "apache-hive"
-Requires-Dist: apache-airflow-providers-cncf-kubernetes>=7.2.0rc1 ; extra == "cncf-kubernetes"
-Requires-Dist: apache-airflow-providers-common-messaging>=1.0.1rc1 ; extra == "common-messaging"
+Requires-Dist: apache-airflow-providers-cncf-kubernetes>=7.2.0 ; extra == "cncf-kubernetes"
+Requires-Dist: apache-airflow-providers-common-messaging>=1.0.1 ; extra == "common-messaging"
 Requires-Dist: apache-airflow-providers-exasol ; extra == "exasol"
 Requires-Dist: apache-airflow-providers-fab ; extra == "fab"
 Requires-Dist: apache-airflow-providers-ftp ; extra == "ftp"
@@ -49,15 +46,17 @@ Requires-Dist: apache-airflow-providers-google ; extra == "google"
 Requires-Dist: apache-airflow-providers-imap ; extra == "imap"
 Requires-Dist: apache-airflow-providers-microsoft-azure ; extra == "microsoft-azure"
 Requires-Dist: apache-airflow-providers-mongo ; extra == "mongo"
-Requires-Dist: apache-airflow-providers-openlineage>=2.3.0rc1 ; extra == "openlineage"
+Requires-Dist: apache-airflow-providers-openlineage>=2.3.0 ; extra == "openlineage"
 Requires-Dist: python3-saml>=1.16.0 ; extra == "python3-saml"
+Requires-Dist: xmlsec!=1.3.15,>=1.3.14 ; extra == "python3-saml"
+Requires-Dist: lxml<5.4.0,>=5.3.2 ; extra == "python3-saml"
 Requires-Dist: s3fs>=2023.10.0 ; extra == "s3fs"
 Requires-Dist: apache-airflow-providers-salesforce ; extra == "salesforce"
 Requires-Dist: apache-airflow-providers-ssh ; extra == "ssh"
 Requires-Dist: apache-airflow-providers-standard ; extra == "standard"
 Project-URL: Bug Tracker, https://github.com/apache/airflow/issues
-Project-URL: Changelog, https://airflow.staged.apache.org/docs/apache-airflow-providers-amazon/9.8.0/changelog.html
-Project-URL: Documentation, https://airflow.staged.apache.org/docs/apache-airflow-providers-amazon/9.8.0
+Project-URL: Changelog, https://airflow.apache.org/docs/apache-airflow-providers-amazon/9.9.0/changelog.html
+Project-URL: Documentation, https://airflow.apache.org/docs/apache-airflow-providers-amazon/9.9.0
 Project-URL: Mastodon, https://fosstodon.org/@airflow
 Project-URL: Slack Chat, https://s.apache.org/airflow-slack
 Project-URL: Source Code, https://github.com/apache/airflow
@@ -105,7 +104,7 @@ Provides-Extra: standard
 
 Package ``apache-airflow-providers-amazon``
 
-Release: ``9.8.0``
+Release: ``9.9.0``
 
 
 Amazon integration (including `Amazon Web Services (AWS) <https://aws.amazon.com/>`__).
@@ -118,7 +117,7 @@ This is a provider package for ``amazon`` provider. All classes for this provide
 are in ``airflow.providers.amazon`` python package.
 
 You can find package information and changelog for the provider
-in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-amazon/9.8.0/>`_.
+in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-amazon/9.9.0/>`_.
 
 Installation
 ------------
@@ -132,15 +131,15 @@ The package supports the following python versions: 3.9,3.10,3.11,3.12
 Requirements
 ------------
 
-==========================================  =====================
+==========================================  ==================
 PIP package                                 Version required
-==========================================  =====================
+==========================================  ==================
 ``apache-airflow``                          ``>=2.10.0``
 ``apache-airflow-providers-common-compat``  ``>=1.6.1``
 ``apache-airflow-providers-common-sql``     ``>=1.27.0``
 ``apache-airflow-providers-http``
-``boto3``                                   ``>=1.37.0``
-``botocore``                                ``>=1.37.0``
+``boto3``                                   ``>=1.37.2``
+``botocore``                                ``>=1.37.2``
 ``inflection``                              ``>=0.5.1``
 ``watchtower``                              ``>=3.3.1,<4``
 ``jsonpath_ng``                             ``>=1.5.3``
@@ -148,12 +147,9 @@ PIP package                                 Version required
 ``asgiref``                                 ``>=2.3.0``
 ``PyAthena``                                ``>=3.10.0``
 ``jmespath``                                ``>=0.7.0``
-``python3-saml``                            ``>=1.16.0``
-``xmlsec``                                  ``>=1.3.14,!=1.3.15``
-``lxml``                                    ``>=5.3.2,<5.4.0``
 ``sagemaker-studio``                        ``>=1.0.9``
 ``marshmallow``                             ``>=3``
-==========================================  =====================
+==========================================  ==================
 
 Cross provider package dependencies
 -----------------------------------
@@ -189,5 +185,5 @@ Dependent package
 ========================================================================================================================  ====================
 
 The changelog for the provider package can be found in the
-`changelog <https://airflow.apache.org/docs/apache-airflow-providers-amazon/9.8.0/changelog.html>`_.
+`changelog <https://airflow.apache.org/docs/apache-airflow-providers-amazon/9.9.0/changelog.html>`_.
 

{apache_airflow_providers_amazon-9.8.0rc1 → apache_airflow_providers_amazon-9.9.0}/README.rst

@@ -23,7 +23,7 @@
 
 Package ``apache-airflow-providers-amazon``
 
-Release: ``9.8.0``
+Release: ``9.9.0``
 
 
 Amazon integration (including `Amazon Web Services (AWS) <https://aws.amazon.com/>`__).
@@ -36,7 +36,7 @@ This is a provider package for ``amazon`` provider. All classes for this provide
 are in ``airflow.providers.amazon`` python package.
 
 You can find package information and changelog for the provider
-in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-amazon/9.8.0/>`_.
+in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-amazon/9.9.0/>`_.
 
 Installation
 ------------
@@ -50,15 +50,15 @@ The package supports the following python versions: 3.9,3.10,3.11,3.12
 Requirements
 ------------
 
-==========================================  =====================
+==========================================  ==================
 PIP package                                 Version required
-==========================================  =====================
+==========================================  ==================
 ``apache-airflow``                          ``>=2.10.0``
 ``apache-airflow-providers-common-compat``  ``>=1.6.1``
 ``apache-airflow-providers-common-sql``     ``>=1.27.0``
 ``apache-airflow-providers-http``
-``boto3``                                   ``>=1.37.0``
-``botocore``                                ``>=1.37.0``
+``boto3``                                   ``>=1.37.2``
+``botocore``                                ``>=1.37.2``
 ``inflection``                              ``>=0.5.1``
 ``watchtower``                              ``>=3.3.1,<4``
 ``jsonpath_ng``                             ``>=1.5.3``
@@ -66,12 +66,9 @@ PIP package                                 Version required
 ``asgiref``                                 ``>=2.3.0``
 ``PyAthena``                                ``>=3.10.0``
 ``jmespath``                                ``>=0.7.0``
-``python3-saml``                            ``>=1.16.0``
-``xmlsec``                                  ``>=1.3.14,!=1.3.15``
-``lxml``                                    ``>=5.3.2,<5.4.0``
 ``sagemaker-studio``                        ``>=1.0.9``
 ``marshmallow``                             ``>=3``
-==========================================  =====================
+==========================================  ==================
 
 Cross provider package dependencies
 -----------------------------------
@@ -107,4 +104,4 @@ Dependent package
 ========================================================================================================================  ====================
 
 The changelog for the provider package can be found in the
-`changelog <https://airflow.apache.org/docs/apache-airflow-providers-amazon/9.8.0/changelog.html>`_.
+`changelog <https://airflow.apache.org/docs/apache-airflow-providers-amazon/9.9.0/changelog.html>`_.

{apache_airflow_providers_amazon-9.8.0rc1 → apache_airflow_providers_amazon-9.9.0}/docs/changelog.rst

@@ -26,6 +26,53 @@
 Changelog
 ---------
 
+9.9.0
+.....
+
+Features
+~~~~~~~~
+
+* ``Add 'MessageDeduplicationId' support to 'SnsPublishOperator' (#51383)``
+* ``Add support for RequestPay=requester option in Amazon S3's Operators, Sensors and Triggers (#51098)``
+* ``Add AWS Lambda Executor (#50516)``
+
+Bug Fixes
+~~~~~~~~~
+
+* ``Removed unnecessary 'aws_conn_id' param from operators constructors (#51236)``
+* ``Fix EcsRunTaskOperator reattach (#51412)``
+* ``Fix EKS token generation (#51333)``
+* ``Fix 'EksPodOperator' in deferrable mode (#51255)``
+* ``Rds Operator pass custom conn_id to superclass (#51196)``
+* ``Fix remote logging CloudWatch handler initialization and stream name assignment (#51022)``
+* ``Check 'is_mapped' to prevent 'operator_extra_links' property failing for Airflow 3. #50932``
+* ``Fix aws_conn_id defaulting after dag.test was updated to use TaskSDK. (#50515)``
+* ``AWS ECS Executor. Assign public ip defaults false (#50713)``
+
+Misc
+~~~~
+
+* ``Remove unused entries from 'DagAccessEntity' (#51174)``
+* ``Update Redshift cluster operator and sensor to inherit AwsBaseOperator (#51129)``
+* ``Remove Airflow 2 code path in executors (#51009)``
+* ``Move AWS auth dependencies to python3-saml extra (#50449)``
+* ``Bump some provider dependencies for faster resolution (#51727)``
+
+Doc-only
+~~~~~~~~
+
+* ``docs: Add missing 'param' for waiter_max_attempts in EMR operator docstring (#51676)``
+* ``Update comment in CloudWatchRemoteLogIO (#51092)``
+* ``Use explicit directives instead of implicit syntax (#50870)``
+
+.. Below changes are excluded from the changelog. Move them to
+   appropriate section above if needed. Do not delete the lines(!):
+   * ``Fix 'example_bedrock_batch_inference' (#51413)``
+   * ``Fixed cross-merged tests that fail for Pytest 8.4.0 (#51366)``
+   * ``Allow test migration to pytest 8.4.0 (#51349)``
+   * ``Fix system test 'test_aws_auth_manager' (#51241)``
+   * ``Fix 'StopIteration' error in AWS System Test 'variable_fetcher' when using remote executor (#51127)``
+
 9.8.0
 .....
 

{apache_airflow_providers_amazon-9.8.0rc1 → apache_airflow_providers_amazon-9.9.0}/docs/executors/batch-executor.rst

@@ -141,6 +141,33 @@ newly created Job Role and  Execution role for the Job Definition.
    :start-after: .. BEGIN DOCKERFILE_AUTH_SECOND_METHOD
    :end-before: .. END DOCKERFILE_AUTH_SECOND_METHOD
 
+.. include:: general.rst
+  :start-after: .. BEGIN BASE_IMAGE
+  :end-before: .. END BASE_IMAGE
+
+.. include:: general.rst
+  :start-after: .. BEGIN LOADING_DAGS_OVERVIEW
+  :end-before: .. END LOADING_DAGS_OVERVIEW
+
+.. include:: general.rst
+  :start-after: .. BEGIN LOADING_DAGS_FROM_S3
+  :end-before: .. END LOADING_DAGS_FROM_S3
+
+.. include:: general.rst
+  :start-after: .. BEGIN LOADING_DAGS_FROM_LOCAL
+  :end-before: .. END LOADING_DAGS_FROM_LOCAL
+
+.. include:: general.rst
+  :start-after: .. BEGIN DEPENDENCIES
+  :end-before: .. END DEPENDENCIES
+
+Building Image for AWS Batch Executor
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+
+Detailed instructions on how to use the Docker image, that you have
+created via this readme, with the Batch Executor can be found
+:ref:`here <batch_setup_guide>`.
+
 .. _batch_logging:
 
 .. include:: general.rst

{apache_airflow_providers_amazon-9.8.0rc1 → apache_airflow_providers_amazon-9.9.0}/docs/executors/ecs-executor.rst

@@ -162,6 +162,33 @@ newly created Task Role and Task Execution role for the Task Definition.
   :start-after: .. BEGIN DOCKERFILE_AUTH_SECOND_METHOD
   :end-before: .. END DOCKERFILE_AUTH_SECOND_METHOD
 
+.. include:: general.rst
+  :start-after: .. BEGIN BASE_IMAGE
+  :end-before: .. END BASE_IMAGE
+
+.. include:: general.rst
+  :start-after: .. BEGIN LOADING_DAGS_OVERVIEW
+  :end-before: .. END LOADING_DAGS_OVERVIEW
+
+.. include:: general.rst
+  :start-after: .. BEGIN LOADING_DAGS_FROM_S3
+  :end-before: .. END LOADING_DAGS_FROM_S3
+
+.. include:: general.rst
+  :start-after: .. BEGIN LOADING_DAGS_FROM_LOCAL
+  :end-before: .. END LOADING_DAGS_FROM_LOCAL
+
+.. include:: general.rst
+  :start-after: .. BEGIN DEPENDENCIES
+  :end-before: .. END DEPENDENCIES
+
+Building Image for AWS ECS Executor
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+
+Detailed instructions on how to use the Docker image, that you have
+created via this readme, with the ECS Executor can be found
+:ref:`here <setup_guide>`.
+
 .. _logging:
 
 .. include:: general.rst

{apache_airflow_providers_amazon-9.8.0rc1 → apache_airflow_providers_amazon-9.9.0}/docs/executors/general.rst

@@ -42,8 +42,7 @@ An example Dockerfile can be found |dockerfileLink|, it creates an
 image that can be used by AWS |executorName| to run Airflow tasks using
 the AWS |executorName| Executor in Apache Airflow. The image supports AWS CLI/API
 integration, allowing you to interact with AWS services within your
-Airflow environment. It also includes options to load DAGs (Directed
-Acyclic Graphs) from either an S3 bucket or a local folder.
+Airflow environment. It also includes options to load Dags from either an S3 bucket or a local folder.
 
 
 Prerequisites
@@ -90,9 +89,10 @@ The second method is to use the build-time arguments
 (``aws_access_key_id``, ``aws_secret_access_key``,
 ``aws_default_region``, and ``aws_session_token``).
 
-Note: This method is not recommended for use in production environments,
-because user credentials are stored in the container, which may be a
-security vulnerability.
+.. warning::
+   This method is not recommended for use in production environments,
+   because user credentials are stored in the container, which may be a
+   security vulnerability.
 
 To pass AWS authentication information using these arguments, use the
 ``--build-arg`` option during the Docker build process. For example:
@@ -109,6 +109,10 @@ Replace ``YOUR_ACCESS_KEY``, ``YOUR_SECRET_KEY``,
 ``YOUR_SESSION_TOKEN``, and ``YOUR_DEFAULT_REGION`` with valid AWS
 credentials.
 
+.. END DOCKERFILE_AUTH_SECOND_METHOD
+
+.. BEGIN BASE_IMAGE
+
 Base Image
 ~~~~~~~~~~
 
@@ -142,15 +146,22 @@ version <https://hub.docker.com/r/apache/airflow/tags?page=1&name=3.9>`__.
 For example, the tag ``latest-python3.9`` specifies that the image will
 have python 3.9 installed.
 
+.. END BASE_IMAGE
+
+.. BEGIN LOADING_DAGS_OVERVIEW
 
 Loading DAGs
 ~~~~~~~~~~~~
 
-There are many ways to load DAGs on a container managed by |executorName|. This Dockerfile
+There are many ways to load DAGs on a container used by |executorName|. This Dockerfile
 is preconfigured with two possible ways: copying from a local folder, or
 downloading from an S3 bucket. Other methods of loading DAGs are
 possible as well.
 
+.. END LOADING_DAGS_OVERVIEW
+
+.. BEGIN LOADING_DAGS_FROM_S3
+
 From S3 Bucket
 ^^^^^^^^^^^^^^
 
@@ -176,6 +187,10 @@ build arguments.
     --build-arg aws_session_token=YOUR_SESSION_TOKEN \
     --build-arg s3_uri=YOUR_S3_URI .
 
+.. END LOADING_DAGS_FROM_S3
+
+.. BEGIN LOADING_DAGS_FROM_LOCAL
+
 From Local Folder
 ^^^^^^^^^^^^^^^^^
 
@@ -194,6 +209,10 @@ If choosing to load DAGs onto a different path than
 ``/opt/airflow/dags``, then the new path will need to be updated in the
 Airflow config.
 
+.. END LOADING_DAGS_FROM_LOCAL
+
+.. BEGIN DEPENDENCIES
+
 Installing Python Dependencies
 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
 
@@ -206,28 +225,19 @@ Uncomment the two appropriate lines in the Dockerfile that copy the
 ``requirements.txt`` file to the container, and run ``pip install`` to
 install the dependencies on the container.
 
-Building Image for AWS |executorName| Executor
-~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
-
-Detailed instructions on how to use the Docker image, that you have
-created via this readme, with the |executorName| Executor can be found
-:ref:`here <setup_guide>`.
-
-.. END DOCKERFILE_AUTH_SECOND_METHOD
+.. END DEPENDENCIES
 
 .. BEGIN LOGGING
 
 Logging
 -------
 
-Airflow tasks executed via this executor run in containers within
+Airflow tasks executed via this executor run within
 the configured VPC. This means that logs are not directly accessible to
-the Airflow Webserver and when containers are stopped, after task
-completion, the logs would be permanently lost.
+the Airflow UI, after task completion, the logs would be permanently lost.
 
 Remote logging should be employed when using the |executorName| executor to persist
-your Airflow Task logs and make them viewable from the Airflow
-Webserver.
+your Airflow Task logs and make them viewable from the Airflow UI.
 
 Configuring Remote Logging
 ~~~~~~~~~~~~~~~~~~~~~~~~~~

{apache_airflow_providers_amazon-9.8.0rc1 → apache_airflow_providers_amazon-9.9.0}/docs/executors/index.rst

@@ -26,3 +26,4 @@ Amazon Executors
 
     ECS Executor <ecs-executor>
     Batch Executor (experimental) <batch-executor>
+    Lambda Executor (experimental) <lambda-executor>