apache-airflow-providers-microsoft-azure 12.8.1rc1__tar.gz → 12.9.0rc1__tar.gz

{apache_airflow_providers_microsoft_azure-12.8.1rc1 → apache_airflow_providers_microsoft_azure-12.9.0rc1}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: apache-airflow-providers-microsoft-azure
-Version: 12.8.1rc1
+Version: 12.9.0rc1
 Summary: Provider package apache-airflow-providers-microsoft-azure for Apache Airflow
 Keywords: airflow-provider,microsoft.azure,airflow,integration
 Author-email: Apache Software Foundation <dev@airflow.apache.org>
@@ -22,7 +22,7 @@ Classifier: Programming Language :: Python :: 3.13
 Classifier: Topic :: System :: Monitoring
 License-File: LICENSE
 License-File: NOTICE
-Requires-Dist: apache-airflow>=2.10.0rc1
+Requires-Dist: apache-airflow>=2.11.0rc1
 Requires-Dist: apache-airflow-providers-common-compat>=1.8.0rc1
 Requires-Dist: adlfs>=2023.10.0
 Requires-Dist: azure-batch>=8.0.0
@@ -57,8 +57,8 @@ Requires-Dist: apache-airflow-providers-common-compat ; extra == "common-compat"
 Requires-Dist: apache-airflow-providers-oracle ; extra == "oracle"
 Requires-Dist: apache-airflow-providers-sftp ; extra == "sftp"
 Project-URL: Bug Tracker, https://github.com/apache/airflow/issues
-Project-URL: Changelog, https://airflow.staged.apache.org/docs/apache-airflow-providers-microsoft-azure/12.8.1/changelog.html
-Project-URL: Documentation, https://airflow.staged.apache.org/docs/apache-airflow-providers-microsoft-azure/12.8.1
+Project-URL: Changelog, https://airflow.staged.apache.org/docs/apache-airflow-providers-microsoft-azure/12.9.0/changelog.html
+Project-URL: Documentation, https://airflow.staged.apache.org/docs/apache-airflow-providers-microsoft-azure/12.9.0
 Project-URL: Mastodon, https://fosstodon.org/@airflow
 Project-URL: Slack Chat, https://s.apache.org/airflow-slack
 Project-URL: Source Code, https://github.com/apache/airflow
@@ -93,7 +93,7 @@ Provides-Extra: sftp
 
 Package ``apache-airflow-providers-microsoft-azure``
 
-Release: ``12.8.1``
+Release: ``12.9.0``
 
 
 `Microsoft Azure <https://azure.microsoft.com/>`__
@@ -106,7 +106,7 @@ This is a provider package for ``microsoft.azure`` provider. All classes for thi
 are in ``airflow.providers.microsoft.azure`` python package.
 
 You can find package information and changelog for the provider
-in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.8.1/>`_.
+in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.9.0/>`_.
 
 Installation
 ------------
@@ -123,7 +123,7 @@ Requirements
 ==========================================  ===========================
 PIP package                                 Version required
 ==========================================  ===========================
-``apache-airflow``                          ``>=2.10.0``
+``apache-airflow``                          ``>=2.11.0``
 ``apache-airflow-providers-common-compat``  ``>=1.8.0``
 ``adlfs``                                   ``>=2023.10.0``
 ``azure-batch``                             ``>=8.0.0``
@@ -190,5 +190,5 @@ Extra              Dependencies
 =================  ==========================================
 
 The changelog for the provider package can be found in the
-`changelog <https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.8.1/changelog.html>`_.
+`changelog <https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.9.0/changelog.html>`_.
 

{apache_airflow_providers_microsoft_azure-12.8.1rc1 → apache_airflow_providers_microsoft_azure-12.9.0rc1}/README.rst

@@ -23,7 +23,7 @@
 
 Package ``apache-airflow-providers-microsoft-azure``
 
-Release: ``12.8.1``
+Release: ``12.9.0``
 
 
 `Microsoft Azure <https://azure.microsoft.com/>`__
@@ -36,7 +36,7 @@ This is a provider package for ``microsoft.azure`` provider. All classes for thi
 are in ``airflow.providers.microsoft.azure`` python package.
 
 You can find package information and changelog for the provider
-in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.8.1/>`_.
+in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.9.0/>`_.
 
 Installation
 ------------
@@ -53,7 +53,7 @@ Requirements
 ==========================================  ===========================
 PIP package                                 Version required
 ==========================================  ===========================
-``apache-airflow``                          ``>=2.10.0``
+``apache-airflow``                          ``>=2.11.0``
 ``apache-airflow-providers-common-compat``  ``>=1.8.0``
 ``adlfs``                                   ``>=2023.10.0``
 ``azure-batch``                             ``>=8.0.0``
@@ -120,4 +120,4 @@ Extra              Dependencies
 =================  ==========================================
 
 The changelog for the provider package can be found in the
-`changelog <https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.8.1/changelog.html>`_.
+`changelog <https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.9.0/changelog.html>`_.

{apache_airflow_providers_microsoft_azure-12.8.1rc1 → apache_airflow_providers_microsoft_azure-12.9.0rc1}/docs/changelog.rst

@@ -27,6 +27,35 @@
 Changelog
 ---------
 
+12.9.0
+......
+
+.. note::
+    This release of provider is only available for Airflow 2.11+ as explained in the
+    Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>_.
+
+Features
+~~~~~~~~
+
+* ``Add Azure Service Bus Queue and Subscription triggers for async message processing (#53356)``
+* ``Add managed identity assignment support (#58364)``
+
+Bug Fixes
+~~~~~~~~~
+
+* ``Fix Microsoft azure provider filesystem metadata (#58568)``
+* ``Add _ensure_identity, modifies files, and tests (#58563)``
+
+Misc
+~~~~
+
+* ``Move out some exceptions to TaskSDK (#54505)``
+* ``Bump minimum Airflow version in providers to Airflow 2.11.0 (#58612)``
+
+.. Below changes are excluded from the changelog. Move them to
+   appropriate section above if needed. Do not delete the lines(!):
+   * ``Updates to release process of providers (#58316)``
+
 12.8.1
 ......
 
@@ -123,8 +152,6 @@ Doc-only
    * ``Fix short names in test_adls (#54907)``
    * ``Move trigger_rule utils from 'airflow/utils'  to 'airflow.task'and integrate with Execution API spec (#53389)``
    * ``Switch pre-commit to prek (#54258)``
-
-.. Review and move the new changes to one of the sections above:
    * ``Fix Airflow 2 reference in README/index of providers (#55240)``
 
 12.6.1
@@ -584,7 +611,8 @@ Misc
 
 * ``implement per-provider tests with lowest-direct dependency resolution (#39946)``
 
-.. Review and move the new changes to one of the sections above:
+.. Below changes are excluded from the changelog. Move them to
+   appropriate section above if needed. Do not delete the lines(!):
    * ``Revert "refactor: Make sure xcoms work correctly in multi-threaded environmen…" (#40300)``
    * ``refactor: Make sure xcoms work correctly in multi-threaded environment by taking the map_index into account (#40297)``
 
@@ -627,7 +655,8 @@ Misc
 * ``Faster 'airflow_version' imports (#39552)``
 * ``Simplify 'airflow_version' imports (#39497)``
 
-.. Review and move the new changes to one of the sections above:
+.. Below changes are excluded from the changelog. Move them to
+   appropriate section above if needed. Do not delete the lines(!):
    * ``Prepare docs 1st wave May 2024 (#39328)``
 
 10.0.0
@@ -663,7 +692,8 @@ Misc
 * ``update to latest service bus (#38384)``
 * ``Limit azure-cosmos (#38175)``
 
-.. Review and move the new changes to one of the sections above:
+.. Below changes are excluded from the changelog. Move them to
+   appropriate section above if needed. Do not delete the lines(!):
    * ``fix: try002 for provider microsoft azure (#38805)``
    * ``Bump ruff to 0.3.3 (#38240)``
 
@@ -704,7 +734,8 @@ Misc
 
 * ``feat: Switch all class, functions, methods deprecations to decorators (#36876)``
 
-.. Review and move the new changes to one of the sections above:
+.. Below changes are excluded from the changelog. Move them to
+   appropriate section above if needed. Do not delete the lines(!):
    * ``Revert "Provide the logger_name param in providers hooks in order to override the logger name (#36675)" (#37015)``
    * ``Fix stacklevel in warnings.warn into the providers (#36831)``
    * ``Standardize airflow build process and switch to Hatchling build backend (#36537)``
@@ -895,7 +926,8 @@ Misc
 * ``Consolidate hook management in AzureBatchOperator (#34437)``
 * ``Consolidate hook management in AzureDataExplorerQueryOperator (#34436)``
 
-.. Review and move the new changes to one of the sections above:
+.. Below changes are excluded from the changelog. Move them to
+   appropriate section above if needed. Do not delete the lines(!):
    * ``Refactor: consolidate import time in providers (#34402)``
    * ``Refactor usage of str() in providers (#34320)``
    * ``Refactor: reduce some conditions in providers (#34440)``
@@ -1043,7 +1075,8 @@ Misc
 
 * ``Moves 'AzureBlobStorageToGCSOperator' from Azure to Google provider (#32306)``
 
-.. Review and move the new changes to one of the sections above:
+.. Below changes are excluded from the changelog. Move them to
+   appropriate section above if needed. Do not delete the lines(!):
    * ``D205 Support - Providers: Stragglers and new additions (#32447)``
 
 6.2.0

apache_airflow_providers_microsoft_azure-12.9.0rc1/docs/connections/message_bus.rst

@@ -0,0 +1,99 @@
+.. Licensed to the Apache Software Foundation (ASF) under one
+    or more contributor license agreements.  See the NOTICE file
+    distributed with this work for additional information
+    regarding copyright ownership.  The ASF licenses this file
+    to you under the Apache License, Version 2.0 (the
+    "License"); you may not use this file except in compliance
+    with the License.  You may obtain a copy of the License at
+
+ ..   http://www.apache.org/licenses/LICENSE-2.0
+
+ .. Unless required by applicable law or agreed to in writing,
+    software distributed under the License is distributed on an
+    "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+    KIND, either express or implied.  See the License for the
+    specific language governing permissions and limitations
+    under the License.
+
+.. _howto/trigger:azure_service_bus_queue:
+
+Microsoft Azure Service Bus Queue Trigger
+=========================================
+
+The Microsoft Azure Service Bus Queue trigger enables you to monitor Azure Service Bus queues for new messages and trigger DAG runs when messages arrive.
+
+Authenticating to Azure
+-----------------------
+
+The trigger uses the connection you have configured in Airflow to connect to Azure.
+Please refer to the :ref:`howto/connection:azure_service_bus` documentation for details on how to configure your connection.
+
+Using the Trigger
+-----------------
+
+This example shows how to use the ``AzureServiceBusQueueTrigger``.
+
+.. code-block:: python
+
+      from airflow.providers.microsoft.azure.triggers.message_bus import AzureServiceBusQueueTrigger
+
+      trigger = AzureServiceBusQueueTrigger(
+          queues=["my_queue"],
+          azure_service_bus_conn_id="azure_service_bus_default",
+          max_message_count=1,
+          poll_interval=5.0,
+      )
+
+      # The trigger will fire when a message is available in the queue.
+
+.. _howto/trigger:azure_service_bus_subscription:
+
+Microsoft Azure Service Bus Subscription Trigger
+================================================
+
+The Microsoft Azure Service Bus Subscription trigger enables you to monitor Azure Service Bus topic subscriptions for new messages and trigger DAG runs when messages arrive.
+
+Authenticating to Azure
+-----------------------
+
+The trigger uses the connection you have configured in Airflow to connect to Azure.
+Please refer to the :ref:`howto/connection:azure_service_bus` documentation for details on how to configure your connection.
+
+Using the Trigger
+-----------------
+
+This example shows how to use the ``AzureServiceBusSubscriptionTrigger``.
+
+.. code-block:: python
+
+      from airflow.providers.microsoft.azure.triggers.message_bus import AzureServiceBusSubscriptionTrigger
+
+      trigger = AzureServiceBusSubscriptionTrigger(
+          topics=["my_topic"],
+          subscription_name="my_subscription",
+          azure_service_bus_conn_id="azure_service_bus_default",
+          max_message_count=1,
+          poll_interval=5.0,
+      )
+
+      # The trigger will fire when a message is available in the topic subscription.
+
+Azure Service Bus Message Queue
+===============================
+
+Azure Service Bus Queue Provider
+--------------------------------
+
+Implemented by :class:`~airflow.providers.microsoft.azure.triggers.message_bus.AzureServiceBusQueueTrigger`
+
+The Azure Service Bus Queue Provider is a message queue provider that uses Azure Service Bus queues.
+It allows you to monitor Azure Service Bus queues for new messages and trigger DAG runs when messages arrive.
+
+
+Azure Service Bus Subscription Provider
+---------------------------------------
+
+Implemented by :class:`~airflow.providers.microsoft.azure.triggers.message_bus.AzureServiceBusSubscriptionTrigger`
+
+The Azure Service Bus Subscription Provider is a message queue provider that uses Azure Service Bus topic subscriptions.
+It allows you to monitor Azure Service Bus topic subscriptions for new messages and trigger DAG runs when messages arrive.

{apache_airflow_providers_microsoft_azure-12.8.1rc1 → apache_airflow_providers_microsoft_azure-12.9.0rc1}/docs/index.rst

@@ -83,7 +83,7 @@ apache-airflow-providers-microsoft-azure package
 `Microsoft Azure <https://azure.microsoft.com/>`__
 
 
-Release: 12.8.1
+Release: 12.9.0
 
 Provider package
 ----------------
@@ -101,12 +101,12 @@ For the minimum Airflow version supported, see ``Requirements`` below.
 Requirements
 ------------
 
-The minimum Apache Airflow version supported by this provider distribution is ``2.10.0``.
+The minimum Apache Airflow version supported by this provider distribution is ``2.11.0``.
 
 ==========================================  ===========================
 PIP package                                 Version required
 ==========================================  ===========================
-``apache-airflow``                          ``>=2.10.0``
+``apache-airflow``                          ``>=2.11.0``
 ``apache-airflow-providers-common-compat``  ``>=1.8.0``
 ``adlfs``                                   ``>=2023.10.0``
 ``azure-batch``                             ``>=8.0.0``
@@ -166,5 +166,5 @@ Downloading official packages
 You can download officially released packages and verify their checksums and signatures from the
 `Official Apache Download site <https://downloads.apache.org/airflow/providers/>`_
 
-* `The apache-airflow-providers-microsoft-azure 12.8.1 sdist package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_microsoft_azure-12.8.1.tar.gz>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_microsoft_azure-12.8.1.tar.gz.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_microsoft_azure-12.8.1.tar.gz.sha512>`__)
-* `The apache-airflow-providers-microsoft-azure 12.8.1 wheel package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_microsoft_azure-12.8.1-py3-none-any.whl>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_microsoft_azure-12.8.1-py3-none-any.whl.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_microsoft_azure-12.8.1-py3-none-any.whl.sha512>`__)
+* `The apache-airflow-providers-microsoft-azure 12.9.0 sdist package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_microsoft_azure-12.9.0.tar.gz>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_microsoft_azure-12.9.0.tar.gz.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_microsoft_azure-12.9.0.tar.gz.sha512>`__)
+* `The apache-airflow-providers-microsoft-azure 12.9.0 wheel package <https://downloads.apache.org/airflow/providers/apache_airflow_providers_microsoft_azure-12.9.0-py3-none-any.whl>`_ (`asc <https://downloads.apache.org/airflow/providers/apache_airflow_providers_microsoft_azure-12.9.0-py3-none-any.whl.asc>`__, `sha512 <https://downloads.apache.org/airflow/providers/apache_airflow_providers_microsoft_azure-12.9.0-py3-none-any.whl.sha512>`__)

{apache_airflow_providers_microsoft_azure-12.8.1rc1 → apache_airflow_providers_microsoft_azure-12.9.0rc1}/provider.yaml

@@ -20,12 +20,13 @@ name: Microsoft Azure
 description: |
   `Microsoft Azure <https://azure.microsoft.com/>`__
 state: ready
-source-date-epoch: 1763069828
+source-date-epoch: 1764110348
 # Note that those versions are maintained by release manager - do not update them manually
 # with the exception of case where other provider in sources has >= new provider version.
 # In such case adding >= NEW_VERSION and bumping to NEW_VERSION in a provider have
 # to be done in the same PR
 versions:
+  - 12.9.0
   - 12.8.1
   - 12.8.0
   - 12.7.1
@@ -233,7 +234,7 @@ sensors:
 
 filesystems:
   - airflow.providers.microsoft.azure.fs.adls
-  - airflow.providers.microsoft.azure.fs.msgraphfs
+  - airflow.providers.microsoft.azure.fs.msgraph
 
 hooks:
   - integration-name: Microsoft Azure Container Instances
@@ -294,6 +295,9 @@ triggers:
   - integration-name: Microsoft Power BI
     python-modules:
       - airflow.providers.microsoft.azure.triggers.powerbi
+  - integration-name: Microsoft Azure Service Bus
+    python-modules:
+      - airflow.providers.microsoft.azure.triggers.message_bus
 
 transfers:
   - source-integration-name: Local

{apache_airflow_providers_microsoft_azure-12.8.1rc1 → apache_airflow_providers_microsoft_azure-12.9.0rc1}/pyproject.toml

@@ -25,7 +25,7 @@ build-backend = "flit_core.buildapi"
 
 [project]
 name = "apache-airflow-providers-microsoft-azure"
-version = "12.8.1rc1"
+version = "12.9.0rc1"
 description = "Provider package apache-airflow-providers-microsoft-azure for Apache Airflow"
 readme = "README.rst"
 license = "Apache-2.0"
@@ -58,7 +58,7 @@ requires-python = ">=3.10"
 # Make sure to run ``prek update-providers-dependencies --all-files``
 # After you modify the dependencies, and rebuild your Breeze CI image with ``breeze ci-image build``
 dependencies = [
-    "apache-airflow>=2.10.0rc1",
+    "apache-airflow>=2.11.0rc1",
     "apache-airflow-providers-common-compat>=1.8.0rc1",
     "adlfs>=2023.10.0",
     "azure-batch>=8.0.0",
@@ -151,8 +151,8 @@ apache-airflow-providers-common-sql = {workspace = true}
 apache-airflow-providers-standard = {workspace = true}
 
 [project.urls]
-"Documentation" = "https://airflow.staged.apache.org/docs/apache-airflow-providers-microsoft-azure/12.8.1"
-"Changelog" = "https://airflow.staged.apache.org/docs/apache-airflow-providers-microsoft-azure/12.8.1/changelog.html"
+"Documentation" = "https://airflow.staged.apache.org/docs/apache-airflow-providers-microsoft-azure/12.9.0"
+"Changelog" = "https://airflow.staged.apache.org/docs/apache-airflow-providers-microsoft-azure/12.9.0/changelog.html"
 "Bug Tracker" = "https://github.com/apache/airflow/issues"
 "Source Code" = "https://github.com/apache/airflow"
 "Slack Chat" = "https://s.apache.org/airflow-slack"

{apache_airflow_providers_microsoft_azure-12.8.1rc1 → apache_airflow_providers_microsoft_azure-12.9.0rc1}/src/airflow/providers/microsoft/azure/__init__.py

@@ -29,11 +29,11 @@ from airflow import __version__ as airflow_version
 
 __all__ = ["__version__"]
 
-__version__ = "12.8.1"
+__version__ = "12.9.0"
 
 if packaging.version.parse(packaging.version.parse(airflow_version).base_version) < packaging.version.parse(
-    "2.10.0"
+    "2.11.0"
 ):
     raise RuntimeError(
-        f"The package `apache-airflow-providers-microsoft-azure:{__version__}` needs Apache Airflow 2.10.0+"
+        f"The package `apache-airflow-providers-microsoft-azure:{__version__}` needs Apache Airflow 2.11.0+"
     )

{apache_airflow_providers_microsoft_azure-12.8.1rc1 → apache_airflow_providers_microsoft_azure-12.9.0rc1}/src/airflow/providers/microsoft/azure/get_provider_info.py

@@ -200,7 +200,7 @@ def get_provider_info():
         ],
         "filesystems": [
             "airflow.providers.microsoft.azure.fs.adls",
-            "airflow.providers.microsoft.azure.fs.msgraphfs",
+            "airflow.providers.microsoft.azure.fs.msgraph",
         ],
         "hooks": [
             {
@@ -281,6 +281,10 @@ def get_provider_info():
                 "integration-name": "Microsoft Power BI",
                 "python-modules": ["airflow.providers.microsoft.azure.triggers.powerbi"],
             },
+            {
+                "integration-name": "Microsoft Azure Service Bus",
+                "python-modules": ["airflow.providers.microsoft.azure.triggers.message_bus"],
+            },
         ],
         "transfers": [
             {

{apache_airflow_providers_microsoft_azure-12.8.1rc1 → apache_airflow_providers_microsoft_azure-12.9.0rc1}/src/airflow/providers/microsoft/azure/hooks/asb.py

@@ -606,6 +606,60 @@ class MessageHook(BaseAzureServiceBusHook):
             for msg in received_msgs:
                 self._process_message(msg, context, message_callback, subscription_receiver)
 
+    def read_message(
+        self,
+        queue_name: str,
+        max_wait_time: float | None = None,
+    ) -> ServiceBusReceivedMessage | None:
+        """
+        Read a single message from a Service Bus queue without callback processing.
+
+        :param queue_name: The name of the queue to read from.
+        :param max_wait_time: Maximum time to wait for messages (seconds).
+        :return: The received message or None if no message is available.
+        """
+        with (
+            self.get_conn() as service_bus_client,
+            service_bus_client.get_queue_receiver(queue_name=queue_name) as receiver,
+            receiver,
+        ):
+            received_msgs = receiver.receive_messages(max_message_count=1, max_wait_time=max_wait_time)
+            if received_msgs:
+                msg = received_msgs[0]
+                receiver.complete_message(msg)
+                return msg
+            return None
+
+    def read_subscription_message(
+        self,
+        topic_name: str,
+        subscription_name: str,
+        max_wait_time: float | None = None,
+    ) -> ServiceBusReceivedMessage | None:
+        """
+        Read a single message from a Service Bus topic subscription without callback processing.
+
+        :param topic_name: The name of the topic.
+        :param subscription_name: The name of the subscription.
+        :param max_wait_time: Maximum time to wait for messages (seconds).
+        :return: The received message or None if no message is available.
+        """
+        with (
+            self.get_conn() as service_bus_client,
+            service_bus_client.get_subscription_receiver(
+                topic_name, subscription_name
+            ) as subscription_receiver,
+            subscription_receiver,
+        ):
+            received_msgs = subscription_receiver.receive_messages(
+                max_message_count=1, max_wait_time=max_wait_time
+            )
+            if received_msgs:
+                msg = received_msgs[0]
+                subscription_receiver.complete_message(msg)
+                return msg
+            return None
+
     def _process_message(
         self,
         msg: ServiceBusReceivedMessage,

{apache_airflow_providers_microsoft_azure-12.8.1rc1 → apache_airflow_providers_microsoft_azure-12.9.0rc1}/src/airflow/providers/microsoft/azure/hooks/synapse.py

@@ -24,8 +24,8 @@ from azure.identity import ClientSecretCredential, DefaultAzureCredential
 from azure.synapse.artifacts import ArtifactsClient
 from azure.synapse.spark import SparkClient
 
-from airflow.exceptions import AirflowException, AirflowTaskTimeout
-from airflow.providers.common.compat.sdk import BaseHook
+from airflow.exceptions import AirflowException
+from airflow.providers.common.compat.sdk import AirflowTaskTimeout, BaseHook
 from airflow.providers.microsoft.azure.utils import (
     add_managed_identity_connection_widgets,
     get_field,

{apache_airflow_providers_microsoft_azure-12.8.1rc1 → apache_airflow_providers_microsoft_azure-12.9.0rc1}/src/airflow/providers/microsoft/azure/operators/container_instances.py

@@ -21,26 +21,29 @@ import re
 import time
 from collections import namedtuple
 from collections.abc import Sequence
-from typing import TYPE_CHECKING, Any
+from typing import TYPE_CHECKING, Any, cast
 
 from azure.mgmt.containerinstance.models import (
     Container,
     ContainerGroup,
     ContainerGroupDiagnostics,
+    ContainerGroupIdentity,
     ContainerGroupSubnetId,
     ContainerPort,
     DnsConfiguration,
     EnvironmentVariable,
     IpAddress,
+    ResourceIdentityType,
     ResourceRequests,
     ResourceRequirements,
+    UserAssignedIdentities,
     Volume as _AzureVolume,
     VolumeMount,
 )
 from msrestazure.azure_exceptions import CloudError
 
-from airflow.exceptions import AirflowException, AirflowTaskTimeout
-from airflow.providers.common.compat.sdk import BaseOperator
+from airflow.exceptions import AirflowException
+from airflow.providers.common.compat.sdk import AirflowTaskTimeout, BaseOperator
 from airflow.providers.microsoft.azure.hooks.container_instance import AzureContainerInstanceHook
 from airflow.providers.microsoft.azure.hooks.container_registry import AzureContainerRegistryHook
 from airflow.providers.microsoft.azure.hooks.container_volume import AzureContainerVolumeHook
@@ -102,6 +105,7 @@ class AzureContainerInstancesOperator(BaseOperator):
     :param dns_config: The DNS configuration for a container group.
     :param diagnostics: Container group diagnostic information (Log Analytics).
     :param priority: Container group priority, Possible values include: 'Regular', 'Spot'
+    :param identity: List of User/System assigned identities for the container group.
 
     **Example**::
 
@@ -144,6 +148,15 @@ class AzureContainerInstancesOperator(BaseOperator):
                 }
             },
             priority="Regular",
+            identity = {
+                "type": "UserAssigned" | "SystemAssigned" | "SystemAssigned,UserAssigned",
+                "resource_ids": [
+                  "/subscriptions/<sub>/resourceGroups/<rg>/providers/Microsoft.ManagedIdentity/userAssignedIdentities/<id>"
+                ]
+                "user_assigned_identities": {
+                  "/subscriptions/.../userAssignedIdentities/<id>": {}
+                }
+            }
             command=["/bin/echo", "world"],
             task_id="start_container",
         )
@@ -180,6 +193,7 @@ class AzureContainerInstancesOperator(BaseOperator):
         dns_config: DnsConfiguration | None = None,
         diagnostics: ContainerGroupDiagnostics | None = None,
         priority: str | None = "Regular",
+        identity: ContainerGroupIdentity | dict | None = None,
         **kwargs,
     ) -> None:
         super().__init__(**kwargs)
@@ -222,6 +236,7 @@ class AzureContainerInstancesOperator(BaseOperator):
         self.dns_config = dns_config
         self.diagnostics = diagnostics
         self.priority = priority
+        self.identity = self._ensure_identity(identity)
         if self.priority not in ["Regular", "Spot"]:
             raise AirflowException(
                 "Invalid value for the priority argument. "
@@ -229,6 +244,66 @@ class AzureContainerInstancesOperator(BaseOperator):
                 f"Found `{self.priority}`."
             )
 
+    # helper to accept dict (user-friendly) or ContainerGroupIdentity (SDK object)
+    @staticmethod
+    def _ensure_identity(identity: ContainerGroupIdentity | dict | None) -> ContainerGroupIdentity | None:
+        """
+        Normalize identity input into a ContainerGroupIdentity instance.
+
+        Accepts:
+         - None -> returns None
+         - ContainerGroupIdentity -> returned as-is
+         - dict -> converted to ContainerGroupIdentity
+         - any other object -> returned as-is (pass-through) to preserve backwards compatibility
+
+        Expected dict shapes:
+          {"type": "UserAssigned", "resource_ids": ["/.../userAssignedIdentities/id1", ...]}
+        or
+          {"type": "SystemAssigned"}
+        or
+          {"type": "SystemAssigned,UserAssigned", "resource_ids": [...]}
+        """
+        if identity is None:
+            return None
+
+        if isinstance(identity, ContainerGroupIdentity):
+            return identity
+
+        if isinstance(identity, dict):
+            # require type
+            id_type = identity.get("type")
+            if not id_type:
+                raise AirflowException(
+                    "identity dict must include 'type' key with value 'UserAssigned' or 'SystemAssigned'"
+                )
+
+            # map common string type names to ResourceIdentityType enum values if available
+            type_map = {
+                "SystemAssigned": ResourceIdentityType.system_assigned,
+                "UserAssigned": ResourceIdentityType.user_assigned,
+                "SystemAssigned,UserAssigned": ResourceIdentityType.system_assigned_user_assigned,
+                "SystemAssigned, UserAssigned": ResourceIdentityType.system_assigned_user_assigned,
+            }
+            cg_type = type_map.get(id_type, id_type)
+
+            # build user_assigned_identities mapping if resource_ids provided
+            resource_ids = identity.get("resource_ids")
+            if resource_ids:
+                if not isinstance(resource_ids, (list, tuple)):
+                    raise AirflowException("identity['resource_ids'] must be a list of resource id strings")
+                user_assigned_identities: dict[str, Any] = {rid: {} for rid in resource_ids}
+            else:
+                # accept a pre-built mapping if given
+                user_assigned_identities = identity.get("user_assigned_identities") or {}
+
+            return ContainerGroupIdentity(
+                type=cg_type,
+                user_assigned_identities=cast(
+                    "dict[str, UserAssignedIdentities] | None", user_assigned_identities
+                ),
+            )
+        return identity
+
     def execute(self, context: Context) -> int:
         # Check name again in case it was templated.
         self._check_name(self.name)
@@ -304,6 +379,7 @@ class AzureContainerInstancesOperator(BaseOperator):
                 dns_config=self.dns_config,
                 diagnostics=self.diagnostics,
                 priority=self.priority,
+                identity=self.identity,
             )
 
             self._ci_hook.create_or_update(self.resource_group, self.name, container_group)

{apache_airflow_providers_microsoft_azure-12.8.1rc1 → apache_airflow_providers_microsoft_azure-12.9.0rc1}/src/airflow/providers/microsoft/azure/operators/msgraph.py

@@ -26,8 +26,8 @@ from typing import (
     Any,
 )
 
-from airflow.exceptions import AirflowException, AirflowProviderDeprecationWarning, TaskDeferred
-from airflow.providers.common.compat.sdk import XCOM_RETURN_KEY, BaseOperator
+from airflow.exceptions import AirflowException, AirflowProviderDeprecationWarning
+from airflow.providers.common.compat.sdk import XCOM_RETURN_KEY, BaseOperator, TaskDeferred
 from airflow.providers.microsoft.azure.hooks.msgraph import KiotaRequestAdapterHook
 from airflow.providers.microsoft.azure.triggers.msgraph import (
     MSGraphTrigger,