apache-airflow-providers-microsoft-azure 12.6.1__tar.gz → 12.8.1rc1__tar.gz
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- apache_airflow_providers_microsoft_azure-12.8.1rc1/NOTICE +5 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/PKG-INFO +61 -50
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/README.rst +50 -40
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/changelog.rst +100 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/azure.rst +2 -0
- apache_airflow_providers_microsoft_azure-12.8.1rc1/docs/filesystems/index.rst +26 -0
- apache_airflow_providers_microsoft_azure-12.8.1rc1/docs/filesystems/msgraph.rst +187 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/index.rst +40 -42
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/operators/msgraph.rst +4 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/provider.yaml +11 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/pyproject.toml +15 -11
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/__init__.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/fs/adls.py +1 -1
- apache_airflow_providers_microsoft_azure-12.8.1rc1/src/airflow/providers/microsoft/azure/fs/msgraph.py +111 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/get_provider_info.py +12 -2
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/adx.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/asb.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/base_azure.py +93 -17
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/batch.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/container_registry.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/container_volume.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/cosmos.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/data_factory.py +2 -5
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/data_lake.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/fileshare.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/msgraph.py +132 -84
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/synapse.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/wasb.py +38 -24
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/log/wasb_task_handler.py +7 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/operators/adls.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/operators/adx.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/operators/asb.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/operators/batch.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/operators/container_instances.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/operators/cosmos.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/operators/data_factory.py +1 -13
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/operators/msgraph.py +3 -2
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/operators/powerbi.py +1 -8
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/operators/synapse.py +2 -14
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/operators/wasb_delete_blob.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/secrets/key_vault.py +6 -3
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/sensors/cosmos.py +1 -6
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/sensors/data_factory.py +1 -6
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/sensors/msgraph.py +1 -6
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/sensors/wasb.py +1 -6
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/transfers/local_to_adls.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/transfers/local_to_wasb.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/transfers/oracle_to_azure_data_lake.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/transfers/s3_to_wasb.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/transfers/sftp_to_wasb.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/triggers/data_factory.py +4 -3
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/triggers/msgraph.py +23 -35
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/triggers/powerbi.py +56 -51
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/version_compat.py +0 -24
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_azure_service_bus.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_azure_synapse.py +3 -3
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_powerbi_dataset_list.py +2 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_powerbi_dataset_refresh.py +2 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_powerbi_workspace_list.py +2 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_s3_to_wasb.py +6 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/fs/test_adls.py +21 -21
- apache_airflow_providers_microsoft_azure-12.8.1rc1/tests/unit/microsoft/azure/fs/test_msgraph.py +155 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_adx.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_asb.py +3 -3
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_base_azure.py +89 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_data_factory.py +6 -2
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_msgraph.py +99 -136
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_powerbi.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_wasb.py +34 -3
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/log/test_wasb_task_handler.py +16 -12
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_asb.py +3 -3
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_data_factory.py +2 -2
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_msgraph.py +17 -19
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_powerbi.py +7 -11
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_powerbi_list.py +8 -12
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_synapse.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/sensors/test_data_factory.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/sensors/test_msgraph.py +5 -6
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/test_utils.py +36 -3
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/transfers/test_s3_to_wasb.py +3 -3
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/triggers/test_data_factory.py +2 -2
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/triggers/test_msgraph.py +28 -27
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/triggers/test_powerbi.py +23 -31
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/triggers/test_wasb.py +12 -1
- apache_airflow_providers_microsoft_azure-12.6.1/tests/unit/microsoft/azure/base.py +0 -53
- {apache_airflow_providers_microsoft_azure-12.6.1/src/airflow/providers/microsoft/azure → apache_airflow_providers_microsoft_azure-12.8.1rc1}/LICENSE +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/.latest-doc-only-change.txt +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/commits.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/conf.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/configurations-ref.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/acr.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/adf.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/adl.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/adls_v2.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/adx.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/asb.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/azure_batch.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/azure_container_volume.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/azure_cosmos.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/azure_fileshare.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/azure_synapse.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/images/msgraph.png +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/index.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/msgraph.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/powerbi.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/wasb.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/installing-providers-from-sources.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/integration-logos/Azure-Cosmos-DB.svg +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/integration-logos/Azure-Data-Factory.svg +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/integration-logos/Azure-Files.svg +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/integration-logos/Blob-Storage.svg +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/integration-logos/Container-Instances.svg +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/integration-logos/Data-Lake-Storage.svg +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/integration-logos/Microsoft-Azure-Batch.png +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/integration-logos/Microsoft-Azure-Data-Explorer.png +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/integration-logos/Microsoft-Azure-Fileshare.png +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/integration-logos/Microsoft-Azure.png +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/integration-logos/Microsoft-Graph-API.png +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/integration-logos/Service-Bus.svg +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/logging/index.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/operators/_partials/prerequisite_tasks.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/operators/adf_run_pipeline.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/operators/adls.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/operators/asb.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/operators/azure_synapse.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/operators/batch.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/operators/index.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/operators/powerbi.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/redirects.txt +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/secrets-backends/azure-key-vault.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/security.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/sensors/cosmos_document_sensor.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/sensors/index.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/sensors/msgraph.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/sensors/wasb_sensors.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/transfer/index.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/transfer/local_to_adls.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/transfer/local_to_wasb.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/transfer/s3_to_wasb.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/transfer/sftp_to_wasb.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/newsfragments/51944.bugfix.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/fs/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/container_instance.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/powerbi.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/log/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/operators/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/secrets/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/sensors/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/transfers/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/triggers/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/triggers/wasb.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/utils.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/conftest.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_adf_run_pipeline.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_adls_create.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_adls_delete.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_adls_list.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_azure_batch_operator.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_azure_container_instances.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_azure_cosmosdb.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_fileshare.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_local_to_adls.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_local_to_wasb.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_msfabric.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_msgraph.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_powerbi.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_sftp_to_wasb.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_synapse_run_pipeline.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_wasb_sensors.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/fs/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_batch.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_container_instance.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_container_registry.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_container_volume.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_cosmos.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_data_lake.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_fileshare.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_synapse.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_synapse_pipeline.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/log/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_adls_create.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_adls_delete.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_adls_list.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_adx.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_batch.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_container_instances.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_cosmos.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_wasb_delete_blob.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/resources/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/resources/dummy.pdf +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/resources/next_users.json +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/resources/status.json +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/resources/users.json +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/secrets/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/secrets/test_key_vault.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/sensors/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/sensors/test_cosmos.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/sensors/test_wasb.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/transfers/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/transfers/test_local_to_adls.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/transfers/test_local_to_wasb.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/transfers/test_oracle_to_azure_data_lake.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/transfers/test_sftp_to_wasb.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.6.1 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/triggers/__init__.py +0 -0
|
@@ -1,12 +1,13 @@
|
|
|
1
1
|
Metadata-Version: 2.4
|
|
2
2
|
Name: apache-airflow-providers-microsoft-azure
|
|
3
|
-
Version: 12.
|
|
3
|
+
Version: 12.8.1rc1
|
|
4
4
|
Summary: Provider package apache-airflow-providers-microsoft-azure for Apache Airflow
|
|
5
5
|
Keywords: airflow-provider,microsoft.azure,airflow,integration
|
|
6
6
|
Author-email: Apache Software Foundation <dev@airflow.apache.org>
|
|
7
7
|
Maintainer-email: Apache Software Foundation <dev@airflow.apache.org>
|
|
8
8
|
Requires-Python: >=3.10
|
|
9
9
|
Description-Content-Type: text/x-rst
|
|
10
|
+
License-Expression: Apache-2.0
|
|
10
11
|
Classifier: Development Status :: 5 - Production/Stable
|
|
11
12
|
Classifier: Environment :: Console
|
|
12
13
|
Classifier: Environment :: Web Environment
|
|
@@ -14,13 +15,15 @@ Classifier: Intended Audience :: Developers
|
|
|
14
15
|
Classifier: Intended Audience :: System Administrators
|
|
15
16
|
Classifier: Framework :: Apache Airflow
|
|
16
17
|
Classifier: Framework :: Apache Airflow :: Provider
|
|
17
|
-
Classifier: License :: OSI Approved :: Apache Software License
|
|
18
18
|
Classifier: Programming Language :: Python :: 3.10
|
|
19
19
|
Classifier: Programming Language :: Python :: 3.11
|
|
20
20
|
Classifier: Programming Language :: Python :: 3.12
|
|
21
21
|
Classifier: Programming Language :: Python :: 3.13
|
|
22
22
|
Classifier: Topic :: System :: Monitoring
|
|
23
|
-
|
|
23
|
+
License-File: LICENSE
|
|
24
|
+
License-File: NOTICE
|
|
25
|
+
Requires-Dist: apache-airflow>=2.10.0rc1
|
|
26
|
+
Requires-Dist: apache-airflow-providers-common-compat>=1.8.0rc1
|
|
24
27
|
Requires-Dist: adlfs>=2023.10.0
|
|
25
28
|
Requires-Dist: azure-batch>=8.0.0
|
|
26
29
|
Requires-Dist: azure-cosmos>=4.6.0
|
|
@@ -36,28 +39,26 @@ Requires-Dist: azure-storage-file-share>=12.7.0
|
|
|
36
39
|
Requires-Dist: azure-servicebus>=7.12.1
|
|
37
40
|
Requires-Dist: azure-synapse-spark>=0.2.0
|
|
38
41
|
Requires-Dist: azure-synapse-artifacts>=0.17.0
|
|
39
|
-
Requires-Dist: adal>=1.2.7
|
|
40
42
|
Requires-Dist: azure-storage-file-datalake>=12.9.1
|
|
41
|
-
Requires-Dist: azure-kusto-data>=4.1.0,!=4.6.0
|
|
43
|
+
Requires-Dist: azure-kusto-data>=4.1.0,!=4.6.0,!=5.0.0
|
|
42
44
|
Requires-Dist: azure-mgmt-datafactory>=2.0.0
|
|
43
45
|
Requires-Dist: azure-mgmt-containerregistry>=8.0.0
|
|
44
46
|
Requires-Dist: azure-mgmt-containerinstance>=10.1.0
|
|
45
|
-
Requires-Dist: flask-appbuilder>=4.0.0
|
|
46
47
|
Requires-Dist: msgraph-core>=1.3.3
|
|
48
|
+
Requires-Dist: msgraphfs>=0.3.0
|
|
47
49
|
Requires-Dist: microsoft-kiota-http>=1.9.4,<2.0.0
|
|
48
50
|
Requires-Dist: microsoft-kiota-serialization-json>=1.9.4
|
|
49
51
|
Requires-Dist: microsoft-kiota-serialization-text>=1.9.4
|
|
50
52
|
Requires-Dist: microsoft-kiota-abstractions>=1.9.4,<2.0.0
|
|
51
53
|
Requires-Dist: microsoft-kiota-authentication-azure>=1.9.4,<2.0.0
|
|
52
|
-
Requires-Dist: msal-extensions>=1.
|
|
53
|
-
Requires-Dist: portalocker>=2.8.1
|
|
54
|
+
Requires-Dist: msal-extensions>=1.3.0
|
|
54
55
|
Requires-Dist: apache-airflow-providers-amazon ; extra == "amazon"
|
|
55
56
|
Requires-Dist: apache-airflow-providers-common-compat ; extra == "common-compat"
|
|
56
57
|
Requires-Dist: apache-airflow-providers-oracle ; extra == "oracle"
|
|
57
58
|
Requires-Dist: apache-airflow-providers-sftp ; extra == "sftp"
|
|
58
59
|
Project-URL: Bug Tracker, https://github.com/apache/airflow/issues
|
|
59
|
-
Project-URL: Changelog, https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.
|
|
60
|
-
Project-URL: Documentation, https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.
|
|
60
|
+
Project-URL: Changelog, https://airflow.staged.apache.org/docs/apache-airflow-providers-microsoft-azure/12.8.1/changelog.html
|
|
61
|
+
Project-URL: Documentation, https://airflow.staged.apache.org/docs/apache-airflow-providers-microsoft-azure/12.8.1
|
|
61
62
|
Project-URL: Mastodon, https://fosstodon.org/@airflow
|
|
62
63
|
Project-URL: Slack Chat, https://s.apache.org/airflow-slack
|
|
63
64
|
Project-URL: Source Code, https://github.com/apache/airflow
|
|
@@ -92,9 +93,8 @@ Provides-Extra: sftp
|
|
|
92
93
|
|
|
93
94
|
Package ``apache-airflow-providers-microsoft-azure``
|
|
94
95
|
|
|
95
|
-
Release: ``12.
|
|
96
|
+
Release: ``12.8.1``
|
|
96
97
|
|
|
97
|
-
Release Date: ``|PypiReleaseDate|``
|
|
98
98
|
|
|
99
99
|
`Microsoft Azure <https://azure.microsoft.com/>`__
|
|
100
100
|
|
|
@@ -106,12 +106,12 @@ This is a provider package for ``microsoft.azure`` provider. All classes for thi
|
|
|
106
106
|
are in ``airflow.providers.microsoft.azure`` python package.
|
|
107
107
|
|
|
108
108
|
You can find package information and changelog for the provider
|
|
109
|
-
in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.
|
|
109
|
+
in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.8.1/>`_.
|
|
110
110
|
|
|
111
111
|
Installation
|
|
112
112
|
------------
|
|
113
113
|
|
|
114
|
-
You can install this package on top of an existing Airflow
|
|
114
|
+
You can install this package on top of an existing Airflow installation (see ``Requirements`` below
|
|
115
115
|
for the minimum Airflow version supported) via
|
|
116
116
|
``pip install apache-airflow-providers-microsoft-azure``
|
|
117
117
|
|
|
@@ -120,41 +120,40 @@ The package supports the following python versions: 3.10,3.11,3.12,3.13
|
|
|
120
120
|
Requirements
|
|
121
121
|
------------
|
|
122
122
|
|
|
123
|
-
|
|
124
|
-
PIP package
|
|
125
|
-
|
|
126
|
-
``apache-airflow``
|
|
127
|
-
``
|
|
128
|
-
``
|
|
129
|
-
``azure-
|
|
130
|
-
``azure-
|
|
131
|
-
``azure-
|
|
132
|
-
``azure-
|
|
133
|
-
``azure-
|
|
134
|
-
``azure-
|
|
135
|
-
``azure-mgmt-
|
|
136
|
-
``azure-
|
|
137
|
-
``azure-
|
|
138
|
-
``azure-storage
|
|
139
|
-
``azure-
|
|
140
|
-
``azure-
|
|
141
|
-
``azure-synapse-
|
|
142
|
-
``
|
|
143
|
-
``azure-storage-file-datalake``
|
|
144
|
-
``azure-kusto-data``
|
|
145
|
-
``azure-mgmt-datafactory``
|
|
146
|
-
``azure-mgmt-containerregistry``
|
|
147
|
-
``azure-mgmt-containerinstance``
|
|
148
|
-
``
|
|
149
|
-
``
|
|
150
|
-
``microsoft-kiota-http``
|
|
151
|
-
``microsoft-kiota-serialization-json``
|
|
152
|
-
``microsoft-kiota-serialization-text``
|
|
153
|
-
``microsoft-kiota-abstractions``
|
|
154
|
-
``microsoft-kiota-authentication-azure``
|
|
155
|
-
``msal-extensions``
|
|
156
|
-
|
|
157
|
-
======================================== ===================
|
|
123
|
+
========================================== ===========================
|
|
124
|
+
PIP package Version required
|
|
125
|
+
========================================== ===========================
|
|
126
|
+
``apache-airflow`` ``>=2.10.0``
|
|
127
|
+
``apache-airflow-providers-common-compat`` ``>=1.8.0``
|
|
128
|
+
``adlfs`` ``>=2023.10.0``
|
|
129
|
+
``azure-batch`` ``>=8.0.0``
|
|
130
|
+
``azure-cosmos`` ``>=4.6.0``
|
|
131
|
+
``azure-mgmt-cosmosdb`` ``>=3.0.0``
|
|
132
|
+
``azure-datalake-store`` ``>=0.0.45``
|
|
133
|
+
``azure-identity`` ``>=1.3.1``
|
|
134
|
+
``azure-keyvault-secrets`` ``>=4.1.0``
|
|
135
|
+
``azure-mgmt-datalake-store`` ``>=0.5.0``
|
|
136
|
+
``azure-mgmt-resource`` ``>=2.2.0``
|
|
137
|
+
``azure-storage-blob`` ``>=12.26.0``
|
|
138
|
+
``azure-mgmt-storage`` ``>=16.0.0``
|
|
139
|
+
``azure-storage-file-share`` ``>=12.7.0``
|
|
140
|
+
``azure-servicebus`` ``>=7.12.1``
|
|
141
|
+
``azure-synapse-spark`` ``>=0.2.0``
|
|
142
|
+
``azure-synapse-artifacts`` ``>=0.17.0``
|
|
143
|
+
``azure-storage-file-datalake`` ``>=12.9.1``
|
|
144
|
+
``azure-kusto-data`` ``>=4.1.0,!=4.6.0,!=5.0.0``
|
|
145
|
+
``azure-mgmt-datafactory`` ``>=2.0.0``
|
|
146
|
+
``azure-mgmt-containerregistry`` ``>=8.0.0``
|
|
147
|
+
``azure-mgmt-containerinstance`` ``>=10.1.0``
|
|
148
|
+
``msgraph-core`` ``>=1.3.3``
|
|
149
|
+
``msgraphfs`` ``>=0.3.0``
|
|
150
|
+
``microsoft-kiota-http`` ``>=1.9.4,<2.0.0``
|
|
151
|
+
``microsoft-kiota-serialization-json`` ``>=1.9.4``
|
|
152
|
+
``microsoft-kiota-serialization-text`` ``>=1.9.4``
|
|
153
|
+
``microsoft-kiota-abstractions`` ``>=1.9.4,<2.0.0``
|
|
154
|
+
``microsoft-kiota-authentication-azure`` ``>=1.9.4,<2.0.0``
|
|
155
|
+
``msal-extensions`` ``>=1.3.0``
|
|
156
|
+
========================================== ===========================
|
|
158
157
|
|
|
159
158
|
Cross provider package dependencies
|
|
160
159
|
-----------------------------------
|
|
@@ -178,6 +177,18 @@ Dependent package
|
|
|
178
177
|
`apache-airflow-providers-sftp <https://airflow.apache.org/docs/apache-airflow-providers-sftp>`_ ``sftp``
|
|
179
178
|
================================================================================================================== =================
|
|
180
179
|
|
|
180
|
+
Optional dependencies
|
|
181
|
+
----------------------
|
|
182
|
+
|
|
183
|
+
================= ==========================================
|
|
184
|
+
Extra Dependencies
|
|
185
|
+
================= ==========================================
|
|
186
|
+
``amazon`` ``apache-airflow-providers-amazon``
|
|
187
|
+
``common.compat`` ``apache-airflow-providers-common-compat``
|
|
188
|
+
``oracle`` ``apache-airflow-providers-oracle``
|
|
189
|
+
``sftp`` ``apache-airflow-providers-sftp``
|
|
190
|
+
================= ==========================================
|
|
191
|
+
|
|
181
192
|
The changelog for the provider package can be found in the
|
|
182
|
-
`changelog <https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.
|
|
193
|
+
`changelog <https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.8.1/changelog.html>`_.
|
|
183
194
|
|
|
@@ -23,9 +23,8 @@
|
|
|
23
23
|
|
|
24
24
|
Package ``apache-airflow-providers-microsoft-azure``
|
|
25
25
|
|
|
26
|
-
Release: ``12.
|
|
26
|
+
Release: ``12.8.1``
|
|
27
27
|
|
|
28
|
-
Release Date: ``|PypiReleaseDate|``
|
|
29
28
|
|
|
30
29
|
`Microsoft Azure <https://azure.microsoft.com/>`__
|
|
31
30
|
|
|
@@ -37,12 +36,12 @@ This is a provider package for ``microsoft.azure`` provider. All classes for thi
|
|
|
37
36
|
are in ``airflow.providers.microsoft.azure`` python package.
|
|
38
37
|
|
|
39
38
|
You can find package information and changelog for the provider
|
|
40
|
-
in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.
|
|
39
|
+
in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.8.1/>`_.
|
|
41
40
|
|
|
42
41
|
Installation
|
|
43
42
|
------------
|
|
44
43
|
|
|
45
|
-
You can install this package on top of an existing Airflow
|
|
44
|
+
You can install this package on top of an existing Airflow installation (see ``Requirements`` below
|
|
46
45
|
for the minimum Airflow version supported) via
|
|
47
46
|
``pip install apache-airflow-providers-microsoft-azure``
|
|
48
47
|
|
|
@@ -51,41 +50,40 @@ The package supports the following python versions: 3.10,3.11,3.12,3.13
|
|
|
51
50
|
Requirements
|
|
52
51
|
------------
|
|
53
52
|
|
|
54
|
-
|
|
55
|
-
PIP package
|
|
56
|
-
|
|
57
|
-
``apache-airflow``
|
|
58
|
-
``
|
|
59
|
-
``
|
|
60
|
-
``azure-
|
|
61
|
-
``azure-
|
|
62
|
-
``azure-
|
|
63
|
-
``azure-
|
|
64
|
-
``azure-
|
|
65
|
-
``azure-
|
|
66
|
-
``azure-mgmt-
|
|
67
|
-
``azure-
|
|
68
|
-
``azure-
|
|
69
|
-
``azure-storage
|
|
70
|
-
``azure-
|
|
71
|
-
``azure-
|
|
72
|
-
``azure-synapse-
|
|
73
|
-
``
|
|
74
|
-
``azure-storage-file-datalake``
|
|
75
|
-
``azure-kusto-data``
|
|
76
|
-
``azure-mgmt-datafactory``
|
|
77
|
-
``azure-mgmt-containerregistry``
|
|
78
|
-
``azure-mgmt-containerinstance``
|
|
79
|
-
``
|
|
80
|
-
``
|
|
81
|
-
``microsoft-kiota-http``
|
|
82
|
-
``microsoft-kiota-serialization-json``
|
|
83
|
-
``microsoft-kiota-serialization-text``
|
|
84
|
-
``microsoft-kiota-abstractions``
|
|
85
|
-
``microsoft-kiota-authentication-azure``
|
|
86
|
-
``msal-extensions``
|
|
87
|
-
|
|
88
|
-
======================================== ===================
|
|
53
|
+
========================================== ===========================
|
|
54
|
+
PIP package Version required
|
|
55
|
+
========================================== ===========================
|
|
56
|
+
``apache-airflow`` ``>=2.10.0``
|
|
57
|
+
``apache-airflow-providers-common-compat`` ``>=1.8.0``
|
|
58
|
+
``adlfs`` ``>=2023.10.0``
|
|
59
|
+
``azure-batch`` ``>=8.0.0``
|
|
60
|
+
``azure-cosmos`` ``>=4.6.0``
|
|
61
|
+
``azure-mgmt-cosmosdb`` ``>=3.0.0``
|
|
62
|
+
``azure-datalake-store`` ``>=0.0.45``
|
|
63
|
+
``azure-identity`` ``>=1.3.1``
|
|
64
|
+
``azure-keyvault-secrets`` ``>=4.1.0``
|
|
65
|
+
``azure-mgmt-datalake-store`` ``>=0.5.0``
|
|
66
|
+
``azure-mgmt-resource`` ``>=2.2.0``
|
|
67
|
+
``azure-storage-blob`` ``>=12.26.0``
|
|
68
|
+
``azure-mgmt-storage`` ``>=16.0.0``
|
|
69
|
+
``azure-storage-file-share`` ``>=12.7.0``
|
|
70
|
+
``azure-servicebus`` ``>=7.12.1``
|
|
71
|
+
``azure-synapse-spark`` ``>=0.2.0``
|
|
72
|
+
``azure-synapse-artifacts`` ``>=0.17.0``
|
|
73
|
+
``azure-storage-file-datalake`` ``>=12.9.1``
|
|
74
|
+
``azure-kusto-data`` ``>=4.1.0,!=4.6.0,!=5.0.0``
|
|
75
|
+
``azure-mgmt-datafactory`` ``>=2.0.0``
|
|
76
|
+
``azure-mgmt-containerregistry`` ``>=8.0.0``
|
|
77
|
+
``azure-mgmt-containerinstance`` ``>=10.1.0``
|
|
78
|
+
``msgraph-core`` ``>=1.3.3``
|
|
79
|
+
``msgraphfs`` ``>=0.3.0``
|
|
80
|
+
``microsoft-kiota-http`` ``>=1.9.4,<2.0.0``
|
|
81
|
+
``microsoft-kiota-serialization-json`` ``>=1.9.4``
|
|
82
|
+
``microsoft-kiota-serialization-text`` ``>=1.9.4``
|
|
83
|
+
``microsoft-kiota-abstractions`` ``>=1.9.4,<2.0.0``
|
|
84
|
+
``microsoft-kiota-authentication-azure`` ``>=1.9.4,<2.0.0``
|
|
85
|
+
``msal-extensions`` ``>=1.3.0``
|
|
86
|
+
========================================== ===========================
|
|
89
87
|
|
|
90
88
|
Cross provider package dependencies
|
|
91
89
|
-----------------------------------
|
|
@@ -109,5 +107,17 @@ Dependent package
|
|
|
109
107
|
`apache-airflow-providers-sftp <https://airflow.apache.org/docs/apache-airflow-providers-sftp>`_ ``sftp``
|
|
110
108
|
================================================================================================================== =================
|
|
111
109
|
|
|
110
|
+
Optional dependencies
|
|
111
|
+
----------------------
|
|
112
|
+
|
|
113
|
+
================= ==========================================
|
|
114
|
+
Extra Dependencies
|
|
115
|
+
================= ==========================================
|
|
116
|
+
``amazon`` ``apache-airflow-providers-amazon``
|
|
117
|
+
``common.compat`` ``apache-airflow-providers-common-compat``
|
|
118
|
+
``oracle`` ``apache-airflow-providers-oracle``
|
|
119
|
+
``sftp`` ``apache-airflow-providers-sftp``
|
|
120
|
+
================= ==========================================
|
|
121
|
+
|
|
112
122
|
The changelog for the provider package can be found in the
|
|
113
|
-
`changelog <https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.
|
|
123
|
+
`changelog <https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.8.1/changelog.html>`_.
|
|
@@ -27,6 +27,106 @@
|
|
|
27
27
|
Changelog
|
|
28
28
|
---------
|
|
29
29
|
|
|
30
|
+
12.8.1
|
|
31
|
+
......
|
|
32
|
+
|
|
33
|
+
Misc
|
|
34
|
+
~~~~
|
|
35
|
+
|
|
36
|
+
* ``Convert all airflow distributions to be compliant with ASF requirements (#58138)``
|
|
37
|
+
* ``Remove adal dependency (#57798)``
|
|
38
|
+
|
|
39
|
+
.. Below changes are excluded from the changelog. Move them to
|
|
40
|
+
appropriate section above if needed. Do not delete the lines(!):
|
|
41
|
+
* ``Delete all unnecessary LICENSE Files (#58191)``
|
|
42
|
+
* ``Enable PT006 rule to microsoft Provider test(azure,mssql,psrp) (#57936)``
|
|
43
|
+
* ``Enable PT006 rule to microsoft Provider test(operators) (#57928)``
|
|
44
|
+
* ``Enable PT006 rule to microsoft Provider test(transfers) (#57925)``
|
|
45
|
+
* ``Enable PT006 rule to microsoft Provider test(log,sensors) (#57927)``
|
|
46
|
+
* ``Enable PT006 rule to microsoft Provider test(hooks) (#57932)``
|
|
47
|
+
* ``Fix mypy static errors in main (#57755)``
|
|
48
|
+
* ``Attempt to resolve pip "ResolutionTooDeep" on cffi conflict (#57697)``
|
|
49
|
+
* ``Enable ruff PLW1508 rule (#57653)``
|
|
50
|
+
* ``Fix documentation/provider.yaml consistencies (#57283)``
|
|
51
|
+
|
|
52
|
+
12.8.0
|
|
53
|
+
......
|
|
54
|
+
|
|
55
|
+
Features
|
|
56
|
+
~~~~~~~~
|
|
57
|
+
|
|
58
|
+
* ``Add Microsoft Graph filesystem integration (#55454)``
|
|
59
|
+
* ``update AzureBaseHook to return credentials that supports get_token method" (#56228)``
|
|
60
|
+
|
|
61
|
+
Misc
|
|
62
|
+
~~~~
|
|
63
|
+
|
|
64
|
+
* ``Migrate microsoft providers to ''common.compat'' (#56995)``
|
|
65
|
+
* ``improve exception handling in AzureDataFactoryTrigger (#56350)``
|
|
66
|
+
|
|
67
|
+
Doc-only
|
|
68
|
+
~~~~~~~~
|
|
69
|
+
|
|
70
|
+
* ``Remove placeholder Release Date in changelog and index files (#56056)``
|
|
71
|
+
|
|
72
|
+
.. Below changes are excluded from the changelog. Move them to
|
|
73
|
+
appropriate section above if needed. Do not delete the lines(!):
|
|
74
|
+
* ``Fix Databricks provider import error without fab provider (#56702)``
|
|
75
|
+
* ``Remove 'pytest.importorskip("flask_appbuilder")' from tests (#56679)``
|
|
76
|
+
* ``Revert "update AzureBaseHook to return credentials that supports get_token me…" (#56223)``
|
|
77
|
+
* ``update AzureBaseHook to return credentials that supports get_token method (#52182)``
|
|
78
|
+
* ``Enable PT011 rule to prvoider tests (#56021)``
|
|
79
|
+
|
|
80
|
+
12.7.1
|
|
81
|
+
......
|
|
82
|
+
|
|
83
|
+
|
|
84
|
+
Bug Fixes
|
|
85
|
+
~~~~~~~~~
|
|
86
|
+
|
|
87
|
+
* ``[OSSTaskHandler, CloudwatchTaskHandler, S3TaskHandler, HdfsTaskHandler, ElasticsearchTaskHandler, GCSTaskHandler, OpensearchTaskHandler, RedisTaskHandler, WasbTaskHandler] supports log file size handling (#55455)``
|
|
88
|
+
* ``Avoid using extra_dejson method on connection in KiotaRequestAdapterHook to avoid AsyncToSync RuntimeError (#55179)``
|
|
89
|
+
|
|
90
|
+
.. Below changes are excluded from the changelog. Move them to
|
|
91
|
+
appropriate section above if needed. Do not delete the lines(!):
|
|
92
|
+
* ``Remove db dependency from test_wasb trigger tests (#55624)``
|
|
93
|
+
* ``Switch all airflow logging to structlog (#52651)``
|
|
94
|
+
|
|
95
|
+
12.7.0
|
|
96
|
+
......
|
|
97
|
+
|
|
98
|
+
|
|
99
|
+
Features
|
|
100
|
+
~~~~~~~~
|
|
101
|
+
|
|
102
|
+
* ``Add setter for blob_service_client in WasbHook to support async injection (#54219)``
|
|
103
|
+
* ``Add CI support for SQLAlchemy 2.0 (#52233)``
|
|
104
|
+
|
|
105
|
+
Bug Fixes
|
|
106
|
+
~~~~~~~~~
|
|
107
|
+
|
|
108
|
+
* ``Made get_conn method async for KiotaRequestAdapterHook to fix AsyncToSync error (#54598)``
|
|
109
|
+
* ``fix unreachable mypy warnings for microsoft/azure (#53647)``
|
|
110
|
+
|
|
111
|
+
Misc
|
|
112
|
+
~~~~
|
|
113
|
+
|
|
114
|
+
* ``Remove portalocker dependency (#54751)``
|
|
115
|
+
|
|
116
|
+
Doc-only
|
|
117
|
+
~~~~~~~~
|
|
118
|
+
|
|
119
|
+
* ``Make term Dag consistent in providers docs (#55101)``
|
|
120
|
+
|
|
121
|
+
.. Below changes are excluded from the changelog. Move them to
|
|
122
|
+
appropriate section above if needed. Do not delete the lines(!):
|
|
123
|
+
* ``Fix short names in test_adls (#54907)``
|
|
124
|
+
* ``Move trigger_rule utils from 'airflow/utils' to 'airflow.task'and integrate with Execution API spec (#53389)``
|
|
125
|
+
* ``Switch pre-commit to prek (#54258)``
|
|
126
|
+
|
|
127
|
+
.. Review and move the new changes to one of the sections above:
|
|
128
|
+
* ``Fix Airflow 2 reference in README/index of providers (#55240)``
|
|
129
|
+
|
|
30
130
|
12.6.1
|
|
31
131
|
......
|
|
32
132
|
|
|
@@ -74,6 +74,8 @@ Extra (optional)
|
|
|
74
74
|
It specifies the json that contains the authentication information.
|
|
75
75
|
* ``managed_identity_client_id``: The client ID of a user-assigned managed identity. If provided with ``workload_identity_tenant_id``, they'll pass to DefaultAzureCredential_.
|
|
76
76
|
* ``workload_identity_tenant_id``: ID of the application's Microsoft Entra tenant. Also called its "directory" ID. If provided with ``managed_identity_client_id``, they'll pass to DefaultAzureCredential_.
|
|
77
|
+
* ``use_azure_identity_object``: If set to true, it will use credential of newer type: ClientSecretCredential or DefaultAzureCredential instead of ServicePrincipalCredentials or AzureIdentityCredentialAdapter.
|
|
78
|
+
These newer credentials support get_token method which can be used to generate OAuth token with custom scope.
|
|
77
79
|
|
|
78
80
|
The entire extra column can be left out to fall back on DefaultAzureCredential_.
|
|
79
81
|
|
|
@@ -0,0 +1,26 @@
|
|
|
1
|
+
.. Licensed to the Apache Software Foundation (ASF) under one
|
|
2
|
+
or more contributor license agreements. See the NOTICE file
|
|
3
|
+
distributed with this work for additional information
|
|
4
|
+
regarding copyright ownership. The ASF licenses this file
|
|
5
|
+
to you under the Apache License, Version 2.0 (the
|
|
6
|
+
"License"); you may not use this file except in compliance
|
|
7
|
+
with the License. You may obtain a copy of the License at
|
|
8
|
+
|
|
9
|
+
.. http://www.apache.org/licenses/LICENSE-2.0
|
|
10
|
+
|
|
11
|
+
.. Unless required by applicable law or agreed to in writing,
|
|
12
|
+
software distributed under the License is distributed on an
|
|
13
|
+
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
|
14
|
+
KIND, either express or implied. See the License for the
|
|
15
|
+
specific language governing permissions and limitations
|
|
16
|
+
under the License.
|
|
17
|
+
|
|
18
|
+
Filesystems
|
|
19
|
+
===========
|
|
20
|
+
|
|
21
|
+
.. toctree::
|
|
22
|
+
:maxdepth: 1
|
|
23
|
+
:caption: Filesystem Providers
|
|
24
|
+
:glob:
|
|
25
|
+
|
|
26
|
+
*
|
|
@@ -0,0 +1,187 @@
|
|
|
1
|
+
.. Licensed to the Apache Software Foundation (ASF) under one
|
|
2
|
+
or more contributor license agreements. See the NOTICE file
|
|
3
|
+
distributed with this work for additional information
|
|
4
|
+
regarding copyright ownership. The ASF licenses this file
|
|
5
|
+
to you under the Apache License, Version 2.0 (the
|
|
6
|
+
"License"); you may not use this file except in compliance
|
|
7
|
+
with the License. You may obtain a copy of the License at
|
|
8
|
+
|
|
9
|
+
.. http://www.apache.org/licenses/LICENSE-2.0
|
|
10
|
+
|
|
11
|
+
.. Unless required by applicable law or agreed to in writing,
|
|
12
|
+
software distributed under the License is distributed on an
|
|
13
|
+
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
|
14
|
+
KIND, either express or implied. See the License for the
|
|
15
|
+
specific language governing permissions and limitations
|
|
16
|
+
under the License.
|
|
17
|
+
|
|
18
|
+
Microsoft Graph Filesystem
|
|
19
|
+
===========================
|
|
20
|
+
|
|
21
|
+
The Microsoft Graph filesystem provides access to OneDrive, SharePoint, and Teams document libraries through Airflow's ObjectStoragePath interface.
|
|
22
|
+
|
|
23
|
+
Supported URL formats:
|
|
24
|
+
|
|
25
|
+
* ``msgraph://connection_id/drive_id/path/to/file``
|
|
26
|
+
* ``sharepoint://connection_id/drive_id/path/to/file``
|
|
27
|
+
* ``onedrive://connection_id/drive_id/path/to/file``
|
|
28
|
+
* ``msgd://connection_id/drive_id/path/to/file``
|
|
29
|
+
|
|
30
|
+
Connection Configuration
|
|
31
|
+
------------------------
|
|
32
|
+
|
|
33
|
+
Create a Microsoft Graph connection in Airflow with the following parameters:
|
|
34
|
+
|
|
35
|
+
* **Connection Type**: msgraph
|
|
36
|
+
* **Host**: Tenant ID
|
|
37
|
+
* **Login**: Client ID
|
|
38
|
+
* **Password**: Client Secret
|
|
39
|
+
|
|
40
|
+
The connection form provides additional configuration fields:
|
|
41
|
+
|
|
42
|
+
* **Tenant ID**: Azure AD tenant identifier
|
|
43
|
+
* **Drive ID**: Specific drive to access (optional - leave empty for general access)
|
|
44
|
+
* **Scopes**: OAuth2 scopes (default: https://graph.microsoft.com/.default)
|
|
45
|
+
|
|
46
|
+
Additional OAuth2 parameters supported via connection extras:
|
|
47
|
+
|
|
48
|
+
* **scope**: OAuth2 access scope
|
|
49
|
+
* **token_endpoint**: Custom token endpoint URL
|
|
50
|
+
* **redirect_uri**: OAuth2 redirect URI for authorization code flow
|
|
51
|
+
* **token_endpoint_auth_method**: Client authentication method (default: client_secret_basic)
|
|
52
|
+
* **code_challenge_method**: PKCE code challenge method (e.g., 'S256')
|
|
53
|
+
* **username**: Username for password grant flow
|
|
54
|
+
* **password**: Password for password grant flow
|
|
55
|
+
|
|
56
|
+
Connection extra field configuration example:
|
|
57
|
+
|
|
58
|
+
.. code-block:: json
|
|
59
|
+
|
|
60
|
+
{
|
|
61
|
+
"drive_id": "b!abc123...",
|
|
62
|
+
"scope": "https://graph.microsoft.com/.default",
|
|
63
|
+
"token_endpoint": "https://login.microsoftonline.com/your-tenant/oauth2/v2.0/token",
|
|
64
|
+
"redirect_uri": "http://localhost:8080/callback",
|
|
65
|
+
"token_endpoint_auth_method": "client_secret_post"
|
|
66
|
+
}
|
|
67
|
+
|
|
68
|
+
Usage Examples
|
|
69
|
+
--------------
|
|
70
|
+
|
|
71
|
+
Reading Files
|
|
72
|
+
^^^^^^^^^^^^^
|
|
73
|
+
|
|
74
|
+
.. code-block:: python
|
|
75
|
+
|
|
76
|
+
from airflow.sdk.io.path import ObjectStoragePath
|
|
77
|
+
|
|
78
|
+
# Access a file in OneDrive
|
|
79
|
+
path = ObjectStoragePath("onedrive://my_conn/drive123/Documents/data.csv")
|
|
80
|
+
|
|
81
|
+
# Read file content
|
|
82
|
+
with path.open("r") as f:
|
|
83
|
+
content = f.read()
|
|
84
|
+
|
|
85
|
+
Directory Operations
|
|
86
|
+
^^^^^^^^^^^^^^^^^^^^
|
|
87
|
+
|
|
88
|
+
.. code-block:: python
|
|
89
|
+
|
|
90
|
+
# List directory contents in SharePoint
|
|
91
|
+
sharepoint_path = ObjectStoragePath("sharepoint://sp_conn/site_drive/Shared Documents/")
|
|
92
|
+
|
|
93
|
+
for item in sharepoint_path.iterdir():
|
|
94
|
+
print(f"Found: {item.name}")
|
|
95
|
+
if item.is_file():
|
|
96
|
+
print(f" Size: {item.stat().st_size} bytes")
|
|
97
|
+
|
|
98
|
+
File Operations
|
|
99
|
+
^^^^^^^^^^^^^^^
|
|
100
|
+
|
|
101
|
+
.. code-block:: python
|
|
102
|
+
|
|
103
|
+
# Copy file between drives
|
|
104
|
+
source = ObjectStoragePath("msgraph://conn1/drive1/source.txt")
|
|
105
|
+
target = ObjectStoragePath("msgraph://conn2/drive2/backup/source.txt")
|
|
106
|
+
source.copy(target)
|
|
107
|
+
|
|
108
|
+
# Move file
|
|
109
|
+
old_path = ObjectStoragePath("onedrive://conn/drive/temp/file.txt")
|
|
110
|
+
new_path = ObjectStoragePath("onedrive://conn/drive/archive/file.txt")
|
|
111
|
+
old_path.move(new_path)
|
|
112
|
+
|
|
113
|
+
# Delete file
|
|
114
|
+
file_to_delete = ObjectStoragePath("msgraph://conn/drive/old_data.csv")
|
|
115
|
+
file_to_delete.unlink()
|
|
116
|
+
|
|
117
|
+
Writing Files
|
|
118
|
+
^^^^^^^^^^^^^
|
|
119
|
+
|
|
120
|
+
.. code-block:: python
|
|
121
|
+
|
|
122
|
+
# Write new file
|
|
123
|
+
output_path = ObjectStoragePath("sharepoint://sp_conn/docs/reports/report.txt")
|
|
124
|
+
|
|
125
|
+
with output_path.open("w") as f:
|
|
126
|
+
f.write("Generated report data\n")
|
|
127
|
+
f.write(f"Created at: {datetime.now()}\n")
|
|
128
|
+
|
|
129
|
+
Drive Discovery
|
|
130
|
+
^^^^^^^^^^^^^^^
|
|
131
|
+
|
|
132
|
+
When you need to find the correct drive ID for your URLs, you can use the Microsoft Graph API operators:
|
|
133
|
+
|
|
134
|
+
.. code-block:: python
|
|
135
|
+
|
|
136
|
+
from airflow.providers.microsoft.azure.operators.msgraph import MSGraphAsyncOperator
|
|
137
|
+
|
|
138
|
+
# List all drives for a user
|
|
139
|
+
list_drives = MSGraphAsyncOperator(
|
|
140
|
+
task_id="list_drives",
|
|
141
|
+
conn_id="msgraph_conn",
|
|
142
|
+
url="me/drives",
|
|
143
|
+
result_processor=lambda response: [
|
|
144
|
+
{"id": drive["id"], "name": drive["name"]} for drive in response["value"]
|
|
145
|
+
],
|
|
146
|
+
)
|
|
147
|
+
|
|
148
|
+
URL Scheme Mapping
|
|
149
|
+
------------------
|
|
150
|
+
|
|
151
|
+
The different URL schemes map to specific Microsoft Graph endpoints:
|
|
152
|
+
|
|
153
|
+
* ``msgraph://`` - General Microsoft Graph access
|
|
154
|
+
* ``onedrive://`` - OneDrive personal and business drives
|
|
155
|
+
* ``sharepoint://`` - SharePoint document libraries
|
|
156
|
+
* ``msgd://`` - Shortened form of msgraph://
|
|
157
|
+
|
|
158
|
+
All schemes use the same underlying Microsoft Graph API and authentication.
|
|
159
|
+
|
|
160
|
+
Requirements
|
|
161
|
+
------------
|
|
162
|
+
|
|
163
|
+
The Microsoft Graph filesystem requires:
|
|
164
|
+
|
|
165
|
+
* ``msgraphfs`` Python package
|
|
166
|
+
* Valid Azure AD application registration with appropriate permissions
|
|
167
|
+
* Microsoft Graph API access for your tenant
|
|
168
|
+
|
|
169
|
+
Required Microsoft Graph permissions:
|
|
170
|
+
|
|
171
|
+
* ``Files.Read`` - To read files
|
|
172
|
+
* ``Files.ReadWrite`` - To read and write files
|
|
173
|
+
* ``Sites.Read.All`` - To access SharePoint sites (if using ``sharepoint://`` URLs)
|
|
174
|
+
|
|
175
|
+
Cross-References
|
|
176
|
+
----------------
|
|
177
|
+
|
|
178
|
+
* :doc:`Microsoft Graph API Operators </operators/msgraph>` - For API operations and drive discovery
|
|
179
|
+
|
|
180
|
+
Reference
|
|
181
|
+
---------
|
|
182
|
+
|
|
183
|
+
For further information, look at:
|
|
184
|
+
|
|
185
|
+
* `Microsoft Graph Files API <https://learn.microsoft.com/en-us/graph/api/resources/onedrive>`__
|
|
186
|
+
* `msgraphfs Python package <https://pypi.org/project/msgraphfs/>`__
|
|
187
|
+
* `Use the Microsoft Graph API <https://learn.microsoft.com/en-us/graph/use-the-api/>`__
|