apache-airflow-providers-microsoft-azure 12.7.0__tar.gz → 12.8.1rc1__tar.gz
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- apache_airflow_providers_microsoft_azure-12.8.1rc1/NOTICE +5 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/PKG-INFO +59 -43
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/README.rst +49 -36
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/changelog.rst +65 -2
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/azure.rst +2 -0
- apache_airflow_providers_microsoft_azure-12.8.1rc1/docs/filesystems/index.rst +26 -0
- apache_airflow_providers_microsoft_azure-12.8.1rc1/docs/filesystems/msgraph.rst +187 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/index.rst +38 -36
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/operators/msgraph.rst +4 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/provider.yaml +10 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/pyproject.toml +10 -7
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/__init__.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/fs/adls.py +1 -1
- apache_airflow_providers_microsoft_azure-12.8.1rc1/src/airflow/providers/microsoft/azure/fs/msgraph.py +111 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/get_provider_info.py +12 -2
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/adx.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/asb.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/base_azure.py +93 -17
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/batch.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/container_registry.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/container_volume.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/cosmos.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/data_factory.py +2 -5
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/data_lake.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/fileshare.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/msgraph.py +18 -6
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/synapse.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/wasb.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/log/wasb_task_handler.py +7 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/operators/adls.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/operators/adx.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/operators/asb.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/operators/batch.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/operators/container_instances.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/operators/cosmos.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/operators/data_factory.py +1 -13
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/operators/msgraph.py +2 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/operators/powerbi.py +1 -8
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/operators/synapse.py +1 -13
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/operators/wasb_delete_blob.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/sensors/cosmos.py +1 -6
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/sensors/data_factory.py +1 -6
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/sensors/msgraph.py +1 -6
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/sensors/wasb.py +1 -6
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/transfers/local_to_adls.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/transfers/local_to_wasb.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/transfers/oracle_to_azure_data_lake.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/transfers/s3_to_wasb.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/transfers/sftp_to_wasb.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/triggers/data_factory.py +4 -3
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/triggers/msgraph.py +1 -12
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/version_compat.py +0 -24
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_azure_service_bus.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_azure_synapse.py +3 -3
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_powerbi_dataset_list.py +2 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_powerbi_dataset_refresh.py +2 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_powerbi_workspace_list.py +2 -0
- apache_airflow_providers_microsoft_azure-12.8.1rc1/tests/unit/microsoft/azure/fs/test_msgraph.py +155 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_adx.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_asb.py +3 -3
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_base_azure.py +89 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_data_factory.py +6 -2
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_msgraph.py +59 -128
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_powerbi.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_wasb.py +2 -2
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/log/test_wasb_task_handler.py +16 -12
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_asb.py +3 -3
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_data_factory.py +2 -2
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_msgraph.py +16 -18
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_powerbi.py +7 -11
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_powerbi_list.py +8 -12
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_synapse.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/sensors/test_data_factory.py +1 -1
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/sensors/test_msgraph.py +5 -6
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/test_utils.py +36 -4
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/transfers/test_s3_to_wasb.py +3 -3
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/triggers/test_data_factory.py +2 -2
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/triggers/test_msgraph.py +21 -26
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/triggers/test_powerbi.py +23 -31
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/triggers/test_wasb.py +12 -1
- apache_airflow_providers_microsoft_azure-12.7.0/tests/unit/microsoft/azure/base.py +0 -53
- {apache_airflow_providers_microsoft_azure-12.7.0/src/airflow/providers/microsoft/azure → apache_airflow_providers_microsoft_azure-12.8.1rc1}/LICENSE +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/.latest-doc-only-change.txt +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/commits.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/conf.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/configurations-ref.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/acr.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/adf.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/adl.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/adls_v2.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/adx.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/asb.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/azure_batch.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/azure_container_volume.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/azure_cosmos.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/azure_fileshare.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/azure_synapse.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/images/msgraph.png +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/index.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/msgraph.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/powerbi.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/connections/wasb.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/installing-providers-from-sources.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/integration-logos/Azure-Cosmos-DB.svg +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/integration-logos/Azure-Data-Factory.svg +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/integration-logos/Azure-Files.svg +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/integration-logos/Blob-Storage.svg +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/integration-logos/Container-Instances.svg +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/integration-logos/Data-Lake-Storage.svg +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/integration-logos/Microsoft-Azure-Batch.png +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/integration-logos/Microsoft-Azure-Data-Explorer.png +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/integration-logos/Microsoft-Azure-Fileshare.png +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/integration-logos/Microsoft-Azure.png +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/integration-logos/Microsoft-Graph-API.png +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/integration-logos/Service-Bus.svg +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/logging/index.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/operators/_partials/prerequisite_tasks.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/operators/adf_run_pipeline.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/operators/adls.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/operators/asb.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/operators/azure_synapse.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/operators/batch.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/operators/index.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/operators/powerbi.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/redirects.txt +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/secrets-backends/azure-key-vault.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/security.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/sensors/cosmos_document_sensor.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/sensors/index.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/sensors/msgraph.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/sensors/wasb_sensors.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/transfer/index.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/transfer/local_to_adls.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/transfer/local_to_wasb.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/transfer/s3_to_wasb.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/docs/transfer/sftp_to_wasb.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/newsfragments/51944.bugfix.rst +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/fs/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/container_instance.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/hooks/powerbi.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/log/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/operators/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/secrets/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/secrets/key_vault.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/sensors/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/transfers/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/triggers/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/triggers/powerbi.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/triggers/wasb.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/src/airflow/providers/microsoft/azure/utils.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/conftest.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_adf_run_pipeline.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_adls_create.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_adls_delete.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_adls_list.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_azure_batch_operator.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_azure_container_instances.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_azure_cosmosdb.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_fileshare.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_local_to_adls.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_local_to_wasb.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_msfabric.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_msgraph.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_powerbi.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_s3_to_wasb.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_sftp_to_wasb.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_synapse_run_pipeline.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/system/microsoft/azure/example_wasb_sensors.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/fs/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/fs/test_adls.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_batch.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_container_instance.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_container_registry.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_container_volume.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_cosmos.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_data_lake.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_fileshare.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_synapse.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/hooks/test_synapse_pipeline.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/log/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_adls_create.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_adls_delete.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_adls_list.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_adx.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_batch.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_container_instances.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_cosmos.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/operators/test_wasb_delete_blob.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/resources/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/resources/dummy.pdf +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/resources/next_users.json +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/resources/status.json +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/resources/users.json +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/secrets/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/secrets/test_key_vault.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/sensors/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/sensors/test_cosmos.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/sensors/test_wasb.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/transfers/__init__.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/transfers/test_local_to_adls.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/transfers/test_local_to_wasb.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/transfers/test_oracle_to_azure_data_lake.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/transfers/test_sftp_to_wasb.py +0 -0
- {apache_airflow_providers_microsoft_azure-12.7.0 → apache_airflow_providers_microsoft_azure-12.8.1rc1}/tests/unit/microsoft/azure/triggers/__init__.py +0 -0
|
@@ -1,12 +1,13 @@
|
|
|
1
1
|
Metadata-Version: 2.4
|
|
2
2
|
Name: apache-airflow-providers-microsoft-azure
|
|
3
|
-
Version: 12.
|
|
3
|
+
Version: 12.8.1rc1
|
|
4
4
|
Summary: Provider package apache-airflow-providers-microsoft-azure for Apache Airflow
|
|
5
5
|
Keywords: airflow-provider,microsoft.azure,airflow,integration
|
|
6
6
|
Author-email: Apache Software Foundation <dev@airflow.apache.org>
|
|
7
7
|
Maintainer-email: Apache Software Foundation <dev@airflow.apache.org>
|
|
8
8
|
Requires-Python: >=3.10
|
|
9
9
|
Description-Content-Type: text/x-rst
|
|
10
|
+
License-Expression: Apache-2.0
|
|
10
11
|
Classifier: Development Status :: 5 - Production/Stable
|
|
11
12
|
Classifier: Environment :: Console
|
|
12
13
|
Classifier: Environment :: Web Environment
|
|
@@ -14,13 +15,15 @@ Classifier: Intended Audience :: Developers
|
|
|
14
15
|
Classifier: Intended Audience :: System Administrators
|
|
15
16
|
Classifier: Framework :: Apache Airflow
|
|
16
17
|
Classifier: Framework :: Apache Airflow :: Provider
|
|
17
|
-
Classifier: License :: OSI Approved :: Apache Software License
|
|
18
18
|
Classifier: Programming Language :: Python :: 3.10
|
|
19
19
|
Classifier: Programming Language :: Python :: 3.11
|
|
20
20
|
Classifier: Programming Language :: Python :: 3.12
|
|
21
21
|
Classifier: Programming Language :: Python :: 3.13
|
|
22
22
|
Classifier: Topic :: System :: Monitoring
|
|
23
|
-
|
|
23
|
+
License-File: LICENSE
|
|
24
|
+
License-File: NOTICE
|
|
25
|
+
Requires-Dist: apache-airflow>=2.10.0rc1
|
|
26
|
+
Requires-Dist: apache-airflow-providers-common-compat>=1.8.0rc1
|
|
24
27
|
Requires-Dist: adlfs>=2023.10.0
|
|
25
28
|
Requires-Dist: azure-batch>=8.0.0
|
|
26
29
|
Requires-Dist: azure-cosmos>=4.6.0
|
|
@@ -36,13 +39,13 @@ Requires-Dist: azure-storage-file-share>=12.7.0
|
|
|
36
39
|
Requires-Dist: azure-servicebus>=7.12.1
|
|
37
40
|
Requires-Dist: azure-synapse-spark>=0.2.0
|
|
38
41
|
Requires-Dist: azure-synapse-artifacts>=0.17.0
|
|
39
|
-
Requires-Dist: adal>=1.2.7
|
|
40
42
|
Requires-Dist: azure-storage-file-datalake>=12.9.1
|
|
41
|
-
Requires-Dist: azure-kusto-data>=4.1.0,!=4.6.0
|
|
43
|
+
Requires-Dist: azure-kusto-data>=4.1.0,!=4.6.0,!=5.0.0
|
|
42
44
|
Requires-Dist: azure-mgmt-datafactory>=2.0.0
|
|
43
45
|
Requires-Dist: azure-mgmt-containerregistry>=8.0.0
|
|
44
46
|
Requires-Dist: azure-mgmt-containerinstance>=10.1.0
|
|
45
47
|
Requires-Dist: msgraph-core>=1.3.3
|
|
48
|
+
Requires-Dist: msgraphfs>=0.3.0
|
|
46
49
|
Requires-Dist: microsoft-kiota-http>=1.9.4,<2.0.0
|
|
47
50
|
Requires-Dist: microsoft-kiota-serialization-json>=1.9.4
|
|
48
51
|
Requires-Dist: microsoft-kiota-serialization-text>=1.9.4
|
|
@@ -54,8 +57,8 @@ Requires-Dist: apache-airflow-providers-common-compat ; extra == "common-compat"
|
|
|
54
57
|
Requires-Dist: apache-airflow-providers-oracle ; extra == "oracle"
|
|
55
58
|
Requires-Dist: apache-airflow-providers-sftp ; extra == "sftp"
|
|
56
59
|
Project-URL: Bug Tracker, https://github.com/apache/airflow/issues
|
|
57
|
-
Project-URL: Changelog, https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.
|
|
58
|
-
Project-URL: Documentation, https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.
|
|
60
|
+
Project-URL: Changelog, https://airflow.staged.apache.org/docs/apache-airflow-providers-microsoft-azure/12.8.1/changelog.html
|
|
61
|
+
Project-URL: Documentation, https://airflow.staged.apache.org/docs/apache-airflow-providers-microsoft-azure/12.8.1
|
|
59
62
|
Project-URL: Mastodon, https://fosstodon.org/@airflow
|
|
60
63
|
Project-URL: Slack Chat, https://s.apache.org/airflow-slack
|
|
61
64
|
Project-URL: Source Code, https://github.com/apache/airflow
|
|
@@ -90,7 +93,7 @@ Provides-Extra: sftp
|
|
|
90
93
|
|
|
91
94
|
Package ``apache-airflow-providers-microsoft-azure``
|
|
92
95
|
|
|
93
|
-
Release: ``12.
|
|
96
|
+
Release: ``12.8.1``
|
|
94
97
|
|
|
95
98
|
|
|
96
99
|
`Microsoft Azure <https://azure.microsoft.com/>`__
|
|
@@ -103,7 +106,7 @@ This is a provider package for ``microsoft.azure`` provider. All classes for thi
|
|
|
103
106
|
are in ``airflow.providers.microsoft.azure`` python package.
|
|
104
107
|
|
|
105
108
|
You can find package information and changelog for the provider
|
|
106
|
-
in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.
|
|
109
|
+
in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.8.1/>`_.
|
|
107
110
|
|
|
108
111
|
Installation
|
|
109
112
|
------------
|
|
@@ -117,39 +120,40 @@ The package supports the following python versions: 3.10,3.11,3.12,3.13
|
|
|
117
120
|
Requirements
|
|
118
121
|
------------
|
|
119
122
|
|
|
120
|
-
|
|
121
|
-
PIP package
|
|
122
|
-
|
|
123
|
-
``apache-airflow``
|
|
124
|
-
``
|
|
125
|
-
``
|
|
126
|
-
``azure-
|
|
127
|
-
``azure-
|
|
128
|
-
``azure-
|
|
129
|
-
``azure-
|
|
130
|
-
``azure-
|
|
131
|
-
``azure-
|
|
132
|
-
``azure-mgmt-
|
|
133
|
-
``azure-
|
|
134
|
-
``azure-
|
|
135
|
-
``azure-storage
|
|
136
|
-
``azure-
|
|
137
|
-
``azure-
|
|
138
|
-
``azure-synapse-
|
|
139
|
-
``
|
|
140
|
-
``azure-storage-file-datalake``
|
|
141
|
-
``azure-kusto-data``
|
|
142
|
-
``azure-mgmt-datafactory``
|
|
143
|
-
``azure-mgmt-containerregistry``
|
|
144
|
-
``azure-mgmt-containerinstance``
|
|
145
|
-
``msgraph-core``
|
|
146
|
-
``
|
|
147
|
-
``microsoft-kiota-
|
|
148
|
-
``microsoft-kiota-serialization-
|
|
149
|
-
``microsoft-kiota-
|
|
150
|
-
``microsoft-kiota-
|
|
151
|
-
``
|
|
152
|
-
|
|
123
|
+
========================================== ===========================
|
|
124
|
+
PIP package Version required
|
|
125
|
+
========================================== ===========================
|
|
126
|
+
``apache-airflow`` ``>=2.10.0``
|
|
127
|
+
``apache-airflow-providers-common-compat`` ``>=1.8.0``
|
|
128
|
+
``adlfs`` ``>=2023.10.0``
|
|
129
|
+
``azure-batch`` ``>=8.0.0``
|
|
130
|
+
``azure-cosmos`` ``>=4.6.0``
|
|
131
|
+
``azure-mgmt-cosmosdb`` ``>=3.0.0``
|
|
132
|
+
``azure-datalake-store`` ``>=0.0.45``
|
|
133
|
+
``azure-identity`` ``>=1.3.1``
|
|
134
|
+
``azure-keyvault-secrets`` ``>=4.1.0``
|
|
135
|
+
``azure-mgmt-datalake-store`` ``>=0.5.0``
|
|
136
|
+
``azure-mgmt-resource`` ``>=2.2.0``
|
|
137
|
+
``azure-storage-blob`` ``>=12.26.0``
|
|
138
|
+
``azure-mgmt-storage`` ``>=16.0.0``
|
|
139
|
+
``azure-storage-file-share`` ``>=12.7.0``
|
|
140
|
+
``azure-servicebus`` ``>=7.12.1``
|
|
141
|
+
``azure-synapse-spark`` ``>=0.2.0``
|
|
142
|
+
``azure-synapse-artifacts`` ``>=0.17.0``
|
|
143
|
+
``azure-storage-file-datalake`` ``>=12.9.1``
|
|
144
|
+
``azure-kusto-data`` ``>=4.1.0,!=4.6.0,!=5.0.0``
|
|
145
|
+
``azure-mgmt-datafactory`` ``>=2.0.0``
|
|
146
|
+
``azure-mgmt-containerregistry`` ``>=8.0.0``
|
|
147
|
+
``azure-mgmt-containerinstance`` ``>=10.1.0``
|
|
148
|
+
``msgraph-core`` ``>=1.3.3``
|
|
149
|
+
``msgraphfs`` ``>=0.3.0``
|
|
150
|
+
``microsoft-kiota-http`` ``>=1.9.4,<2.0.0``
|
|
151
|
+
``microsoft-kiota-serialization-json`` ``>=1.9.4``
|
|
152
|
+
``microsoft-kiota-serialization-text`` ``>=1.9.4``
|
|
153
|
+
``microsoft-kiota-abstractions`` ``>=1.9.4,<2.0.0``
|
|
154
|
+
``microsoft-kiota-authentication-azure`` ``>=1.9.4,<2.0.0``
|
|
155
|
+
``msal-extensions`` ``>=1.3.0``
|
|
156
|
+
========================================== ===========================
|
|
153
157
|
|
|
154
158
|
Cross provider package dependencies
|
|
155
159
|
-----------------------------------
|
|
@@ -173,6 +177,18 @@ Dependent package
|
|
|
173
177
|
`apache-airflow-providers-sftp <https://airflow.apache.org/docs/apache-airflow-providers-sftp>`_ ``sftp``
|
|
174
178
|
================================================================================================================== =================
|
|
175
179
|
|
|
180
|
+
Optional dependencies
|
|
181
|
+
----------------------
|
|
182
|
+
|
|
183
|
+
================= ==========================================
|
|
184
|
+
Extra Dependencies
|
|
185
|
+
================= ==========================================
|
|
186
|
+
``amazon`` ``apache-airflow-providers-amazon``
|
|
187
|
+
``common.compat`` ``apache-airflow-providers-common-compat``
|
|
188
|
+
``oracle`` ``apache-airflow-providers-oracle``
|
|
189
|
+
``sftp`` ``apache-airflow-providers-sftp``
|
|
190
|
+
================= ==========================================
|
|
191
|
+
|
|
176
192
|
The changelog for the provider package can be found in the
|
|
177
|
-
`changelog <https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.
|
|
193
|
+
`changelog <https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.8.1/changelog.html>`_.
|
|
178
194
|
|
|
@@ -23,7 +23,7 @@
|
|
|
23
23
|
|
|
24
24
|
Package ``apache-airflow-providers-microsoft-azure``
|
|
25
25
|
|
|
26
|
-
Release: ``12.
|
|
26
|
+
Release: ``12.8.1``
|
|
27
27
|
|
|
28
28
|
|
|
29
29
|
`Microsoft Azure <https://azure.microsoft.com/>`__
|
|
@@ -36,7 +36,7 @@ This is a provider package for ``microsoft.azure`` provider. All classes for thi
|
|
|
36
36
|
are in ``airflow.providers.microsoft.azure`` python package.
|
|
37
37
|
|
|
38
38
|
You can find package information and changelog for the provider
|
|
39
|
-
in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.
|
|
39
|
+
in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.8.1/>`_.
|
|
40
40
|
|
|
41
41
|
Installation
|
|
42
42
|
------------
|
|
@@ -50,39 +50,40 @@ The package supports the following python versions: 3.10,3.11,3.12,3.13
|
|
|
50
50
|
Requirements
|
|
51
51
|
------------
|
|
52
52
|
|
|
53
|
-
|
|
54
|
-
PIP package
|
|
55
|
-
|
|
56
|
-
``apache-airflow``
|
|
57
|
-
``
|
|
58
|
-
``
|
|
59
|
-
``azure-
|
|
60
|
-
``azure-
|
|
61
|
-
``azure-
|
|
62
|
-
``azure-
|
|
63
|
-
``azure-
|
|
64
|
-
``azure-
|
|
65
|
-
``azure-mgmt-
|
|
66
|
-
``azure-
|
|
67
|
-
``azure-
|
|
68
|
-
``azure-storage
|
|
69
|
-
``azure-
|
|
70
|
-
``azure-
|
|
71
|
-
``azure-synapse-
|
|
72
|
-
``
|
|
73
|
-
``azure-storage-file-datalake``
|
|
74
|
-
``azure-kusto-data``
|
|
75
|
-
``azure-mgmt-datafactory``
|
|
76
|
-
``azure-mgmt-containerregistry``
|
|
77
|
-
``azure-mgmt-containerinstance``
|
|
78
|
-
``msgraph-core``
|
|
79
|
-
``
|
|
80
|
-
``microsoft-kiota-
|
|
81
|
-
``microsoft-kiota-serialization-
|
|
82
|
-
``microsoft-kiota-
|
|
83
|
-
``microsoft-kiota-
|
|
84
|
-
``
|
|
85
|
-
|
|
53
|
+
========================================== ===========================
|
|
54
|
+
PIP package Version required
|
|
55
|
+
========================================== ===========================
|
|
56
|
+
``apache-airflow`` ``>=2.10.0``
|
|
57
|
+
``apache-airflow-providers-common-compat`` ``>=1.8.0``
|
|
58
|
+
``adlfs`` ``>=2023.10.0``
|
|
59
|
+
``azure-batch`` ``>=8.0.0``
|
|
60
|
+
``azure-cosmos`` ``>=4.6.0``
|
|
61
|
+
``azure-mgmt-cosmosdb`` ``>=3.0.0``
|
|
62
|
+
``azure-datalake-store`` ``>=0.0.45``
|
|
63
|
+
``azure-identity`` ``>=1.3.1``
|
|
64
|
+
``azure-keyvault-secrets`` ``>=4.1.0``
|
|
65
|
+
``azure-mgmt-datalake-store`` ``>=0.5.0``
|
|
66
|
+
``azure-mgmt-resource`` ``>=2.2.0``
|
|
67
|
+
``azure-storage-blob`` ``>=12.26.0``
|
|
68
|
+
``azure-mgmt-storage`` ``>=16.0.0``
|
|
69
|
+
``azure-storage-file-share`` ``>=12.7.0``
|
|
70
|
+
``azure-servicebus`` ``>=7.12.1``
|
|
71
|
+
``azure-synapse-spark`` ``>=0.2.0``
|
|
72
|
+
``azure-synapse-artifacts`` ``>=0.17.0``
|
|
73
|
+
``azure-storage-file-datalake`` ``>=12.9.1``
|
|
74
|
+
``azure-kusto-data`` ``>=4.1.0,!=4.6.0,!=5.0.0``
|
|
75
|
+
``azure-mgmt-datafactory`` ``>=2.0.0``
|
|
76
|
+
``azure-mgmt-containerregistry`` ``>=8.0.0``
|
|
77
|
+
``azure-mgmt-containerinstance`` ``>=10.1.0``
|
|
78
|
+
``msgraph-core`` ``>=1.3.3``
|
|
79
|
+
``msgraphfs`` ``>=0.3.0``
|
|
80
|
+
``microsoft-kiota-http`` ``>=1.9.4,<2.0.0``
|
|
81
|
+
``microsoft-kiota-serialization-json`` ``>=1.9.4``
|
|
82
|
+
``microsoft-kiota-serialization-text`` ``>=1.9.4``
|
|
83
|
+
``microsoft-kiota-abstractions`` ``>=1.9.4,<2.0.0``
|
|
84
|
+
``microsoft-kiota-authentication-azure`` ``>=1.9.4,<2.0.0``
|
|
85
|
+
``msal-extensions`` ``>=1.3.0``
|
|
86
|
+
========================================== ===========================
|
|
86
87
|
|
|
87
88
|
Cross provider package dependencies
|
|
88
89
|
-----------------------------------
|
|
@@ -106,5 +107,17 @@ Dependent package
|
|
|
106
107
|
`apache-airflow-providers-sftp <https://airflow.apache.org/docs/apache-airflow-providers-sftp>`_ ``sftp``
|
|
107
108
|
================================================================================================================== =================
|
|
108
109
|
|
|
110
|
+
Optional dependencies
|
|
111
|
+
----------------------
|
|
112
|
+
|
|
113
|
+
================= ==========================================
|
|
114
|
+
Extra Dependencies
|
|
115
|
+
================= ==========================================
|
|
116
|
+
``amazon`` ``apache-airflow-providers-amazon``
|
|
117
|
+
``common.compat`` ``apache-airflow-providers-common-compat``
|
|
118
|
+
``oracle`` ``apache-airflow-providers-oracle``
|
|
119
|
+
``sftp`` ``apache-airflow-providers-sftp``
|
|
120
|
+
================= ==========================================
|
|
121
|
+
|
|
109
122
|
The changelog for the provider package can be found in the
|
|
110
|
-
`changelog <https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.
|
|
123
|
+
`changelog <https://airflow.apache.org/docs/apache-airflow-providers-microsoft-azure/12.8.1/changelog.html>`_.
|
|
@@ -27,11 +27,74 @@
|
|
|
27
27
|
Changelog
|
|
28
28
|
---------
|
|
29
29
|
|
|
30
|
-
12.
|
|
30
|
+
12.8.1
|
|
31
|
+
......
|
|
32
|
+
|
|
33
|
+
Misc
|
|
34
|
+
~~~~
|
|
35
|
+
|
|
36
|
+
* ``Convert all airflow distributions to be compliant with ASF requirements (#58138)``
|
|
37
|
+
* ``Remove adal dependency (#57798)``
|
|
38
|
+
|
|
39
|
+
.. Below changes are excluded from the changelog. Move them to
|
|
40
|
+
appropriate section above if needed. Do not delete the lines(!):
|
|
41
|
+
* ``Delete all unnecessary LICENSE Files (#58191)``
|
|
42
|
+
* ``Enable PT006 rule to microsoft Provider test(azure,mssql,psrp) (#57936)``
|
|
43
|
+
* ``Enable PT006 rule to microsoft Provider test(operators) (#57928)``
|
|
44
|
+
* ``Enable PT006 rule to microsoft Provider test(transfers) (#57925)``
|
|
45
|
+
* ``Enable PT006 rule to microsoft Provider test(log,sensors) (#57927)``
|
|
46
|
+
* ``Enable PT006 rule to microsoft Provider test(hooks) (#57932)``
|
|
47
|
+
* ``Fix mypy static errors in main (#57755)``
|
|
48
|
+
* ``Attempt to resolve pip "ResolutionTooDeep" on cffi conflict (#57697)``
|
|
49
|
+
* ``Enable ruff PLW1508 rule (#57653)``
|
|
50
|
+
* ``Fix documentation/provider.yaml consistencies (#57283)``
|
|
51
|
+
|
|
52
|
+
12.8.0
|
|
53
|
+
......
|
|
54
|
+
|
|
55
|
+
Features
|
|
56
|
+
~~~~~~~~
|
|
57
|
+
|
|
58
|
+
* ``Add Microsoft Graph filesystem integration (#55454)``
|
|
59
|
+
* ``update AzureBaseHook to return credentials that supports get_token method" (#56228)``
|
|
60
|
+
|
|
61
|
+
Misc
|
|
62
|
+
~~~~
|
|
63
|
+
|
|
64
|
+
* ``Migrate microsoft providers to ''common.compat'' (#56995)``
|
|
65
|
+
* ``improve exception handling in AzureDataFactoryTrigger (#56350)``
|
|
66
|
+
|
|
67
|
+
Doc-only
|
|
68
|
+
~~~~~~~~
|
|
69
|
+
|
|
70
|
+
* ``Remove placeholder Release Date in changelog and index files (#56056)``
|
|
71
|
+
|
|
72
|
+
.. Below changes are excluded from the changelog. Move them to
|
|
73
|
+
appropriate section above if needed. Do not delete the lines(!):
|
|
74
|
+
* ``Fix Databricks provider import error without fab provider (#56702)``
|
|
75
|
+
* ``Remove 'pytest.importorskip("flask_appbuilder")' from tests (#56679)``
|
|
76
|
+
* ``Revert "update AzureBaseHook to return credentials that supports get_token me…" (#56223)``
|
|
77
|
+
* ``update AzureBaseHook to return credentials that supports get_token method (#52182)``
|
|
78
|
+
* ``Enable PT011 rule to prvoider tests (#56021)``
|
|
79
|
+
|
|
80
|
+
12.7.1
|
|
31
81
|
......
|
|
32
82
|
|
|
33
83
|
|
|
34
|
-
|
|
84
|
+
Bug Fixes
|
|
85
|
+
~~~~~~~~~
|
|
86
|
+
|
|
87
|
+
* ``[OSSTaskHandler, CloudwatchTaskHandler, S3TaskHandler, HdfsTaskHandler, ElasticsearchTaskHandler, GCSTaskHandler, OpensearchTaskHandler, RedisTaskHandler, WasbTaskHandler] supports log file size handling (#55455)``
|
|
88
|
+
* ``Avoid using extra_dejson method on connection in KiotaRequestAdapterHook to avoid AsyncToSync RuntimeError (#55179)``
|
|
89
|
+
|
|
90
|
+
.. Below changes are excluded from the changelog. Move them to
|
|
91
|
+
appropriate section above if needed. Do not delete the lines(!):
|
|
92
|
+
* ``Remove db dependency from test_wasb trigger tests (#55624)``
|
|
93
|
+
* ``Switch all airflow logging to structlog (#52651)``
|
|
94
|
+
|
|
95
|
+
12.7.0
|
|
96
|
+
......
|
|
97
|
+
|
|
35
98
|
|
|
36
99
|
Features
|
|
37
100
|
~~~~~~~~
|
|
@@ -74,6 +74,8 @@ Extra (optional)
|
|
|
74
74
|
It specifies the json that contains the authentication information.
|
|
75
75
|
* ``managed_identity_client_id``: The client ID of a user-assigned managed identity. If provided with ``workload_identity_tenant_id``, they'll pass to DefaultAzureCredential_.
|
|
76
76
|
* ``workload_identity_tenant_id``: ID of the application's Microsoft Entra tenant. Also called its "directory" ID. If provided with ``managed_identity_client_id``, they'll pass to DefaultAzureCredential_.
|
|
77
|
+
* ``use_azure_identity_object``: If set to true, it will use credential of newer type: ClientSecretCredential or DefaultAzureCredential instead of ServicePrincipalCredentials or AzureIdentityCredentialAdapter.
|
|
78
|
+
These newer credentials support get_token method which can be used to generate OAuth token with custom scope.
|
|
77
79
|
|
|
78
80
|
The entire extra column can be left out to fall back on DefaultAzureCredential_.
|
|
79
81
|
|
|
@@ -0,0 +1,26 @@
|
|
|
1
|
+
.. Licensed to the Apache Software Foundation (ASF) under one
|
|
2
|
+
or more contributor license agreements. See the NOTICE file
|
|
3
|
+
distributed with this work for additional information
|
|
4
|
+
regarding copyright ownership. The ASF licenses this file
|
|
5
|
+
to you under the Apache License, Version 2.0 (the
|
|
6
|
+
"License"); you may not use this file except in compliance
|
|
7
|
+
with the License. You may obtain a copy of the License at
|
|
8
|
+
|
|
9
|
+
.. http://www.apache.org/licenses/LICENSE-2.0
|
|
10
|
+
|
|
11
|
+
.. Unless required by applicable law or agreed to in writing,
|
|
12
|
+
software distributed under the License is distributed on an
|
|
13
|
+
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
|
14
|
+
KIND, either express or implied. See the License for the
|
|
15
|
+
specific language governing permissions and limitations
|
|
16
|
+
under the License.
|
|
17
|
+
|
|
18
|
+
Filesystems
|
|
19
|
+
===========
|
|
20
|
+
|
|
21
|
+
.. toctree::
|
|
22
|
+
:maxdepth: 1
|
|
23
|
+
:caption: Filesystem Providers
|
|
24
|
+
:glob:
|
|
25
|
+
|
|
26
|
+
*
|
|
@@ -0,0 +1,187 @@
|
|
|
1
|
+
.. Licensed to the Apache Software Foundation (ASF) under one
|
|
2
|
+
or more contributor license agreements. See the NOTICE file
|
|
3
|
+
distributed with this work for additional information
|
|
4
|
+
regarding copyright ownership. The ASF licenses this file
|
|
5
|
+
to you under the Apache License, Version 2.0 (the
|
|
6
|
+
"License"); you may not use this file except in compliance
|
|
7
|
+
with the License. You may obtain a copy of the License at
|
|
8
|
+
|
|
9
|
+
.. http://www.apache.org/licenses/LICENSE-2.0
|
|
10
|
+
|
|
11
|
+
.. Unless required by applicable law or agreed to in writing,
|
|
12
|
+
software distributed under the License is distributed on an
|
|
13
|
+
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
|
|
14
|
+
KIND, either express or implied. See the License for the
|
|
15
|
+
specific language governing permissions and limitations
|
|
16
|
+
under the License.
|
|
17
|
+
|
|
18
|
+
Microsoft Graph Filesystem
|
|
19
|
+
===========================
|
|
20
|
+
|
|
21
|
+
The Microsoft Graph filesystem provides access to OneDrive, SharePoint, and Teams document libraries through Airflow's ObjectStoragePath interface.
|
|
22
|
+
|
|
23
|
+
Supported URL formats:
|
|
24
|
+
|
|
25
|
+
* ``msgraph://connection_id/drive_id/path/to/file``
|
|
26
|
+
* ``sharepoint://connection_id/drive_id/path/to/file``
|
|
27
|
+
* ``onedrive://connection_id/drive_id/path/to/file``
|
|
28
|
+
* ``msgd://connection_id/drive_id/path/to/file``
|
|
29
|
+
|
|
30
|
+
Connection Configuration
|
|
31
|
+
------------------------
|
|
32
|
+
|
|
33
|
+
Create a Microsoft Graph connection in Airflow with the following parameters:
|
|
34
|
+
|
|
35
|
+
* **Connection Type**: msgraph
|
|
36
|
+
* **Host**: Tenant ID
|
|
37
|
+
* **Login**: Client ID
|
|
38
|
+
* **Password**: Client Secret
|
|
39
|
+
|
|
40
|
+
The connection form provides additional configuration fields:
|
|
41
|
+
|
|
42
|
+
* **Tenant ID**: Azure AD tenant identifier
|
|
43
|
+
* **Drive ID**: Specific drive to access (optional - leave empty for general access)
|
|
44
|
+
* **Scopes**: OAuth2 scopes (default: https://graph.microsoft.com/.default)
|
|
45
|
+
|
|
46
|
+
Additional OAuth2 parameters supported via connection extras:
|
|
47
|
+
|
|
48
|
+
* **scope**: OAuth2 access scope
|
|
49
|
+
* **token_endpoint**: Custom token endpoint URL
|
|
50
|
+
* **redirect_uri**: OAuth2 redirect URI for authorization code flow
|
|
51
|
+
* **token_endpoint_auth_method**: Client authentication method (default: client_secret_basic)
|
|
52
|
+
* **code_challenge_method**: PKCE code challenge method (e.g., 'S256')
|
|
53
|
+
* **username**: Username for password grant flow
|
|
54
|
+
* **password**: Password for password grant flow
|
|
55
|
+
|
|
56
|
+
Connection extra field configuration example:
|
|
57
|
+
|
|
58
|
+
.. code-block:: json
|
|
59
|
+
|
|
60
|
+
{
|
|
61
|
+
"drive_id": "b!abc123...",
|
|
62
|
+
"scope": "https://graph.microsoft.com/.default",
|
|
63
|
+
"token_endpoint": "https://login.microsoftonline.com/your-tenant/oauth2/v2.0/token",
|
|
64
|
+
"redirect_uri": "http://localhost:8080/callback",
|
|
65
|
+
"token_endpoint_auth_method": "client_secret_post"
|
|
66
|
+
}
|
|
67
|
+
|
|
68
|
+
Usage Examples
|
|
69
|
+
--------------
|
|
70
|
+
|
|
71
|
+
Reading Files
|
|
72
|
+
^^^^^^^^^^^^^
|
|
73
|
+
|
|
74
|
+
.. code-block:: python
|
|
75
|
+
|
|
76
|
+
from airflow.sdk.io.path import ObjectStoragePath
|
|
77
|
+
|
|
78
|
+
# Access a file in OneDrive
|
|
79
|
+
path = ObjectStoragePath("onedrive://my_conn/drive123/Documents/data.csv")
|
|
80
|
+
|
|
81
|
+
# Read file content
|
|
82
|
+
with path.open("r") as f:
|
|
83
|
+
content = f.read()
|
|
84
|
+
|
|
85
|
+
Directory Operations
|
|
86
|
+
^^^^^^^^^^^^^^^^^^^^
|
|
87
|
+
|
|
88
|
+
.. code-block:: python
|
|
89
|
+
|
|
90
|
+
# List directory contents in SharePoint
|
|
91
|
+
sharepoint_path = ObjectStoragePath("sharepoint://sp_conn/site_drive/Shared Documents/")
|
|
92
|
+
|
|
93
|
+
for item in sharepoint_path.iterdir():
|
|
94
|
+
print(f"Found: {item.name}")
|
|
95
|
+
if item.is_file():
|
|
96
|
+
print(f" Size: {item.stat().st_size} bytes")
|
|
97
|
+
|
|
98
|
+
File Operations
|
|
99
|
+
^^^^^^^^^^^^^^^
|
|
100
|
+
|
|
101
|
+
.. code-block:: python
|
|
102
|
+
|
|
103
|
+
# Copy file between drives
|
|
104
|
+
source = ObjectStoragePath("msgraph://conn1/drive1/source.txt")
|
|
105
|
+
target = ObjectStoragePath("msgraph://conn2/drive2/backup/source.txt")
|
|
106
|
+
source.copy(target)
|
|
107
|
+
|
|
108
|
+
# Move file
|
|
109
|
+
old_path = ObjectStoragePath("onedrive://conn/drive/temp/file.txt")
|
|
110
|
+
new_path = ObjectStoragePath("onedrive://conn/drive/archive/file.txt")
|
|
111
|
+
old_path.move(new_path)
|
|
112
|
+
|
|
113
|
+
# Delete file
|
|
114
|
+
file_to_delete = ObjectStoragePath("msgraph://conn/drive/old_data.csv")
|
|
115
|
+
file_to_delete.unlink()
|
|
116
|
+
|
|
117
|
+
Writing Files
|
|
118
|
+
^^^^^^^^^^^^^
|
|
119
|
+
|
|
120
|
+
.. code-block:: python
|
|
121
|
+
|
|
122
|
+
# Write new file
|
|
123
|
+
output_path = ObjectStoragePath("sharepoint://sp_conn/docs/reports/report.txt")
|
|
124
|
+
|
|
125
|
+
with output_path.open("w") as f:
|
|
126
|
+
f.write("Generated report data\n")
|
|
127
|
+
f.write(f"Created at: {datetime.now()}\n")
|
|
128
|
+
|
|
129
|
+
Drive Discovery
|
|
130
|
+
^^^^^^^^^^^^^^^
|
|
131
|
+
|
|
132
|
+
When you need to find the correct drive ID for your URLs, you can use the Microsoft Graph API operators:
|
|
133
|
+
|
|
134
|
+
.. code-block:: python
|
|
135
|
+
|
|
136
|
+
from airflow.providers.microsoft.azure.operators.msgraph import MSGraphAsyncOperator
|
|
137
|
+
|
|
138
|
+
# List all drives for a user
|
|
139
|
+
list_drives = MSGraphAsyncOperator(
|
|
140
|
+
task_id="list_drives",
|
|
141
|
+
conn_id="msgraph_conn",
|
|
142
|
+
url="me/drives",
|
|
143
|
+
result_processor=lambda response: [
|
|
144
|
+
{"id": drive["id"], "name": drive["name"]} for drive in response["value"]
|
|
145
|
+
],
|
|
146
|
+
)
|
|
147
|
+
|
|
148
|
+
URL Scheme Mapping
|
|
149
|
+
------------------
|
|
150
|
+
|
|
151
|
+
The different URL schemes map to specific Microsoft Graph endpoints:
|
|
152
|
+
|
|
153
|
+
* ``msgraph://`` - General Microsoft Graph access
|
|
154
|
+
* ``onedrive://`` - OneDrive personal and business drives
|
|
155
|
+
* ``sharepoint://`` - SharePoint document libraries
|
|
156
|
+
* ``msgd://`` - Shortened form of msgraph://
|
|
157
|
+
|
|
158
|
+
All schemes use the same underlying Microsoft Graph API and authentication.
|
|
159
|
+
|
|
160
|
+
Requirements
|
|
161
|
+
------------
|
|
162
|
+
|
|
163
|
+
The Microsoft Graph filesystem requires:
|
|
164
|
+
|
|
165
|
+
* ``msgraphfs`` Python package
|
|
166
|
+
* Valid Azure AD application registration with appropriate permissions
|
|
167
|
+
* Microsoft Graph API access for your tenant
|
|
168
|
+
|
|
169
|
+
Required Microsoft Graph permissions:
|
|
170
|
+
|
|
171
|
+
* ``Files.Read`` - To read files
|
|
172
|
+
* ``Files.ReadWrite`` - To read and write files
|
|
173
|
+
* ``Sites.Read.All`` - To access SharePoint sites (if using ``sharepoint://`` URLs)
|
|
174
|
+
|
|
175
|
+
Cross-References
|
|
176
|
+
----------------
|
|
177
|
+
|
|
178
|
+
* :doc:`Microsoft Graph API Operators </operators/msgraph>` - For API operations and drive discovery
|
|
179
|
+
|
|
180
|
+
Reference
|
|
181
|
+
---------
|
|
182
|
+
|
|
183
|
+
For further information, look at:
|
|
184
|
+
|
|
185
|
+
* `Microsoft Graph Files API <https://learn.microsoft.com/en-us/graph/api/resources/onedrive>`__
|
|
186
|
+
* `msgraphfs Python package <https://pypi.org/project/msgraphfs/>`__
|
|
187
|
+
* `Use the Microsoft Graph API <https://learn.microsoft.com/en-us/graph/use-the-api/>`__
|