semantic-link-labs 0.8.0__py3-none-any.whl → 0.8.2__py3-none-any.whl

{semantic_link_labs-0.8.0.dist-info → semantic_link_labs-0.8.2.dist-info}/METADATA

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: semantic-link-labs
-Version: 0.8.0
+Version: 0.8.2
 Summary: Semantic Link Labs for Microsoft Fabric
 Author: Microsoft Corporation
 License: MIT License
@@ -27,7 +27,7 @@ Requires-Dist: pytest >=8.2.1 ; extra == 'test'
 # Semantic Link Labs
 
 [![PyPI version](https://badge.fury.io/py/semantic-link-labs.svg)](https://badge.fury.io/py/semantic-link-labs)
-[![Read The Docs](https://readthedocs.org/projects/semantic-link-labs/badge/?version=0.8.0&style=flat)](https://readthedocs.org/projects/semantic-link-labs/)
+[![Read The Docs](https://readthedocs.org/projects/semantic-link-labs/badge/?version=0.8.2&style=flat)](https://readthedocs.org/projects/semantic-link-labs/)
 [![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black)
 [![Downloads](https://static.pepy.tech/badge/semantic-link-labs)](https://pepy.tech/project/semantic-link-labs)
 
@@ -35,9 +35,31 @@ Requires-Dist: pytest >=8.2.1 ; extra == 'test'
 [Read the documentation on ReadTheDocs!](https://semantic-link-labs.readthedocs.io/en/stable/)
 ---
 
-This is a python library intended to be used in [Microsoft Fabric notebooks](https://learn.microsoft.com/fabric/data-engineering/how-to-use-notebook). This library was originally intended to solely contain functions used for [migrating semantic models to Direct Lake mode](https://github.com/microsoft/semantic-link-labs?tab=readme-ov-file#direct-lake-migration). However, it quickly became apparent that functions within such a library could support many other useful activities in the realm of semantic models, reports, lakehouses and really anything Fabric-related. As such, this library contains a variety of functions ranging from running [Vertipaq Analyzer](https://semantic-link-labs.readthedocs.io/en/stable/sempy_labs.html#sempy_labs.import_vertipaq_analyzer) or the [Best Practice Analyzer](https://semantic-link-labs.readthedocs.io/en/stable/sempy_labs.html#sempy_labs.run_model_bpa) against a semantic model to seeing if any [lakehouse tables hit Direct Lake guardrails](https://semantic-link-labs.readthedocs.io/en/stable/sempy_labs.lakehouse.html#sempy_labs.lakehouse.get_lakehouse_tables) or accessing the [Tabular Object Model](https://semantic-link-labs.readthedocs.io/en/stable/sempy_labs.tom.html) and more!
-
-Instructions for migrating import/DirectQuery semantic models to Direct Lake mode can be found [here](https://github.com/microsoft/semantic-link-labs?tab=readme-ov-file#direct-lake-migration).
+Semantic Link Labs is a Python library designed for use in [Microsoft Fabric notebooks](https://learn.microsoft.com/fabric/data-engineering/how-to-use-notebook). This library extends the capabilities of [Semantic Link](https://learn.microsoft.com/fabric/data-science/semantic-link-overview) offering additional functionalities to seamlessly integrate and work alongside it. The goal of Semantic Link Labs is to simplify technical processes, empowering people to focus on higher level activities and allowing tasks that are better suited for machines to be efficiently handled without human intervention.
+
+## Featured Scenarios
+* Semantic Models
+    * [Migrating an import/DirectQuery semantic model to Direct Lake](https://github.com/microsoft/semantic-link-labs?tab=readme-ov-file#direct-lake-migration)
+    * [Model Best Practice Analyzer (BPA)](https://semantic-link-labs.readthedocs.io/en/stable/sempy_labs.html#sempy_labs.run_model_bpa)
+    * [Vertipaq Analyzer](https://semantic-link-labs.readthedocs.io/en/stable/sempy_labs.html#sempy_labs.vertipaq_analyzer)
+    * [Tabular Object Model](https://github.com/microsoft/semantic-link-labs/blob/main/notebooks/Tabular%20Object%20Model.ipynb) [(TOM)](https://semantic-link-labs.readthedocs.io/en/stable/sempy_labs.tom.html)
+    * [Translate a semantic model's metadata](https://semantic-link-labs.readthedocs.io/en/stable/sempy_labs.html#sempy_labs.translate_semantic_model)
+    * [Check Direct Lake Guardrails](https://semantic-link-labs.readthedocs.io/en/stable/sempy_labs.lakehouse.html#sempy_labs.lakehouse.get_lakehouse_tables)
+    * [Refresh](https://github.com/microsoft/semantic-link-labs/blob/main/notebooks/Semantic%20Model%20Refresh.ipynb), [clear cache](https://semantic-link-labs.readthedocs.io/en/stable/sempy_labs.html#sempy_labs.clear_cache), [backup](https://semantic-link-labs.readthedocs.io/en/stable/sempy_labs.html#sempy_labs.backup_semantic_model), [restore](https://semantic-link-labs.readthedocs.io/en/stable/sempy_labs.html#sempy_labs.restore_semantic_model), [copy backup files](https://semantic-link-labs.readthedocs.io/en/stable/sempy_labs.html#sempy_labs.copy_semantic_model_backup_file), [move/deploy across workspaces](https://semantic-link-labs.readthedocs.io/en/stable/sempy_labs.html#sempy_labs.deploy_semantic_model)
+    * [Run DAX queries which impersonate a user](https://semantic-link-labs.readthedocs.io/en/stable/sempy_labs.html#sempy_labs.evaluate_dax_impersonation)
+* Reports
+    * [Report Best Practice Analyzer (BPA)](https://semantic-link-labs.readthedocs.io/en/stable/sempy_labs.report.html#sempy_labs.report.run_report_bpa)
+    * [View report metadata](https://github.com/microsoft/semantic-link-labs/blob/main/notebooks/Report%20Analysis.ipynb)
+    * [View semantic model objects most frequently used in Power BI reports](https://semantic-link-labs.readthedocs.io/en/stable/sempy_labs.html#sempy_labs.list_semantic_model_object_report_usage)
+    * [View broken reports](https://semantic-link-labs.readthedocs.io/en/stable/sempy_labs.html#sempy_labs.list_report_semantic_model_objects)
+    * [Rebind reports](https://semantic-link-labs.readthedocs.io/en/stable/sempy_labs.report.html#sempy_labs.report.report_rebind)
+* Capacities
+    * [Migrating a Power BI Premium capacity (P sku) to a Fabric capacity (F sku)](https://github.com/microsoft/semantic-link-labs/blob/main/notebooks/Capacity%20Migration.ipynb)
+* APIs
+    * Wrapper functions for [Power BI](https://learn.microsoft.com/rest/api/power-bi/), [Fabric](https://learn.microsoft.com/rest/api/fabric/articles/using-fabric-apis), and [Azure](https://learn.microsoft.com/rest/api/azure/?view=rest-power-bi-embedded-2021-01-01) APIs
+
+
+### Check out the [helper notebooks](https://github.com/microsoft/semantic-link-labs/tree/main/notebooks) for getting started!
 
 If you encounter any issues, please [raise a bug](https://github.com/microsoft/semantic-link-labs/issues/new?assignees=&labels=&projects=&template=bug_report.md&title=).
 
@@ -81,7 +103,9 @@ An even better way to ensure the semantic-link-labs library is available in your
 2. Select your newly created environment within the 'Environment' drop down in the navigation bar at the top of the notebook
 
 ## Version History
-* [0.8.0](https://github.com/microsoft/semantic-link-labs/releases/tag/0.8.0) (September 24, 2024)
+* [0.8.2](https://github.com/microsoft/semantic-link-labs/releases/tag/0.8.2) (October 2, 2024)
+* [0.8.1](https://github.com/microsoft/semantic-link-labs/releases/tag/0.8.1) (October 2, 2024)
+* [0.8.0](https://github.com/microsoft/semantic-link-labs/releases/tag/0.8.0) (September 25, 2024)
 * [0.7.4](https://github.com/microsoft/semantic-link-labs/releases/tag/0.7.4) (September 16, 2024)
 * [0.7.3](https://github.com/microsoft/semantic-link-labs/releases/tag/0.7.3) (September 11, 2024)
 * [0.7.2](https://github.com/microsoft/semantic-link-labs/releases/tag/0.7.2) (August 30, 2024)
@@ -128,7 +152,7 @@ Check out my [blog post](https://www.elegantbi.com/post/direct-lake-migration) o
 5. Back in the notebook, the next step will create your new Direct Lake semantic model with the name of your choice, taking all the relevant properties from the orignal semantic model and refreshing/framing your new semantic model.
 
 > [!NOTE]
-> As of version 0.2.1, calculated tables are also migrated to Direct Lake (as data tables with their DAX expression stored as model annotations in the new semantic model). Additionally, Field Parameters are migrated as they were in the original semantic model (as a calculated table).
+> Calculated tables are also migrated to Direct Lake (as data tables with their DAX expression stored as model annotations in the new semantic model). Additionally, Field Parameters are migrated as they were in the original semantic model (as a calculated table). [Auto date/time tables](https://learn.microsoft.com/power-bi/guidance/auto-date-time) are not migrated. Auto date/time must be disabled in Power BI Desktop and proper date table(s) must be created prior to migration.
 
 6. Finally, you can easily rebind your all reports which use the import/DQ semantic model to the new Direct Lake semantic model in one click.
 
@@ -141,6 +165,14 @@ Check out my [blog post](https://www.elegantbi.com/post/direct-lake-migration) o
 * Non-supported objects are not transferred (i.e. calculated columns, relationships using columns with unsupported data types etc.).
 * Reports used by your original semantic model will be rebinded to your new semantic model.
 
+### Limitations
+* Calculated columns are not migrated.
+* Auto date/time tables are not migrated.
+* References to calculated columns in Field Parameters are removed.
+* References to calculated columns in measure expressions or other DAX expressions will break.
+* Calculated tables are migrated as possible. The success of this migration depends on the interdependencies and complexity of the calculated table. This part of the migration is a workaround as technically calculated tables are not supported in Direct Lake.
+* See [here](https://learn.microsoft.com/fabric/get-started/direct-lake-overview#considerations-and-limitations) for the rest of the limitations of Direct Lake.
+
 ## Contributing
 
 This project welcomes contributions and suggestions.  Most contributions require you to agree to a

{semantic_link_labs-0.8.0.dist-info → semantic_link_labs-0.8.2.dist-info}/RECORD

@@ -1,33 +1,43 @@
-sempy_labs/__init__.py,sha256=YDYIiHI4wCOL_2iC-VPO6NOCchdulTKwjkb6b8-qrqE,9538
-sempy_labs/_ai.py,sha256=CjlFebT35Rzbw90BmsDy7PjLiAZMZ-B7wZ_EoI444bw,16271
+sempy_labs/__init__.py,sha256=rX6aU2I1Y30fOXJs2xNTvep8Hni5s3J67TT9MCDLpcw,9957
+sempy_labs/_ai.py,sha256=CzsNw6Wpd2B5Rd0RcY250-_p0L-0gFoMNLEc_KmrobU,16177
 sempy_labs/_capacities.py,sha256=X39LHYde3rgwW8vTbNUMt2S9dekTfy6sqQGXg-MCybY,20132
-sempy_labs/_capacity_migration.py,sha256=0m_yXrdQ1F5tAFsPJ5RXC_6LzAxpxgMQs8IwqPggXZ8,23632
+sempy_labs/_capacity_migration.py,sha256=tVrIT4sSWKQg-6AqjrvGQPIBGHTcMtPqdymUnEJKVbs,23612
 sempy_labs/_clear_cache.py,sha256=JgY4Nio7Zy9YHOPxQseiZ5lJLWEi5s3Qn5SLSvuyBwo,12490
 sempy_labs/_connections.py,sha256=w1NeC9auc07ko2pY3m5vM_9-sgW_chw1OxPzDviVC5k,12179
+sempy_labs/_data_pipelines.py,sha256=gSmlkBpse0bodNfcfmS45_LKLtiv98nIqxbH70nSo-I,3590
 sempy_labs/_dataflows.py,sha256=ApGMklXMQZQssYa7egxlBtsYz5mcR3JS69ZgeORXVBM,4051
 sempy_labs/_dax.py,sha256=dt1GgHceyM7f6phRBPxRKnmQy_KYKpcgFQHuOjGbpLo,2029
 sempy_labs/_deployment_pipelines.py,sha256=-wjqQieR25BR-0r2QfTzg4QuFzOgcayZLnS-fNYIPPU,5347
+sempy_labs/_documentation.py,sha256=yVA8VPEzx_fmljtcvSxtB7-BeupYsfdMXXjp6Fpnyo8,5007
 sempy_labs/_environments.py,sha256=oyfEeOLX5XPevumj4Il5t1z2gmsR8xm6pg1wfGoutMc,4821
-sempy_labs/_generate_semantic_model.py,sha256=j6cwxwjMZcYdu6jlvROY_tVk20LxNiD6roV0bM6fE-I,13283
-sempy_labs/_git.py,sha256=vV8ho0Q9e4BRaNY9XXaIUlNDQlTzmqsHbj3YGYBtoXU,12695
-sempy_labs/_helper_functions.py,sha256=Cd0ArhAeX3BVT08z3N7h_oBq2aVcM_w-9_bEPaLdgaI,30505
-sempy_labs/_icons.py,sha256=8Hq8ZcqXn0S_DIFhFCr_w2ThRM3s6isBikdZ7xYDWK4,2241
-sempy_labs/_list_functions.py,sha256=qx-IVPHhlNNk4ZJ61BNJtJlatChoao_Jjup8EIegofU,68074
-sempy_labs/_model_auto_build.py,sha256=fX3bCLFCOMQHuheKIoB48fUABG7XAT7qqsMbUiWSrY0,5071
-sempy_labs/_model_bpa.py,sha256=pfrD1OUsiJGWLG41U4zBPybqo_87nf6igurYJY2Sdd0,20437
-sempy_labs/_model_bpa_bulk.py,sha256=SUps0bHJnRjLCrqUJoblfGjrJ-8YdgdD8-RgWJyXrP0,15053
+sempy_labs/_eventhouses.py,sha256=tVUYJkAcwoBZooXawJpCKzx2YypawKECrfKouRTkMJU,3537
+sempy_labs/_eventstreams.py,sha256=NV0YAC6V3nBxJIVKWH7ceAtooZoH9rA4zv45xTcb-t0,3556
+sempy_labs/_generate_semantic_model.py,sha256=mvM1DDWEkyfU8Ee4NT9Zu52qZyCnmq0971esIjp_LpQ,13253
+sempy_labs/_git.py,sha256=vXWv6e45H0OGIyzBvB-anSJYrBFjA2MVUYIjaUPd54I,12731
+sempy_labs/_helper_functions.py,sha256=7mTpsTZpW0M3lGIReSuGIgntnb_wcQr2Jm6FolxRClI,32310
+sempy_labs/_icons.py,sha256=pwei9IrwbNAxmxCNgX_8cACwjhvmM6cYYZcS3sLR9jc,2696
+sempy_labs/_kql_databases.py,sha256=DE_5un0QO5ayYiqKiMDinis0ZysmIWWaEoYQ9ach_8o,4110
+sempy_labs/_kql_querysets.py,sha256=kH8diN3DxuCINlKhAvzyXKXtj0uJ0uhcxrWI9j097vU,3646
+sempy_labs/_list_functions.py,sha256=jBdLo_8gnNk1nQdTlGvRbC_PMdyctxGnLQXwkDFNMcE,55255
+sempy_labs/_mirrored_warehouses.py,sha256=xcVnrNwi46snQiS5iFKcZe-GGoFLqva7qW4iOPUD7Y8,1577
+sempy_labs/_ml_experiments.py,sha256=fTqFB0qn0T1k4vGmaghvKUolb5Kvg_qfTOYl3ABknt8,3676
+sempy_labs/_ml_models.py,sha256=nAISwah2fQI0OOJfBAEuI7d4uKu4DUIHi4BqUye6FQE,3572
+sempy_labs/_model_auto_build.py,sha256=-qDwmFx3KMuIaaUU8CzmCX7CF7ZUVWWu-_GH2UhAU_8,5045
+sempy_labs/_model_bpa.py,sha256=ow2UiiTGF_9nAldQxLdR4wmVrExXMYurhOVxu9pOFBQ,20377
+sempy_labs/_model_bpa_bulk.py,sha256=35M6FnHP6T-3rkwUHOeL6BRj-aKL7lRxpPvJKnj8wwU,14944
 sempy_labs/_model_bpa_rules.py,sha256=B8hg3_ktS5ql859nL3e9kdV8fNDBgMNO5j2hGrXp6po,44855
-sempy_labs/_model_dependencies.py,sha256=nZdqq2iMhZejnS_LCd2rpK6r1B7jWpa3URkxobRPifY,12986
-sempy_labs/_notebooks.py,sha256=5d7YBV5UGHMjJ-OlhqKFBsbCYLK8kU8cZe-oMM5vsCA,4604
+sempy_labs/_model_dependencies.py,sha256=rFPVDA6gLKxy2rDPtHHIvVJF9SmJz4xRe4n922bzWtA,13452
+sempy_labs/_notebooks.py,sha256=K1ZZ9y-lOzDLeJ2UlCmJlN7kml5FRPmE0Bj5SvNDwq8,4339
 sempy_labs/_one_lake_integration.py,sha256=eIuLxlw8eXfUH2avKhsyLmXZbTllSwGsz2j_HMAikpQ,6234
-sempy_labs/_query_scale_out.py,sha256=g9JKdegaAY9DqgR5-LFV88DF90KGni79P8o-4rqFFDc,15273
-sempy_labs/_refresh_semantic_model.py,sha256=2qzP9KqmwA20RuL1o6Lt9bIjC-KtdX8ZgcTvJParg-w,7157
-sempy_labs/_spark.py,sha256=rYOkAI9J3nAnGf5dZj1GMqTYU_-_KuySesSMEI1fWuk,20343
+sempy_labs/_query_scale_out.py,sha256=Wk6vxyI6x1xFV30UpEwvzlD0TnentpKOO-8mEVLc7zE,15253
+sempy_labs/_refresh_semantic_model.py,sha256=Kb3sZf9ihBcbh2la6c7wuAhUvGnqrlNR2obAdNJNz98,6920
+sempy_labs/_spark.py,sha256=_gkmitnGIf0Q_wKDHcnkmGSyE6GtPgsi2QnudLcBWKU,19477
 sempy_labs/_sql.py,sha256=p0CvDD3fF0IQdoFI6308-DDUFQR9V_qWpXfQvyX3znw,5356
 sempy_labs/_translations.py,sha256=ocRtdgymcPYOT3jiYcVv9ze5i2gDjgLcTJBEl66pKtg,19771
-sempy_labs/_vertipaq.py,sha256=3tdjnvXSKlrd9ULqzjTQdgjNkuizgFYWVBrM65qr1AY,35845
+sempy_labs/_vertipaq.py,sha256=txae-LoCE8K8Z7lVmlC7FgIS6vVxwLtKhGcnU28ZuBk,35738
+sempy_labs/_warehouses.py,sha256=qIDteSE5dFm0rkzF3Ouryb467VKxrHywNSSvtf_TcXM,3920
 sempy_labs/_workspace_identity.py,sha256=2uum6Ojv1x3Zzp8JEAQ2ER9J5yafb_v_TgZwY5vdBwA,2120
-sempy_labs/_workspaces.py,sha256=w_6sImSwZRun-aTwwlLNEBC0rQIjCWZ51VWs90mxge4,10105
+sempy_labs/_workspaces.py,sha256=KZfQ1hAKhfIsq52ZF-RBptueWUh6-P-OA8YDfmSQbpM,10080
 sempy_labs/_bpa_translation/_model/_translations_am-ET.po,sha256=ve23guQ48HXXn2_yGicUtr_Orhi9nth_lna8-x93GjA,37928
 sempy_labs/_bpa_translation/_model/_translations_ar-AE.po,sha256=YtJzrUXQesme9D-m9JUGw4q7RSYfyXF25FH7PwDWcFI,35787
 sempy_labs/_bpa_translation/_model/_translations_bg-BG.po,sha256=bvX36ZCeHGYiiZjDTzGz1kSxR89u05ZwuGPoIl9olX8,42546
@@ -67,29 +77,29 @@ sempy_labs/_bpa_translation/_model/_translations_uk-UA.po,sha256=t7kpMB65cOKNIg8
 sempy_labs/_bpa_translation/_model/_translations_zh-CN.po,sha256=QhmS3HSnILLN-OgMUGmNFvGr4TEhoH1FKL0F1SgU2nk,26035
 sempy_labs/_bpa_translation/_model/_translations_zu-ZA.po,sha256=0ZivJJa-ggc7PJqLAgDmi8OGGUGzEcleGPmlLL9YYb4,30495
 sempy_labs/admin/__init__.py,sha256=whrBFHvjWav0ni_LOYJ4Q63WtiJEPOQ1etudl2wiWKA,1445
-sempy_labs/admin/_basic_functions.py,sha256=7nnOU9FMlk2WoqySNb25v3A4TvvHM-SAyBJVL63OXv4,26643
-sempy_labs/admin/_domains.py,sha256=OgV0TC3a7sXKDX7RSVrzWh3KAWonGyr8FpuaGtiDq8Y,11701
+sempy_labs/admin/_basic_functions.py,sha256=2gFJ9XSU3Bm-IpBYk9vUDqnCCkWicRcNGjF6qP4ds6w,29229
+sempy_labs/admin/_domains.py,sha256=ByDqLsm1eDPnTr93yuVsPnhEQLGerWWwWk4_rAlRD1M,11691
 sempy_labs/directlake/__init__.py,sha256=ZlpQQDdA5-C10zSf9YICH0waMIFM-55aacsEzvpuHEM,2047
 sempy_labs/directlake/_directlake_schema_compare.py,sha256=ocHFU6E6HSKgcNLywGM0dx0ie9AXYwk-E7o7EYcqiN4,4422
-sempy_labs/directlake/_directlake_schema_sync.py,sha256=BxOB0SvDEa9pHAUD2jF1xZKE_BzPkkptQU2Q1SxYTkE,4329
-sempy_labs/directlake/_dl_helper.py,sha256=jQtrsNrhJcjKJReX0J5lHk7cswb0S5HtikBjs8Vg2D4,8575
+sempy_labs/directlake/_directlake_schema_sync.py,sha256=I2SohqatMPDY8WXinAYP5QrVZ2wIaE4xsP-fVbTyAHE,4319
+sempy_labs/directlake/_dl_helper.py,sha256=K4IN37gA_aRaFjpUT6hN1ExBMOR04_be2RSOtHh7k0Y,9260
 sempy_labs/directlake/_generate_shared_expression.py,sha256=ayMkgmlmFzDTYrqbXGm5C3w05YDkI4SYnyi1eaIo9Vs,3087
 sempy_labs/directlake/_get_directlake_lakehouse.py,sha256=sovI4ds2SEgkp4Fi465jtJ4seRvQxdYgcixRDvsUwNM,2321
 sempy_labs/directlake/_get_shared_expression.py,sha256=Xl2_GYqRll95cN7JjwLlULbcRXM71Ij9JkrYAp7cNJM,1943
-sempy_labs/directlake/_guardrails.py,sha256=0zqqkEDk02_jb4MzWJCKRNcDtfPGBcWUcxuQcDbgWns,2390
+sempy_labs/directlake/_guardrails.py,sha256=20l2f2jeIJ2-z2H64Vi2n1e8cjMuideXSbBT9OYQ3kE,2500
 sempy_labs/directlake/_list_directlake_model_calc_tables.py,sha256=_rpnbgsFAz2W16PpgIOB0Rj_Fs1ZKrDbz3DUaaR_bfU,2143
 sempy_labs/directlake/_show_unsupported_directlake_objects.py,sha256=-8werbzIi_xknMkymIsq-JwNTAvt0W18xA4HagXhT8U,3332
 sempy_labs/directlake/_update_directlake_model_lakehouse_connection.py,sha256=LpxYPxF_rkLD2okyKejLIV-qA8UeJ9xRWyv32kNdR_c,2822
-sempy_labs/directlake/_update_directlake_partition_entity.py,sha256=Pbx7LCdKyqEfX1npLvhw0WzFnOEbluwB3_xW0ELvHL4,8580
-sempy_labs/directlake/_warm_cache.py,sha256=ZgPricISRszx-yDERXihBDGVhEFB9yX-nBtLX0ZJTXI,8258
+sempy_labs/directlake/_update_directlake_partition_entity.py,sha256=DCPNZfhqVG_yXnQbrMuattGGo1tuXt54RdAaiN84MSQ,8570
+sempy_labs/directlake/_warm_cache.py,sha256=X4R2_i4jFnFXYmwhDIxPb9h1CdPVLzFKHItsz0QpeRg,8248
 sempy_labs/lakehouse/__init__.py,sha256=6LVQltQ3cjyiuxvjXTuNdJ163zSqi4h_tEZY4zsxuSw,647
 sempy_labs/lakehouse/_get_lakehouse_columns.py,sha256=Bb_iCTlNwl0wdN4dW_E7tVnfbHhHwQT_l0SUqvcbYpo,2582
-sempy_labs/lakehouse/_get_lakehouse_tables.py,sha256=sRIJEAHj8uj6BStr6ojae5RGuQ-dRB5R20mpCaj-UzI,8832
-sempy_labs/lakehouse/_lakehouse.py,sha256=qtCVr1cM0TWY6z5YS57w0nj3DEfXT5xmyDtr3676kAk,5172
+sempy_labs/lakehouse/_get_lakehouse_tables.py,sha256=W5ZNC52v79FBXBhHwmhnyQHBuy-PnDJyC5OX4zf-h_4,8802
+sempy_labs/lakehouse/_lakehouse.py,sha256=_yn0ySUrJQD9nySa3gFpEGr6AvF-vOKIMNJruotfxHQ,5224
 sempy_labs/lakehouse/_shortcuts.py,sha256=MT_Cqog5cTMz9fN3M_ZjAaQSjXXiyCyPWGY8LbaXZsI,6977
 sempy_labs/migration/__init__.py,sha256=w4vvGk6wTWXVfofJDmio2yIFvSSJsxOpjv6mvNGmrOI,1043
 sempy_labs/migration/_create_pqt_file.py,sha256=oYoKD78K9Ox1fqtkh-BfU_G5nUIoK_-5ChvCKDsYsWU,9257
-sempy_labs/migration/_migrate_calctables_to_lakehouse.py,sha256=p-2ge9Co3fyzJzCH58RWUDZP8kf9AIjI2gWqI7IF4SA,17751
+sempy_labs/migration/_migrate_calctables_to_lakehouse.py,sha256=y5fDjqgl-rpXgZWMGagLQS_aUqJ2ksWLR-cnriWJO7Q,17986
 sempy_labs/migration/_migrate_calctables_to_semantic_model.py,sha256=GC3zthtCsESLl_Mao-3C01_CzbfGBDTaEdq6k0DT2yQ,6203
 sempy_labs/migration/_migrate_model_objects_to_semantic_model.py,sha256=DAXz5TwPlrDxxciBp3NrTOlnkjeKaOYfntWMgyCXI10,23318
 sempy_labs/migration/_migrate_tables_columns_to_semantic_model.py,sha256=TX0NIffDocbK1B4cfssUHXjOG1htcaFOFWzDsBCGsi0,6515
@@ -97,14 +107,14 @@ sempy_labs/migration/_migration_validation.py,sha256=ZsUdVlBmo03ycaZE6fFRRGU6qpE
 sempy_labs/migration/_refresh_calc_tables.py,sha256=eDj0OJQ07Tum4umZH0NsUW5Rx_YXEpGnAu8OVVoQ4yk,5190
 sempy_labs/report/_BPAReportTemplate.json,sha256=9Uh-7E6d2ooxQ7j5JRayv_ayEULc7Gzg42kZGKdOqH8,63920
 sempy_labs/report/__init__.py,sha256=LqbIi1SnB532l79ldsFbeIkk-6dEnWkJYgNCaF2IR08,1056
-sempy_labs/report/_generate_report.py,sha256=7H2xQ5nHDK1_2RjvNNHX3IwWyNSRbTGMpGWxMmmjdOk,12189
-sempy_labs/report/_report_bpa.py,sha256=kkpg-7sMj8Ww9Wnwi2I-k64fNyiQxOaVj-IrMuVLDXA,13378
+sempy_labs/report/_generate_report.py,sha256=d7GVgLP77TApY4EKgvsvMwEYFo1Yl2_al8i8FCB6FPM,12179
+sempy_labs/report/_report_bpa.py,sha256=vPUCgGXgMbKBlFj3wFVOko2hWiuxrdTf9G-eSOfq3tQ,13667
 sempy_labs/report/_report_bpa_rules.py,sha256=tPVGA0hmE6QMLlWtig7Va7Ksr2yXWl_Lndq--tWWd6w,4959
 sempy_labs/report/_report_functions.py,sha256=qY2lE9tyf-xQo8Fdu2yl2nneiMMM6LFkwlqnyAOJjgg,29318
 sempy_labs/report/_report_helper.py,sha256=fkSo5m3_KlAlo-fu8FTnxINigWbZI66ex-r44WalKsw,8711
 sempy_labs/report/_report_list_functions.py,sha256=4k-bPEi4uW_ozHTZNc_67idP1LQZPT-gO9ToRCv06fk,3127
 sempy_labs/report/_report_rebind.py,sha256=F1gXE-VM_812EFOfqbMDnAdynVfVKKx9Cvs31Hnuras,5004
-sempy_labs/report/_reportwrapper.py,sha256=Cbq3IfuqSx-phfOmS3uZ1JeQdU3EaCdsK61W2-GBJkw,75802
+sempy_labs/report/_reportwrapper.py,sha256=NczgthYYI7oAgrm2yXp5Z1aocxqoXAdhnXI06wRd3s0,75719
 sempy_labs/report/_bpareporttemplate/.platform,sha256=kWRa6B_KwSYLsvVFDx372mQriQO8v7dJ_YzQV_cfD-Q,303
 sempy_labs/report/_bpareporttemplate/definition.pbir,sha256=bttyHZYKqjA8OBb_cezGlX4H82cDvGZVCl1QB3fij4E,343
 sempy_labs/report/_bpareporttemplate/.pbi/localSettings.json,sha256=kzjBlNdjbsSBBSHBwbQc298AJCr9Vp6Ex0D5PemUuT0,1578
@@ -135,9 +145,9 @@ sempy_labs/report/_bpareporttemplate/definition/pages/c597da16dc7e63222a82/visua
 sempy_labs/report/_bpareporttemplate/definition/pages/d37dce724a0ccc30044b/page.json,sha256=wBVuNc8S2NaUA0FC708w6stmR2djNZp8nAsHMqesgsc,293
 sempy_labs/report/_bpareporttemplate/definition/pages/d37dce724a0ccc30044b/visuals/ce8532a7e25020271077/visual.json,sha256=mlY6t9OlSe-Y6_QmXJpS1vggU6Y3FjISUKECL8FVSg8,931
 sempy_labs/tom/__init__.py,sha256=Qbs8leW0fjzvWwOjyWK3Hjeehu7IvpB1beASGsi28bk,121
-sempy_labs/tom/_model.py,sha256=H66LjyTt9XfVAsp24-7ApXE0IY07_KHkaKETacQLcos,156140
-semantic_link_labs-0.8.0.dist-info/LICENSE,sha256=ws_MuBL-SCEBqPBFl9_FqZkaaydIJmxHrJG2parhU4M,1141
-semantic_link_labs-0.8.0.dist-info/METADATA,sha256=Cu4dCzJpSUKF25bk-MD3vrX8ag2ajT9zaRAxwHsUIUQ,12320
-semantic_link_labs-0.8.0.dist-info/WHEEL,sha256=GV9aMThwP_4oNCtvEC2ec3qUYutgWeAzklro_0m4WJQ,91
-semantic_link_labs-0.8.0.dist-info/top_level.txt,sha256=kiQX1y42Dbein1l3Q8jMUYyRulDjdlc2tMepvtrvixQ,11
-semantic_link_labs-0.8.0.dist-info/RECORD,,
+sempy_labs/tom/_model.py,sha256=tfC241UprOx8ZLGqnSnaAzi20qlghESc0uK95i2HaAs,165380
+semantic_link_labs-0.8.2.dist-info/LICENSE,sha256=ws_MuBL-SCEBqPBFl9_FqZkaaydIJmxHrJG2parhU4M,1141
+semantic_link_labs-0.8.2.dist-info/METADATA,sha256=1hsvBRmEpNCyw0quXQ3UDVsVS98cv0RYb8R3z0AMU4c,15783
+semantic_link_labs-0.8.2.dist-info/WHEEL,sha256=GV9aMThwP_4oNCtvEC2ec3qUYutgWeAzklro_0m4WJQ,91
+semantic_link_labs-0.8.2.dist-info/top_level.txt,sha256=kiQX1y42Dbein1l3Q8jMUYyRulDjdlc2tMepvtrvixQ,11
+semantic_link_labs-0.8.2.dist-info/RECORD,,

sempy_labs/__init__.py

@@ -1,3 +1,44 @@
+from sempy_labs._ml_models import (
+    list_ml_models,
+    create_ml_model,
+    delete_ml_model,
+)
+from sempy_labs._ml_experiments import (
+    list_ml_experiments,
+    create_ml_experiment,
+    delete_ml_experiment,
+)
+from sempy_labs._warehouses import (
+    create_warehouse,
+    list_warehouses,
+    delete_warehouse,
+)
+from sempy_labs._data_pipelines import (
+    list_data_pipelines,
+    create_data_pipeline,
+    delete_data_pipeline,
+)
+from sempy_labs._eventhouses import (
+    create_eventhouse,
+    list_eventhouses,
+    delete_eventhouse,
+)
+from sempy_labs._eventstreams import (
+    list_eventstreams,
+    create_eventstream,
+    delete_eventstream,
+)
+from sempy_labs._kql_querysets import (
+    list_kql_querysets,
+    create_kql_queryset,
+    delete_kql_queryset,
+)
+from sempy_labs._kql_databases import (
+    list_kql_databases,
+    create_kql_database,
+    delete_kql_database,
+)
+from sempy_labs._mirrored_warehouses import list_mirrored_warehouses
 from sempy_labs._environments import (
     create_environment,
     delete_environment,
@@ -23,8 +64,6 @@ from sempy_labs._capacity_migration import (
 )
 from sempy_labs._capacities import (
     create_fabric_capacity,
-    # get_capacity_resource_governance,
-    # list_vcores,
     resume_fabric_capacity,
     suspend_fabric_capacity,
     update_fabric_capacity,
@@ -33,7 +72,6 @@ from sempy_labs._capacities import (
     delete_embedded_capacity,
     delete_premium_capacity,
 )
-
 from sempy_labs._spark import (
     get_spark_settings,
     update_spark_settings,
@@ -42,7 +80,6 @@ from sempy_labs._spark import (
     delete_custom_pool,
     update_custom_pool,
 )
-
 from sempy_labs._workspaces import (
     list_workspace_users,
     update_workspace_user,
@@ -107,27 +144,14 @@ from sempy_labs._list_functions import (
     list_shortcuts,
     get_object_level_security,
     list_capacities,
-    # list_annotations,
-    # list_columns,
     list_dashboards,
-    # list_datamarts,
-    # list_datapipelines,
-    # list_eventstreams,
-    # list_kpis,
-    # list_kqldatabases,
-    # list_kqlquerysets,
+    list_datamarts,
     list_lakehouses,
-    # list_mirroredwarehouses,
-    # list_mlexperiments,
-    # list_mlmodels,
-    # list_relationships,
-    # list_sqlendpoints,
-    # list_tables,
-    list_warehouses,
-    create_warehouse,
+    list_sql_endpoints,
     update_item,
 )
 from sempy_labs._helper_functions import (
+    convert_to_friendly_case,
     resolve_environment_id,
     resolve_capacity_id,
     resolve_warehouse_id,
@@ -150,10 +174,7 @@ from sempy_labs._helper_functions import (
     get_capacity_id,
     get_capacity_name,
     resolve_capacity_name,
-    #  language_validate
 )
-
-#  from sempy_labs._model_auto_build import model_auto_build
 from sempy_labs._model_bpa_bulk import (
     run_model_bpa_bulk,
     create_model_bpa_semantic_model,
@@ -184,7 +205,6 @@ from sempy_labs._refresh_semantic_model import (
 from sempy_labs._translations import translate_semantic_model
 from sempy_labs._vertipaq import (
     vertipaq_analyzer,
-    # visualize_vertipaq,
     import_vertipaq_analyzer,
 )
 
@@ -218,26 +238,13 @@ __all__ = [
     "deploy_semantic_model",
     "get_semantic_model_bim",
     "get_object_level_security",
-    #'list_annotations',
-    #'list_columns',
     "list_dashboards",
     "list_dataflow_storage_accounts",
-    #'list_datamarts',
-    #'list_datapipelines',
-    #'list_eventstreams',
-    #'list_kpis',
-    #'list_kqldatabases',
-    #'list_kqlquerysets',
     "list_lakehouses",
-    #'list_mirroredwarehouses',
-    #'list_mlexperiments',
-    #'list_mlmodels',
-    #'list_relationships',
-    #'list_sqlendpoints',
-    #'list_tables',
     "list_warehouses",
     "list_workspace_role_assignments",
     "create_warehouse",
+    "delete_warehouse",
     "update_item",
     "create_abfss_path",
     "format_dax_object_name",
@@ -251,8 +258,6 @@ __all__ = [
     "resolve_dataset_name",
     "resolve_report_id",
     "resolve_report_name",
-    # 'language_validate',
-    # "model_auto_build",
     "model_bpa_rules",
     "run_model_bpa",
     "measure_dependency_tree",
@@ -270,7 +275,6 @@ __all__ = [
     "cancel_dataset_refresh",
     "translate_semantic_model",
     "vertipaq_analyzer",
-    # 'visualize_vertipaq',
     "import_vertipaq_analyzer",
     "list_semantic_model_objects",
     "list_shortcuts",
@@ -318,7 +322,6 @@ __all__ = [
     "delete_fabric_capacity",
     "resume_fabric_capacity",
     "update_fabric_capacity",
-    "create_fabric_capacity",
     "delete_premium_capacity",
     "suspend_fabric_capacity",
     "delete_embedded_capacity",
@@ -327,17 +330,33 @@ __all__ = [
     "migrate_capacities",
     "create_fabric_capacity",
     "migrate_capacity_settings",
-    # "get_capacity_resource_governance",
-    # "list_vcores",
     "migrate_disaster_recovery_settings",
     "migrate_notification_settings",
     "migrate_access_settings",
     "migrate_delegated_tenant_settings",
-    "resume_fabric_capacity",
-    "suspend_fabric_capacity",
-    "update_fabric_capacity",
-    "delete_fabric_capacity",
-    "check_fabric_capacity_name_availablility",
-    "delete_embedded_capacity",
-    "delete_premium_capacity",
+    "convert_to_friendly_case",
+    "list_mirrored_warehouses",
+    "list_kql_databases",
+    "create_kql_database",
+    "delete_kql_database",
+    "create_eventhouse",
+    "list_eventhouses",
+    "delete_eventhouse",
+    "list_data_pipelines",
+    "create_data_pipeline",
+    "delete_data_pipeline",
+    "list_eventstreams",
+    "create_eventstream",
+    "delete_eventstream",
+    "list_kql_querysets",
+    "create_kql_queryset",
+    "delete_kql_queryset",
+    "list_ml_models",
+    "create_ml_model",
+    "delete_ml_model",
+    "list_ml_experiments",
+    "create_ml_experiment",
+    "delete_ml_experiment",
+    "list_sql_endpoints",
+    "list_datamarts",
 ]

sempy_labs/_ai.py

@@ -1,8 +1,6 @@
 import sempy
 import sempy.fabric as fabric
 import pandas as pd
-from synapse.ml.services.openai import OpenAICompletion
-from pyspark.sql.functions import col
 from pyspark.sql import SparkSession
 from typing import List, Optional, Union
 from IPython.display import display

sempy_labs/_capacity_migration.py

@@ -136,8 +136,7 @@ def migrate_capacities(
     resource_group : str | dict
         The name of the Azure resource group.
         For A skus, this parameter will be ignored and the resource group used for the F sku will be the same as the A sku's resource group.
-        For P skus, if this parameter is a string, it will use that resource group for all of the newly created F skus.
-                    if this parameter is a dictionary, it will use that mapping (capacity name -> resource group) for creating capacities with the mapped resource groups.
+        For P skus, if this parameter is a string, it will use that resource group for all of the newly created F skus. If this parameter is a dictionary, it will use that mapping (capacity name -> resource group) for creating capacities with the mapped resource groups.
     capacities : str | List[str], default=None
         The capacity(ies) to migrate from A/P -> F sku.
         Defaults to None which migrates all accessible A/P sku capacities to F skus.

sempy_labs/_data_pipelines.py

@@ -0,0 +1,118 @@
+import sempy.fabric as fabric
+import pandas as pd
+import sempy_labs._icons as icons
+from typing import Optional
+from sempy_labs._helper_functions import (
+    resolve_workspace_name_and_id,
+    lro,
+    pagination,
+)
+from sempy.fabric.exceptions import FabricHTTPException
+
+
+def list_data_pipelines(workspace: Optional[str] = None) -> pd.DataFrame:
+    """
+    Shows the data pipelines within a workspace.
+
+    Parameters
+    ----------
+    workspace : str, default=None
+        The Fabric workspace name.
+        Defaults to None which resolves to the workspace of the attached lakehouse
+        or if no lakehouse attached, resolves to the workspace of the notebook.
+
+    Returns
+    -------
+    pandas.DataFrame
+        A pandas dataframe showing the data pipelines within a workspace.
+    """
+
+    df = pd.DataFrame(columns=["Data Pipeline Name", "Data Pipeline ID", "Description"])
+
+    (workspace, workspace_id) = resolve_workspace_name_and_id(workspace)
+
+    client = fabric.FabricRestClient()
+    response = client.get(f"/v1/workspaces/{workspace_id}/dataPipelines")
+    if response.status_code != 200:
+        raise FabricHTTPException(response)
+
+    responses = pagination(client, response)
+
+    for r in responses:
+        for v in r.get("value", []):
+            new_data = {
+                "Data Pipeline Name": v.get("displayName"),
+                "Data Pipeline ID": v.get("id"),
+                "Description": v.get("description"),
+            }
+            df = pd.concat([df, pd.DataFrame(new_data, index=[0])], ignore_index=True)
+
+    return df
+
+
+def create_data_pipeline(
+    name: str, description: Optional[str] = None, workspace: Optional[str] = None
+):
+    """
+    Creates a Fabric data pipeline.
+
+    Parameters
+    ----------
+    name: str
+        Name of the data pipeline.
+    description : str, default=None
+        A description of the environment.
+    workspace : str, default=None
+        The Fabric workspace name.
+        Defaults to None which resolves to the workspace of the attached lakehouse
+        or if no lakehouse attached, resolves to the workspace of the notebook.
+    """
+
+    (workspace, workspace_id) = resolve_workspace_name_and_id(workspace)
+
+    request_body = {"displayName": name}
+
+    if description:
+        request_body["description"] = description
+
+    client = fabric.FabricRestClient()
+    response = client.post(
+        f"/v1/workspaces/{workspace_id}/dataPipelines", json=request_body
+    )
+
+    lro(client, response, status_codes=[201, 202])
+
+    print(
+        f"{icons.green_dot} The '{name}' data pipeline has been created within the '{workspace}' workspace."
+    )
+
+
+def delete_data_pipeline(name: str, workspace: Optional[str] = None):
+    """
+    Deletes a Fabric data pipeline.
+
+    Parameters
+    ----------
+    name: str
+        Name of the data pipeline.
+    workspace : str, default=None
+        The Fabric workspace name.
+        Defaults to None which resolves to the workspace of the attached lakehouse
+        or if no lakehouse attached, resolves to the workspace of the notebook.
+    """
+
+    (workspace, workspace_id) = resolve_workspace_name_and_id(workspace)
+
+    item_id = fabric.resolve_item_id(
+        item_name=name, type="DataPipeline", workspace=workspace
+    )
+
+    client = fabric.FabricRestClient()
+    response = client.delete(f"/v1/workspaces/{workspace_id}/dataPipelines/{item_id}")
+
+    if response.status_code != 200:
+        raise FabricHTTPException(response)
+
+    print(
+        f"{icons.green_dot} The '{name}' data pipeline within the '{workspace}' workspace has been deleted."
+    )