PyPI - lightning - Versions diffs - 2.3.0__tar.gz → 2.3.0.dev20240324__tar.gz - Mend

lightning 2.3.0tar.gz → 2.3.0.dev20240324tar.gz

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.

Files changed (573) hide show

{lightning-2.3.0/src/lightning.egg-info → lightning-2.3.0.dev20240324}/PKG-INFO RENAMED Viewed

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: lightning
-Version: 2.3.0
+Version: 2.3.0.dev20240324
 Summary: The Deep Learning framework to train, deploy, and ship AI products Lightning fast.
 Home-page: https://github.com/Lightning-AI/lightning
 Author: Lightning AI et al.
@@ -27,18 +27,18 @@ Classifier: Programming Language :: Python :: 3.10
 Classifier: Programming Language :: Python :: 3.11
 Requires-Python: >=3.8
 Description-Content-Type: text/markdown
-Provides-Extra: fabric-examples
 Provides-Extra: fabric-strategies
 Provides-Extra: fabric-test
-Provides-Extra: store-test
+Provides-Extra: fabric-examples
 Provides-Extra: app-ui
-Provides-Extra: app-cloud
 Provides-Extra: app-test
 Provides-Extra: app-components
-Provides-Extra: pytorch-examples
-Provides-Extra: pytorch-strategies
+Provides-Extra: app-cloud
 Provides-Extra: pytorch-extra
+Provides-Extra: pytorch-strategies
 Provides-Extra: pytorch-test
+Provides-Extra: pytorch-examples
+Provides-Extra: store-test
 Provides-Extra: fabric-all
 Provides-Extra: fabric-dev
 Provides-Extra: pytorch-all
@@ -47,13 +47,13 @@ Provides-Extra: app-extra
 Provides-Extra: app-all
 Provides-Extra: app-dev
 Provides-Extra: data
-Provides-Extra: examples
 Provides-Extra: strategies
 Provides-Extra: test
+Provides-Extra: examples
 Provides-Extra: ui
+Provides-Extra: components
 Provides-Extra: cloud
 Provides-Extra: app
-Provides-Extra: components
 Provides-Extra: extra
 Provides-Extra: all
 Provides-Extra: dev
@@ -74,11 +74,11 @@ License-File: LICENSE
 ______________________________________________________________________
 <p align="center">
-  <a href="https://lightning.ai/">Lightning AI</a> •
-  <a href="#examples">Examples</a> •
-  <a href="#pytorch-lightning-train-and-deploy-pytorch-at-scale">PyTorch Lightning</a> •
-  <a href="#lightning-fabric-expert-control">Fabric</a> •
-  <a href="https://pytorch-lightning.readthedocs.io/en/2.3.0">Docs</a> •
+  <a href="https://lightning.ai/">Lightning.ai</a> •
+  <a href="https://lightning.ai/docs/pytorch/stable/">PyTorch Lightning</a> •
+  <a href="https://lightning.ai/docs/fabric/stable/">Fabric</a> •
+  <a href="https://lightning.ai/docs/app/stable/">Lightning Apps</a> •
+  <a href="https://pytorch-lightning.readthedocs.io/en/2.3.0.dev20240324">Docs</a> •
   <a href="#community">Community</a> •
   <a href="https://lightning.ai/docs/pytorch/stable/generated/CONTRIBUTING.html">Contribute</a> •
 </p>
@@ -101,20 +101,6 @@ ______________________________________________________________________
 </div>
-<div align="center">
-<p align="center">
-&nbsp;
-<a target="_blank" href="https://lightning.ai/docs/pytorch/latest/starter/introduction.html#define-a-lightningmodule">
-  <img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/get-started-badge.svg" height="36px" alt="Get started"/>
-</a>
-</p>
-</div>
 ## Install Lightning
 Simple installation from PyPI
@@ -127,11 +113,15 @@ pip install lightning
 ______________________________________________________________________
-## Lightning has 2 core packages
+## Lightning has 4 core packages
 [PyTorch Lightning: Train and deploy PyTorch at scale](#pytorch-lightning-train-and-deploy-pytorch-at-scale).
 <br/>
 [Lightning Fabric: Expert control](#lightning-fabric-expert-control).
+<br/>
+[Lightning Data: Blazing fast, distributed streaming of training data from cloud storage](https://github.com/Lightning-AI/pytorch-lightning/tree/master/src/lightning/data).
+<br/>
+[Lightning Apps: Build AI products and ML workflows](#lightning-apps-build-ai-products-and-ml-workflows).
 Lightning gives you granular control over how much abstraction you want to add over PyTorch.
@@ -139,9 +129,7 @@ Lightning gives you granular control over how much abstraction you want to add o
     <img src="https://pl-public-data.s3.amazonaws.com/assets_lightning/continuum.png" width="80%">
 </div>
-&nbsp;
-&nbsp;
+______________________________________________________________________
 # PyTorch Lightning: Train and Deploy PyTorch at Scale
@@ -151,15 +139,6 @@ PyTorch Lightning is just organized PyTorch - Lightning disentangles PyTorch cod
 ______________________________________________________________________
-### Examples
-Explore various types of training possible with PyTorch Lightning. Pretrain and finetune ANY kind of model to perform ANY task like classification, segmentation, summarization and more:
-| Task  | Description | Run |
-|---|---|---|
-| [Hello world](#hello-simple-model)  | Pretrain - Hello world example | <a target="_blank" href="https://lightning.ai/lightning-ai/studios/pytorch-lightning-hello-world"><img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/studio-badge.svg" alt="Open In Studio"/></a> |
-| [Image segmentation](https://lightning.ai/lightning-ai/studios/image-segmentation-with-pytorch-lightning)  | Finetune - ResNet-50 model to segment images | <a target="_blank" href="https://lightning.ai/lightning-ai/studios/image-segmentation-with-pytorch-lightning"><img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/studio-badge.svg" alt="Open In Studio"/></a> |
-| [Text classification](https://lightning.ai/lightning-ai/studios/text-classification-with-pytorch-lightning)  | Finetune - text classifier (BERT model) | <a target="_blank" href="https://lightning.ai/lightning-ai/studios/text-classification-with-pytorch-lightning"><img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/studio-badge.svg" alt="Open In Studio"/></a> |
 ### Hello simple model
 ```python
@@ -361,10 +340,7 @@ ______________________________________________________________________
 ______________________________________________________________________
-&nbsp;
-&nbsp;
-# Lightning Fabric: Expert control
+# Lightning Fabric: Expert control.
 Run on any device at any scale with expert-level control over PyTorch training loop and scaling strategy. You can even write your own Trainer.
@@ -546,8 +522,62 @@ ______________________________________________________________________
 ______________________________________________________________________
-&nbsp;
-&nbsp;
+# Lightning Apps: Build AI products and ML workflows
+Lightning Apps remove the cloud infrastructure boilerplate so you can focus on solving the research or business problems. Lightning Apps can run on the Lightning Cloud, your own cluster or a private cloud.
+<div align="center">
+    <img src="https://pl-public-data.s3.amazonaws.com/assets_lightning/lightning-apps-teaser.png" width="80%">
+</div>
+## Hello Lightning app world
+```python
+# app.py
+import lightning as L
+class TrainComponent(L.LightningWork):
+    def run(self, x):
+        print(f"train a model on {x}")
+class AnalyzeComponent(L.LightningWork):
+    def run(self, x):
+        print(f"analyze model on {x}")
+class WorkflowOrchestrator(L.LightningFlow):
+    def __init__(self) -> None:
+        super().__init__()
+        self.train = TrainComponent(cloud_compute=L.CloudCompute("cpu"))
+        self.analyze = AnalyzeComponent(cloud_compute=L.CloudCompute("gpu"))
+    def run(self):
+        self.train.run("CPU machine 1")
+        self.analyze.run("GPU machine 2")
+app = L.LightningApp(WorkflowOrchestrator())
+```
+Run on the cloud or locally
+```bash
+# run on the cloud
+lightning run app app.py --setup --cloud
+# run locally
+lightning run app app.py
+```
+______________________________________________________________________
+<div align="center">
+    <a href="https://lightning.ai/docs/app/stable/">Read the Lightning Apps docs</a>
+</div>
+______________________________________________________________________
 ## Examples
@@ -578,8 +608,7 @@ ______________________________________________________________________
 - [Logistic Regression](https://lightning-bolts.readthedocs.io/en/stable/models/classic_ml.html#logistic-regression)
 - [Linear Regression](https://lightning-bolts.readthedocs.io/en/stable/models/classic_ml.html#linear-regression)
-&nbsp;
-&nbsp;
+______________________________________________________________________
 ## Continuous Integration
@@ -594,7 +623,7 @@ Lightning is rigorously tested across multiple CPUs, GPUs and TPUs and against m
 |       System / PyTorch ver.        | 1.13                                                                                                                                                                                                                            | 2.0                                                                                                                                                                                                                             |                                                                                                               2.1                                                                                                               |
 | :--------------------------------: | :-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: | :-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: |:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
-|        Linux py3.9 \[GPUs\]        |  |  | [![Build Status](https://dev.azure.com/Lightning-AI/lightning/_apis/build/status%2Fpytorch-lightning%20%28GPUs%29?branchName=refs%2Ftags%2F2.3.0)](https://dev.azure.com/Lightning-AI/lightning/_build/latest?definitionId=24&branchName=master) |
+|        Linux py3.9 \[GPUs\]        |  |  | [![Build Status](https://dev.azure.com/Lightning-AI/lightning/_apis/build/status%2Fpytorch-lightning%20%28GPUs%29?branchName=refs%2Ftags%2F2.3.0.dev20240324)](https://dev.azure.com/Lightning-AI/lightning/_build/latest?definitionId=24&branchName=master) |
 |        Linux py3.9 \[TPUs\]        |                                                                                                                                                                                                                                 |  [![Test PyTorch - TPU](https://github.com/Lightning-AI/lightning/actions/workflows/tpu-tests.yml/badge.svg)](https://github.com/Lightning-AI/lightning/actions/workflows/tpu-tests.yml)     |      |
 |  Linux (multiple Python versions)  | [![Test PyTorch](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml/badge.svg)](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml)                                 | [![Test PyTorch](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml/badge.svg)](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml)                                 |                 [![Test PyTorch](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml/badge.svg)](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml)                 |
 |   OSX (multiple Python versions)   | [![Test PyTorch](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml/badge.svg)](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml)                                 | [![Test PyTorch](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml/badge.svg)](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml)                                 |                 [![Test PyTorch](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml/badge.svg)](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml)                 |
@@ -603,8 +632,7 @@ Lightning is rigorously tested across multiple CPUs, GPUs and TPUs and against m
 </center>
 </details>
-&nbsp;
-&nbsp;
+______________________________________________________________________
 ## Community

{lightning-2.3.0 → lightning-2.3.0.dev20240324}/README.md RENAMED Viewed

@@ -12,10 +12,10 @@
 ______________________________________________________________________
 <p align="center">
-  <a href="https://lightning.ai/">Lightning AI</a> •
-  <a href="#examples">Examples</a> •
-  <a href="#pytorch-lightning-train-and-deploy-pytorch-at-scale">PyTorch Lightning</a> •
-  <a href="#lightning-fabric-expert-control">Fabric</a> •
+  <a href="https://lightning.ai/">Lightning.ai</a> •
+  <a href="https://lightning.ai/docs/pytorch/stable/">PyTorch Lightning</a> •
+  <a href="https://lightning.ai/docs/fabric/stable/">Fabric</a> •
+  <a href="https://lightning.ai/docs/app/stable/">Lightning Apps</a> •
   <a href="https://pytorch-lightning.readthedocs.io/en/stable/">Docs</a> •
   <a href="#community">Community</a> •
   <a href="https://lightning.ai/docs/pytorch/stable/generated/CONTRIBUTING.html">Contribute</a> •
@@ -39,20 +39,6 @@ ______________________________________________________________________
 </div>
-<div align="center">
-<p align="center">
-&nbsp;
-<a target="_blank" href="https://lightning.ai/docs/pytorch/latest/starter/introduction.html#define-a-lightningmodule">
-  <img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/get-started-badge.svg" height="36px" alt="Get started"/>
-</a>
-</p>
-</div>
 ## Install Lightning
 Simple installation from PyPI
@@ -106,11 +92,15 @@ pip install -iU https://test.pypi.org/simple/ pytorch-lightning
 ______________________________________________________________________
-## Lightning has 2 core packages
+## Lightning has 4 core packages
 [PyTorch Lightning: Train and deploy PyTorch at scale](#pytorch-lightning-train-and-deploy-pytorch-at-scale).
 <br/>
 [Lightning Fabric: Expert control](#lightning-fabric-expert-control).
+<br/>
+[Lightning Data: Blazing fast, distributed streaming of training data from cloud storage](https://github.com/Lightning-AI/pytorch-lightning/tree/master/src/lightning/data).
+<br/>
+[Lightning Apps: Build AI products and ML workflows](#lightning-apps-build-ai-products-and-ml-workflows).
 Lightning gives you granular control over how much abstraction you want to add over PyTorch.
@@ -118,9 +108,7 @@ Lightning gives you granular control over how much abstraction you want to add o
     <img src="https://pl-public-data.s3.amazonaws.com/assets_lightning/continuum.png" width="80%">
 </div>
-&nbsp;
-&nbsp;
+______________________________________________________________________
 # PyTorch Lightning: Train and Deploy PyTorch at Scale
@@ -130,15 +118,6 @@ PyTorch Lightning is just organized PyTorch - Lightning disentangles PyTorch cod
 ______________________________________________________________________
-### Examples
-Explore various types of training possible with PyTorch Lightning. Pretrain and finetune ANY kind of model to perform ANY task like classification, segmentation, summarization and more:
-| Task  | Description | Run |
-|---|---|---|
-| [Hello world](#hello-simple-model)  | Pretrain - Hello world example | <a target="_blank" href="https://lightning.ai/lightning-ai/studios/pytorch-lightning-hello-world"><img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/studio-badge.svg" alt="Open In Studio"/></a> |
-| [Image segmentation](https://lightning.ai/lightning-ai/studios/image-segmentation-with-pytorch-lightning)  | Finetune - ResNet-50 model to segment images | <a target="_blank" href="https://lightning.ai/lightning-ai/studios/image-segmentation-with-pytorch-lightning"><img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/studio-badge.svg" alt="Open In Studio"/></a> |
-| [Text classification](https://lightning.ai/lightning-ai/studios/text-classification-with-pytorch-lightning)  | Finetune - text classifier (BERT model) | <a target="_blank" href="https://lightning.ai/lightning-ai/studios/text-classification-with-pytorch-lightning"><img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/studio-badge.svg" alt="Open In Studio"/></a> |
 ### Hello simple model
 ```python
@@ -340,10 +319,7 @@ ______________________________________________________________________
 ______________________________________________________________________
-&nbsp;
-&nbsp;
-# Lightning Fabric: Expert control
+# Lightning Fabric: Expert control.
 Run on any device at any scale with expert-level control over PyTorch training loop and scaling strategy. You can even write your own Trainer.
@@ -525,8 +501,62 @@ ______________________________________________________________________
 ______________________________________________________________________
-&nbsp;
-&nbsp;
+# Lightning Apps: Build AI products and ML workflows
+Lightning Apps remove the cloud infrastructure boilerplate so you can focus on solving the research or business problems. Lightning Apps can run on the Lightning Cloud, your own cluster or a private cloud.
+<div align="center">
+    <img src="https://pl-public-data.s3.amazonaws.com/assets_lightning/lightning-apps-teaser.png" width="80%">
+</div>
+## Hello Lightning app world
+```python
+# app.py
+import lightning as L
+class TrainComponent(L.LightningWork):
+    def run(self, x):
+        print(f"train a model on {x}")
+class AnalyzeComponent(L.LightningWork):
+    def run(self, x):
+        print(f"analyze model on {x}")
+class WorkflowOrchestrator(L.LightningFlow):
+    def __init__(self) -> None:
+        super().__init__()
+        self.train = TrainComponent(cloud_compute=L.CloudCompute("cpu"))
+        self.analyze = AnalyzeComponent(cloud_compute=L.CloudCompute("gpu"))
+    def run(self):
+        self.train.run("CPU machine 1")
+        self.analyze.run("GPU machine 2")
+app = L.LightningApp(WorkflowOrchestrator())
+```
+Run on the cloud or locally
+```bash
+# run on the cloud
+lightning run app app.py --setup --cloud
+# run locally
+lightning run app app.py
+```
+______________________________________________________________________
+<div align="center">
+    <a href="https://lightning.ai/docs/app/stable/">Read the Lightning Apps docs</a>
+</div>
+______________________________________________________________________
 ## Examples
@@ -557,8 +587,7 @@ ______________________________________________________________________
 - [Logistic Regression](https://lightning-bolts.readthedocs.io/en/stable/models/classic_ml.html#logistic-regression)
 - [Linear Regression](https://lightning-bolts.readthedocs.io/en/stable/models/classic_ml.html#linear-regression)
-&nbsp;
-&nbsp;
+______________________________________________________________________
 ## Continuous Integration
@@ -582,8 +611,7 @@ Lightning is rigorously tested across multiple CPUs, GPUs and TPUs and against m
 </center>
 </details>
-&nbsp;
-&nbsp;
+______________________________________________________________________
 ## Community

{lightning-2.3.0 → lightning-2.3.0.dev20240324}/pyproject.toml RENAMED Viewed

@@ -12,6 +12,11 @@
 # See the License for the specific language governing permissions and
 # limitations under the License.
+[metadata]
+name = "lightning"
+author = "Lightning-AI et al."
+url = "https://github.com/Lightning-AI/lightning"
 [build-system]
 requires = [
     "setuptools",

{lightning-2.3.0 → lightning-2.3.0.dev20240324}/requirements/app/app.txt RENAMED Viewed

@@ -1,4 +1,4 @@
-lightning-cloud == 0.5.69  # Must be pinned to ensure compatibility
+lightning-cloud == 0.5.65  # Must be pinned to ensure compatibility
 packaging
 typing-extensions >=4.4.0, <4.10.0
 deepdiff >=5.7.0, <6.6.0
@@ -23,7 +23,7 @@ Jinja2 <3.2.0
 PyYAML <=6.0.1
 requests <2.32.0
 rich >=12.3.0, <13.6.0
-urllib3 <2.0.0
+urllib3 <2.1.0
 uvicorn <0.24.0
 websocket-client <1.7.0
 websockets <11.1.0

{lightning-2.3.0 → lightning-2.3.0.dev20240324}/requirements/base.txt RENAMED Viewed

@@ -1,9 +1,9 @@
 PyYAML<7.0,>=5.4
-fsspec[http]<2025.0,>=2022.5.0
+fsspec[http]<2024.0,>=2022.5.0
 lightning-utilities<1.0,>=0.8.0
 numpy<2.0,>=1.17.2
 packaging<24.0,>=20.0
-torch<3.0,>=2.0.0
+torch<3.0,>=1.13.0
 torchmetrics<2.0,>=0.7.0
 tqdm<5.0,>=4.57.0
 typing-extensions<5.0,>=4.4.0

{lightning-2.3.0 → lightning-2.3.0.dev20240324}/requirements/fabric/base.txt RENAMED Viewed

@@ -2,8 +2,8 @@
 #  in case you want to preserve/enforce restrictions on the latest compatible version, add "strict" as an in-line comment
 numpy >=1.17.2, <1.27.0
-torch >=2.0.0, <2.4.0
-fsspec[http] >=2022.5.0, <2024.4.0
+torch >=1.13.0, <2.3.0
+fsspec[http] >=2022.5.0, <2023.11.0
 packaging >=20.0, <=23.1
 typing-extensions >=4.4.0, <4.10.0
 lightning-utilities >=0.8.0, <0.12.0

{lightning-2.3.0 → lightning-2.3.0.dev20240324}/requirements/fabric/examples.txt RENAMED Viewed

@@ -1,6 +1,6 @@
 # NOTE: the upper bound for the package version is only set for CI stability, and it is dropped while installing this package
 #  in case you want to preserve/enforce restrictions on the latest compatible version, add "strict" as an in-line comment
-torchvision >=0.15.0, <0.19.0
+torchvision >=0.14.0, <0.18.0
 torchmetrics >=0.10.0, <1.3.0
 lightning-utilities >=0.8.0, <0.12.0

{lightning-2.3.0 → lightning-2.3.0.dev20240324}/requirements/fabric/strategies.txt RENAMED Viewed

@@ -5,5 +5,5 @@
 # note: is a bug around 0.10 with `MPS_Accelerator must implement all abstract methods`
 #  shall be resolved by https://github.com/microsoft/DeepSpeed/issues/4372
-deepspeed >=0.8.2, <=0.9.3; platform_system != "Windows" and platform_system != "Darwin"  # strict
+deepspeed >=0.8.2, <=0.9.3; platform_system != "Windows"  # strict
 bitsandbytes >=0.42.0,<0.43.0

{lightning-2.3.0 → lightning-2.3.0.dev20240324}/requirements/pytorch/base.txt RENAMED Viewed

@@ -2,10 +2,10 @@
 #  in case you want to preserve/enforce restrictions on the latest compatible version, add "strict" as an in-line comment
 numpy >=1.17.2, <1.27.0
-torch >=2.0.0, <2.4.0
+torch >=1.13.0, <2.3.0
 tqdm >=4.57.0, <4.67.0
 PyYAML >=5.4, <6.1.0
-fsspec[http] >=2022.5.0, <2024.4.0
+fsspec[http] >=2022.5.0, <2023.11.0
 torchmetrics >=0.7.0, <1.3.0  # needed for using fixed compare_version
 packaging >=20.0, <=23.1
 typing-extensions >=4.4.0, <4.10.0

{lightning-2.3.0 → lightning-2.3.0.dev20240324}/requirements/pytorch/examples.txt RENAMED Viewed

@@ -2,7 +2,8 @@
 #  in case you want to preserve/enforce restrictions on the latest compatible version, add "strict" as an in-line comment
 requests <2.32.0
-torchvision >=0.15.0, <0.19.0
+torchvision >=0.14.0, <0.18.0
+gym[classic_control] >=0.17.0, <0.27.0
 ipython[all] <8.15.0
 torchmetrics >=0.10.0, <1.3.0
 lightning-utilities >=0.8.0, <0.12.0

{lightning-2.3.0 → lightning-2.3.0.dev20240324}/requirements/pytorch/strategies.txt RENAMED Viewed

@@ -3,4 +3,4 @@
 # note: is a bug around 0.10 with `MPS_Accelerator must implement all abstract methods`
 #  shall be resolved by https://github.com/microsoft/DeepSpeed/issues/4372
-deepspeed >=0.8.2, <=0.9.3; platform_system != "Windows" and platform_system != "Darwin"  # strict
+deepspeed >=0.8.2, <=0.9.3; platform_system != "Windows"  # strict

{lightning-2.3.0 → lightning-2.3.0.dev20240324}/src/lightning/app/core/app.py RENAMED Viewed

@@ -30,7 +30,6 @@ from lightning.app import _console
 from lightning.app.api.request_types import _APIRequest, _CommandRequest, _DeltaRequest
 from lightning.app.core.constants import (
     BATCH_DELTA_COUNT,
-    CHECK_ERROR_QUEUE_INTERVAL,
     DEBUG_ENABLED,
     FLOW_DURATION_SAMPLES,
     FLOW_DURATION_THRESHOLD,
@@ -166,7 +165,6 @@ class LightningApp:
         self._last_run_time: float = 0.0
         self._run_times: list = []
-        self._last_check_error_queue: float = 0.0
         # Path attributes can't get properly attached during the initialization, because the full name
         # is only available after all Flows and Works have been instantiated.
@@ -320,12 +318,10 @@ class LightningApp:
             return []
     def check_error_queue(self) -> None:
-        if (time() - self._last_check_error_queue) > CHECK_ERROR_QUEUE_INTERVAL:
-            exception: Exception = self.get_state_changed_from_queue(self.error_queue)  # type: ignore[assignment,arg-type]
-            if isinstance(exception, Exception):
-                self.exception = exception
-                self.stage = AppStage.FAILED
-            self._last_check_error_queue = time()
+        exception: Exception = self.get_state_changed_from_queue(self.error_queue)  # type: ignore[assignment,arg-type]
+        if isinstance(exception, Exception):
+            self.exception = exception
+            self.stage = AppStage.FAILED
     @property
     def flows(self) -> List[Union[LightningWork, "LightningFlow"]]:

{lightning-2.3.0 → lightning-2.3.0.dev20240324}/src/lightning/app/core/constants.py RENAMED Viewed

@@ -70,7 +70,6 @@ DOT_IGNORE_FILENAME = ".lightningignore"
 LIGHTNING_COMPONENT_PUBLIC_REGISTRY = "https://lightning.ai/v1/components"
 LIGHTNING_APPS_PUBLIC_REGISTRY = "https://lightning.ai/v1/apps"
 LIGHTNING_MODELS_PUBLIC_REGISTRY = "https://lightning.ai/v1/models"
-ENABLE_ORCHESTRATOR = bool(int(os.getenv("ENABLE_ORCHESTRATOR", "1")))
 LIGHTNING_CLOUDSPACE_HOST = os.getenv("LIGHTNING_CLOUDSPACE_HOST")
 LIGHTNING_CLOUDSPACE_EXPOSED_PORT_COUNT = int(os.getenv("LIGHTNING_CLOUDSPACE_EXPOSED_PORT_COUNT", "0"))
@@ -100,7 +99,6 @@ SYS_CUSTOMIZATIONS_SYNC_ROOT = "/tmp/sys-customizations-sync"  # todo
 SYS_CUSTOMIZATIONS_SYNC_PATH = ".sys-customizations-sync"
 BATCH_DELTA_COUNT = int(os.getenv("BATCH_DELTA_COUNT", "128"))
-CHECK_ERROR_QUEUE_INTERVAL = float(os.getenv("CHECK_ERROR_QUEUE_INTERVAL", "30"))
 def enable_multiple_works_in_default_container() -> bool:

{lightning-2.3.0 → lightning-2.3.0.dev20240324}/src/lightning/app/runners/cloud.py RENAMED Viewed

@@ -34,7 +34,7 @@ from lightning_cloud.openapi import (
     CloudspaceIdRunsBody,
     Externalv1LightningappInstance,
     Gridv1ImageSpec,
-    IdGetBody,
+    IdGetBody1,
     ProjectIdCloudspacesBody,
     V1BuildSpec,
     V1CloudSpace,
@@ -1027,7 +1027,7 @@ class CloudRuntime(Runtime):
             project_id=project_id,
             cloudspace_id=cloudspace_id,
             id=run_id,
-            body=IdGetBody(
+            body=IdGetBody1(
                 cluster_id=cluster_id,
                 name=run_name,
                 desired_state=desired_state,

{lightning-2.3.0 → lightning-2.3.0.dev20240324}/src/lightning/app/runners/multiprocess.py RENAMED Viewed

@@ -81,17 +81,16 @@ class MultiProcessRuntime(Runtime):
             _set_flow_context()
-            if constants.ENABLE_ORCHESTRATOR:
-                storage_orchestrator = StorageOrchestrator(
-                    self.app,
-                    self.app.request_queues,
-                    self.app.response_queues,
-                    self.app.copy_request_queues,
-                    self.app.copy_response_queues,
-                )
-                self.threads.append(storage_orchestrator)
-                storage_orchestrator.setDaemon(True)
-                storage_orchestrator.start()
+            storage_orchestrator = StorageOrchestrator(
+                self.app,
+                self.app.request_queues,
+                self.app.response_queues,
+                self.app.copy_request_queues,
+                self.app.copy_response_queues,
+            )
+            self.threads.append(storage_orchestrator)
+            storage_orchestrator.setDaemon(True)
+            storage_orchestrator.start()
             if self.start_server:
                 self.app.should_publish_changes_to_api = True

lightning 2.3.0__tar.gz → 2.3.0.dev20240324__tar.gz

lightning 2.3.0tar.gz → 2.3.0.dev20240324tar.gz