PyPI - lightning - Versions diffs - 2.3.0.dev20240609__tar.gz → 2.4.0.dev20240630__tar.gz - Mend

lightning 2.3.0.dev20240609tar.gz → 2.4.0.dev20240630tar.gz

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.

Files changed (573) hide show

{lightning-2.3.0.dev20240609/src/lightning.egg-info → lightning-2.4.0.dev20240630}/PKG-INFO RENAMED Viewed

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: lightning
-Version: 2.3.0.dev20240609
+Version: 2.4.0.dev20240630
 Summary: The Deep Learning framework to train, deploy, and ship AI products Lightning fast.
 Home-page: https://github.com/Lightning-AI/lightning
 Author: Lightning AI et al.
@@ -27,18 +27,18 @@ Classifier: Programming Language :: Python :: 3.10
 Classifier: Programming Language :: Python :: 3.11
 Requires-Python: >=3.8
 Description-Content-Type: text/markdown
-Provides-Extra: fabric-examples
-Provides-Extra: fabric-strategies
-Provides-Extra: fabric-test
-Provides-Extra: store-test
 Provides-Extra: app-ui
+Provides-Extra: app-components
 Provides-Extra: app-cloud
 Provides-Extra: app-test
-Provides-Extra: app-components
-Provides-Extra: pytorch-examples
+Provides-Extra: store-test
+Provides-Extra: fabric-strategies
+Provides-Extra: fabric-examples
+Provides-Extra: fabric-test
 Provides-Extra: pytorch-strategies
-Provides-Extra: pytorch-extra
+Provides-Extra: pytorch-examples
 Provides-Extra: pytorch-test
+Provides-Extra: pytorch-extra
 Provides-Extra: fabric-all
 Provides-Extra: fabric-dev
 Provides-Extra: pytorch-all
@@ -46,14 +46,14 @@ Provides-Extra: pytorch-dev
 Provides-Extra: app-extra
 Provides-Extra: app-all
 Provides-Extra: app-dev
-Provides-Extra: data
-Provides-Extra: examples
-Provides-Extra: strategies
-Provides-Extra: test
 Provides-Extra: ui
+Provides-Extra: components
 Provides-Extra: cloud
+Provides-Extra: test
 Provides-Extra: app
-Provides-Extra: components
+Provides-Extra: data
+Provides-Extra: strategies
+Provides-Extra: examples
 Provides-Extra: extra
 Provides-Extra: all
 Provides-Extra: dev
@@ -74,11 +74,11 @@ License-File: LICENSE
 ______________________________________________________________________
 <p align="center">
-  <a href="https://lightning.ai/">Lightning.ai</a> •
-  <a href="https://lightning.ai/docs/pytorch/stable/">PyTorch Lightning</a> •
-  <a href="https://lightning.ai/docs/fabric/stable/">Fabric</a> •
-  <a href="https://lightning.ai/docs/app/stable/">Lightning Apps</a> •
-  <a href="https://pytorch-lightning.readthedocs.io/en/2.3.0.dev20240609">Docs</a> •
+  <a href="https://lightning.ai/">Lightning AI</a> •
+  <a href="#examples">Examples</a> •
+  <a href="#pytorch-lightning-train-and-deploy-pytorch-at-scale">PyTorch Lightning</a> •
+  <a href="#lightning-fabric-expert-control">Fabric</a> •
+  <a href="https://pytorch-lightning.readthedocs.io/en/2.4.0.dev20240630">Docs</a> •
   <a href="#community">Community</a> •
   <a href="https://lightning.ai/docs/pytorch/stable/generated/CONTRIBUTING.html">Contribute</a> •
 </p>
@@ -101,6 +101,20 @@ ______________________________________________________________________
 </div>
+<div align="center">
+<p align="center">
+&nbsp;
+<a target="_blank" href="https://lightning.ai/docs/pytorch/latest/starter/introduction.html#define-a-lightningmodule">
+  <img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/get-started-badge.svg" height="36px" alt="Get started"/>
+</a>
+</p>
+</div>
 ## Install Lightning
 Simple installation from PyPI
@@ -113,15 +127,11 @@ pip install lightning
 ______________________________________________________________________
-## Lightning has 4 core packages
+## Lightning has 2 core packages
 [PyTorch Lightning: Train and deploy PyTorch at scale](#pytorch-lightning-train-and-deploy-pytorch-at-scale).
 <br/>
 [Lightning Fabric: Expert control](#lightning-fabric-expert-control).
-<br/>
-[Lightning Data: Blazing fast, distributed streaming of training data from cloud storage](https://github.com/Lightning-AI/pytorch-lightning/tree/master/src/lightning/data).
-<br/>
-[Lightning Apps: Build AI products and ML workflows](#lightning-apps-build-ai-products-and-ml-workflows).
 Lightning gives you granular control over how much abstraction you want to add over PyTorch.
@@ -129,7 +139,9 @@ Lightning gives you granular control over how much abstraction you want to add o
     <img src="https://pl-public-data.s3.amazonaws.com/assets_lightning/continuum.png" width="80%">
 </div>
-______________________________________________________________________
+&nbsp;
+&nbsp;
 # PyTorch Lightning: Train and Deploy PyTorch at Scale
@@ -139,6 +151,15 @@ PyTorch Lightning is just organized PyTorch - Lightning disentangles PyTorch cod
 ______________________________________________________________________
+### Examples
+Explore various types of training possible with PyTorch Lightning. Pretrain and finetune ANY kind of model to perform ANY task like classification, segmentation, summarization and more:
+| Task  | Description | Run |
+|---|---|---|
+| [Hello world](#hello-simple-model)  | Pretrain - Hello world example | <a target="_blank" href="https://lightning.ai/lightning-ai/studios/pytorch-lightning-hello-world"><img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/studio-badge.svg" alt="Open In Studio"/></a> |
+| [Image segmentation](https://lightning.ai/lightning-ai/studios/image-segmentation-with-pytorch-lightning)  | Finetune - ResNet-50 model to segment images | <a target="_blank" href="https://lightning.ai/lightning-ai/studios/image-segmentation-with-pytorch-lightning"><img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/studio-badge.svg" alt="Open In Studio"/></a> |
+| [Text classification](https://lightning.ai/lightning-ai/studios/text-classification-with-pytorch-lightning)  | Finetune - text classifier (BERT model) | <a target="_blank" href="https://lightning.ai/lightning-ai/studios/text-classification-with-pytorch-lightning"><img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/studio-badge.svg" alt="Open In Studio"/></a> |
 ### Hello simple model
 ```python
@@ -340,7 +361,10 @@ ______________________________________________________________________
 ______________________________________________________________________
-# Lightning Fabric: Expert control.
+&nbsp;
+&nbsp;
+# Lightning Fabric: Expert control
 Run on any device at any scale with expert-level control over PyTorch training loop and scaling strategy. You can even write your own Trainer.
@@ -522,62 +546,8 @@ ______________________________________________________________________
 ______________________________________________________________________
-# Lightning Apps: Build AI products and ML workflows
-Lightning Apps remove the cloud infrastructure boilerplate so you can focus on solving the research or business problems. Lightning Apps can run on the Lightning Cloud, your own cluster or a private cloud.
-<div align="center">
-    <img src="https://pl-public-data.s3.amazonaws.com/assets_lightning/lightning-apps-teaser.png" width="80%">
-</div>
-## Hello Lightning app world
-```python
-# app.py
-import lightning as L
-class TrainComponent(L.LightningWork):
-    def run(self, x):
-        print(f"train a model on {x}")
-class AnalyzeComponent(L.LightningWork):
-    def run(self, x):
-        print(f"analyze model on {x}")
-class WorkflowOrchestrator(L.LightningFlow):
-    def __init__(self) -> None:
-        super().__init__()
-        self.train = TrainComponent(cloud_compute=L.CloudCompute("cpu"))
-        self.analyze = AnalyzeComponent(cloud_compute=L.CloudCompute("gpu"))
-    def run(self):
-        self.train.run("CPU machine 1")
-        self.analyze.run("GPU machine 2")
-app = L.LightningApp(WorkflowOrchestrator())
-```
-Run on the cloud or locally
-```bash
-# run on the cloud
-lightning run app app.py --setup --cloud
-# run locally
-lightning run app app.py
-```
-______________________________________________________________________
-<div align="center">
-    <a href="https://lightning.ai/docs/app/stable/">Read the Lightning Apps docs</a>
-</div>
-______________________________________________________________________
+&nbsp;
+&nbsp;
 ## Examples
@@ -608,7 +578,8 @@ ______________________________________________________________________
 - [Logistic Regression](https://lightning-bolts.readthedocs.io/en/stable/models/classic_ml.html#logistic-regression)
 - [Linear Regression](https://lightning-bolts.readthedocs.io/en/stable/models/classic_ml.html#linear-regression)
-______________________________________________________________________
+&nbsp;
+&nbsp;
 ## Continuous Integration
@@ -623,7 +594,7 @@ Lightning is rigorously tested across multiple CPUs, GPUs and TPUs and against m
 |       System / PyTorch ver.        | 1.13                                                                                                                                                                                                                            | 2.0                                                                                                                                                                                                                             |                                                                                                               2.1                                                                                                               |
 | :--------------------------------: | :-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: | :-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: |:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
-|        Linux py3.9 \[GPUs\]        |  |  | [![Build Status](https://dev.azure.com/Lightning-AI/lightning/_apis/build/status%2Fpytorch-lightning%20%28GPUs%29?branchName=refs%2Ftags%2F2.3.0.dev20240609)](https://dev.azure.com/Lightning-AI/lightning/_build/latest?definitionId=24&branchName=master) |
+|        Linux py3.9 \[GPUs\]        |  |  | [![Build Status](https://dev.azure.com/Lightning-AI/lightning/_apis/build/status%2Fpytorch-lightning%20%28GPUs%29?branchName=refs%2Ftags%2F2.4.0.dev20240630)](https://dev.azure.com/Lightning-AI/lightning/_build/latest?definitionId=24&branchName=master) |
 |        Linux py3.9 \[TPUs\]        |                                                                                                                                                                                                                                 |  [![Test PyTorch - TPU](https://github.com/Lightning-AI/lightning/actions/workflows/tpu-tests.yml/badge.svg)](https://github.com/Lightning-AI/lightning/actions/workflows/tpu-tests.yml)     |      |
 |  Linux (multiple Python versions)  | [![Test PyTorch](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml/badge.svg)](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml)                                 | [![Test PyTorch](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml/badge.svg)](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml)                                 |                 [![Test PyTorch](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml/badge.svg)](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml)                 |
 |   OSX (multiple Python versions)   | [![Test PyTorch](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml/badge.svg)](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml)                                 | [![Test PyTorch](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml/badge.svg)](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml)                                 |                 [![Test PyTorch](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml/badge.svg)](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml)                 |
@@ -632,7 +603,8 @@ Lightning is rigorously tested across multiple CPUs, GPUs and TPUs and against m
 </center>
 </details>
-______________________________________________________________________
+&nbsp;
+&nbsp;
 ## Community

{lightning-2.3.0.dev20240609 → lightning-2.4.0.dev20240630}/README.md RENAMED Viewed

@@ -12,10 +12,10 @@
 ______________________________________________________________________
 <p align="center">
-  <a href="https://lightning.ai/">Lightning.ai</a> •
-  <a href="https://lightning.ai/docs/pytorch/stable/">PyTorch Lightning</a> •
-  <a href="https://lightning.ai/docs/fabric/stable/">Fabric</a> •
-  <a href="https://lightning.ai/docs/app/stable/">Lightning Apps</a> •
+  <a href="https://lightning.ai/">Lightning AI</a> •
+  <a href="#examples">Examples</a> •
+  <a href="#pytorch-lightning-train-and-deploy-pytorch-at-scale">PyTorch Lightning</a> •
+  <a href="#lightning-fabric-expert-control">Fabric</a> •
   <a href="https://pytorch-lightning.readthedocs.io/en/stable/">Docs</a> •
   <a href="#community">Community</a> •
   <a href="https://lightning.ai/docs/pytorch/stable/generated/CONTRIBUTING.html">Contribute</a> •
@@ -39,6 +39,20 @@ ______________________________________________________________________
 </div>
+<div align="center">
+<p align="center">
+&nbsp;
+<a target="_blank" href="https://lightning.ai/docs/pytorch/latest/starter/introduction.html#define-a-lightningmodule">
+  <img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/get-started-badge.svg" height="36px" alt="Get started"/>
+</a>
+</p>
+</div>
 ## Install Lightning
 Simple installation from PyPI
@@ -92,15 +106,11 @@ pip install -iU https://test.pypi.org/simple/ pytorch-lightning
 ______________________________________________________________________
-## Lightning has 4 core packages
+## Lightning has 2 core packages
 [PyTorch Lightning: Train and deploy PyTorch at scale](#pytorch-lightning-train-and-deploy-pytorch-at-scale).
 <br/>
 [Lightning Fabric: Expert control](#lightning-fabric-expert-control).
-<br/>
-[Lightning Data: Blazing fast, distributed streaming of training data from cloud storage](https://github.com/Lightning-AI/pytorch-lightning/tree/master/src/lightning/data).
-<br/>
-[Lightning Apps: Build AI products and ML workflows](#lightning-apps-build-ai-products-and-ml-workflows).
 Lightning gives you granular control over how much abstraction you want to add over PyTorch.
@@ -108,7 +118,9 @@ Lightning gives you granular control over how much abstraction you want to add o
     <img src="https://pl-public-data.s3.amazonaws.com/assets_lightning/continuum.png" width="80%">
 </div>
-______________________________________________________________________
+&nbsp;
+&nbsp;
 # PyTorch Lightning: Train and Deploy PyTorch at Scale
@@ -118,6 +130,15 @@ PyTorch Lightning is just organized PyTorch - Lightning disentangles PyTorch cod
 ______________________________________________________________________
+### Examples
+Explore various types of training possible with PyTorch Lightning. Pretrain and finetune ANY kind of model to perform ANY task like classification, segmentation, summarization and more:
+| Task  | Description | Run |
+|---|---|---|
+| [Hello world](#hello-simple-model)  | Pretrain - Hello world example | <a target="_blank" href="https://lightning.ai/lightning-ai/studios/pytorch-lightning-hello-world"><img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/studio-badge.svg" alt="Open In Studio"/></a> |
+| [Image segmentation](https://lightning.ai/lightning-ai/studios/image-segmentation-with-pytorch-lightning)  | Finetune - ResNet-50 model to segment images | <a target="_blank" href="https://lightning.ai/lightning-ai/studios/image-segmentation-with-pytorch-lightning"><img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/studio-badge.svg" alt="Open In Studio"/></a> |
+| [Text classification](https://lightning.ai/lightning-ai/studios/text-classification-with-pytorch-lightning)  | Finetune - text classifier (BERT model) | <a target="_blank" href="https://lightning.ai/lightning-ai/studios/text-classification-with-pytorch-lightning"><img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/studio-badge.svg" alt="Open In Studio"/></a> |
 ### Hello simple model
 ```python
@@ -319,7 +340,10 @@ ______________________________________________________________________
 ______________________________________________________________________
-# Lightning Fabric: Expert control.
+&nbsp;
+&nbsp;
+# Lightning Fabric: Expert control
 Run on any device at any scale with expert-level control over PyTorch training loop and scaling strategy. You can even write your own Trainer.
@@ -501,62 +525,8 @@ ______________________________________________________________________
 ______________________________________________________________________
-# Lightning Apps: Build AI products and ML workflows
-Lightning Apps remove the cloud infrastructure boilerplate so you can focus on solving the research or business problems. Lightning Apps can run on the Lightning Cloud, your own cluster or a private cloud.
-<div align="center">
-    <img src="https://pl-public-data.s3.amazonaws.com/assets_lightning/lightning-apps-teaser.png" width="80%">
-</div>
-## Hello Lightning app world
-```python
-# app.py
-import lightning as L
-class TrainComponent(L.LightningWork):
-    def run(self, x):
-        print(f"train a model on {x}")
-class AnalyzeComponent(L.LightningWork):
-    def run(self, x):
-        print(f"analyze model on {x}")
-class WorkflowOrchestrator(L.LightningFlow):
-    def __init__(self) -> None:
-        super().__init__()
-        self.train = TrainComponent(cloud_compute=L.CloudCompute("cpu"))
-        self.analyze = AnalyzeComponent(cloud_compute=L.CloudCompute("gpu"))
-    def run(self):
-        self.train.run("CPU machine 1")
-        self.analyze.run("GPU machine 2")
-app = L.LightningApp(WorkflowOrchestrator())
-```
-Run on the cloud or locally
-```bash
-# run on the cloud
-lightning run app app.py --setup --cloud
-# run locally
-lightning run app app.py
-```
-______________________________________________________________________
-<div align="center">
-    <a href="https://lightning.ai/docs/app/stable/">Read the Lightning Apps docs</a>
-</div>
-______________________________________________________________________
+&nbsp;
+&nbsp;
 ## Examples
@@ -587,7 +557,8 @@ ______________________________________________________________________
 - [Logistic Regression](https://lightning-bolts.readthedocs.io/en/stable/models/classic_ml.html#logistic-regression)
 - [Linear Regression](https://lightning-bolts.readthedocs.io/en/stable/models/classic_ml.html#linear-regression)
-______________________________________________________________________
+&nbsp;
+&nbsp;
 ## Continuous Integration
@@ -611,7 +582,8 @@ Lightning is rigorously tested across multiple CPUs, GPUs and TPUs and against m
 </center>
 </details>
-______________________________________________________________________
+&nbsp;
+&nbsp;
 ## Community

{lightning-2.3.0.dev20240609 → lightning-2.4.0.dev20240630}/pyproject.toml RENAMED Viewed

@@ -140,6 +140,7 @@ exclude = [
     "src/lightning/app/cli/component-template",
     "src/lightning/app/cli/pl-app-template",
     "src/lightning/app/cli/react-ui-template",
+    "src/lightning/app/launcher/utils.py",
 ]
 install_types = "True"
 non_interactive = "True"

{lightning-2.3.0.dev20240609 → lightning-2.4.0.dev20240630}/requirements/app/app.txt RENAMED Viewed

@@ -1,4 +1,4 @@
-lightning-cloud == 0.5.69  # Must be pinned to ensure compatibility
+lightning-cloud == 0.5.70  # Must be pinned to ensure compatibility
 packaging
 typing-extensions >=4.4.0, <4.10.0
 deepdiff >=5.7.0, <6.6.0
@@ -6,7 +6,7 @@ fsspec[http] >=2022.5.0, <2023.11.0
 croniter >=1.3.0, <1.5.0  # strict; TODO: for now until we find something more robust.
 traitlets >=5.3.0, <5.12.0
 arrow >=1.2.0, <1.3.0
-lightning-utilities >=0.8.0, <0.12.0
+lightning-utilities >=0.10.0, <0.12.0
 beautifulsoup4 >=4.8.0, <4.13.0
 inquirer >=2.10.0, <3.2.0
 psutil <5.9.6
@@ -23,7 +23,9 @@ Jinja2 <3.2.0
 PyYAML <=6.0.1
 requests <2.32.0
 rich >=12.3.0, <13.6.0
-urllib3 <2.1.0
+urllib3 <2.0.0
 uvicorn <0.24.0
 websocket-client <1.7.0
 websockets <11.1.0
+numpy >=1.17.2, <2.0
+msgpack

{lightning-2.3.0.dev20240609 → lightning-2.4.0.dev20240630}/requirements/base.txt RENAMED Viewed

@@ -1,6 +1,6 @@
 PyYAML<7.0,>=5.4
 fsspec[http]<2025.0,>=2022.5.0
-lightning-utilities<1.0,>=0.8.0
+lightning-utilities<1.0,>=0.10.0
 numpy<2.0,>=1.17.2
 packaging<24.0,>=20.0
 torch<3.0,>=2.0.0

{lightning-2.3.0.dev20240609 → lightning-2.4.0.dev20240630}/requirements/fabric/base.txt RENAMED Viewed

@@ -6,4 +6,4 @@ torch >=2.0.0, <2.4.0
 fsspec[http] >=2022.5.0, <2024.4.0
 packaging >=20.0, <=23.1
 typing-extensions >=4.4.0, <4.10.0
-lightning-utilities >=0.8.0, <0.12.0
+lightning-utilities >=0.10.0, <0.12.0

{lightning-2.3.0.dev20240609 → lightning-2.4.0.dev20240630}/requirements/pytorch/base.txt RENAMED Viewed

@@ -9,4 +9,4 @@ fsspec[http] >=2022.5.0, <2024.4.0
 torchmetrics >=0.7.0, <1.3.0  # needed for using fixed compare_version
 packaging >=20.0, <=23.1
 typing-extensions >=4.4.0, <4.10.0
-lightning-utilities >=0.8.0, <0.12.0
+lightning-utilities >=0.10.0, <0.12.0

{lightning-2.3.0.dev20240609 → lightning-2.4.0.dev20240630}/requirements/pytorch/extra.txt RENAMED Viewed

@@ -3,8 +3,8 @@
 # extended list of package dependencies to reach full functionality
 matplotlib>3.1, <3.9.0
-omegaconf >=2.0.5, <2.4.0
-hydra-core >=1.0.5, <1.4.0
+omegaconf >=2.2.3, <2.4.0
+hydra-core >=1.2.0, <1.4.0
 jsonargparse[signatures] >=4.27.7, <4.28.0
 rich >=12.3.0, <13.6.0
 tensorboardX >=2.2, <2.7.0  # min version is set by torch.onnx missing attribute

{lightning-2.3.0.dev20240609 → lightning-2.4.0.dev20240630}/src/lightning/app/cli/lightning_cli.py RENAMED Viewed

@@ -40,7 +40,19 @@ from lightning.app.cli.connect.data import connect_data
 from lightning.app.cli.lightning_cli_delete import delete
 from lightning.app.cli.lightning_cli_launch import launch
 from lightning.app.cli.lightning_cli_list import get_list
-from lightning.app.core.constants import ENABLE_APP_COMMENT_COMMAND_EXECUTION, get_lightning_cloud_url
+from lightning.app.core.constants import (
+    APP_SERVER_HOST,
+    APP_SERVER_PORT,
+    ENABLE_APP_COMMENT_COMMAND_EXECUTION,
+    get_lightning_cloud_url,
+)
+from lightning.app.launcher.launcher import (
+    run_lightning_flow,
+    run_lightning_work,
+    serve_frontend,
+    start_application_server,
+    start_flow_and_servers,
+)
 from lightning.app.runners.cloud import CloudRuntime
 from lightning.app.runners.runtime import dispatch
 from lightning.app.runners.runtime_type import RuntimeType
@@ -393,3 +405,99 @@ def _prepare_file(file: str) -> str:
         return file
     raise FileNotFoundError(f"The provided file {file} hasn't been found.")
+@run.command("server")
+@click.argument("file", type=click.Path(exists=True))
+@click.option("--queue-id", help="ID for identifying queue", default="", type=str)
+@click.option("--host", help="Application running host", default=APP_SERVER_HOST, type=str)
+@click.option("--port", help="Application running port", default=APP_SERVER_PORT, type=int)
+def run_server(file: str, queue_id: str, host: str, port: int) -> None:
+    """It takes the application file as input, build the application object and then use that to run the application
+    server.
+    This is used by the cloud runners to start the status server for the application
+    """
+    logger.debug(f"Run Server: {file} {queue_id} {host} {port}")
+    start_application_server(file, host, port, queue_id=queue_id)
+@run.command("flow")
+@click.argument("file", type=click.Path(exists=True))
+@click.option("--queue-id", help="ID for identifying queue", default="", type=str)
+@click.option("--base-url", help="Base url at which the app server is hosted", default="")
+def run_flow(file: str, queue_id: str, base_url: str) -> None:
+    """It takes the application file as input, build the application object, proxy all the work components and then run
+    the application flow defined in the root component.
+    It does exactly what a singleprocess dispatcher would do but with proxied work components.
+    """
+    logger.debug(f"Run Flow: {file} {queue_id} {base_url}")
+    run_lightning_flow(file, queue_id=queue_id, base_url=base_url)
+@run.command("work")
+@click.argument("file", type=click.Path(exists=True))
+@click.option("--work-name", type=str)
+@click.option("--queue-id", help="ID for identifying queue", default="", type=str)
+def run_work(file: str, work_name: str, queue_id: str) -> None:
+    """Unlike other entrypoints, this command will take the file path or module details for a work component and run
+    that by fetching the states from the queues."""
+    logger.debug(f"Run Work: {file} {work_name} {queue_id}")
+    run_lightning_work(
+        file=file,
+        work_name=work_name,
+        queue_id=queue_id,
+    )
+@run.command("frontend")
+@click.argument("file", type=click.Path(exists=True))
+@click.option("--flow-name")
+@click.option("--host")
+@click.option("--port", type=int)
+def run_frontend(file: str, flow_name: str, host: str, port: int) -> None:
+    """Serve the frontend specified by the given flow."""
+    logger.debug(f"Run Frontend: {file} {flow_name} {host}")
+    serve_frontend(file=file, flow_name=flow_name, host=host, port=port)
+@run.command("flow-and-servers")
+@click.argument("file", type=click.Path(exists=True))
+@click.option("--queue-id", help="ID for identifying queue", default="", type=str)
+@click.option("--base-url", help="Base url at which the app server is hosted", default="")
+@click.option("--host", help="Application running host", default=APP_SERVER_HOST, type=str)
+@click.option("--port", help="Application running port", default=APP_SERVER_PORT, type=int)
+@click.option(
+    "--flow-port",
+    help="Pair of flow name and frontend port",
+    type=(str, int),
+    multiple=True,
+)
+def run_flow_and_servers(
+    file: str,
+    base_url: str,
+    queue_id: str,
+    host: str,
+    port: int,
+    flow_port: Tuple[Tuple[str, int]],
+) -> None:
+    """It takes the application file as input, build the application object and then use that to run the application
+    flow defined in the root component, the application server and all the flow frontends.
+    This is used by the cloud runners to start the flow, the status server and all frontends for the application
+    """
+    logger.debug(f"Run Flow: {file} {queue_id} {base_url}")
+    logger.debug(f"Run Server: {file} {queue_id} {host} {port}.")
+    logger.debug(f"Run Frontend's: {flow_port}")
+    start_flow_and_servers(
+        entrypoint_file=file,
+        base_url=base_url,
+        queue_id=queue_id,
+        host=host,
+        port=port,
+        flow_names_and_ports=flow_port,
+    )

{lightning-2.3.0.dev20240609 → lightning-2.4.0.dev20240630}/src/lightning/app/core/app.py RENAMED Viewed

@@ -35,6 +35,7 @@ from lightning.app.core.constants import (
     FLOW_DURATION_SAMPLES,
     FLOW_DURATION_THRESHOLD,
     FRONTEND_DIR,
+    SHOULD_START_WORKS_WITH_FLOW,
     STATE_ACCUMULATE_WAIT,
 )
 from lightning.app.core.queues import BaseQueue
@@ -144,6 +145,7 @@ class LightningApp:
         self.threads: List[threading.Thread] = []
         self.exception = None
         self.collect_changes: bool = True
+        self._should_start_works_with_flow: bool = SHOULD_START_WORKS_WITH_FLOW
         self.status: Optional[AppStatus] = None
         # TODO: Enable ready locally for opening the UI.
@@ -733,6 +735,9 @@ class LightningApp:
                 self.flow_to_work_delta_queues[w.name].put(deep_diff)
     def _start_with_flow_works(self) -> None:
+        if not self._should_start_works_with_flow:
+            return
         for w in self.works:
             if w._start_with_flow:
                 parallel = w.parallel

lightning 2.3.0.dev20240609__tar.gz → 2.4.0.dev20240630__tar.gz

lightning 2.3.0.dev20240609tar.gz → 2.4.0.dev20240630tar.gz