PyPI - lightning - Versions diffs - 2.3.0.dev20240609__tar.gz → 2.3.0.dev20240623__tar.gz - Mend

lightning 2.3.0.dev20240609tar.gz → 2.3.0.dev20240623tar.gz

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.

Files changed (572) hide show

{lightning-2.3.0.dev20240609/src/lightning.egg-info → lightning-2.3.0.dev20240623}/PKG-INFO RENAMED Viewed

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: lightning
-Version: 2.3.0.dev20240609
+Version: 2.3.0.dev20240623
 Summary: The Deep Learning framework to train, deploy, and ship AI products Lightning fast.
 Home-page: https://github.com/Lightning-AI/lightning
 Author: Lightning AI et al.
@@ -27,18 +27,18 @@ Classifier: Programming Language :: Python :: 3.10
 Classifier: Programming Language :: Python :: 3.11
 Requires-Python: >=3.8
 Description-Content-Type: text/markdown
-Provides-Extra: fabric-examples
-Provides-Extra: fabric-strategies
-Provides-Extra: fabric-test
-Provides-Extra: store-test
 Provides-Extra: app-ui
+Provides-Extra: app-components
 Provides-Extra: app-cloud
 Provides-Extra: app-test
-Provides-Extra: app-components
-Provides-Extra: pytorch-examples
+Provides-Extra: store-test
+Provides-Extra: fabric-strategies
+Provides-Extra: fabric-examples
+Provides-Extra: fabric-test
 Provides-Extra: pytorch-strategies
-Provides-Extra: pytorch-extra
+Provides-Extra: pytorch-examples
 Provides-Extra: pytorch-test
+Provides-Extra: pytorch-extra
 Provides-Extra: fabric-all
 Provides-Extra: fabric-dev
 Provides-Extra: pytorch-all
@@ -46,14 +46,14 @@ Provides-Extra: pytorch-dev
 Provides-Extra: app-extra
 Provides-Extra: app-all
 Provides-Extra: app-dev
-Provides-Extra: data
-Provides-Extra: examples
-Provides-Extra: strategies
-Provides-Extra: test
 Provides-Extra: ui
+Provides-Extra: components
 Provides-Extra: cloud
+Provides-Extra: test
 Provides-Extra: app
-Provides-Extra: components
+Provides-Extra: data
+Provides-Extra: strategies
+Provides-Extra: examples
 Provides-Extra: extra
 Provides-Extra: all
 Provides-Extra: dev
@@ -74,11 +74,11 @@ License-File: LICENSE
 ______________________________________________________________________
 <p align="center">
-  <a href="https://lightning.ai/">Lightning.ai</a> •
-  <a href="https://lightning.ai/docs/pytorch/stable/">PyTorch Lightning</a> •
-  <a href="https://lightning.ai/docs/fabric/stable/">Fabric</a> •
-  <a href="https://lightning.ai/docs/app/stable/">Lightning Apps</a> •
-  <a href="https://pytorch-lightning.readthedocs.io/en/2.3.0.dev20240609">Docs</a> •
+  <a href="https://lightning.ai/">Lightning AI</a> •
+  <a href="#examples">Examples</a> •
+  <a href="#pytorch-lightning-train-and-deploy-pytorch-at-scale">PyTorch Lightning</a> •
+  <a href="#lightning-fabric-expert-control">Fabric</a> •
+  <a href="https://pytorch-lightning.readthedocs.io/en/2.3.0.dev20240623">Docs</a> •
   <a href="#community">Community</a> •
   <a href="https://lightning.ai/docs/pytorch/stable/generated/CONTRIBUTING.html">Contribute</a> •
 </p>
@@ -101,6 +101,20 @@ ______________________________________________________________________
 </div>
+<div align="center">
+<p align="center">
+&nbsp;
+<a target="_blank" href="https://lightning.ai/docs/pytorch/latest/starter/introduction.html#define-a-lightningmodule">
+  <img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/get-started-badge.svg" height="36px" alt="Get started"/>
+</a>
+</p>
+</div>
 ## Install Lightning
 Simple installation from PyPI
@@ -113,15 +127,11 @@ pip install lightning
 ______________________________________________________________________
-## Lightning has 4 core packages
+## Lightning has 2 core packages
 [PyTorch Lightning: Train and deploy PyTorch at scale](#pytorch-lightning-train-and-deploy-pytorch-at-scale).
 <br/>
 [Lightning Fabric: Expert control](#lightning-fabric-expert-control).
-<br/>
-[Lightning Data: Blazing fast, distributed streaming of training data from cloud storage](https://github.com/Lightning-AI/pytorch-lightning/tree/master/src/lightning/data).
-<br/>
-[Lightning Apps: Build AI products and ML workflows](#lightning-apps-build-ai-products-and-ml-workflows).
 Lightning gives you granular control over how much abstraction you want to add over PyTorch.
@@ -129,7 +139,9 @@ Lightning gives you granular control over how much abstraction you want to add o
     <img src="https://pl-public-data.s3.amazonaws.com/assets_lightning/continuum.png" width="80%">
 </div>
-______________________________________________________________________
+&nbsp;
+&nbsp;
 # PyTorch Lightning: Train and Deploy PyTorch at Scale
@@ -139,6 +151,15 @@ PyTorch Lightning is just organized PyTorch - Lightning disentangles PyTorch cod
 ______________________________________________________________________
+### Examples
+Explore various types of training possible with PyTorch Lightning. Pretrain and finetune ANY kind of model to perform ANY task like classification, segmentation, summarization and more:
+| Task  | Description | Run |
+|---|---|---|
+| [Hello world](#hello-simple-model)  | Pretrain - Hello world example | <a target="_blank" href="https://lightning.ai/lightning-ai/studios/pytorch-lightning-hello-world"><img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/studio-badge.svg" alt="Open In Studio"/></a> |
+| [Image segmentation](https://lightning.ai/lightning-ai/studios/image-segmentation-with-pytorch-lightning)  | Finetune - ResNet-50 model to segment images | <a target="_blank" href="https://lightning.ai/lightning-ai/studios/image-segmentation-with-pytorch-lightning"><img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/studio-badge.svg" alt="Open In Studio"/></a> |
+| [Text classification](https://lightning.ai/lightning-ai/studios/text-classification-with-pytorch-lightning)  | Finetune - text classifier (BERT model) | <a target="_blank" href="https://lightning.ai/lightning-ai/studios/text-classification-with-pytorch-lightning"><img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/studio-badge.svg" alt="Open In Studio"/></a> |
 ### Hello simple model
 ```python
@@ -340,7 +361,10 @@ ______________________________________________________________________
 ______________________________________________________________________
-# Lightning Fabric: Expert control.
+&nbsp;
+&nbsp;
+# Lightning Fabric: Expert control
 Run on any device at any scale with expert-level control over PyTorch training loop and scaling strategy. You can even write your own Trainer.
@@ -522,62 +546,8 @@ ______________________________________________________________________
 ______________________________________________________________________
-# Lightning Apps: Build AI products and ML workflows
-Lightning Apps remove the cloud infrastructure boilerplate so you can focus on solving the research or business problems. Lightning Apps can run on the Lightning Cloud, your own cluster or a private cloud.
-<div align="center">
-    <img src="https://pl-public-data.s3.amazonaws.com/assets_lightning/lightning-apps-teaser.png" width="80%">
-</div>
-## Hello Lightning app world
-```python
-# app.py
-import lightning as L
-class TrainComponent(L.LightningWork):
-    def run(self, x):
-        print(f"train a model on {x}")
-class AnalyzeComponent(L.LightningWork):
-    def run(self, x):
-        print(f"analyze model on {x}")
-class WorkflowOrchestrator(L.LightningFlow):
-    def __init__(self) -> None:
-        super().__init__()
-        self.train = TrainComponent(cloud_compute=L.CloudCompute("cpu"))
-        self.analyze = AnalyzeComponent(cloud_compute=L.CloudCompute("gpu"))
-    def run(self):
-        self.train.run("CPU machine 1")
-        self.analyze.run("GPU machine 2")
-app = L.LightningApp(WorkflowOrchestrator())
-```
-Run on the cloud or locally
-```bash
-# run on the cloud
-lightning run app app.py --setup --cloud
-# run locally
-lightning run app app.py
-```
-______________________________________________________________________
-<div align="center">
-    <a href="https://lightning.ai/docs/app/stable/">Read the Lightning Apps docs</a>
-</div>
-______________________________________________________________________
+&nbsp;
+&nbsp;
 ## Examples
@@ -608,7 +578,8 @@ ______________________________________________________________________
 - [Logistic Regression](https://lightning-bolts.readthedocs.io/en/stable/models/classic_ml.html#logistic-regression)
 - [Linear Regression](https://lightning-bolts.readthedocs.io/en/stable/models/classic_ml.html#linear-regression)
-______________________________________________________________________
+&nbsp;
+&nbsp;
 ## Continuous Integration
@@ -623,7 +594,7 @@ Lightning is rigorously tested across multiple CPUs, GPUs and TPUs and against m
 |       System / PyTorch ver.        | 1.13                                                                                                                                                                                                                            | 2.0                                                                                                                                                                                                                             |                                                                                                               2.1                                                                                                               |
 | :--------------------------------: | :-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: | :-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: |:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
-|        Linux py3.9 \[GPUs\]        |  |  | [![Build Status](https://dev.azure.com/Lightning-AI/lightning/_apis/build/status%2Fpytorch-lightning%20%28GPUs%29?branchName=refs%2Ftags%2F2.3.0.dev20240609)](https://dev.azure.com/Lightning-AI/lightning/_build/latest?definitionId=24&branchName=master) |
+|        Linux py3.9 \[GPUs\]        |  |  | [![Build Status](https://dev.azure.com/Lightning-AI/lightning/_apis/build/status%2Fpytorch-lightning%20%28GPUs%29?branchName=refs%2Ftags%2F2.3.0.dev20240623)](https://dev.azure.com/Lightning-AI/lightning/_build/latest?definitionId=24&branchName=master) |
 |        Linux py3.9 \[TPUs\]        |                                                                                                                                                                                                                                 |  [![Test PyTorch - TPU](https://github.com/Lightning-AI/lightning/actions/workflows/tpu-tests.yml/badge.svg)](https://github.com/Lightning-AI/lightning/actions/workflows/tpu-tests.yml)     |      |
 |  Linux (multiple Python versions)  | [![Test PyTorch](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml/badge.svg)](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml)                                 | [![Test PyTorch](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml/badge.svg)](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml)                                 |                 [![Test PyTorch](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml/badge.svg)](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml)                 |
 |   OSX (multiple Python versions)   | [![Test PyTorch](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml/badge.svg)](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml)                                 | [![Test PyTorch](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml/badge.svg)](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml)                                 |                 [![Test PyTorch](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml/badge.svg)](https://github.com/Lightning-AI/lightning/actions/workflows/ci-tests-pytorch.yml)                 |
@@ -632,7 +603,8 @@ Lightning is rigorously tested across multiple CPUs, GPUs and TPUs and against m
 </center>
 </details>
-______________________________________________________________________
+&nbsp;
+&nbsp;
 ## Community

{lightning-2.3.0.dev20240609 → lightning-2.3.0.dev20240623}/README.md RENAMED Viewed

@@ -12,10 +12,10 @@
 ______________________________________________________________________
 <p align="center">
-  <a href="https://lightning.ai/">Lightning.ai</a> •
-  <a href="https://lightning.ai/docs/pytorch/stable/">PyTorch Lightning</a> •
-  <a href="https://lightning.ai/docs/fabric/stable/">Fabric</a> •
-  <a href="https://lightning.ai/docs/app/stable/">Lightning Apps</a> •
+  <a href="https://lightning.ai/">Lightning AI</a> •
+  <a href="#examples">Examples</a> •
+  <a href="#pytorch-lightning-train-and-deploy-pytorch-at-scale">PyTorch Lightning</a> •
+  <a href="#lightning-fabric-expert-control">Fabric</a> •
   <a href="https://pytorch-lightning.readthedocs.io/en/stable/">Docs</a> •
   <a href="#community">Community</a> •
   <a href="https://lightning.ai/docs/pytorch/stable/generated/CONTRIBUTING.html">Contribute</a> •
@@ -39,6 +39,20 @@ ______________________________________________________________________
 </div>
+<div align="center">
+<p align="center">
+&nbsp;
+<a target="_blank" href="https://lightning.ai/docs/pytorch/latest/starter/introduction.html#define-a-lightningmodule">
+  <img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/get-started-badge.svg" height="36px" alt="Get started"/>
+</a>
+</p>
+</div>
 ## Install Lightning
 Simple installation from PyPI
@@ -92,15 +106,11 @@ pip install -iU https://test.pypi.org/simple/ pytorch-lightning
 ______________________________________________________________________
-## Lightning has 4 core packages
+## Lightning has 2 core packages
 [PyTorch Lightning: Train and deploy PyTorch at scale](#pytorch-lightning-train-and-deploy-pytorch-at-scale).
 <br/>
 [Lightning Fabric: Expert control](#lightning-fabric-expert-control).
-<br/>
-[Lightning Data: Blazing fast, distributed streaming of training data from cloud storage](https://github.com/Lightning-AI/pytorch-lightning/tree/master/src/lightning/data).
-<br/>
-[Lightning Apps: Build AI products and ML workflows](#lightning-apps-build-ai-products-and-ml-workflows).
 Lightning gives you granular control over how much abstraction you want to add over PyTorch.
@@ -108,7 +118,9 @@ Lightning gives you granular control over how much abstraction you want to add o
     <img src="https://pl-public-data.s3.amazonaws.com/assets_lightning/continuum.png" width="80%">
 </div>
-______________________________________________________________________
+&nbsp;
+&nbsp;
 # PyTorch Lightning: Train and Deploy PyTorch at Scale
@@ -118,6 +130,15 @@ PyTorch Lightning is just organized PyTorch - Lightning disentangles PyTorch cod
 ______________________________________________________________________
+### Examples
+Explore various types of training possible with PyTorch Lightning. Pretrain and finetune ANY kind of model to perform ANY task like classification, segmentation, summarization and more:
+| Task  | Description | Run |
+|---|---|---|
+| [Hello world](#hello-simple-model)  | Pretrain - Hello world example | <a target="_blank" href="https://lightning.ai/lightning-ai/studios/pytorch-lightning-hello-world"><img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/studio-badge.svg" alt="Open In Studio"/></a> |
+| [Image segmentation](https://lightning.ai/lightning-ai/studios/image-segmentation-with-pytorch-lightning)  | Finetune - ResNet-50 model to segment images | <a target="_blank" href="https://lightning.ai/lightning-ai/studios/image-segmentation-with-pytorch-lightning"><img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/studio-badge.svg" alt="Open In Studio"/></a> |
+| [Text classification](https://lightning.ai/lightning-ai/studios/text-classification-with-pytorch-lightning)  | Finetune - text classifier (BERT model) | <a target="_blank" href="https://lightning.ai/lightning-ai/studios/text-classification-with-pytorch-lightning"><img src="https://pl-bolts-doc-images.s3.us-east-2.amazonaws.com/app-2/studio-badge.svg" alt="Open In Studio"/></a> |
 ### Hello simple model
 ```python
@@ -319,7 +340,10 @@ ______________________________________________________________________
 ______________________________________________________________________
-# Lightning Fabric: Expert control.
+&nbsp;
+&nbsp;
+# Lightning Fabric: Expert control
 Run on any device at any scale with expert-level control over PyTorch training loop and scaling strategy. You can even write your own Trainer.
@@ -501,62 +525,8 @@ ______________________________________________________________________
 ______________________________________________________________________
-# Lightning Apps: Build AI products and ML workflows
-Lightning Apps remove the cloud infrastructure boilerplate so you can focus on solving the research or business problems. Lightning Apps can run on the Lightning Cloud, your own cluster or a private cloud.
-<div align="center">
-    <img src="https://pl-public-data.s3.amazonaws.com/assets_lightning/lightning-apps-teaser.png" width="80%">
-</div>
-## Hello Lightning app world
-```python
-# app.py
-import lightning as L
-class TrainComponent(L.LightningWork):
-    def run(self, x):
-        print(f"train a model on {x}")
-class AnalyzeComponent(L.LightningWork):
-    def run(self, x):
-        print(f"analyze model on {x}")
-class WorkflowOrchestrator(L.LightningFlow):
-    def __init__(self) -> None:
-        super().__init__()
-        self.train = TrainComponent(cloud_compute=L.CloudCompute("cpu"))
-        self.analyze = AnalyzeComponent(cloud_compute=L.CloudCompute("gpu"))
-    def run(self):
-        self.train.run("CPU machine 1")
-        self.analyze.run("GPU machine 2")
-app = L.LightningApp(WorkflowOrchestrator())
-```
-Run on the cloud or locally
-```bash
-# run on the cloud
-lightning run app app.py --setup --cloud
-# run locally
-lightning run app app.py
-```
-______________________________________________________________________
-<div align="center">
-    <a href="https://lightning.ai/docs/app/stable/">Read the Lightning Apps docs</a>
-</div>
-______________________________________________________________________
+&nbsp;
+&nbsp;
 ## Examples
@@ -587,7 +557,8 @@ ______________________________________________________________________
 - [Logistic Regression](https://lightning-bolts.readthedocs.io/en/stable/models/classic_ml.html#logistic-regression)
 - [Linear Regression](https://lightning-bolts.readthedocs.io/en/stable/models/classic_ml.html#linear-regression)
-______________________________________________________________________
+&nbsp;
+&nbsp;
 ## Continuous Integration
@@ -611,7 +582,8 @@ Lightning is rigorously tested across multiple CPUs, GPUs and TPUs and against m
 </center>
 </details>
-______________________________________________________________________
+&nbsp;
+&nbsp;
 ## Community

{lightning-2.3.0.dev20240609 → lightning-2.3.0.dev20240623}/requirements/app/app.txt RENAMED Viewed

@@ -23,7 +23,7 @@ Jinja2 <3.2.0
 PyYAML <=6.0.1
 requests <2.32.0
 rich >=12.3.0, <13.6.0
-urllib3 <2.1.0
+urllib3 <2.0.0
 uvicorn <0.24.0
 websocket-client <1.7.0
 websockets <11.1.0

{lightning-2.3.0.dev20240609 → lightning-2.3.0.dev20240623}/requirements/base.txt RENAMED Viewed

@@ -1,6 +1,6 @@
 PyYAML<7.0,>=5.4
 fsspec[http]<2025.0,>=2022.5.0
-lightning-utilities<1.0,>=0.8.0
+lightning-utilities<1.0,>=0.10.0
 numpy<2.0,>=1.17.2
 packaging<24.0,>=20.0
 torch<3.0,>=2.0.0

{lightning-2.3.0.dev20240609 → lightning-2.3.0.dev20240623}/requirements/fabric/base.txt RENAMED Viewed

@@ -6,4 +6,4 @@ torch >=2.0.0, <2.4.0
 fsspec[http] >=2022.5.0, <2024.4.0
 packaging >=20.0, <=23.1
 typing-extensions >=4.4.0, <4.10.0
-lightning-utilities >=0.8.0, <0.12.0
+lightning-utilities >=0.10.0, <0.12.0

{lightning-2.3.0.dev20240609 → lightning-2.3.0.dev20240623}/requirements/pytorch/base.txt RENAMED Viewed

@@ -9,4 +9,4 @@ fsspec[http] >=2022.5.0, <2024.4.0
 torchmetrics >=0.7.0, <1.3.0  # needed for using fixed compare_version
 packaging >=20.0, <=23.1
 typing-extensions >=4.4.0, <4.10.0
-lightning-utilities >=0.8.0, <0.12.0
+lightning-utilities >=0.10.0, <0.12.0

{lightning-2.3.0.dev20240609 → lightning-2.3.0.dev20240623}/src/lightning/fabric/CHANGELOG.md RENAMED Viewed

@@ -5,63 +5,67 @@ All notable changes to this project will be documented in this file.
 The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
-## [unReleased] - 2024-MM-DD
+## [unreleased] - YYYY-MM-DD
 ### Added
-- Added sanitization for classes before logging them as hyperparameters ([#19771](https://github.com/Lightning-AI/pytorch-lightning/pull/19771))
+-
-- Enabled consolidating distributed checkpoints through `fabric consolidate` in the new CLI ([#19560](https://github.com/Lightning-AI/pytorch-lightning/pull/19560))
+-
-- Added the ability to explicitly mark forward methods in Fabric via `_FabricModule.mark_forward_method()` ([#19690](https://github.com/Lightning-AI/pytorch-lightning/pull/19690))
+### Changed
-- Added support for PyTorch 2.3 ([#19708](https://github.com/Lightning-AI/pytorch-lightning/pull/19708))
+-
-- Added `ModelParallelStrategy` to support 2D parallelism ([#19846](https://github.com/Lightning-AI/pytorch-lightning/pull/19846), [#19852](https://github.com/Lightning-AI/pytorch-lightning/pull/19852), [#19870](https://github.com/Lightning-AI/pytorch-lightning/pull/19870), [#19872](https://github.com/Lightning-AI/pytorch-lightning/pull/19872))
+-
-- Added a call to `torch.distributed.destroy_process_group` in atexit handler if process group needs destruction ([#19931](https://github.com/Lightning-AI/pytorch-lightning/pull/19931))
+### Deprecated
-- Added support for configuring hybrid-sharding by passing a tuple for the `FSDPStrategy(device_mesh=...)` argument ([#19504](https://github.com/Lightning-AI/pytorch-lightning/pull/19504))
+-
+-
-### Changed
+### Removed
-- Renamed `lightning run model` to `fabric run` ([#19442](https://github.com/Lightning-AI/pytorch-lightning/pull/19442), [#19527](https://github.com/Lightning-AI/pytorch-lightning/pull/19527))
+-
+-
-- The `Fabric.rank_zero_first` context manager now uses a barrier without timeout to avoid long-running tasks to be interrupted ([#19448](https://github.com/Lightning-AI/lightning/pull/19448))
+### Fixed
+-
-- Fabric now raises an error if you forget to call `fabric.backward()` when it is needed by the strategy or precision selection ([#19447](https://github.com/Lightning-AI/lightning/pull/19447), [#19493](https://github.com/Lightning-AI/lightning/pull/19493))
+-
-- `_BackwardSyncControl` can now control what to do when gradient accumulation is disabled ([#19577](https://github.com/Lightning-AI/lightning/pull/19577))
+## [2.3.0] - 2024-06-13
-### Deprecated
+### Added
--
+- Added sanitization for classes before logging them as hyperparameters ([#19771](https://github.com/Lightning-AI/pytorch-lightning/pull/19771))
+- Enabled consolidating distributed checkpoints through `fabric consolidate` in the new CLI ([#19560](https://github.com/Lightning-AI/pytorch-lightning/pull/19560))
+- Added the ability to explicitly mark forward methods in Fabric via `_FabricModule.mark_forward_method()` ([#19690](https://github.com/Lightning-AI/pytorch-lightning/pull/19690))
+- Added support for PyTorch 2.3 ([#19708](https://github.com/Lightning-AI/pytorch-lightning/pull/19708))
+- Added `ModelParallelStrategy` to support 2D parallelism ([#19846](https://github.com/Lightning-AI/pytorch-lightning/pull/19846), [#19852](https://github.com/Lightning-AI/pytorch-lightning/pull/19852), [#19870](https://github.com/Lightning-AI/pytorch-lightning/pull/19870), [#19872](https://github.com/Lightning-AI/pytorch-lightning/pull/19872))
+- Added a call to `torch.distributed.destroy_process_group` in atexit handler if process group needs destruction ([#19931](https://github.com/Lightning-AI/pytorch-lightning/pull/19931))
+- Added support for configuring hybrid-sharding by passing a tuple for the `FSDPStrategy(device_mesh=...)` argument ([#19504](https://github.com/Lightning-AI/pytorch-lightning/pull/19504))
--
+### Changed
--
+- Renamed `lightning run model` to `fabric run` ([#19442](https://github.com/Lightning-AI/pytorch-lightning/pull/19442), [#19527](https://github.com/Lightning-AI/pytorch-lightning/pull/19527))
+- The `Fabric.rank_zero_first` context manager now uses a barrier without timeout to avoid long-running tasks to be interrupted ([#19448](https://github.com/Lightning-AI/lightning/pull/19448))
+- Fabric now raises an error if you forget to call `fabric.backward()` when it is needed by the strategy or precision selection ([#19447](https://github.com/Lightning-AI/lightning/pull/19447), [#19493](https://github.com/Lightning-AI/lightning/pull/19493))
+- `_BackwardSyncControl` can now control what to do when gradient accumulation is disabled ([#19577](https://github.com/Lightning-AI/lightning/pull/19577))
 ### Removed
 - Removed support for PyTorch 1.13 ([#19706](https://github.com/Lightning-AI/lightning/pull/19706))
--
--
 ### Fixed
 - Fixed a matrix shape mismatch issue when running a model loaded from a quantized checkpoint (bitsandbytes) ([#19886](https://github.com/Lightning-AI/lightning/pull/19886))
--
--
 ## [2.2.2] - 2024-04-11

{lightning-2.3.0.dev20240609 → lightning-2.3.0.dev20240623}/src/lightning/fabric/utilities/distributed.py RENAMED Viewed

@@ -2,6 +2,7 @@ import atexit
 import contextlib
 import logging
 import os
+import signal
 import time
 from contextlib import nullcontext
 from datetime import timedelta
@@ -306,8 +307,11 @@ def _init_dist_connection(
 def _destroy_dist_connection() -> None:
+    # Don't allow Ctrl+C to interrupt this handler
+    signal.signal(signal.SIGINT, signal.SIG_IGN)
     if _distributed_is_initialized():
         torch.distributed.destroy_process_group()
+    signal.signal(signal.SIGINT, signal.SIG_DFL)
 def _get_default_process_group_backend_for_device(device: torch.device) -> str:

{lightning-2.3.0.dev20240609 → lightning-2.3.0.dev20240623}/src/lightning/fabric/utilities/testing/_runif.py RENAMED Viewed

@@ -17,7 +17,7 @@ import sys
 from typing import Dict, List, Optional, Tuple
 import torch
-from lightning_utilities.core.imports import compare_version
+from lightning_utilities.core.imports import RequirementCache, compare_version
 from packaging.version import Version
 from lightning.fabric.accelerators import XLAAccelerator
@@ -112,7 +112,7 @@ def _runif_reasons(
             reasons.append("Standalone execution")
         kwargs["standalone"] = True
-    if deepspeed and not _DEEPSPEED_AVAILABLE:
+    if deepspeed and not (_DEEPSPEED_AVAILABLE and RequirementCache(module="deepspeed.utils")):
         reasons.append("Deepspeed")
     if dynamo:

lightning 2.3.0.dev20240609__tar.gz → 2.3.0.dev20240623__tar.gz

lightning 2.3.0.dev20240609tar.gz → 2.3.0.dev20240623tar.gz