liger-kernel-nightly 0.5.5.dev20250320214749__py3-none-any.whl → 0.5.5.dev20250322021112__py3-none-any.whl
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Potentially problematic release.
This version of liger-kernel-nightly might be problematic. Click here for more details.
- {liger_kernel_nightly-0.5.5.dev20250320214749.dist-info → liger_kernel_nightly-0.5.5.dev20250322021112.dist-info}/METADATA +4 -4
- {liger_kernel_nightly-0.5.5.dev20250320214749.dist-info → liger_kernel_nightly-0.5.5.dev20250322021112.dist-info}/RECORD +6 -6
- {liger_kernel_nightly-0.5.5.dev20250320214749.dist-info → liger_kernel_nightly-0.5.5.dev20250322021112.dist-info}/LICENSE +0 -0
- {liger_kernel_nightly-0.5.5.dev20250320214749.dist-info → liger_kernel_nightly-0.5.5.dev20250322021112.dist-info}/NOTICE +0 -0
- {liger_kernel_nightly-0.5.5.dev20250320214749.dist-info → liger_kernel_nightly-0.5.5.dev20250322021112.dist-info}/WHEEL +0 -0
- {liger_kernel_nightly-0.5.5.dev20250320214749.dist-info → liger_kernel_nightly-0.5.5.dev20250322021112.dist-info}/top_level.txt +0 -0
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
Metadata-Version: 2.1
|
|
2
2
|
Name: liger_kernel_nightly
|
|
3
|
-
Version: 0.5.5.
|
|
3
|
+
Version: 0.5.5.dev20250322021112
|
|
4
4
|
Summary: Efficient Triton kernels for LLM Training
|
|
5
5
|
License: BSD 2-CLAUSE LICENSE
|
|
6
6
|
Copyright 2024 LinkedIn Corporation
|
|
@@ -176,7 +176,7 @@ y = orpo_loss(lm_head.weight, x, target)
|
|
|
176
176
|
- **Exact:** Computation is exact—no approximations! Both forward and backward passes are implemented with rigorous unit tests and undergo convergence testing against training runs without Liger Kernel to ensure accuracy.
|
|
177
177
|
- **Lightweight:** Liger Kernel has minimal dependencies, requiring only Torch and Triton—no extra libraries needed! Say goodbye to dependency headaches!
|
|
178
178
|
- **Multi-GPU supported:** Compatible with multi-GPU setups (PyTorch FSDP, DeepSpeed, DDP, etc.).
|
|
179
|
-
- **Trainer Framework Integration**: [Axolotl](https://github.com/axolotl-ai-cloud/axolotl), [LLaMa-Factory](https://github.com/hiyouga/LLaMA-Factory), [SFTTrainer](https://github.com/huggingface/trl/releases/tag/v0.10.1), [Hugging Face Trainer](https://github.com/huggingface/transformers/pull/32860), [SWIFT](https://github.com/modelscope/ms-swift)
|
|
179
|
+
- **Trainer Framework Integration**: [Axolotl](https://github.com/axolotl-ai-cloud/axolotl), [LLaMa-Factory](https://github.com/hiyouga/LLaMA-Factory), [SFTTrainer](https://github.com/huggingface/trl/releases/tag/v0.10.1), [Hugging Face Trainer](https://github.com/huggingface/transformers/pull/32860), [SWIFT](https://github.com/modelscope/ms-swift), [oumi](https://github.com/oumi-ai/oumi/tree/main)
|
|
180
180
|
|
|
181
181
|
## Installation
|
|
182
182
|
|
|
@@ -386,8 +386,8 @@ loss.backward()
|
|
|
386
386
|
## Contact
|
|
387
387
|
|
|
388
388
|
- For issues, create a Github ticket in this repository
|
|
389
|
-
- For open discussion, join [our discord channel](https://discord.
|
|
390
|
-
- For formal collaboration, send an email to yannchen@linkedin.com
|
|
389
|
+
- For open discussion, join [our discord channel on GPUMode](https://discord.com/channels/1189498204333543425/1275130785933951039)
|
|
390
|
+
- For formal collaboration, send an email to yannchen@linkedin.com and hning@linkedin.com
|
|
391
391
|
|
|
392
392
|
## Cite this work
|
|
393
393
|
|
|
@@ -69,9 +69,9 @@ liger_kernel/transformers/trainer/__init__.py,sha256=p7yQfklV8-467qSz_ZMimkbDF7H
|
|
|
69
69
|
liger_kernel/transformers/trainer/orpo_trainer.py,sha256=pdekW7l6Qg_aqa5SYKYlSWUF8m3lkOFvFLcIMEHrz9s,8338
|
|
70
70
|
liger_kernel/triton/__init__.py,sha256=qCiCamzCRv6lpV8IqpAc9YMdNKC7GKurClWceQPnlis,92
|
|
71
71
|
liger_kernel/triton/monkey_patch.py,sha256=Rd0hUHAzDkFfHvnX7-PBaNK5EKnZhtfM_h-fgQH9HPY,1568
|
|
72
|
-
liger_kernel_nightly-0.5.5.
|
|
73
|
-
liger_kernel_nightly-0.5.5.
|
|
74
|
-
liger_kernel_nightly-0.5.5.
|
|
75
|
-
liger_kernel_nightly-0.5.5.
|
|
76
|
-
liger_kernel_nightly-0.5.5.
|
|
77
|
-
liger_kernel_nightly-0.5.5.
|
|
72
|
+
liger_kernel_nightly-0.5.5.dev20250322021112.dist-info/LICENSE,sha256=OhzLDHJ0to4a8sodVLELZiCFylZ1NAAYLs-HrjPy0ag,1312
|
|
73
|
+
liger_kernel_nightly-0.5.5.dev20250322021112.dist-info/METADATA,sha256=t43xPpqj832O9qh6D1IfCqO06dNiO8VVJEUMvDzgs6U,22959
|
|
74
|
+
liger_kernel_nightly-0.5.5.dev20250322021112.dist-info/NOTICE,sha256=njwnoPZLh9AN8SJQzxvCGLHi-8X__AvWRze6joNXIY8,2066
|
|
75
|
+
liger_kernel_nightly-0.5.5.dev20250322021112.dist-info/WHEEL,sha256=iAkIy5fosb7FzIOwONchHf19Qu7_1wCWyFNR5gu9nU0,91
|
|
76
|
+
liger_kernel_nightly-0.5.5.dev20250322021112.dist-info/top_level.txt,sha256=2eghu4hA3LnkM7ElW92tQ8zegWKgSbeo-k-aGe1YnvY,13
|
|
77
|
+
liger_kernel_nightly-0.5.5.dev20250322021112.dist-info/RECORD,,
|
|
File without changes
|
|
File without changes
|
|
File without changes
|