liger-kernel-nightly 0.5.2.dev20250109023714__py3-none-any.whl → 0.5.2.dev20250115025212__py3-none-any.whl
Sign up to get free protection for your applications and to get access to all the features.
- {liger_kernel_nightly-0.5.2.dev20250109023714.dist-info → liger_kernel_nightly-0.5.2.dev20250115025212.dist-info}/METADATA +6 -6
- {liger_kernel_nightly-0.5.2.dev20250109023714.dist-info → liger_kernel_nightly-0.5.2.dev20250115025212.dist-info}/RECORD +6 -6
- {liger_kernel_nightly-0.5.2.dev20250109023714.dist-info → liger_kernel_nightly-0.5.2.dev20250115025212.dist-info}/LICENSE +0 -0
- {liger_kernel_nightly-0.5.2.dev20250109023714.dist-info → liger_kernel_nightly-0.5.2.dev20250115025212.dist-info}/NOTICE +0 -0
- {liger_kernel_nightly-0.5.2.dev20250109023714.dist-info → liger_kernel_nightly-0.5.2.dev20250115025212.dist-info}/WHEEL +0 -0
- {liger_kernel_nightly-0.5.2.dev20250109023714.dist-info → liger_kernel_nightly-0.5.2.dev20250115025212.dist-info}/top_level.txt +0 -0
@@ -1,6 +1,6 @@
|
|
1
1
|
Metadata-Version: 2.1
|
2
2
|
Name: liger_kernel_nightly
|
3
|
-
Version: 0.5.2.
|
3
|
+
Version: 0.5.2.dev20250115025212
|
4
4
|
Summary: Efficient Triton kernels for LLM Training
|
5
5
|
License: BSD 2-CLAUSE LICENSE
|
6
6
|
Copyright 2024 LinkedIn Corporation
|
@@ -105,8 +105,8 @@ Requires-Dist: seaborn; extra == "dev"
|
|
105
105
|
|
106
106
|
<details>
|
107
107
|
<summary>Latest News 🔥</summary>
|
108
|
-
|
109
|
-
- [2024/12/11] We release [v0.5.0](https://github.com/linkedin/Liger-Kernel/releases/tag/v0.5.0): 80% more memory efficient post training losses (DPO, ORPO, CPO, etc)!
|
108
|
+
|
109
|
+
- [2024/12/11] We release [v0.5.0](https://github.com/linkedin/Liger-Kernel/releases/tag/v0.5.0): 80% more memory efficient post training losses (DPO, ORPO, CPO, etc)!
|
110
110
|
- [2024/12/5] We release LinkedIn Engineering Blog - [Liger-Kernel: Empowering an open source ecosystem of Triton Kernels for Efficient LLM Training](https://www.linkedin.com/blog/engineering/open-source/liger-kernel-open-source-ecosystem-for-efficient-llm-training)
|
111
111
|
- [2024/11/6] We release [v0.4.0](https://github.com/linkedin/Liger-Kernel/releases/tag/v0.4.0): Full AMD support, Tech Report, Modal CI, Llama-3.2-Vision!
|
112
112
|
- [2024/10/21] We have released the tech report of Liger Kernel on Arxiv: https://arxiv.org/pdf/2410.10989
|
@@ -299,7 +299,7 @@ loss.backward()
|
|
299
299
|
| Gemma1 | `liger_kernel.transformers.apply_liger_kernel_to_gemma` | RoPE, RMSNorm, GeGLU, CrossEntropyLoss, FusedLinearCrossEntropy |
|
300
300
|
| Gemma2 | `liger_kernel.transformers.apply_liger_kernel_to_gemma2` | RoPE, RMSNorm, GeGLU, CrossEntropyLoss, FusedLinearCrossEntropy |
|
301
301
|
| Qwen2, Qwen2.5, & QwQ | `liger_kernel.transformers.apply_liger_kernel_to_qwen2` | RoPE, RMSNorm, SwiGLU, CrossEntropyLoss, FusedLinearCrossEntropy |
|
302
|
-
| Qwen2-VL | `liger_kernel.transformers.apply_liger_kernel_to_qwen2_vl` | RMSNorm, LayerNorm, SwiGLU, CrossEntropyLoss, FusedLinearCrossEntropy |
|
302
|
+
| Qwen2-VL, & QVQ | `liger_kernel.transformers.apply_liger_kernel_to_qwen2_vl` | RMSNorm, LayerNorm, SwiGLU, CrossEntropyLoss, FusedLinearCrossEntropy |
|
303
303
|
| Phi3 & Phi3.5 | `liger_kernel.transformers.apply_liger_kernel_to_phi3` | RoPE, RMSNorm, SwiGLU, CrossEntropyLoss, FusedLinearCrossEntropy |
|
304
304
|
|
305
305
|
|
@@ -353,11 +353,11 @@ loss.backward()
|
|
353
353
|
- [License Information](https://github.com/linkedin/Liger-Kernel/blob/main/docs/License.md)
|
354
354
|
|
355
355
|
## Sponsorship and Collaboration
|
356
|
-
|
356
|
+
|
357
357
|
- [AMD](https://www.amd.com/en.html): Providing AMD GPUs for our AMD CI.
|
358
358
|
- [Intel](https://www.intel.com/): Providing Intel GPUs for our Intel CI.
|
359
359
|
- [Modal](https://modal.com/): Free 3000 credits from GPU MODE IRL for our NVIDIA CI.
|
360
|
-
- [EmbeddedLLM](https://embeddedllm.com/): Making Liger Kernel run fast and stable on AMD.
|
360
|
+
- [EmbeddedLLM](https://embeddedllm.com/): Making Liger Kernel run fast and stable on AMD.
|
361
361
|
- [HuggingFace](https://huggingface.co/): Integrating Liger Kernel into Hugging Face Transformers and TRL.
|
362
362
|
- [Lightning AI](https://lightning.ai/): Integrating Liger Kernel into Lightning Thunder.
|
363
363
|
- [Axolotl](https://axolotl.ai/): Integrating Liger Kernel into Axolotl.
|
@@ -58,9 +58,9 @@ liger_kernel/transformers/trainer/__init__.py,sha256=p7yQfklV8-467qSz_ZMimkbDF7H
|
|
58
58
|
liger_kernel/transformers/trainer/orpo_trainer.py,sha256=pdekW7l6Qg_aqa5SYKYlSWUF8m3lkOFvFLcIMEHrz9s,8338
|
59
59
|
liger_kernel/triton/__init__.py,sha256=qCiCamzCRv6lpV8IqpAc9YMdNKC7GKurClWceQPnlis,92
|
60
60
|
liger_kernel/triton/monkey_patch.py,sha256=Rd0hUHAzDkFfHvnX7-PBaNK5EKnZhtfM_h-fgQH9HPY,1568
|
61
|
-
liger_kernel_nightly-0.5.2.
|
62
|
-
liger_kernel_nightly-0.5.2.
|
63
|
-
liger_kernel_nightly-0.5.2.
|
64
|
-
liger_kernel_nightly-0.5.2.
|
65
|
-
liger_kernel_nightly-0.5.2.
|
66
|
-
liger_kernel_nightly-0.5.2.
|
61
|
+
liger_kernel_nightly-0.5.2.dev20250115025212.dist-info/LICENSE,sha256=OhzLDHJ0to4a8sodVLELZiCFylZ1NAAYLs-HrjPy0ag,1312
|
62
|
+
liger_kernel_nightly-0.5.2.dev20250115025212.dist-info/METADATA,sha256=sDbWP1JYiBLWMiChKJMWMd5sVddlHdRk0Jw8oQnkEP8,21055
|
63
|
+
liger_kernel_nightly-0.5.2.dev20250115025212.dist-info/NOTICE,sha256=njwnoPZLh9AN8SJQzxvCGLHi-8X__AvWRze6joNXIY8,2066
|
64
|
+
liger_kernel_nightly-0.5.2.dev20250115025212.dist-info/WHEEL,sha256=P9jw-gEje8ByB7_hXoICnHtVCrEwMQh-630tKvQWehc,91
|
65
|
+
liger_kernel_nightly-0.5.2.dev20250115025212.dist-info/top_level.txt,sha256=2eghu4hA3LnkM7ElW92tQ8zegWKgSbeo-k-aGe1YnvY,13
|
66
|
+
liger_kernel_nightly-0.5.2.dev20250115025212.dist-info/RECORD,,
|
File without changes
|
File without changes
|
File without changes
|