bitsandbytes 0.50.0__py3-none-win_arm64.whl

bitsandbytes-0.50.0.dist-info/METADATA

@@ -0,0 +1,288 @@
+Metadata-Version: 2.4
+Name: bitsandbytes
+Version: 0.50.0
+Summary: k-bit optimizers and matrix multiplication routines.
+Author-email: Tim Dettmers <dettmers@cs.washington.edu>
+Maintainer-email: Titus von Köller <titus@huggingface.co>, Matthew Douglas <matthew.douglas@huggingface.co>
+License-Expression: MIT
+Project-URL: homepage, https://github.com/bitsandbytes-foundation/bitsandbytes
+Project-URL: changelog, https://github.com/bitsandbytes-foundation/bitsandbytes/blob/main/CHANGELOG.md
+Project-URL: docs, https://huggingface.co/docs/bitsandbytes/main
+Project-URL: issues, https://github.com/bitsandbytes-foundation/bitsandbytes/issues
+Keywords: gpu,optimizers,optimization,8-bit,quantization,compression
+Classifier: Development Status :: 4 - Beta
+Classifier: Environment :: GPU :: NVIDIA CUDA :: 11.8
+Classifier: Environment :: GPU :: NVIDIA CUDA :: 12
+Classifier: Environment :: GPU :: NVIDIA CUDA :: 13
+Classifier: Intended Audience :: Developers
+Classifier: Intended Audience :: Science/Research
+Classifier: Operating System :: POSIX :: Linux
+Classifier: Operating System :: MacOS
+Classifier: Operating System :: Microsoft :: Windows
+Classifier: Programming Language :: C++
+Classifier: Programming Language :: Python :: Implementation :: CPython
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Programming Language :: Python :: 3.14
+Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
+Requires-Python: >=3.10
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: torch<3,>=2.4
+Requires-Dist: numpy>=1.17
+Requires-Dist: packaging>=20.9
+Provides-Extra: benchmark
+Requires-Dist: pandas; extra == "benchmark"
+Requires-Dist: matplotlib; extra == "benchmark"
+Provides-Extra: docs
+Requires-Dist: hf-doc-builder==0.5.0; extra == "docs"
+Provides-Extra: dev
+Requires-Dist: bitsandbytes[test]; extra == "dev"
+Requires-Dist: build<2,>=1.0.0; extra == "dev"
+Requires-Dist: ruff~=0.14.3; extra == "dev"
+Requires-Dist: pre-commit<4,>=3.5.0; extra == "dev"
+Requires-Dist: wheel<1,>=0.42; extra == "dev"
+Provides-Extra: test
+Requires-Dist: einops~=0.8.0; extra == "test"
+Requires-Dist: lion-pytorch==0.2.3; extra == "test"
+Requires-Dist: pytest~=8.3; extra == "test"
+Requires-Dist: scipy<2,>=1.11.4; extra == "test"
+Requires-Dist: transformers<5,>=4.30.1; extra == "test"
+Dynamic: license-file
+
+<p align="center"><img src="https://avatars.githubusercontent.com/u/175231607?s=200&v=4" alt=""></p>
+<h1 align="center">bitsandbytes</h1>
+<p align="center">
+    <a href="https://github.com/bitsandbytes-foundation/bitsandbytes/main/LICENSE"><img alt="License" src="https://img.shields.io/github/license/bitsandbytes-foundation/bitsandbytes.svg?color=blue"></a>
+    <a href="https://pepy.tech/project/bitsandbytes"><img alt="Downloads" src="https://static.pepy.tech/badge/bitsandbytes/month"></a>
+    <a href="https://github.com/bitsandbytes-foundation/bitsandbytes/actions/workflows/tests-nightly.yml"><img alt="Nightly Unit Tests" src="https://img.shields.io/github/actions/workflow/status/bitsandbytes-foundation/bitsandbytes/tests-nightly.yml?logo=github&label=Nightly%20Tests"></a>
+    <a href="https://github.com/bitsandbytes-foundation/bitsandbytes/releases"><img alt="GitHub Release" src="https://img.shields.io/github/v/release/bitsandbytes-foundation/bitsandbytes"></a>
+    <a href="https://pypi.org/project/bitsandbytes/"><img alt="PyPI - Python Version" src="https://img.shields.io/pypi/pyversions/bitsandbytes"></a>
+</p>
+
+`bitsandbytes` enables accessible large language models via k-bit quantization for PyTorch. We provide three main features for dramatically reducing memory consumption for inference and training:
+
+* 8-bit optimizers uses block-wise quantization to maintain 32-bit performance at a small fraction of the memory cost.
+* LLM.int8() or 8-bit quantization enables large language model inference with only half the required memory and without any performance degradation. This method is based on vector-wise quantization to quantize most features to 8-bits and separately treating outliers with 16-bit matrix multiplication.
+* QLoRA or 4-bit quantization enables large language model training with several memory-saving techniques that don't compromise performance. This method quantizes a model to 4-bits and inserts a small set of trainable low-rank adaptation (LoRA) weights to allow training.
+
+The library includes quantization primitives for 8-bit & 4-bit operations, through `bitsandbytes.nn.Linear8bitLt` and `bitsandbytes.nn.Linear4bit` and 8-bit optimizers through `bitsandbytes.optim` module.
+
+## System Requirements
+bitsandbytes has the following minimum requirements for all platforms:
+
+* Python 3.10+
+* [PyTorch](https://pytorch.org/get-started/locally/) 2.4+
+  * _Note: While we aim to provide wide backwards compatibility, we recommend using the latest version of PyTorch for the best experience._
+
+#### Accelerator support:
+
+<small>Note: this table reflects the status of the current development branch. For the latest stable release, see the
+[document in the 0.49.2 tag](https://github.com/bitsandbytes-foundation/bitsandbytes/blob/0.49.2/README.md#accelerator-support).
+</small>
+
+##### Legend:
+🚧 = Planned |
+〰️ = Partially Supported |
+✅ = Supported |
+❌ = Not Supported
+
+<table>
+  <thead>
+    <tr>
+      <th>Platform</th>
+      <th>Accelerator</th>
+      <th>Hardware Requirements</th>
+      <th>LLM.int8()</th>
+      <th>QLoRA 4-bit</th>
+      <th>8-bit Optimizers</th>
+    </tr>
+  </thead>
+  <tbody>
+    <tr>
+      <td colspan="6">🐧 <strong>Linux, glibc >= 2.24</strong></td>
+    </tr>
+    <tr>
+      <td align="right">x86-64</td>
+      <td>◻️ CPU</td>
+      <td>Minimum: AVX2<br>Optimized: AVX512F, AVX512BF16</td>
+      <td>✅</td>
+      <td>✅</td>
+      <td>✅</td>
+    </tr>
+    <tr>
+      <td></td>
+      <td>🟩 NVIDIA GPU <br><code>cuda</code></td>
+      <td>SM60+ minimum<br>SM75+ recommended</td>
+      <td>✅</td>
+      <td>✅</td>
+      <td>✅</td>
+    </tr>
+    <tr>
+      <td></td>
+      <td>🟥 AMD GPU <br><code>cuda</code></td>
+      <td>
+        CDNA: gfx908, gfx90a, gfx942, gfx950<br>
+        RDNA: gfx103X, gfx110X, gfx115X, gfx120X
+      </td>
+      <td>✅</td>
+      <td>✅</td>
+      <td>✅</td>
+    </tr>
+    <tr>
+      <td></td>
+      <td>🟦 Intel GPU <br><code>xpu</code></td>
+      <td>
+        Data Center GPU Max Series<br>
+        Arc A-Series (Alchemist)<br>
+        Arc B-Series (Battlemage)
+      </td>
+      <td>✅</td>
+      <td>✅</td>
+      <td>✅</td>
+    </tr>
+    <tr>
+      <td></td>
+      <td>🟪 Intel Gaudi <br><code>hpu</code></td>
+      <td>Gaudi2, Gaudi3</td>
+      <td>✅</td>
+      <td>〰️</td>
+      <td>❌</td>
+    </tr>
+    <tr>
+      <td align="right">aarch64</td>
+      <td>◻️ CPU</td>
+      <td></td>
+      <td>✅ *</td>
+      <td>✅</td>
+      <td>✅</td>
+    </tr>
+    <tr>
+      <td></td>
+      <td>🟩 NVIDIA GPU <br><code>cuda</code></td>
+      <td>SM75+</td>
+      <td>✅</td>
+      <td>✅</td>
+      <td>✅</td>
+    </tr>
+    <tr>
+      <td colspan="6">🪟 <strong>Windows 11 / Windows Server 2022+</strong></td>
+    </tr>
+    <tr>
+      <td align="right">x86-64</td>
+      <td>◻️ CPU</td>
+      <td>AVX2</td>
+      <td>✅</td>
+      <td>✅</td>
+      <td>✅</td>
+    </tr>
+    <tr>
+      <td></td>
+      <td>🟩 NVIDIA GPU <br><code>cuda</code></td>
+      <td>SM60+ minimum<br>SM75+ recommended</td>
+      <td>✅</td>
+      <td>✅</td>
+      <td>✅</td>
+    </tr>
+    <tr>
+      <td></td>
+      <td>🟥 AMD GPU <br><code>cuda</code></td>
+      <td>
+        RDNA: gfx103X, gfx110X, gfx115X, gfx120X
+      </td>
+      <td>✅</td>
+      <td>✅</td>
+      <td>✅</td>
+    </tr>
+    <tr>
+      <td></td>
+      <td>🟦 Intel GPU <br><code>xpu</code></td>
+      <td>
+        Arc A-Series (Alchemist) <br>
+        Arc B-Series (Battlemage)
+      </td>
+      <td>✅</td>
+      <td>✅</td>
+      <td>✅</td>
+    </tr>
+    <tr>
+      <td align="right">arm64</td>
+      <td>◻️ CPU</td>
+      <td></td>
+      <td>✅</td>
+      <td>✅</td>
+      <td>✅</td>
+    </tr>
+    <tr>
+      <td colspan="6">🍎 <strong>macOS 14+</strong></td>
+    </tr>
+    <tr>
+      <td align="right">arm64</td>
+      <td>◻️ CPU</td>
+      <td>Apple M1+</td>
+      <td>✅ *</td>
+      <td>✅</td>
+      <td>✅</td>
+    </tr>
+    <tr>
+      <td></td>
+      <td>⬜ Metal <br><code>mps</code></td>
+      <td>Apple M1+</td>
+      <td>✅ *</td>
+      <td>✅</td>
+      <td>🚧</td>
+  </tbody>
+</table>
+<sup>* While supported, these marked features may lack in performance optimizations.</sup>
+
+## :book: Documentation
+* [Official Documentation](https://huggingface.co/docs/bitsandbytes/main)
+* 🤗 [Transformers](https://huggingface.co/docs/transformers/quantization/bitsandbytes)
+* 🤗 [Diffusers](https://huggingface.co/docs/diffusers/quantization/bitsandbytes)
+* 🤗 [PEFT](https://huggingface.co/docs/peft/developer_guides/quantization#quantize-a-model)
+
+## :heart: Sponsors
+The continued maintenance and development of `bitsandbytes` is made possible thanks to the generous support of our sponsors. Their contributions help ensure that we can keep improving the project and delivering valuable updates to the community.
+
+<kbd><a href="https://hf.co" target="_blank"><img width="100" src="https://huggingface.co/datasets/huggingface/brand-assets/resolve/main/hf-logo.svg" alt="Hugging Face"></a></kbd>
+
+## License
+`bitsandbytes` is MIT licensed.
+
+## How to cite us
+If you found this library useful, please consider citing our work:
+
+### QLoRA
+
+```bibtex
+@article{dettmers2023qlora,
+  title={Qlora: Efficient finetuning of quantized llms},
+  author={Dettmers, Tim and Pagnoni, Artidoro and Holtzman, Ari and Zettlemoyer, Luke},
+  journal={arXiv preprint arXiv:2305.14314},
+  year={2023}
+}
+```
+
+### LLM.int8()
+
+```bibtex
+@article{dettmers2022llmint8,
+  title={LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale},
+  author={Dettmers, Tim and Lewis, Mike and Belkada, Younes and Zettlemoyer, Luke},
+  journal={arXiv preprint arXiv:2208.07339},
+  year={2022}
+}
+```
+
+### 8-bit Optimizers
+
+```bibtex
+@article{dettmers2022optimizers,
+  title={8-bit Optimizers via Block-wise Quantization},
+  author={Dettmers, Tim and Lewis, Mike and Shleifer, Sam and Zettlemoyer, Luke},
+  journal={9th International Conference on Learning Representations, ICLR},
+  year={2022}
+}
+```

bitsandbytes-0.50.0.dist-info/RECORD

@@ -0,0 +1,54 @@
+bitsandbytes/__init__.py,sha256=kDfieZyNke1kvCu8cxY_3rAoqO33QLcx-IaTgjTAnwI,2300
+bitsandbytes/__main__.py,sha256=_ObgXmW-NG395jj_oP86gSOw2LgqMtrGBmpjZOiRcuY,94
+bitsandbytes/_ops.py,sha256=zTO6TkHqTscULBL-kMnICUH_LOoT4s9noTrSB95wIw4,20429
+bitsandbytes/cextension.py,sha256=7TjyZFk1w1CTI4SWZDrGMPnVlMVXtpMvDZgAz_e9228,17579
+bitsandbytes/consts.py,sha256=hhASlIvnZUQd4XXo1wlQ86KpSfVSUCW91F7-wVjfjlk,392
+bitsandbytes/cuda_specs.py,sha256=Ep1ZRftiM2rfsDO8FljAnHkbySGEs_WMQeRmjFo4gh0,3347
+bitsandbytes/functional.py,sha256=xX1_1FHgvt_LZSOFb4kUtzDXSMdPL-29Y_vpdY-zc1g,67097
+bitsandbytes/libbitsandbytes_cpu.dll,sha256=Ou59TH_lL6x47LGu69HjCZuMNwV8IuIjcYIJF2Va0ag,25088
+bitsandbytes/py.typed,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+bitsandbytes/utils.py,sha256=vlyJUqa7-9jvDehlniAjzC0bdVE75zbNuGGKDi7cFnQ,7136
+bitsandbytes/autograd/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+bitsandbytes/autograd/_functions.py,sha256=mx4hMqLyEM_k7LkntSuaxObTUjOmoZNtJAQU5Sok_Gw,18191
+bitsandbytes/backends/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+bitsandbytes/backends/utils.py,sha256=I8NYpiI6fLBIOfrBOJjdkj2KdOugcR4LJ4O1hv8aXS4,2416
+bitsandbytes/backends/cpu/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+bitsandbytes/backends/cpu/ops.py,sha256=_EgYUUGdEHHqzuHljdvwgTtwde-0ve1cJVznfnqMw68,21491
+bitsandbytes/backends/cuda/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+bitsandbytes/backends/cuda/ops.py,sha256=ISEXDmxtupbj8C3VY9nKIG8IujIT8ZHOhkdX7dgbvJ8,42972
+bitsandbytes/backends/default/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+bitsandbytes/backends/default/ops.py,sha256=SchGOud5vlwQFUTTHTDdLyj8xkaJSAsdUXhIgDZGw80,20434
+bitsandbytes/backends/hpu/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+bitsandbytes/backends/hpu/ops.py,sha256=j8IqjGLIA9GJAli9XpMH1uf9gm_WdLhCYjhbVW3x0zg,1510
+bitsandbytes/backends/mps/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+bitsandbytes/backends/mps/ops.py,sha256=c1Dmq_yOFliSQGhqnQEpXOHqsW9WspN2Q1JRD56yMmQ,9382
+bitsandbytes/backends/triton/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+bitsandbytes/backends/triton/kernels_4bit.py,sha256=UK8KmOtulENhLS1vqlX8HTz7WcC4Q9nl4eL2ILVNiLo,22727
+bitsandbytes/backends/triton/kernels_8bit_quant.py,sha256=HFWa6sz8-D9FujJxbOWgAP373Uv4uz1ZWmjQ6FCvdfs,6737
+bitsandbytes/backends/triton/kernels_optim.py,sha256=I4r6tRxbM5PW2ZCpbZTjAjyqdaO46UkX6lkUbLHJpWY,39862
+bitsandbytes/backends/triton/ops.py,sha256=mk52KiC5kANZkTqh_kQOwybZYweHNOvNCKYlvb6TbSw,10580
+bitsandbytes/backends/xpu/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+bitsandbytes/backends/xpu/ops.py,sha256=hx6GBJrEcq5lEEsbOe_oVQLp2yE0YXc9sn9zdLVpB8s,10150
+bitsandbytes/diagnostics/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+bitsandbytes/diagnostics/cuda.py,sha256=aHdBmtEzpMi9kqrlc5Ocom-42GFZrum7z-a32hs_lug,7449
+bitsandbytes/diagnostics/main.py,sha256=Hvs6YrcuIMCjCj5rn7bVk0jnF2BLgCEMhA4caZf0Aiw,4336
+bitsandbytes/diagnostics/utils.py,sha256=moc7UuWYEB56YDXIsWj-8okDElRaHjcxXl5Tv0iNTdc,296
+bitsandbytes/nn/__init__.py,sha256=MHhyc2sKbGEQNOb0-tyiDHkmiVI_XYVV3swD1K1Y7uI,451
+bitsandbytes/nn/modules.py,sha256=iQJUedMwq-NQA-tG6gqRGZKXi9QI5RW99gIIi2ESwlA,45482
+bitsandbytes/nn/parametrize.py,sha256=thoaELsxt09Xe6GhOnZL-GI8EqxBWncXEQu-TqLo1lM,8571
+bitsandbytes/optim/__init__.py,sha256=AvB75Z18WaU0EfmE5tH73CwLQxyhLFznOc2VZ97Ovcw,903
+bitsandbytes/optim/adagrad.py,sha256=5KV3AyV-aA6NL9c43owtwe_5tlEwXRDS2WF5v3OQg6M,6961
+bitsandbytes/optim/adam.py,sha256=5Cdz2JmRFNZdF4yfzfrkIqJLrAuqFIlPFxUCDkInupc,13178
+bitsandbytes/optim/adamw.py,sha256=HG1I6N_Gf1H6BbYaELHcgo72mkgp61J_PfGd8UyXDZg,12786
+bitsandbytes/optim/ademamix.py,sha256=6FVGN-U587a_Auo-AMonrdjQN9vGZq_BNNvdveoGX9g,13160
+bitsandbytes/optim/lamb.py,sha256=QPSgNqHsTBEWb_mjKrh4lb-UotLPQY3JP8D9ZMjQDI4,7505
+bitsandbytes/optim/lars.py,sha256=ogP3rgbKebrydIz16uJqnIEhxdpLC8mTgQogVAnpvUA,8585
+bitsandbytes/optim/lion.py,sha256=WmRuaeVntkjkKvIivVh7t3Ac-nqKWFxtZ3NShQc3rJM,8575
+bitsandbytes/optim/optimizer.py,sha256=pS8X47Bo3sgkDDIkGEp8C6stE-ZM_Hx1DvFWExyg9MI,28883
+bitsandbytes/optim/rmsprop.py,sha256=wJel4HgLjCPEHjcB5vPFZF6HleKD4vh1ILYt0dPR0is,6304
+bitsandbytes/optim/sgd.py,sha256=UYydMLYpBnW3nj4tnIq5FYjkhOLXz8YBaISKHQ3go6Q,5068
+bitsandbytes-0.50.0.dist-info/licenses/LICENSE,sha256=8IqUv7C9wdfxy1m62vD4xVGxDbhxGFYi2_H9A2r_qcs,1107
+bitsandbytes-0.50.0.dist-info/METADATA,sha256=LOUNQe0YquzfKPVjvoBIWBi4vGH8RFWX3VuqHGISEHQ,10823
+bitsandbytes-0.50.0.dist-info/WHEEL,sha256=7p5VkX3z5OMy8JR5LmEJwjgGjqYEqLr-eMf5rGGwnq8,98
+bitsandbytes-0.50.0.dist-info/top_level.txt,sha256=bK-Zzu-JyIIh4njm8jTYcbuqX-Z80XTcDal4lXCG0-M,13
+bitsandbytes-0.50.0.dist-info/RECORD,,

bitsandbytes-0.50.0.dist-info/WHEEL

@@ -0,0 +1,5 @@
+Wheel-Version: 1.0
+Generator: setuptools (83.0.0)
+Root-Is-Purelib: false
+Tag: py3-none-win_arm64
+

bitsandbytes-0.50.0.dist-info/licenses/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) Facebook, Inc. and its affiliates.
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

bitsandbytes-0.50.0.dist-info/top_level.txt

@@ -0,0 +1 @@
+bitsandbytes