bitsandbytes-cpu-fork 0.50.2.dev11__tar.gz → 0.50.2.dev12__tar.gz
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/PKG-INFO +140 -2
- bitsandbytes_cpu_fork-0.50.2.dev11/bitsandbytes_cpu_fork.egg-info/PKG-INFO → bitsandbytes_cpu_fork-0.50.2.dev12/README.md +515 -408
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/__init__.py +1 -1
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/libbitsandbytes_cpu.dll +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/nn/modules.py +89 -10
- bitsandbytes_cpu_fork-0.50.2.dev11/README.md → bitsandbytes_cpu_fork-0.50.2.dev12/bitsandbytes_cpu_fork.egg-info/PKG-INFO +546 -377
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/docs_cpu/QUICKSTART.md +17 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/docs_cpu/QUICKSTART_EN.md +18 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tests/test_linear4bit.py +56 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/LICENSE +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/MANIFEST.in +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/__main__.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/_cpu_caps.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/_ops.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/autograd/__init__.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/autograd/_functions.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/backends/__init__.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/backends/cpu/__init__.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/backends/cpu/ops.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/backends/cuda/__init__.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/backends/cuda/ops.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/backends/default/__init__.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/backends/default/ops.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/backends/hpu/__init__.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/backends/hpu/ops.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/backends/mps/__init__.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/backends/mps/ops.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/backends/triton/__init__.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/backends/triton/kernels_4bit.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/backends/triton/kernels_8bit_quant.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/backends/triton/kernels_optim.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/backends/triton/ops.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/backends/utils.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/backends/xpu/__init__.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/backends/xpu/ops.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/cextension.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/cli.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/consts.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/cuda_specs.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/detect_cpu.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/diagnostics/__init__.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/diagnostics/cuda.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/diagnostics/main.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/diagnostics/utils.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/disk_balancer.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/efst.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/functional.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/fused/__init__.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/fused/_native.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/fused/_ref.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/gdn_cpu.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/nn/__init__.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/nn/parametrize.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/optim/__init__.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/optim/adagrad.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/optim/adam.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/optim/adamw.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/optim/adamw4bit.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/optim/ademamix.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/optim/lamb.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/optim/lars.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/optim/lion.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/optim/optimizer.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/optim/rmsprop.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/optim/sgd.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/py.typed +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/q3bit.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/torch_cpu_kit.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/utils.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes/vcomp140.dll +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes_cpu_cli.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes_cpu_fork.egg-info/SOURCES.txt +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes_cpu_fork.egg-info/dependency_links.txt +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes_cpu_fork.egg-info/entry_points.txt +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes_cpu_fork.egg-info/requires.txt +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/bitsandbytes_cpu_fork.egg-info/top_level.txt +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/build_linux.sh +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/build_manual/build_manual.bat +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/build_manual/export.def +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/build_manual/export_avx512.def +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/build_manual/export_generic.def +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/build_manual/selftest_win.bat +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/build_termux.sh +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/avx2_gemv_4bit.h +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/common.cuh +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/common.h +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/compat.cuh +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/compat_device.cuh +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/cpu_cache.h +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/cpu_features.h +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/cpu_gdn.cpp +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/cpu_ops.cpp +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/cpu_ops.h +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/gemm_4bit.cu +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/gemm_4bit_common.cuh +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/gemm_4bit_mma.cuh +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/gemm_4bit_simt.cu +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/gemm_4bit_simt.cuh +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/gemm_4bit_sm75.cu +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/gemm_4bit_sm75.cuh +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/gemm_4bit_sm80.cu +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/gemm_4bit_sm80.cuh +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/kernels.cu +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/kernels.cuh +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/ops.cu +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/ops.cuh +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/pythonInterface.cpp +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/test_avx2_gemv_4bit.cpp +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/test_cpu_cache.cpp +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/xpu_kernels.cpp +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/xpu_kernels.h +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/xpu_ops.cpp +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/csrc/xpu_ops.h +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/docs_cpu/API_REFERENCE.md +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/docs_cpu/API_REFERENCE_EN.md +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/docs_cpu/EPYC_VALIDATION.md +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/docs_cpu/ISA_MATRIX.md +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/docs_cpu/MOTION_BOUNDARY.md +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/docs_cpu/MOTION_BOUNDARY_EN.md +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/docs_cpu/TECHNICAL_GUIDE.md +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/docs_cpu/TECHNICAL_GUIDE_EN.md +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/docs_cpu/TECH_REPORT.md +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/docs_cpu/TECH_REPORT_EN.md +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/docs_cpu/WHEEL_PLATFORM_NOTES.md +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/docs_cpu/check_docs.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/examples/compile_inference.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/examples/cpu/cpu_training.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/examples/int8_inference_huggingface.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/examples/xpu/benchmark_paged_memory.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/examples/xpu/paged_xpu_training.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/pyproject.toml +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/selftest_cpu.c +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/setup.cfg +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/setup.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tests/test_autograd.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tests/test_cpu_e2e.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tests/test_cuda_setup_evaluator.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tests/test_functional.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tests/test_generation.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tests/test_linear8bitlt.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tests/test_modules.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tests/test_ops.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tests/test_optim.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tests/test_parametrize.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tests/test_rmsnorm_fwd_cpu.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tools/carve_selftest.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tools/create_github_release.ps1 +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tools/dump_signatures.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tools/gen_api_reference.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tools/mft_recover.c +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tools/mft_recover_gui.c +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tools/mft_recover_gui.manifest +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tools/mft_selftest.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tools/mftcore.h +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tools/patch_dev9.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tools/publish.ps1 +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tools/recovery_pipeline_selftest.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tools/sector_carve.c +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tools/sector_carve_gui.c +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tools/sector_mirror.c +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tools/sector_mirror_gui.c +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tools/train_llm_sft.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tools/verify_help_examples.py +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tools/verify_linux_cli.sh +0 -0
- {bitsandbytes_cpu_fork-0.50.2.dev11 → bitsandbytes_cpu_fork-0.50.2.dev12}/tools/verify_train_release.py +0 -0
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
Metadata-Version: 2.4
|
|
2
2
|
Name: bitsandbytes-cpu-fork
|
|
3
|
-
Version: 0.50.2.
|
|
3
|
+
Version: 0.50.2.dev12
|
|
4
4
|
Summary: bitsandbytes with a pure-CPU training backend (AVX2 / NEON): 8-bit optimizers, fused GDN, gemm_8bit, disk balancer. No GPU required.
|
|
5
5
|
License-Expression: MIT
|
|
6
6
|
Project-URL: repository, https://github.com/Ganyvnanoaa09-0906/bitsandbytes-CPU
|
|
@@ -36,7 +36,7 @@ Dynamic: license-file
|
|
|
36
36
|
> toolkit and no driver** — just an AVX2 x86-64 CPU (or ARM64 NEON), the CPU build of PyTorch,
|
|
37
37
|
> and 12–16 GB of RAM.
|
|
38
38
|
|
|
39
|
-
**Version: `0.50.2.
|
|
39
|
+
**Version: `0.50.2.dev12`** · import name is unchanged (`import bitsandbytes as bnb`) · MIT.
|
|
40
40
|
|
|
41
41
|
What the CPU backend provides: 8-bit blockwise optimizers (≈2.3 bytes of state per parameter
|
|
42
42
|
instead of 8; the 4-bit optimizer ≈1.03), 4/8-bit layers that run on CPU tensors, the fused
|
|
@@ -57,6 +57,15 @@ pip install bitsandbytes-cpu-fork
|
|
|
57
57
|
python -m bitsandbytes # prints version / platform / library info
|
|
58
58
|
```
|
|
59
59
|
|
|
60
|
+
If upstream `bitsandbytes` is already installed, **uninstall bitsandbytes first**: this fork
|
|
61
|
+
deliberately keeps the `bitsandbytes` import name (so transformers / peft / diffusers integrations
|
|
62
|
+
need no change), and pip will let the two distributions overwrite each other's files.
|
|
63
|
+
|
|
64
|
+
```bash
|
|
65
|
+
pip uninstall -y bitsandbytes
|
|
66
|
+
pip install bitsandbytes-cpu-fork
|
|
67
|
+
```
|
|
68
|
+
|
|
60
69
|
Requirements: Python ≥ 3.10 (64-bit), PyTorch ≥ 2.0 CPU build, x86-64 with AVX2 (a generic
|
|
61
70
|
SSE2 fallback is shipped) or ARM64 with NEON, Windows 10/11 or Linux glibc ≥ 2.17.
|
|
62
71
|
|
|
@@ -130,6 +139,31 @@ layer = layer.to("cpu") # .to() is what quantises the weights
|
|
|
130
139
|
y = layer(torch.randn(2, 1024))
|
|
131
140
|
```
|
|
132
141
|
|
|
142
|
+
Quantising an **existing** fp32/bf16 layer (the usual case) means moving the weights in first:
|
|
143
|
+
|
|
144
|
+
```python
|
|
145
|
+
orig = torch.nn.Linear(1024, 1024)
|
|
146
|
+
layer = bnb.nn.Linear4bit(orig.in_features, orig.out_features,
|
|
147
|
+
quant_type="nf4", compute_dtype=torch.float32)
|
|
148
|
+
layer.weight = bnb.nn.Params4bit(orig.weight.detach().clone(), quant_type="nf4", blocksize=64)
|
|
149
|
+
layer = layer.to("cpu") # quantisation happens here; calling forward() before this raises
|
|
150
|
+
out = layer(torch.randn(2, 1024))
|
|
151
|
+
```
|
|
152
|
+
|
|
153
|
+
Checkpoints round-trip through the ordinary API -- the 4-bit payload and the quantization state are
|
|
154
|
+
saved together and restored by `load_state_dict()`:
|
|
155
|
+
|
|
156
|
+
```python
|
|
157
|
+
sd = layer.state_dict()
|
|
158
|
+
fresh = bnb.nn.Linear4bit(1024, 1024, quant_type="nf4", compute_dtype=torch.float32)
|
|
159
|
+
fresh.load_state_dict(sd)
|
|
160
|
+
fresh = fresh.to("cpu") # already quantized: this keeps the loaded state
|
|
161
|
+
assert torch.equal(layer(x), fresh(x))
|
|
162
|
+
```
|
|
163
|
+
|
|
164
|
+
Only if you split the state dict by hand do you need the low-level form:
|
|
165
|
+
`bnb.nn.Params4bit.from_prequantized(quantized_stats=sd, data=sd.pop("weight"), device="cpu")`.
|
|
166
|
+
|
|
133
167
|
### Fused Gated DeltaNet (Qwen3-Next / Qwen3.5 linear attention)
|
|
134
168
|
|
|
135
169
|
```python
|
|
@@ -197,6 +231,36 @@ Also: `estimate_training_memory_gb()`, `spawn_training_jobs(cmds, plan)` (logs p
|
|
|
197
231
|
|
|
198
232
|
---
|
|
199
233
|
|
|
234
|
+
## Threading: which knob actually controls the CPU kernels
|
|
235
|
+
|
|
236
|
+
The CPU kernels parallelise with **OpenMP**. `torch.set_num_threads()` only affects PyTorch's own
|
|
237
|
+
operators; it does **not** change how many threads a bnb kernel uses. Use the environment, set
|
|
238
|
+
before the process starts (it is read at import time):
|
|
239
|
+
|
|
240
|
+
```bash
|
|
241
|
+
OMP_NUM_THREADS=4 python train.py
|
|
242
|
+
```
|
|
243
|
+
|
|
244
|
+
Measured on the 6-core reference laptop (4-bit dequantize, 2048x4096, one process at a time):
|
|
245
|
+
|
|
246
|
+
| setting | time |
|
|
247
|
+
|---|---|
|
|
248
|
+
| `torch.set_num_threads(1)` | 4.5 ms |
|
|
249
|
+
| `torch.set_num_threads(6)` | 5.2 ms -- not the knob |
|
|
250
|
+
| `OMP_NUM_THREADS=1` | 6.7 ms |
|
|
251
|
+
| `OMP_NUM_THREADS=6` | 4.4 ms |
|
|
252
|
+
|
|
253
|
+
Two consequences for training loops:
|
|
254
|
+
|
|
255
|
+
- **Match the two settings.** `torch.set_num_threads(6)` on a 6-thread CPU plus the default
|
|
256
|
+
OpenMP pool oversubscribes the machine; set `OMP_NUM_THREADS` to the same value.
|
|
257
|
+
- **DataLoader workers inherit the environment.** Set `OMP_NUM_THREADS` before workers are forked,
|
|
258
|
+
otherwise every worker starts a full OpenMP pool.
|
|
259
|
+
|
|
260
|
+
`torch_cpu_kit.tune_threads()` (above) calibrates a real step instead of guessing.
|
|
261
|
+
|
|
262
|
+
---
|
|
263
|
+
|
|
200
264
|
## What is inside the CPU backend
|
|
201
265
|
|
|
202
266
|
| Area | What it does |
|
|
@@ -308,6 +372,47 @@ the full trade-off tables, including negative results.
|
|
|
308
372
|
|
|
309
373
|
---
|
|
310
374
|
|
|
375
|
+
### What the quantized paths cost
|
|
376
|
+
|
|
377
|
+
Numbers from one 6-core reference laptop (R5-4500U, AVX2, no GPU), one process at a time. Read them
|
|
378
|
+
as the shape of the trade-off, not as universal constants.
|
|
379
|
+
|
|
380
|
+
**4-bit layer inference on CPU is a memory win, not a speed win.** Weight memory drops ~20x
|
|
381
|
+
(a 2048x2048 layer: 4.0 MB fp32 -> 0.2 MB) but every forward pass dequantizes, so it is slower than
|
|
382
|
+
the fp32 layer:
|
|
383
|
+
|
|
384
|
+
| batch | fp32 | 4-bit | 4-bit / fp32 |
|
|
385
|
+
|---|---|---|---|
|
|
386
|
+
| 1 | 1.33 ms | 5.32 ms | 4.00x slower |
|
|
387
|
+
| 8 | 4.34 ms | 7.66 ms | 1.76x slower |
|
|
388
|
+
| 64 | 5.67 ms | 9.57 ms | 1.69x slower |
|
|
389
|
+
|
|
390
|
+
**8-bit optimizer: the win depends on the tensor size, not only on the parameter count.** The same
|
|
391
|
+
32M parameters, arranged differently (`optimizer.step()` only):
|
|
392
|
+
|
|
393
|
+
| layout | fp32 | 8-bit | ratio |
|
|
394
|
+
|---|---|---|---|
|
|
395
|
+
| 1 tensor x 32M | 177.1 ms | 93.6 ms | 0.53x (faster) |
|
|
396
|
+
| 32 tensors x 1M | 155.8 ms | 127.0 ms | 0.82x |
|
|
397
|
+
| 128 tensors x 250k | 126.9 ms | 154.7 ms | 1.22x (slower) |
|
|
398
|
+
|
|
399
|
+
There is a fixed **per-tensor** cost, so 8-bit pays off once a tensor holds roughly **1M elements**
|
|
400
|
+
or more; on many tiny tensors it can be slower than fp32. Real transformer layouts are dominated by
|
|
401
|
+
large matrices, which is why full-model numbers still favour it (GPT2-124M, 148 tensors: 445 ms vs
|
|
402
|
+
688 ms fp32).
|
|
403
|
+
|
|
404
|
+
**8-bit vs 4-bit vs fp32, three-way** (`optimizer.step()`, real GPT-2 architectures):
|
|
405
|
+
|
|
406
|
+
| model | fp32 | 8-bit | 4-bit | state per parameter |
|
|
407
|
+
|---|---|---|---|---|
|
|
408
|
+
| GPT2-124M (148 tensors) | 688 ms | **445 ms** | 1151 ms | 8.00 / 2.04 / 1.03 B |
|
|
409
|
+
| GPT2-345M (292 tensors) | 1962 ms | **1304 ms** | 3995 ms | 8.00 / 2.04 / 1.03 B |
|
|
410
|
+
|
|
411
|
+
Default to 8-bit. Reach for 4-bit only when the optimizer state has to be smaller than the 4x
|
|
412
|
+
reduction 8-bit already gives, and accept the ~2x slower step.
|
|
413
|
+
|
|
414
|
+
---
|
|
415
|
+
|
|
311
416
|
## Platform limitations
|
|
312
417
|
|
|
313
418
|
- **CPU only.** CUDA/ROCm/XPU kernels are not built; a GPU is never required or used.
|
|
@@ -384,6 +489,38 @@ The long-form docs live in the repository (`bitsandbytes/docs_cpu/`, Chinese and
|
|
|
384
489
|
- [`ISA_MATRIX.md`](https://github.com/Ganyvnanoaa09-0906/bitsandbytes-CPU/blob/HEAD/bitsandbytes/docs_cpu/ISA_MATRIX.md) — x86 AVX2/generic/AVX-512 + aarch64 test matrix
|
|
385
490
|
- [`WHEEL_PLATFORM_NOTES.md`](https://github.com/Ganyvnanoaa09-0906/bitsandbytes-CPU/blob/HEAD/bitsandbytes/docs_cpu/WHEEL_PLATFORM_NOTES.md) — which wheel runs where, and why
|
|
386
491
|
|
|
492
|
+
## Video on CPU (verified)
|
|
493
|
+
|
|
494
|
+
Inference is verified: LCM-LoRA 3.7–4.4× (512² / 192²-6f), ONNX Runtime fp32 UNet + async VAE
|
|
495
|
+
**43 frames 257.0 s vs 280.9 s (1.09×)** with per-frame PSNR **73.2 dB** vs torch fp32 (18-frame
|
|
496
|
+
control run: 71.95 dB); int8 UNet is unusable (11.04 dB). Training (AnimateDiff 5D LoRA) runs
|
|
497
|
+
end-to-end on CPU (~11.2 s/step, 5.9 GB, loss/checkpoint/sample produced) but **learned motion
|
|
498
|
+
is not demonstrated** — all seven demo runs report `has_global_motion=False`; temporal-only LoRA
|
|
499
|
+
measured harmful, spatial rank4/151 steps is the usable recipe so far. Details and negative
|
|
500
|
+
results: `VIDEO_GUIDE.md`.
|
|
501
|
+
|
|
502
|
+
## Project extras (outside the library API)
|
|
503
|
+
|
|
504
|
+
The repository also ships the tooling used to build and verify the releases; none of it is
|
|
505
|
+
imported by the library:
|
|
506
|
+
|
|
507
|
+
- **Audio capability benches** — `scripts/bench/audio/`: ASR `faster-whisper-small` int8
|
|
508
|
+
**5.8x realtime / WER 0**, Piper TTS **15-18x**, Kokoro-82M **1.9-2.1x**, training-cost tiers
|
|
509
|
+
(tiny CNN / 19M VITS-proxy / 185M Whisper-proxy) and a real KWS training demo. Weights are
|
|
510
|
+
never committed; bad input exits 2.
|
|
511
|
+
- **Video E2E pipeline** — `scripts/video/` + `VIDEO_GUIDE.md`: stage-wise generation/training,
|
|
512
|
+
motion diagnostics, and the six dev11 perf fixes (all six cores, no grad checkpointing,
|
|
513
|
+
flush denormals, 5-thread training default).
|
|
514
|
+
- **NTFS recovery toolkit** — `bitsandbytes/tools/`: `sector_mirror` (bad-sector mirror with
|
|
515
|
+
resume), `mft_recover` (deleted files straight from `$MFT`), `sector_carve` (PNG/JPEG/GIF/
|
|
516
|
+
ZIP incl. docx-xlsx-pptx/PDF/MP4); each has a CLI + GUI and a byte-for-byte selftest.
|
|
517
|
+
- **Release engineering** — `tools/`: `normalize_sdist.py` + `check_sdist_identity.py` audit the
|
|
518
|
+
**uploaded bytes** (2-DLL policy, sha256-only; 16 selftest + 20 adversarial cases), plus the
|
|
519
|
+
normalize-limit and docs-gate suites. dev11's sdist was rebuilt twice from `git archive` and
|
|
520
|
+
matched on the normalized tar sha.
|
|
521
|
+
- **AR experiments** — `gt1030/ar_*`, `scripts/lib/small_image_model_v2.py` (documented in the
|
|
522
|
+
devlog; not part of the library API).
|
|
523
|
+
|
|
387
524
|
## Changelog
|
|
388
525
|
|
|
389
526
|
| Version | Changes |
|
|
@@ -398,6 +535,7 @@ The long-form docs live in the repository (`bitsandbytes/docs_cpu/`, Chinese and
|
|
|
398
535
|
| `0.50.2.dev8` | **restored `AdamW4bit`** (the kernel was dropped when dev4 vendored upstream; now scalar C kernel + torch fallback, 1.031 B/param); **new `bitsandbytes.q3bit` API** — `quantize_3bit`/`dequantize_3bit`/`gemm_3bit`/`gemm_3bit_transposed`, `QuantLinear3bit` (frozen 3-bit base + LoRA), `convert_linears_3bit`, native kernels on Linux with identical pure-torch fallback; CLI reference now includes 4bitopt/q3bit and all 43 examples execute in CI-style verification |
|
|
399
536
|
| `0.50.2.dev9` | **Windows native kernels**: CI now compiles the MSVC DLL from the current csrc and the export list includes the 4-bit optimizer and 2/3-bit symbols (they were silently missing before); **q3bit real-model validation** on Qwen3-1.7B (frozen 3-bit base + LoRA, eval 4.34→4.03 over 80 steps, RSS −67%, native step 7.7 s vs fp32 5.5 s); fixed the causal-LM **double-shift** label bug in the iGPU training kit (Windows package v0.1.2) |
|
|
400
537
|
| `0.50.2.dev10` | **NTFS recovery toolkit** (`sector_carve`, `mft_recover`, CLI + GUI, selftests) and the **video E2E pipeline** (generation/training, LCM and motion diagnostics); AVX2 4-bit GEMV fixes (wrong FP4 codebook, lazy-init race, non-divisible blocksize); gt1030 probe scripts and docs |
|
|
538
|
+
| `0.50.2.dev12` | description sync with the verified video results (43 frames 257.0 vs 280.9 s, per-frame PSNR 73.2 dB; training is loop-verified only), 4-bit CPU usability audit fixes (9 issues), `exp/ue8m0/` negative-result archive |
|
|
401
539
|
| `0.50.2.dev11` | **NT-store fast paths**: 4-bit dequant writes bypass the cache above 16 MiB (1.7–2.0× at 32–64 MB) and RMSNorm chooses NT by total footprint (x+res+out vs per-CCX L3); CPUID L3-sharing mask fix and the NT threshold wired to one macro; **byte-reproducible sdist** with an identity gate that audits the uploaded bytes (`--sdist`, 2-DLL policy, 20 adversarial cases) plus a docs gate requiring all six ZH/EN docs; repo regrouping into `scripts/*`; UTF-8 BOM strip; 5 reproducible CPU audio benches; 6 video perf fixes and 3 AR fixes |
|
|
402
540
|
|
|
403
541
|
## License and attribution
|