compressed-tensors-nightly 0.8.0.20241126__tar.gz → 0.8.0.20241128__tar.gz
Sign up to get free protection for your applications and to get access to all the features.
- {compressed-tensors-nightly-0.8.0.20241126/src/compressed_tensors_nightly.egg-info → compressed-tensors-nightly-0.8.0.20241128}/PKG-INFO +1 -1
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/compressors/quantized_compressors/naive_quantized.py +4 -2
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/compressors/quantized_compressors/pack_quantized.py +2 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128/src/compressed_tensors_nightly.egg-info}/PKG-INFO +1 -1
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/LICENSE +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/README.md +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/pyproject.toml +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/setup.cfg +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/setup.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/base.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/compressors/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/compressors/base.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/compressors/helpers.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/compressors/model_compressors/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/compressors/model_compressors/model_compressor.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/compressors/quantized_compressors/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/compressors/quantized_compressors/base.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/compressors/sparse_compressors/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/compressors/sparse_compressors/base.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/compressors/sparse_compressors/dense.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/compressors/sparse_compressors/sparse_bitmask.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/compressors/sparse_quantized_compressors/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/compressors/sparse_quantized_compressors/marlin_24.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/config/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/config/base.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/config/dense.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/config/sparse_bitmask.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/linear/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/linear/compressed_linear.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/quantization/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/quantization/lifecycle/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/quantization/lifecycle/apply.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/quantization/lifecycle/compressed.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/quantization/lifecycle/forward.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/quantization/lifecycle/helpers.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/quantization/lifecycle/initialize.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/quantization/quant_args.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/quantization/quant_config.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/quantization/quant_scheme.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/quantization/utils/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/quantization/utils/helpers.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/registry/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/registry/registry.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/utils/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/utils/helpers.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/utils/offload.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/utils/permutations_24.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/utils/permute.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/utils/safetensors_load.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/utils/semi_structured_conversions.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors/version.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors_nightly.egg-info/SOURCES.txt +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors_nightly.egg-info/dependency_links.txt +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors_nightly.egg-info/requires.txt +0 -0
- {compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/src/compressed_tensors_nightly.egg-info/top_level.txt +0 -0
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
Metadata-Version: 2.1
|
|
2
2
|
Name: compressed-tensors-nightly
|
|
3
|
-
Version: 0.8.0.
|
|
3
|
+
Version: 0.8.0.20241128
|
|
4
4
|
Summary: Library for utilization of compressed safetensors of neural network models
|
|
5
5
|
Home-page: https://github.com/neuralmagic/compressed-tensors
|
|
6
6
|
Author: Neuralmagic, Inc.
|
|
@@ -93,9 +93,11 @@ class NaiveQuantizationCompressor(BaseQuantizationCompressor):
|
|
|
93
93
|
args=quantization_args,
|
|
94
94
|
dtype=quantization_args.pytorch_dtype(),
|
|
95
95
|
)
|
|
96
|
+
else:
|
|
97
|
+
quantized_weight = weight
|
|
96
98
|
|
|
97
|
-
|
|
98
|
-
|
|
99
|
+
if device is not None:
|
|
100
|
+
quantized_weight = quantized_weight.to(device)
|
|
99
101
|
|
|
100
102
|
return {"weight": quantized_weight}
|
|
101
103
|
|
|
@@ -94,6 +94,8 @@ class PackedQuantizationCompressor(BaseQuantizationCompressor):
|
|
|
94
94
|
args=quantization_args,
|
|
95
95
|
dtype=torch.int8,
|
|
96
96
|
)
|
|
97
|
+
else:
|
|
98
|
+
quantized_weight = weight
|
|
97
99
|
|
|
98
100
|
packed_weight = pack_to_int32(quantized_weight, quantization_args.num_bits)
|
|
99
101
|
weight_shape = torch.tensor(weight.shape)
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
Metadata-Version: 2.1
|
|
2
2
|
Name: compressed-tensors-nightly
|
|
3
|
-
Version: 0.8.0.
|
|
3
|
+
Version: 0.8.0.20241128
|
|
4
4
|
Summary: Library for utilization of compressed safetensors of neural network models
|
|
5
5
|
Home-page: https://github.com/neuralmagic/compressed-tensors
|
|
6
6
|
Author: Neuralmagic, Inc.
|
{compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/LICENSE
RENAMED
|
File without changes
|
{compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/README.md
RENAMED
|
File without changes
|
|
File without changes
|
{compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/setup.cfg
RENAMED
|
File without changes
|
{compressed-tensors-nightly-0.8.0.20241126 → compressed-tensors-nightly-0.8.0.20241128}/setup.py
RENAMED
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|