compressed-tensors-nightly 0.8.0.20241124__tar.gz → 0.8.0.20241126__tar.gz
Sign up to get free protection for your applications and to get access to all the features.
- {compressed-tensors-nightly-0.8.0.20241124/src/compressed_tensors_nightly.egg-info → compressed-tensors-nightly-0.8.0.20241126}/PKG-INFO +1 -1
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/quantization/quant_scheme.py +16 -2
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126/src/compressed_tensors_nightly.egg-info}/PKG-INFO +1 -1
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/LICENSE +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/README.md +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/pyproject.toml +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/setup.cfg +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/setup.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/base.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/compressors/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/compressors/base.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/compressors/helpers.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/compressors/model_compressors/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/compressors/model_compressors/model_compressor.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/compressors/quantized_compressors/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/compressors/quantized_compressors/base.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/compressors/quantized_compressors/naive_quantized.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/compressors/quantized_compressors/pack_quantized.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/compressors/sparse_compressors/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/compressors/sparse_compressors/base.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/compressors/sparse_compressors/dense.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/compressors/sparse_compressors/sparse_bitmask.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/compressors/sparse_quantized_compressors/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/compressors/sparse_quantized_compressors/marlin_24.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/config/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/config/base.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/config/dense.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/config/sparse_bitmask.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/linear/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/linear/compressed_linear.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/quantization/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/quantization/lifecycle/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/quantization/lifecycle/apply.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/quantization/lifecycle/compressed.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/quantization/lifecycle/forward.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/quantization/lifecycle/helpers.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/quantization/lifecycle/initialize.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/quantization/quant_args.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/quantization/quant_config.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/quantization/utils/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/quantization/utils/helpers.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/registry/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/registry/registry.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/utils/__init__.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/utils/helpers.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/utils/offload.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/utils/permutations_24.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/utils/permute.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/utils/safetensors_load.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/utils/semi_structured_conversions.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors/version.py +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors_nightly.egg-info/SOURCES.txt +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors_nightly.egg-info/dependency_links.txt +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors_nightly.egg-info/requires.txt +0 -0
- {compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/src/compressed_tensors_nightly.egg-info/top_level.txt +0 -0
@@ -1,6 +1,6 @@
|
|
1
1
|
Metadata-Version: 2.1
|
2
2
|
Name: compressed-tensors-nightly
|
3
|
-
Version: 0.8.0.
|
3
|
+
Version: 0.8.0.20241126
|
4
4
|
Summary: Library for utilization of compressed safetensors of neural network models
|
5
5
|
Home-page: https://github.com/neuralmagic/compressed-tensors
|
6
6
|
Author: Neuralmagic, Inc.
|
@@ -13,14 +13,14 @@
|
|
13
13
|
# limitations under the License.
|
14
14
|
|
15
15
|
from copy import deepcopy
|
16
|
-
from typing import List, Optional
|
16
|
+
from typing import Any, Dict, List, Optional
|
17
17
|
|
18
18
|
from compressed_tensors.quantization.quant_args import (
|
19
19
|
QuantizationArgs,
|
20
20
|
QuantizationStrategy,
|
21
21
|
QuantizationType,
|
22
22
|
)
|
23
|
-
from pydantic import BaseModel
|
23
|
+
from pydantic import BaseModel, model_validator
|
24
24
|
|
25
25
|
|
26
26
|
__all__ = [
|
@@ -47,6 +47,20 @@ class QuantizationScheme(BaseModel):
|
|
47
47
|
input_activations: Optional[QuantizationArgs] = None
|
48
48
|
output_activations: Optional[QuantizationArgs] = None
|
49
49
|
|
50
|
+
@model_validator(mode="after")
|
51
|
+
def validate_model_after(model: "QuantizationArgs") -> Dict[str, Any]:
|
52
|
+
inputs = model.input_activations
|
53
|
+
outputs = model.output_activations
|
54
|
+
|
55
|
+
if inputs is not None:
|
56
|
+
if inputs.actorder is not None:
|
57
|
+
raise ValueError("Cannot apply actorder to input activations")
|
58
|
+
|
59
|
+
if outputs is not None:
|
60
|
+
if outputs.actorder is not None:
|
61
|
+
raise ValueError("Cannot apply actorder to output activations")
|
62
|
+
|
63
|
+
return model
|
50
64
|
|
51
65
|
"""
|
52
66
|
Pre-Set Quantization Scheme Args
|
@@ -1,6 +1,6 @@
|
|
1
1
|
Metadata-Version: 2.1
|
2
2
|
Name: compressed-tensors-nightly
|
3
|
-
Version: 0.8.0.
|
3
|
+
Version: 0.8.0.20241126
|
4
4
|
Summary: Library for utilization of compressed safetensors of neural network models
|
5
5
|
Home-page: https://github.com/neuralmagic/compressed-tensors
|
6
6
|
Author: Neuralmagic, Inc.
|
{compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/LICENSE
RENAMED
File without changes
|
{compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/README.md
RENAMED
File without changes
|
File without changes
|
{compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/setup.cfg
RENAMED
File without changes
|
{compressed-tensors-nightly-0.8.0.20241124 → compressed-tensors-nightly-0.8.0.20241126}/setup.py
RENAMED
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|