compressed-tensors-nightly 0.7.1.20241024__tar.gz → 0.7.1.20241026__tar.gz
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- {compressed-tensors-nightly-0.7.1.20241024/src/compressed_tensors_nightly.egg-info → compressed-tensors-nightly-0.7.1.20241026}/PKG-INFO +1 -1
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/config/base.py +60 -2
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026/src/compressed_tensors_nightly.egg-info}/PKG-INFO +1 -1
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/LICENSE +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/README.md +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/pyproject.toml +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/setup.cfg +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/setup.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/__init__.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/base.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/compressors/__init__.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/compressors/base.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/compressors/helpers.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/compressors/model_compressors/__init__.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/compressors/model_compressors/model_compressor.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/compressors/quantized_compressors/__init__.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/compressors/quantized_compressors/base.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/compressors/quantized_compressors/naive_quantized.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/compressors/quantized_compressors/pack_quantized.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/compressors/sparse_compressors/__init__.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/compressors/sparse_compressors/base.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/compressors/sparse_compressors/dense.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/compressors/sparse_compressors/sparse_bitmask.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/compressors/sparse_quantized_compressors/__init__.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/compressors/sparse_quantized_compressors/marlin_24.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/config/__init__.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/config/dense.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/config/sparse_bitmask.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/linear/__init__.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/linear/compressed_linear.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/quantization/__init__.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/quantization/cache.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/quantization/lifecycle/__init__.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/quantization/lifecycle/apply.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/quantization/lifecycle/calibration.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/quantization/lifecycle/compressed.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/quantization/lifecycle/forward.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/quantization/lifecycle/frozen.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/quantization/lifecycle/helpers.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/quantization/lifecycle/initialize.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/quantization/observers/__init__.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/quantization/observers/base.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/quantization/observers/helpers.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/quantization/observers/min_max.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/quantization/observers/mse.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/quantization/quant_args.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/quantization/quant_config.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/quantization/quant_scheme.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/quantization/utils/__init__.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/quantization/utils/helpers.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/registry/__init__.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/registry/registry.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/utils/__init__.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/utils/helpers.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/utils/offload.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/utils/permutations_24.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/utils/permute.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/utils/safetensors_load.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/utils/semi_structured_conversions.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors/version.py +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors_nightly.egg-info/SOURCES.txt +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors_nightly.egg-info/dependency_links.txt +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors_nightly.egg-info/requires.txt +0 -0
- {compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/src/compressed_tensors_nightly.egg-info/top_level.txt +0 -0
@@ -1,6 +1,6 @@
|
|
1
1
|
Metadata-Version: 2.1
|
2
2
|
Name: compressed-tensors-nightly
|
3
|
-
Version: 0.7.1.
|
3
|
+
Version: 0.7.1.20241026
|
4
4
|
Summary: Library for utilization of compressed safetensors of neural network models
|
5
5
|
Home-page: https://github.com/neuralmagic/compressed-tensors
|
6
6
|
Author: Neuralmagic, Inc.
|
@@ -12,16 +12,17 @@
|
|
12
12
|
# See the License for the specific language governing permissions and
|
13
13
|
# limitations under the License.
|
14
14
|
|
15
|
-
from enum import Enum
|
15
|
+
from enum import Enum, unique
|
16
16
|
from typing import List, Optional
|
17
17
|
|
18
18
|
from compressed_tensors.registry import RegistryMixin
|
19
19
|
from pydantic import BaseModel
|
20
20
|
|
21
21
|
|
22
|
-
__all__ = ["SparsityCompressionConfig", "CompressionFormat"]
|
22
|
+
__all__ = ["SparsityCompressionConfig", "CompressionFormat", "SparsityStructure"]
|
23
23
|
|
24
24
|
|
25
|
+
@unique
|
25
26
|
class CompressionFormat(Enum):
|
26
27
|
dense = "dense"
|
27
28
|
sparse_bitmask = "sparse-bitmask"
|
@@ -32,6 +33,63 @@ class CompressionFormat(Enum):
|
|
32
33
|
marlin_24 = "marlin-24"
|
33
34
|
|
34
35
|
|
36
|
+
@unique
|
37
|
+
class SparsityStructure(Enum):
|
38
|
+
"""
|
39
|
+
An enumeration to represent different sparsity structures.
|
40
|
+
|
41
|
+
Attributes
|
42
|
+
----------
|
43
|
+
TWO_FOUR : str
|
44
|
+
Represents a 2:4 sparsity structure.
|
45
|
+
ZERO_ZERO : str
|
46
|
+
Represents a 0:0 sparsity structure.
|
47
|
+
UNSTRUCTURED : str
|
48
|
+
Represents an unstructured sparsity structure.
|
49
|
+
|
50
|
+
Examples
|
51
|
+
--------
|
52
|
+
>>> SparsityStructure('2:4')
|
53
|
+
<SparsityStructure.TWO_FOUR: '2:4'>
|
54
|
+
|
55
|
+
>>> SparsityStructure('unstructured')
|
56
|
+
<SparsityStructure.UNSTRUCTURED: 'unstructured'>
|
57
|
+
|
58
|
+
>>> SparsityStructure('2:4') == SparsityStructure.TWO_FOUR
|
59
|
+
True
|
60
|
+
|
61
|
+
>>> SparsityStructure('UNSTRUCTURED') == SparsityStructure.UNSTRUCTURED
|
62
|
+
True
|
63
|
+
|
64
|
+
>>> SparsityStructure(None) == SparsityStructure.UNSTRUCTURED
|
65
|
+
True
|
66
|
+
|
67
|
+
>>> SparsityStructure('invalid')
|
68
|
+
Traceback (most recent call last):
|
69
|
+
...
|
70
|
+
ValueError: invalid is not a valid SparsityStructure
|
71
|
+
"""
|
72
|
+
|
73
|
+
TWO_FOUR = "2:4"
|
74
|
+
UNSTRUCTURED = "unstructured"
|
75
|
+
ZERO_ZERO = "0:0"
|
76
|
+
|
77
|
+
def __new__(cls, value):
|
78
|
+
obj = object.__new__(cls)
|
79
|
+
obj._value_ = value.lower() if value is not None else value
|
80
|
+
return obj
|
81
|
+
|
82
|
+
@classmethod
|
83
|
+
def _missing_(cls, value):
|
84
|
+
# Handle None and case-insensitive values
|
85
|
+
if value is None:
|
86
|
+
return cls.UNSTRUCTURED
|
87
|
+
for member in cls:
|
88
|
+
if member.value == value.lower():
|
89
|
+
return member
|
90
|
+
raise ValueError(f"{value} is not a valid {cls.__name__}")
|
91
|
+
|
92
|
+
|
35
93
|
class SparsityCompressionConfig(RegistryMixin, BaseModel):
|
36
94
|
"""
|
37
95
|
Base data class for storing sparsity compression parameters
|
@@ -1,6 +1,6 @@
|
|
1
1
|
Metadata-Version: 2.1
|
2
2
|
Name: compressed-tensors-nightly
|
3
|
-
Version: 0.7.1.
|
3
|
+
Version: 0.7.1.20241026
|
4
4
|
Summary: Library for utilization of compressed safetensors of neural network models
|
5
5
|
Home-page: https://github.com/neuralmagic/compressed-tensors
|
6
6
|
Author: Neuralmagic, Inc.
|
{compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/LICENSE
RENAMED
File without changes
|
{compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/README.md
RENAMED
File without changes
|
File without changes
|
{compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/setup.cfg
RENAMED
File without changes
|
{compressed-tensors-nightly-0.7.1.20241024 → compressed-tensors-nightly-0.7.1.20241026}/setup.py
RENAMED
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|
File without changes
|