blosc2 3.3.0__tar.gz → 3.3.2__tar.gz

{blosc2-3.3.0 → blosc2-3.3.2}/ANNOUNCE.rst

@@ -1,12 +1,11 @@
-Announcing Python-Blosc2 3.3.0
+Announcing Python-Blosc2 3.3.2
 ==============================
 
-We are introducing a new blosc2.transpose() function for natively transposing
-2D NDArray instances and a fast path for NDArray.slice() that delivers up to
-40x speedup when slices align with underlying chunks. Documentation has also
-been improved with several edits throughout.
-
-See benchmarks at: https://github.com/Blosc/python-blosc2/blob/main/bench/ndarray/aligned_chunks.py
+This is a bugfix release, with some minor optimizations.  We fixed
+specially a bug in the determination of chunk shape in constructors
+on CPUs with large L3 cache sizes (like AMD EPYC).  We also fixed a
+bug preventing the correct chaining of *string* lazy expressions for
+logical operators (``&``, ``|``, ``^``...).
 
 You can think of Python-Blosc2 3.x as an extension of NumPy/numexpr that:
 

{blosc2-3.3.0 → blosc2-3.3.2}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.2
 Name: blosc2
-Version: 3.3.0
+Version: 3.3.2
 Summary: A fast & compressed ndarray library with a flexible compute engine.
 Author-Email: Blosc Development Team <blosc@blosc.org>
 Maintainer-Email: Blosc Development Team <blosc@blosc.org>
@@ -15,12 +15,13 @@ Classifier: Topic :: Software Development :: Libraries :: Python Modules
 Classifier: Operating System :: Microsoft :: Windows
 Classifier: Operating System :: Unix
 Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.10
 Classifier: Programming Language :: Python :: 3.11
 Classifier: Programming Language :: Python :: 3.12
 Classifier: Programming Language :: Python :: 3.13
 Project-URL: homepage, https://github.com/Blosc/python-blosc2
 Project-URL: documentation, https://www.blosc.org/python-blosc2/python-blosc2.html
-Requires-Python: >=3.11
+Requires-Python: >=3.10
 Requires-Dist: numpy>=1.26
 Requires-Dist: ndindex
 Requires-Dist: msgpack

{blosc2-3.3.0 → blosc2-3.3.2}/RELEASE_NOTES.md

@@ -1,5 +1,41 @@
 # Release notes
 
+## Changes from 3.3.1 to 3.3.2
+
+* Fixed a bug in the determination of chunk shape for the `NDArray` constructor.
+  This was causing problems when creating `NDArray` instances with a CPU that
+  was reporting a L3 cache size close (or exceeding) 2 GB.  See PR #392.
+
+* Fixed a bug preventing the correct chaining of *string* lazy expressions for
+  logical operators (`&`, `|`, `^`...).  See PR #391.
+
+* More performance optimization for `blosc2.permute_dims`.  Thanks to
+  Ricardo Sales Piquer (@ricardosp4) for the implementation.
+
+* Now, storage defaults (`blosc2.storage_dflts`) are honored, even if no
+  `storage=` param is used in constructors.
+
+## Changes from 3.3.0 to 3.3.1
+
+* In our effort to better adapt to better adapt to the array API
+  (https://data-apis.org/array-api/latest/), we have introduced
+  permute_dims() and matrix_transpose() functions, and the .T property.
+  This replaces to previous transpose() function, which is now deprecated.
+  See PR #384.  Thanks to Ricardo Sales Piquer (@ricardosp4).
+
+* Constructors like `arange()`, `linspace()` and `fromiter()` now
+  use far less memory when creating large arrays. As an example, a 5 TB
+  array of 8-byte floats now uses less than 200 MB of memory instead of
+  170 GB previously.  See PR #387.
+
+* Now, when opening a lazy expression with `blosc2.open()`, and there is
+  a missing operand, the open still works, but the dtype and shape
+  attributes are None.  This is useful for lazy expressions that have
+  lost some operands, but you still want to open them for inspection.
+  See PR #385.
+
+* Added an example of getting a slice out of a C2Array.
+
 ## Changes from 3.2.1 to 3.3.0
 
 * New `blosc2.transpose()` function for transposing 2D NDArray instances

{blosc2-3.3.0 → blosc2-3.3.2}/doc/python-blosc2.rst

@@ -6,7 +6,7 @@
 
     <p style="text-align: center; color: black; background-color: rgba(230, 169, 9, 0.65);">
         <a href="https://github.com/Blosc/python-blosc2/blob/main/RELEASE_NOTES.md"
-           style="font-size: 1.5em;">Version 3.2.1 released on 2025-04-27!</a>
+           style="font-size: 1.5em;">Version 3.3.1 released on 2025-04-20!</a>
         <span style="display: inline-block; width: 20px;"></span>
         <span style="font-family: monospace;">pip install blosc2 -U</span>
     </p>

{blosc2-3.3.0 → blosc2-3.3.2}/doc/reference/linear_algebra.rst

@@ -13,3 +13,5 @@ The next functions can be used for computing linear algebra operations with :ref
 
     matmul
     transpose
+    matrix_transpose
+    permute_dims

{blosc2-3.3.0 → blosc2-3.3.2}/doc/reference/ndarray.rst

@@ -40,6 +40,7 @@ Attributes
 .. autosummary::
     :toctree: autofiles/ndarray
 
+    T
     ndim
     shape
     ext_shape

blosc2-3.3.2/examples/c2array-get-slice.py

@@ -0,0 +1,37 @@
+#######################################################################
+# Copyright (c) 2019-present, Blosc Development Team <blosc@blosc.org>
+# All rights reserved.
+#
+# This source code is licensed under a BSD-style license (found in the
+# LICENSE file in the root directory of this source tree)
+#######################################################################
+
+# Example for opening and reading a C2Array (remote array)
+
+from time import time
+
+import numpy as np
+
+import blosc2
+
+urlbase = "https://cat2.cloud/demo"
+root = "@public"
+
+# Access the server
+# urlpath = blosc2.URLPath(f'{root}/examples/ds-1d.b2nd', urlbase)
+# urlpath = blosc2.URLPath(f'{root}/examples/sa-1M.b2nd', urlbase)
+urlpath = blosc2.URLPath(f"{root}/examples/lung-jpeg2000_10x.b2nd", urlbase)
+# urlpath = blosc2.URLPath(f'{root}/examples/uncompressed_lung-jpeg2000_10x.b2nd', urlbase)
+
+# Open the remote array
+t0 = time()
+remote_array = blosc2.open(urlpath, mode="r")
+size = np.prod(remote_array.shape) * remote_array.cparams.typesize
+print(f"Time for opening data (HTTP): {time() - t0:.3f}s - file size: {size / 2**10:.2f} KB")
+
+# Fetch a slice of the remote array as a numpy array
+t0 = time()
+a = remote_array[5:9]
+print(f"Time for reading data (HTTP): {time() - t0:.3f}s - {a.nbytes / 2**10:.2f} KB")
+
+# TODO: Fetch a slice of the remote array as a blosc2.NDArray

{blosc2-3.3.0 → blosc2-3.3.2}/examples/ndarray/arange-constructor.py

@@ -19,7 +19,7 @@ N = 10_000_000
 shape = (N,)
 print(f"*** Creating a blosc2 array with {N:_} elements (shape: {shape}) ***")
 t0 = time()
-a = blosc2.arange(shape=shape, dtype=np.int32)
+a = blosc2.arange(N, shape=shape, dtype=np.int32)
 cratio = a.schunk.nbytes / a.schunk.cbytes
 print(
     f"Time: {time() - t0:.3f} s ({N / (time() - t0) / 1e6:.2f} M/s)"

{blosc2-3.3.0 → blosc2-3.3.2}/pyproject.toml

@@ -24,11 +24,12 @@ classifiers = [
     "Operating System :: Microsoft :: Windows",
     "Operating System :: Unix",
     "Programming Language :: Python :: 3",
+    "Programming Language :: Python :: 3.10",
     "Programming Language :: Python :: 3.11",
     "Programming Language :: Python :: 3.12",
     "Programming Language :: Python :: 3.13",
 ]
-requires-python = ">=3.11"
+requires-python = ">=3.10"
 # Follow guidelines from https://scientific-python.org/specs/spec-0000/
 dependencies = [
     "numpy>=1.26",
@@ -40,7 +41,7 @@ dependencies = [
     "py-cpuinfo; platform_machine != 'wasm32'",
     "requests",
 ]
-version = "3.3.0"
+version = "3.3.2"
 
 
 [project.optional-dependencies]

{blosc2-3.3.0 → blosc2-3.3.2}/src/blosc2/__init__.py

@@ -248,7 +248,9 @@ from .ndarray import (
     full,
     save,
     matmul,
+    permute_dims,
     transpose,
+    matrix_transpose,
 )
 
 from .c2array import c2context, C2Array, URLPath
@@ -267,7 +269,6 @@ from .proxy import Proxy, ProxySource, ProxyNDSource, ProxyNDField, SimpleProxy,
 
 from .schunk import SChunk, open
 
-
 # Registry for postfilters
 postfilter_funcs = {}
 """