rustytree-xarray 0.4.0__tar.gz → 0.5.1__tar.gz

{rustytree_xarray-0.4.0 → rustytree_xarray-0.5.1}/.github/dependabot.yml

@@ -5,7 +5,7 @@
 #
 # Deliberately NOT managed here (bumped by hand — coordinated, cross-manifest):
 #   - icechunk / typetag: FFI lockstep. The Python `icechunk` (pyproject) must
-#     share a minor with the Rust `icechunk` (`=2.1.0`) and `typetag`
+#     share a minor with the Rust `icechunk` (`=2.2.2`) and `typetag`
 #     (`=0.2.22`) the crate links — the msgpack `Session` bytes format is
 #     coupled across the boundary, so a solo bump breaks `Session::from_bytes`
 #     (the 2.0.5→2.0.6 skew behind #46). Bump all three together manually.

{rustytree_xarray-0.4.0 → rustytree_xarray-0.5.1}/.github/workflows/ci.yml

@@ -39,7 +39,7 @@ jobs:
       - uses: dtolnay/rust-toolchain@stable
         with:
           components: clippy, rustfmt
-      - uses: actions/setup-python@v6
+      - uses: actions/setup-python@v7
         with:
           python-version: "3.12"
       - uses: Swatinem/rust-cache@v2
@@ -73,7 +73,7 @@ jobs:
         with:
           # Keyed by Python version so each matrix cell gets its own cache.
           key: py-${{ matrix.python-version }}
-      - uses: actions/setup-python@v6
+      - uses: actions/setup-python@v7
         with:
           python-version: ${{ matrix.python-version }}
       - uses: astral-sh/setup-uv@v7
@@ -87,7 +87,7 @@ jobs:
         # below (we'd build the wheel twice — saves ~80s per matrix cell).
         # These are the deps pytest needs; ruff is not among them — linting runs
         # in the dedicated `lint` job above.
-        run: uv pip install --python .venv/bin/python pytest pytest-cov 'zarr>=3.0' 'icechunk>=2.1.0,<2.2' 'dask[distributed]>=2024.1'
+        run: uv pip install --python .venv/bin/python pytest pytest-cov 'zarr>=3.0' 'icechunk>=2.2.0,<2.3' 'dask[distributed]>=2024.1'
       - name: Build extension (maturin develop)
         run: .venv/bin/maturin develop
       - name: pytest

{rustytree_xarray-0.4.0 → rustytree_xarray-0.5.1}/.github/workflows/release.yml

@@ -48,7 +48,7 @@ jobs:
     runs-on: ${{ matrix.platform.os }}
     steps:
       - uses: actions/checkout@v7
-      - uses: actions/setup-python@v6
+      - uses: actions/setup-python@v7
         with:
           python-version: ${{ matrix.python-version }}
       - uses: dtolnay/rust-toolchain@stable

{rustytree_xarray-0.4.0 → rustytree_xarray-0.5.1}/CHANGELOG.md

@@ -11,6 +11,60 @@ release, that section is renamed to `[x.y.z] - YYYY-MM-DD` and a fresh
 
 ## [Unreleased]
 
+## [0.5.1] - 2026-09-21
+
+### Changed
+
+- Bump the pinned `icechunk` from 2.1.0 to 2.2.2 ([#82]). rustytree links the
+  `icechunk` Rust crate and round-trips sessions through
+  `Session::{as,from}_bytes` using plain (positional, not named-field) msgpack
+  encoding, so a struct field added anywhere ahead of the end of the encoded
+  type shifts every field after it. Between 2.1.x and 2.2.x, icechunk's
+  `RepositoryConfig` gained `max_concurrent_decodes`, inserted before
+  `caching` rather than appended — exactly the kind of change that breaks
+  cross-version `Session` bytes. The `dev` extra and CI now require
+  `icechunk>=2.2.0,<2.3` so the Python and Rust icechunk versions keep
+  sharing a minor. `typetag` stays at `=0.2.22` (icechunk 2.2.2 still
+  requires it, so the `py_credentials` `inventory` registry keeps matching
+  icechunk-python's), and icechunk-python's `PythonCredentialsFetcher` shape
+  is unchanged, so no `py_credentials.rs` code change was needed — only its
+  version-referencing doc comment. Verified: `cargo test --locked
+  --no-default-features` (58/58) and the full `pytest` suite (202 passed, 4
+  skipped for tests needing live S3/arraylake access, 1 pre-existing xfail)
+  against a `maturin develop` build linked to real icechunk-python 2.2.2,
+  covering real `Session` byte round-trips (`test_open_via_session_bytes`,
+  the ancestor-merge session tests) and the dask-distributed pickle path
+  (`test_distributed_compute_matches_threaded`).
+
+## [0.5.0] - 2026-07-26
+
+### Added
+
+- Eager-fetch small `object`-dtype (vlen `string`) scalars and self-named
+  1-D coords during the walk's Phase C ([#77]). `xr.open_datatree(engine=
+  "rustytree")` was paying one serial lazy read per `object`-dtype variable
+  at open time — xarray's `_contains_datetime_like_objects` samples every
+  such variable to rule out `cftime.datetime`, independent of the existing
+  CF-time-like/dim-coord triggers Phase C already covers. Extends the walk's
+  parallel pre-fetch to cover this case (bounded by a 4096-element count cap
+  and an 8 MiB total-byte-size cap, since per-element size is unbounded for
+  strings unlike the existing fixed-width numeric cap), and adds the
+  matching `object` → declared-read-dtype cast on the eager path in
+  `backend.py` (mirroring the lazy path's existing cast from #71). Scoped to
+  scalars and self-named 1-D coords only, so an ordinary small string data
+  variable doesn't lose its dask laziness just because it's small. Verified
+  on the live `s3://nexrad-arco/KLOT` store: ~48% faster `open_datatree`
+  (8.223s → 4.241s mean over 4 trials), 42 serial lazy reads eliminated.
+
+### Changed
+
+- Routine dependency and CI-action bumps via Dependabot ([#72], [#74],
+  [#75], [#76]). Cargo: `quinn-proto` 0.11.14 → 0.11.16 ([#72]); cargo-minor
+  group — `tokio` 1.53.0 → 1.53.1, `thiserror` 2.0.18 → 2.0.19, `async-trait`
+  0.1.89 → 0.1.91, `serde` 1.0.228 → 1.0.229, `zarrs_storage` 0.4.4 → 0.4.5,
+  `serde_json` 1.0.150 → 1.0.151 ([#75]); `zarrs_object_store` 0.6.2 → 0.7.0
+  ([#76]). CI: `actions/setup-python` 6 → 7 ([#74]).
+
 ## [0.4.0] - 2026-07-24
 
 ### Added
@@ -835,7 +889,9 @@ below.
   intentionally not normalized — relative-vs-absolute glob
   semantics differ in `PurePosixPath.match`.
 
-[Unreleased]: https://github.com/aladinor/rustytree/compare/v0.4.0...HEAD
+[Unreleased]: https://github.com/aladinor/rustytree/compare/v0.5.1...HEAD
+[0.5.1]: https://github.com/aladinor/rustytree/compare/v0.5.0...v0.5.1
+[0.5.0]: https://github.com/aladinor/rustytree/compare/v0.4.0...v0.5.0
 [0.4.0]: https://github.com/aladinor/rustytree/compare/v0.3.0...v0.4.0
 [0.3.0]: https://github.com/aladinor/rustytree/compare/v0.2.1...v0.3.0
 [0.2.1]: https://github.com/aladinor/rustytree/compare/v0.2.0...v0.2.1
@@ -884,3 +940,9 @@ below.
 [#64]: https://github.com/aladinor/rustytree/pull/64
 [#68]: https://github.com/aladinor/rustytree/pull/68
 [#71]: https://github.com/aladinor/rustytree/pull/71
+[#72]: https://github.com/aladinor/rustytree/pull/72
+[#74]: https://github.com/aladinor/rustytree/pull/74
+[#75]: https://github.com/aladinor/rustytree/pull/75
+[#76]: https://github.com/aladinor/rustytree/pull/76
+[#77]: https://github.com/aladinor/rustytree/pull/77
+[#82]: https://github.com/aladinor/rustytree/pull/82