views-frames 1.6.0__tar.gz → 1.8.0__tar.gz

views_frames-1.6.0/README.md → views_frames-1.8.0/PKG-INFO

@@ -1,22 +1,57 @@
+Metadata-Version: 2.4
+Name: views-frames
+Version: 1.8.0
+Summary: The VIEWS platform data-contract layer: immutable array+identifier frames (numpy only, root of the dependency DAG).
+Project-URL: Homepage, https://github.com/views-platform/views-frames
+Project-URL: Repository, https://github.com/views-platform/views-frames
+Project-URL: Changelog, https://github.com/views-platform/views-frames/blob/main/CHANGELOG.md
+Author-email: Simon Polichinel von der Maase <simmaa@prio.org>
+License-Expression: MIT
+License-File: LICENSE
+Classifier: Development Status :: 5 - Production/Stable
+Classifier: Intended Audience :: Science/Research
+Classifier: Operating System :: OS Independent
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Topic :: Scientific/Engineering
+Classifier: Typing :: Typed
+Requires-Python: >=3.10
+Requires-Dist: numpy<3,>=1.26
+Provides-Extra: arrow
+Requires-Dist: pyarrow<20,>=14; extra == 'arrow'
+Provides-Extra: docs
+Requires-Dist: jupyterlab<5,>=4; extra == 'docs'
+Requires-Dist: matplotlib<4,>=3.8; extra == 'docs'
+Requires-Dist: nbmake<2,>=1.5; extra == 'docs'
+Requires-Dist: pyarrow<20,>=14; extra == 'docs'
+Requires-Dist: scipy<2,>=1.11; extra == 'docs'
+Description-Content-Type: text/markdown
+
 # views-frames
 
 > The VIEWS platform's **data-contract layer**: small, stable, abstract array
 > containers (`FeatureFrame`, `PredictionFrame`, and their anticipated siblings)
 > that every other repo depends on and that depends on nothing internal.
 >
-> **Status:** **v1.6.0 — frozen API** (frozen since v1.0.0, ADR-018; the v1.1 surface is
+> **Status:** **v1.7.0 — frozen API** (frozen since v1.0.0, ADR-018; the v1.1 surface is
 > purely additive — the coherent posterior summary, ADR-019; v1.2.0 rebuilt the tower
 > `outside-in`, C-44; v1.3.0 makes the tower summary distribution-agnostic — no magnitude
 > zeroing by default, register C-45; v1.4.0 adds generic provenance to `FrameMetadata`
 > (`run_id`/`data_version`) and publishes the shared `assert_frame_envelope` checker,
 > ADR-020; v1.5.0 adds the threshold **exceedance** estimator `P(Y > c)`, ADR-021; v1.6.0
-> adds the worst-case **expected_shortfall** estimator, ADR-022). This
+> adds the worst-case **expected_shortfall** estimator, ADR-022; v1.7.0 adds a third
+> sibling package **`views_frames_reconcile`** — forecast reconciliation, ADR-023). This
 > README is the design
 > bible; the contract it specifies is realised in `src/views_frames/` (index, frames,
 > io, conformance suite) plus the `src/views_frames_summarize/` sibling package
 > (sample-axis summarization — `collapse`/MAP/HDI/quantiles, the coherent-tower estimators
 > `hdi_tower`/`tower_point`/`bimodality`/`summarize_tower`, + cross-level
-> aggregation; ADR-017, ADR-019). The blocking design decisions are resolved (§13a) and
+> aggregation; ADR-017, ADR-019) and the `src/views_frames_reconcile/` sibling package
+> (forecast reconciliation — make grid forecasts sum to country totals per draw; ADR-023).
+> The blocking design decisions are resolved (§13a) and
 > ratified as ADRs 011–018; two rounds of consumer review validated
 > the design. Consumer adoption (re-export shims, pandas migration) is the owner's
 > migration, not this repo's.
@@ -220,7 +255,13 @@ makes it safe to depend on from everywhere (SDP).
 3. **Immutable value objects.** A frame is validated at construction and then
    treated as read-only. Operations (`collapse`, `select`, `with_metadata`)
    **return new frames**; they never mutate in place. (Directly forbids the
-   C-184 cross-repo-mutation anti-pattern.) **Copy-vs-view:** structural and
+   C-184 cross-repo-mutation anti-pattern.) **Enforced for the index, by
+   convention for the value buffer:** the identifier arrays (`time`/`unit`) are
+   write-protected (`setflags(write=False)`); the `values` buffer is left
+   **writeable on purpose** — so structural ops can share it zero-copy — and is
+   immutable *by convention*: mutating `.values` in place is unsupported and may
+   silently corrupt buffer-sharing frames (ADR-025 / register C-63; enforcing it
+   is a deferred MAJOR-rider). **Copy-vs-view:** structural and
    metadata-only operations (`with_metadata`, contiguous `select`) return frames
    that **share** the underlying `values` buffer (numpy view / zero-copy), and a
    `mmap`-backed frame stays `mmap`-backed — a new frame must never copy a
@@ -395,6 +436,14 @@ views-frames/
 │   ├── point.py                   # map_estimate (histogram MAP)
 │   ├── interval.py                # hdi, quantiles  → arrays aligned to the frame index
 │   └── aggregate.py               # conservation-correct cross-level aggregation
+├── src/views_frames_reconcile/    # forecast reconciliation OVER frames (ADR-023)
+│   ├── __init__.py                #   depends on views_frames + numpy only; never the reverse
+│   ├── proportional.py            # reconcile_proportional — per-draw top-down scaling
+│   ├── grouping.py                # reconcile_pgm_to_cm — group by (time, country)
+│   ├── frames.py                  # prediction_frame_from_arrays adapter
+│   ├── validation.py              # fail-loud input guards
+│   ├── module.py                  # ReconciliationModule (holds the injected mapping)
+│   └── conformance.py             # assert_reconcile_contract
 └── tests/
     ├── conformance/               # the published contract suite consumers re-run (see §9)
     └── unit/
@@ -417,6 +466,38 @@ Layout rules (these *are* the screaming-architecture requirements):
 - A new developer should infer every responsibility from the file tree without
   reading bodies.
 
+### 6a. The `views_frames_reconcile` sibling (ADR-023)
+
+Forecast **reconciliation** — making grid (`pgm`) predictions sum to their country
+(`cm`) totals — is a numpy-only frame→frame operation, structurally the same kind of
+thing as `views_frames_summarize` (ADR-017). It is its own sibling package, **not** in
+the leaf and **not** in views-postprocessing (its old, mis-homed host).
+
+**Charter.** **May:** forecast-reconciliation algorithms on frames (the per-draw
+top-down proportional method; future methods as sibling modules — the principled
+probabilistic upgrade, C-37); per-sample reconciliation; fail-loud validation; a
+conformance suite. **Must not:** IO; **fetch the `(time, unit) → country` mapping** (it
+is *injected* by the caller as numpy arrays, exactly like `cross_level_align` — ADR-014);
+actuals/scoring (views-evaluation); plotting; or any `views_*` import except
+`views_frames`. Import-DAG: `views_frames_reconcile → {views_frames}`.
+
+```python
+import numpy as np
+from views_frames_reconcile import ReconciliationModule
+
+# mapping is INJECTED by the caller (sourced from the producer; never fetched here):
+#   map_keys: (M, 2) int (time, priogrid_gid)   map_vals: (M,) int country_id
+reconciler = ReconciliationModule(map_keys, map_vals)
+pgm_reconciled = reconciler.reconcile(cm_frame, pgm_frame)  # new pgm PredictionFrame
+# each (time, country) group's cells now sum, per draw, to the country total
+# (all-zero grid draws stay zero); zeros preserved; non-negative.
+```
+
+> **Future DRY pass (deferred).** `grouping.py` labels grid rows by country with the
+> leaf's `cross_level_align_arrays` and overlaps `cross_level_align` (index.py). Folding
+> the two is a separate later story — the v1.7.0 relocation is a faithful **WET** move,
+> proven bit-identical to the original before any refactor.
+
 ---
 
 ## 7. On-disk / serialization contract (where "doesn't scale" is actually decided)

views_frames-1.6.0/PKG-INFO → views_frames-1.8.0/README.md

@@ -1,48 +1,25 @@
-Metadata-Version: 2.4
-Name: views-frames
-Version: 1.6.0
-Summary: The VIEWS platform data-contract layer: immutable array+identifier frames (numpy only, root of the dependency DAG).
-Project-URL: Homepage, https://github.com/views-platform/views-frames
-Project-URL: Repository, https://github.com/views-platform/views-frames
-Project-URL: Changelog, https://github.com/views-platform/views-frames/blob/main/CHANGELOG.md
-Author-email: Simon Polichinel von der Maase <simmaa@prio.org>
-License-Expression: MIT
-License-File: LICENSE
-Classifier: Development Status :: 5 - Production/Stable
-Classifier: Intended Audience :: Science/Research
-Classifier: Operating System :: OS Independent
-Classifier: Programming Language :: Python :: 3
-Classifier: Programming Language :: Python :: 3.10
-Classifier: Programming Language :: Python :: 3.11
-Classifier: Programming Language :: Python :: 3.12
-Classifier: Programming Language :: Python :: 3.13
-Classifier: Topic :: Scientific/Engineering
-Classifier: Typing :: Typed
-Requires-Python: >=3.10
-Requires-Dist: numpy<3,>=1.26
-Provides-Extra: arrow
-Requires-Dist: pyarrow<20,>=14; extra == 'arrow'
-Description-Content-Type: text/markdown
-
 # views-frames
 
 > The VIEWS platform's **data-contract layer**: small, stable, abstract array
 > containers (`FeatureFrame`, `PredictionFrame`, and their anticipated siblings)
 > that every other repo depends on and that depends on nothing internal.
 >
-> **Status:** **v1.6.0 — frozen API** (frozen since v1.0.0, ADR-018; the v1.1 surface is
+> **Status:** **v1.7.0 — frozen API** (frozen since v1.0.0, ADR-018; the v1.1 surface is
 > purely additive — the coherent posterior summary, ADR-019; v1.2.0 rebuilt the tower
 > `outside-in`, C-44; v1.3.0 makes the tower summary distribution-agnostic — no magnitude
 > zeroing by default, register C-45; v1.4.0 adds generic provenance to `FrameMetadata`
 > (`run_id`/`data_version`) and publishes the shared `assert_frame_envelope` checker,
 > ADR-020; v1.5.0 adds the threshold **exceedance** estimator `P(Y > c)`, ADR-021; v1.6.0
-> adds the worst-case **expected_shortfall** estimator, ADR-022). This
+> adds the worst-case **expected_shortfall** estimator, ADR-022; v1.7.0 adds a third
+> sibling package **`views_frames_reconcile`** — forecast reconciliation, ADR-023). This
 > README is the design
 > bible; the contract it specifies is realised in `src/views_frames/` (index, frames,
 > io, conformance suite) plus the `src/views_frames_summarize/` sibling package
 > (sample-axis summarization — `collapse`/MAP/HDI/quantiles, the coherent-tower estimators
 > `hdi_tower`/`tower_point`/`bimodality`/`summarize_tower`, + cross-level
-> aggregation; ADR-017, ADR-019). The blocking design decisions are resolved (§13a) and
+> aggregation; ADR-017, ADR-019) and the `src/views_frames_reconcile/` sibling package
+> (forecast reconciliation — make grid forecasts sum to country totals per draw; ADR-023).
+> The blocking design decisions are resolved (§13a) and
 > ratified as ADRs 011–018; two rounds of consumer review validated
 > the design. Consumer adoption (re-export shims, pandas migration) is the owner's
 > migration, not this repo's.
@@ -246,7 +223,13 @@ makes it safe to depend on from everywhere (SDP).
 3. **Immutable value objects.** A frame is validated at construction and then
    treated as read-only. Operations (`collapse`, `select`, `with_metadata`)
    **return new frames**; they never mutate in place. (Directly forbids the
-   C-184 cross-repo-mutation anti-pattern.) **Copy-vs-view:** structural and
+   C-184 cross-repo-mutation anti-pattern.) **Enforced for the index, by
+   convention for the value buffer:** the identifier arrays (`time`/`unit`) are
+   write-protected (`setflags(write=False)`); the `values` buffer is left
+   **writeable on purpose** — so structural ops can share it zero-copy — and is
+   immutable *by convention*: mutating `.values` in place is unsupported and may
+   silently corrupt buffer-sharing frames (ADR-025 / register C-63; enforcing it
+   is a deferred MAJOR-rider). **Copy-vs-view:** structural and
    metadata-only operations (`with_metadata`, contiguous `select`) return frames
    that **share** the underlying `values` buffer (numpy view / zero-copy), and a
    `mmap`-backed frame stays `mmap`-backed — a new frame must never copy a
@@ -421,6 +404,14 @@ views-frames/
 │   ├── point.py                   # map_estimate (histogram MAP)
 │   ├── interval.py                # hdi, quantiles  → arrays aligned to the frame index
 │   └── aggregate.py               # conservation-correct cross-level aggregation
+├── src/views_frames_reconcile/    # forecast reconciliation OVER frames (ADR-023)
+│   ├── __init__.py                #   depends on views_frames + numpy only; never the reverse
+│   ├── proportional.py            # reconcile_proportional — per-draw top-down scaling
+│   ├── grouping.py                # reconcile_pgm_to_cm — group by (time, country)
+│   ├── frames.py                  # prediction_frame_from_arrays adapter
+│   ├── validation.py              # fail-loud input guards
+│   ├── module.py                  # ReconciliationModule (holds the injected mapping)
+│   └── conformance.py             # assert_reconcile_contract
 └── tests/
     ├── conformance/               # the published contract suite consumers re-run (see §9)
     └── unit/
@@ -443,6 +434,38 @@ Layout rules (these *are* the screaming-architecture requirements):
 - A new developer should infer every responsibility from the file tree without
   reading bodies.
 
+### 6a. The `views_frames_reconcile` sibling (ADR-023)
+
+Forecast **reconciliation** — making grid (`pgm`) predictions sum to their country
+(`cm`) totals — is a numpy-only frame→frame operation, structurally the same kind of
+thing as `views_frames_summarize` (ADR-017). It is its own sibling package, **not** in
+the leaf and **not** in views-postprocessing (its old, mis-homed host).
+
+**Charter.** **May:** forecast-reconciliation algorithms on frames (the per-draw
+top-down proportional method; future methods as sibling modules — the principled
+probabilistic upgrade, C-37); per-sample reconciliation; fail-loud validation; a
+conformance suite. **Must not:** IO; **fetch the `(time, unit) → country` mapping** (it
+is *injected* by the caller as numpy arrays, exactly like `cross_level_align` — ADR-014);
+actuals/scoring (views-evaluation); plotting; or any `views_*` import except
+`views_frames`. Import-DAG: `views_frames_reconcile → {views_frames}`.
+
+```python
+import numpy as np
+from views_frames_reconcile import ReconciliationModule
+
+# mapping is INJECTED by the caller (sourced from the producer; never fetched here):
+#   map_keys: (M, 2) int (time, priogrid_gid)   map_vals: (M,) int country_id
+reconciler = ReconciliationModule(map_keys, map_vals)
+pgm_reconciled = reconciler.reconcile(cm_frame, pgm_frame)  # new pgm PredictionFrame
+# each (time, country) group's cells now sum, per draw, to the country total
+# (all-zero grid draws stay zero); zeros preserved; non-negative.
+```
+
+> **Future DRY pass (deferred).** `grouping.py` labels grid rows by country with the
+> leaf's `cross_level_align_arrays` and overlaps `cross_level_align` (index.py). Folding
+> the two is a separate later story — the v1.7.0 relocation is a faithful **WET** move,
+> proven bit-identical to the original before any refactor.
+
 ---
 
 ## 7. On-disk / serialization contract (where "doesn't scale" is actually decided)

{views_frames-1.6.0 → views_frames-1.8.0}/pyproject.toml

@@ -4,7 +4,7 @@ build-backend = "hatchling.build"
 
 [project]
 name = "views-frames"
-version = "1.6.0"
+version = "1.8.0"
 description = "The VIEWS platform data-contract layer: immutable array+identifier frames (numpy only, root of the dependency DAG)."
 authors = [
     { name = "Simon Polichinel von der Maase", email = "simmaa@prio.org" },
@@ -39,6 +39,22 @@ Changelog = "https://github.com/views-platform/views-frames/blob/main/CHANGELOG.
 # Optional serialization extra — pyarrow is allowed ONLY behind io/ (README §3.1).
 [project.optional-dependencies]
 arrow = ["pyarrow>=14,<20"]
+# Optional docs/notebooks extra — plotting + jupyter for the showcase notebooks
+# (notebooks/, an un-gated dev artifact outside src/). NEVER runtime dependencies;
+# self-references [arrow] so `uv sync --extra docs` also enables the parquet round-trip
+# demo in notebooks/01_frames.ipynb. matplotlib/scipy are notebook-only (the core is
+# numpy-only); these are imported by notebooks, never by the package.
+docs = [
+    "views-frames[arrow]",
+    "matplotlib>=3.8,<4",
+    "scipy>=1.11,<2",
+    "jupyterlab>=4,<5",
+    # nbmake drives the non-blocking notebook-execution CI check (issue #151): it just
+    # runs the notebooks end-to-end to catch frozen-API drift. A test tool, but it rides
+    # in [docs] so the single `uv sync --extra docs` provisions everything the notebooks
+    # job needs (kernel + plotting + the checker).
+    "nbmake>=1.5,<2",
+]
 
 [dependency-groups]
 dev = [
@@ -52,7 +68,7 @@ dev = [
 ]
 
 [tool.hatch.build.targets.wheel]
-packages = ["src/views_frames", "src/views_frames_summarize"]
+packages = ["src/views_frames", "src/views_frames_summarize", "src/views_frames_reconcile"]
 
 [tool.hatch.build.targets.sdist]
 include = ["/src"]
@@ -76,9 +92,10 @@ show_missing = true
 [tool.ruff]
 line-length = 88
 target-version = "py310"
-# research/ is the volatile estimator lab (outside the frozen, gated src/); it is
-# not held to the leaf's lint/format bar.
-extend-exclude = ["research"]
+# research/ is the volatile estimator lab and notebooks/ holds the un-gated showcase
+# notebooks + their helper (notebooks/_synthetic.py) — both sit outside the frozen,
+# gated src/ and are not held to the leaf's lint/format bar.
+extend-exclude = ["research", "notebooks"]
 
 [tool.ruff.lint]
 select = ["E", "F", "I", "N", "UP", "B", "A", "C4", "SIM"]
@@ -87,6 +104,13 @@ select = ["E", "F", "I", "N", "UP", "B", "A", "C4", "SIM"]
 # The falsification stubs assert against the README via long, literal regexes
 # whose lines cannot wrap without changing their semantics.
 "tests/test_falsification_*.py" = ["E501"]
+# The reconciliation parity tests are faithfully relocated from views-postprocessing
+# (Epic 11 / ADR-023); their dense numpy/dict-comprehension assertions are kept verbatim
+# rather than re-wrapped.
+"tests/test_reconciliation_*.py" = ["E501"]
+# The dev/ops scripts (oracle regeneration; the reconciliation parity verifier) are not
+# CI-run and carry dense numpy one-liners + report f-strings; not held to the wrap bar.
+"scripts/*.py" = ["E501"]
 
 [tool.mypy]
 python_version = "3.10"

views_frames-1.8.0/src/views_frames_reconcile/__init__.py

@@ -0,0 +1,24 @@
+"""Forecast reconciliation (pgm forecasts reconciled to cm totals).
+
+Slice 1 ports the top-down proportional method from views-reporting as a pure
+numpy function. New methods (e.g. principled probabilistic reconciliation, C-37)
+should be added as sibling modules, not by modifying ``proportional``.
+"""
+
+from views_frames_reconcile.module import ReconciliationModule
+from views_frames_reconcile.proportional import reconcile_proportional
+from views_frames_reconcile.result import (
+    ALIGNED_DRAWS,
+    METHOD_PROPORTIONAL,
+    POINT_BROADCAST,
+    ReconciliationResult,
+)
+
+__all__ = [
+    "ALIGNED_DRAWS",
+    "METHOD_PROPORTIONAL",
+    "POINT_BROADCAST",
+    "ReconciliationModule",
+    "ReconciliationResult",
+    "reconcile_proportional",
+]

views_frames-1.8.0/src/views_frames_reconcile/conformance.py

@@ -0,0 +1,77 @@
+"""Conformance checks for the reconcile package (ADR-023).
+
+A consumer can re-run these against its own frame factories to confirm the reconciler
+behaves: grid (``pgm``) predictions sum, per draw, to their country (``cm``) totals
+(except all-zero grid draws, which stay zero — the documented edge); zeros preserved;
+values stay non-negative; the output is a same-shape ``pgm`` ``PredictionFrame`` at PGM
+level; and the cm/pgm mapping is **injected, never fetched** (ADR-014/ADR-023).
+
+Mirrors ``views_frames_summarize/conformance.py:assert_summarizer_contract``.
+"""
+
+from __future__ import annotations
+
+from typing import Any
+
+import numpy as np
+from numpy.typing import NDArray
+
+from views_frames import PredictionFrame, SpatialLevel
+from views_frames_reconcile.module import ReconciliationModule
+
+
+def assert_reconcile_contract(
+    cm_frame: PredictionFrame,
+    pgm_frame: PredictionFrame,
+    map_keys: NDArray[np.integer[Any]] | object,
+    map_vals: NDArray[np.integer[Any]] | object,
+) -> None:
+    """Assert the reconciler obeys its contract on ``(cm_frame, pgm_frame, mapping)``.
+
+    The mapping is **injected** (``map_keys``/``map_vals`` arrays) — never fetched
+    (enforced by the signature + the import-DAG; honoured here by the sum-to-country
+    law, which only holds if each cell is grouped under its injected country).
+
+    Raises:
+        AssertionError: a contract law is violated.
+    """
+    mk = np.asarray(map_keys)
+    mv = np.asarray(map_vals)
+    out = ReconciliationModule(mk, mv).reconcile(cm_frame, pgm_frame)
+
+    # 1. Output type / shape / level / index: a same-shape pgm PredictionFrame at PGM.
+    assert type(out) is type(pgm_frame), "reconcile must return the pgm frame type"
+    assert out.values.shape == pgm_frame.values.shape, "reconcile must preserve (N, S)"
+    assert out.index.level is SpatialLevel.PGM, "reconciled frame stays at PGM level"
+    assert np.array_equal(out.index.time, pgm_frame.index.time), "time index preserved"
+    assert np.array_equal(out.index.unit, pgm_frame.index.unit), "unit index preserved"
+
+    # 2. Non-negativity.
+    assert bool((out.values >= 0).all()), "reconciled forecasts must be non-negative"
+
+    # 3. Zero-preservation: an input zero cell stays zero.
+    assert bool((out.values[pgm_frame.values == 0] == 0).all()), "zeros preserved"
+
+    # 4. Sum-to-country per draw: each (time, country) group's cells sum, per draw, to
+    #    its country total — except all-zero input draws, which stay zero (the edge).
+    cm_units = pgm_frame.index.cross_level_align_arrays(mk, mv, SpatialLevel.CM).unit
+    pg_time = pgm_frame.index.time
+    cm_pos = {
+        (int(t), int(u)): j
+        for j, (t, u) in enumerate(
+            zip(cm_frame.index.time, cm_frame.index.unit, strict=True)
+        )
+    }
+    for t, c in np.unique(np.stack([pg_time, cm_units], axis=1), axis=0):
+        rows = (pg_time == t) & (cm_units == c)
+        in_sum = pgm_frame.values[rows].sum(axis=0)  # (S,)
+        out_sum = out.values[rows].sum(axis=0)  # (S,)
+        # cm may be a point (sample_count == 1, broadcast inside reconcile) or aligned
+        # draws — broadcast its per-(time, country) total to the draw axis either way.
+        cm_total = cm_frame.values[cm_pos[(int(t), int(c))]]
+        total = np.broadcast_to(cm_total, out_sum.shape)
+        active = in_sum != 0
+        np.testing.assert_allclose(
+            out_sum[active], total[active], rtol=1e-4, atol=1e-3
+        )
+        assert bool((out_sum[~active] == 0).all()), "all-zero draws stay zero"

views_frames-1.8.0/src/views_frames_reconcile/frames.py

@@ -0,0 +1,69 @@
+"""Array → `PredictionFrame` adapters for reconciliation (epic #31, story #33).
+
+Reconciliation works on views-frames `PredictionFrame`s at two spatial levels:
+country (`cm`) and PRIO-GRID (`pgm`). Both are built the same way from
+`(time, unit, values)` arrays — only the `SpatialLevel` and the unit identifier
+(`country_id` vs `priogrid_gid`) differ. Predictions here carry a real posterior
+sample axis, so values are `(N, S)` with `S >= 1`.
+
+This is the reconciliation package's **own** I/O: it differs from the unfao
+delivery adapters (`unfao/frames.py`), which wrap pandas *scalar* columns as
+`(N, 1)` point frames — so per CRP they are not forced together. numpy +
+views-frames only; no torch, no pandas.
+"""
+
+from __future__ import annotations
+
+from typing import Any
+
+import numpy as np
+from numpy.typing import NDArray
+
+from views_frames import (
+    FrameMetadata,
+    PredictionFrame,
+    SpatialLevel,
+    SpatioTemporalIndex,
+)
+
+
+def prediction_frame_from_arrays(
+    time: NDArray[np.integer[Any]] | object,
+    unit: NDArray[np.integer[Any]] | object,
+    values: NDArray[np.floating[Any]] | object,
+    *,
+    level: SpatialLevel,
+    metadata: FrameMetadata | None = None,
+) -> PredictionFrame:
+    """Build a `PredictionFrame` from `(time, unit, values)` at ``level``.
+
+    Args:
+        time: 1-D integer array, length ``N`` (``month_id``).
+        unit: 1-D integer array, length ``N`` — ``country_id`` for
+            ``SpatialLevel.CM``, ``priogrid_gid`` for ``SpatialLevel.PGM``.
+        values: ``(N, S)`` float32-coercible array of posterior samples.
+        level: the frame's spatial level.
+
+    Returns:
+        A `PredictionFrame` of shape ``(N, S)`` at ``level``. The values buffer
+        is reused without copy when already float32 (views-frames C-07); the
+        input arrays are never mutated.
+
+    Raises:
+        ValueError: ``values`` is not 2-D, or ``time``/``unit`` are not 1-D of
+            length ``N``.
+    """
+    time_arr = np.asarray(time, dtype=np.int64)
+    unit_arr = np.asarray(unit, dtype=np.int64)
+    vals = np.asarray(values, dtype=np.float32)
+
+    if vals.ndim != 2:
+        raise ValueError(f"values must be 2-D (N, S); got ndim={vals.ndim}")
+    if time_arr.shape != (vals.shape[0],) or unit_arr.shape != (vals.shape[0],):
+        raise ValueError(
+            f"time {time_arr.shape} and unit {unit_arr.shape} must both be 1-D "
+            f"of length N={vals.shape[0]}"
+        )
+
+    index = SpatioTemporalIndex(time=time_arr, unit=unit_arr, level=level)
+    return PredictionFrame(vals, index, metadata)

views_frames-1.8.0/src/views_frames_reconcile/grouping.py

@@ -0,0 +1,92 @@
+"""Reconcile a pgm `PredictionFrame` to cm country totals (epic #31, story #34).
+
+The heart of the migration: for each `(time, country)`, scale that country's grid
+cells so their per-draw sum matches the country forecast, using the parity-proven
+leaf `reconcile_proportional` (PR #30). Grid rows are labelled by country with
+views-frames `cross_level_align` — the sanctioned cm↔pgm primitive, which fails
+loud if any grid row lacks a country (mirrors the original's "valid countries"
+guard). De-mutated: returns a **new** pgm frame (C-184); the input is untouched.
+
+numpy + views-frames only. The loop is over `(time, country)` groups (a small
+number), not over rows; each group call is fully vectorised over cells × samples.
+"""
+
+from __future__ import annotations
+
+from typing import Any
+
+import numpy as np
+from numpy.typing import NDArray
+
+from views_frames import PredictionFrame, SpatialLevel
+from views_frames_reconcile.proportional import reconcile_proportional
+
+
+def reconcile_pgm_to_cm(
+    pgm_frame: PredictionFrame,
+    cm_frame: PredictionFrame,
+    map_keys: NDArray[np.integer[Any]] | object,
+    map_vals: NDArray[np.integer[Any]] | object,
+) -> PredictionFrame:
+    """Return a new pgm `PredictionFrame` reconciled to ``cm_frame``'s totals.
+
+    Args:
+        pgm_frame: grid forecasts at PGM level, values ``(N_pg, S)``.
+        cm_frame: country forecasts at CM level, values ``(N_cm, S)``.
+        map_keys: ``(M, 2)`` int ``(time, priogrid_gid)`` covering every pgm row.
+        map_vals: ``(M,)`` int ``country_id`` for each key (injected; geography is
+            never embedded here — views-frames ADR-014).
+
+    Returns:
+        A new pgm `PredictionFrame` (same index/metadata as ``pgm_frame``) whose
+        cells sum, per draw, to the country forecast — except all-zero country
+        draws, which stay zero (the leaf's documented edge case).
+
+    Raises:
+        ValueError: a grid row has no country mapping (raised by
+            ``cross_level_align``), or a ``(time, country)`` group has no matching
+            country forecast in ``cm_frame``.
+    """
+    # 1. Label every grid row with its country (cm-level units); fails loud if a
+    #    row's (time, priogrid) is absent from the injected mapping.
+    cm_units = pgm_frame.index.cross_level_align_arrays(
+        np.asarray(map_keys), np.asarray(map_vals), SpatialLevel.CM
+    ).unit  # (N_pg,)
+    pg_time = pgm_frame.index.time
+
+    # 2. (time, country) -> row position in the country frame.
+    cm_time = cm_frame.index.time
+    cm_unit = cm_frame.index.unit
+    cm_vals = cm_frame.values
+    cm_pos = {(int(cm_time[j]), int(cm_unit[j])): j for j in range(cm_frame.n_rows)}
+
+    # 3. Group grid rows by (time, country) and reconcile each group with the leaf.
+    #    Group-by-sort: a single argsort lays the rows out contiguously per group
+    #    (O(N log N), one index array) — no per-group full-array scan — so it
+    #    scales to the full grid (register C-38). Group iteration order is
+    #    irrelevant: each group writes only its own rows.
+    pg_vals = pgm_frame.values
+    out = np.empty_like(pg_vals)
+    group_key = np.stack([pg_time, cm_units], axis=1)  # (N_pg, 2)
+    unique_groups, inverse, counts = np.unique(
+        group_key, axis=0, return_inverse=True, return_counts=True
+    )
+    inverse = np.asarray(inverse).reshape(-1)
+    order = np.argsort(inverse, kind="stable")  # rows grouped contiguously by group
+    # group gi -> order[bounds[gi]:bounds[gi + 1]]
+    bounds = np.concatenate(([0], np.cumsum(counts)))
+
+    for gi in range(unique_groups.shape[0]):
+        t, c = int(unique_groups[gi, 0]), int(unique_groups[gi, 1])
+        if (t, c) not in cm_pos:
+            raise ValueError(
+                f"grid group (time={t}, country={c}) has no country forecast "
+                "in cm_frame"
+            )
+        rows = order[bounds[gi]:bounds[gi + 1]]
+        country_total = cm_vals[cm_pos[(t, c)]]  # (S,)
+        # leaf convention: grid is (samples, cells); our frame slice is (cells, samples)
+        scaled = reconcile_proportional(pg_vals[rows].T, country_total)  # (S, n_cells)
+        out[rows] = scaled.T  # back to (n_cells, S)
+
+    return PredictionFrame(out, pgm_frame.index, pgm_frame.metadata)

views_frames-1.8.0/src/views_frames_reconcile/module.py

@@ -0,0 +1,120 @@
+"""Frames-native reconciliation orchestration (epic #31, story #36).
+
+`ReconciliationModule` holds the injected `(time, priogrid_gid) -> country_id`
+mapping (geography is injected, never embedded — views-frames ADR-014) and
+applies it: `reconcile(cm_frame, pgm_frame)` validates the inputs and scales the
+grid forecasts to the country totals, returning a **new** pgm frame (de-mutated,
+C-184).
+
+**SRP:** orchestration only — the scaling math is the leaf (`proportional`), the
+grouping is `grouping`, the guards are `validation`, the I/O is `frames`. No
+torch, no pandas, no viewser, no wandb: the original's `ProcessPoolExecutor` and
+WandB alerting are dropped (numpy is fast; there is no GPU). If scale ever needs
+parallelism, add it behind this same interface (OCP). Multi-target inputs are
+reconciled by calling `reconcile` once per target.
+"""
+
+from __future__ import annotations
+
+from typing import Any
+
+import numpy as np
+from numpy.typing import NDArray
+
+from views_frames import PredictionFrame
+from views_frames_reconcile.grouping import reconcile_pgm_to_cm
+from views_frames_reconcile.result import (
+    ALIGNED_DRAWS,
+    METHOD_PROPORTIONAL,
+    POINT_BROADCAST,
+    ReconciliationResult,
+)
+from views_frames_reconcile.validation import validate_reconciliation_inputs
+
+
+def _broadcast_point_country(
+    cm_frame: PredictionFrame, n_samples: int
+) -> PredictionFrame:
+    """Tile a point country forecast (``sample_count == 1``) across ``n_samples`` draws.
+
+    Bit-identical to the WET broadcast pipeline-core's ``align_country_to_grid`` does
+    (views-frames#143): the single column is repeated, so every draw is rescaled to the
+    same total. It lives in the orchestrator so the leaf ``proportional`` and the
+    parity-frozen ``grouping`` hot loop stay **untouched** — the equal-count path is
+    byte-for-byte identical and only ``sample_count == 1`` takes this new path.
+    """
+    tiled = np.tile(np.asarray(cm_frame.values, dtype=np.float32), (1, n_samples))
+    return PredictionFrame(tiled, cm_frame.index, cm_frame.metadata)
+
+
+class ReconciliationModule:
+    """Reconcile pgm forecasts to cm country totals (one target per call)."""
+
+    def __init__(
+        self,
+        map_keys: NDArray[np.integer[Any]] | object,
+        map_vals: NDArray[np.integer[Any]] | object,
+    ) -> None:
+        """Inject the `(time, priogrid_gid) -> country_id` mapping.
+
+        Args:
+            map_keys: ``(M, 2)`` int array of ``(time, priogrid_gid)`` pairs.
+            map_vals: ``(M,)`` int ``country_id`` for each key.
+
+        Raises:
+            ValueError: ``map_keys`` is not ``(M, 2)`` or ``map_vals`` is not
+                length ``M``.
+        """
+        keys = np.asarray(map_keys)
+        vals = np.asarray(map_vals)
+        if keys.ndim != 2 or keys.shape[1] != 2:
+            raise ValueError("map_keys must be an (M, 2) array of (time, priogrid_gid)")
+        if vals.shape != (keys.shape[0],):
+            raise ValueError("map_vals must be a length-M array aligned to map_keys")
+        self._map_keys = keys
+        self._map_vals = vals
+
+    def reconcile_result(
+        self, cm_frame: PredictionFrame, pgm_frame: PredictionFrame
+    ) -> ReconciliationResult:
+        """Reconcile, also reporting the mode — a ``ReconciliationResult``.
+
+        A **point** country (``cm.sample_count == 1``) is broadcast across the grid's
+        draws before reconciling (mode ``point-broadcast``); an **aligned** country
+        (``cm.sample_count == S``) scales draw-for-draw (mode ``aligned-draws``, the
+        documented per-draw approximation). Any other count fails loud.
+
+        The mode is **returned**, never stamped on the leaf's generic ``FrameMetadata``
+        (ADR-020 / register C-47 — the leaf carries no reconciliation vocabulary; see
+        ``result.py``).
+
+        Raises:
+            ValueError: the inputs fail validation (level / sample-count — cm must be 1
+                or pgm's ``S`` / time coverage / missing country forecast).
+        """
+        validate_reconciliation_inputs(
+            cm_frame, pgm_frame, self._map_keys, self._map_vals
+        )
+        if cm_frame.sample_count != pgm_frame.sample_count:
+            cm = _broadcast_point_country(cm_frame, pgm_frame.sample_count)
+            mode = POINT_BROADCAST
+        else:
+            cm = cm_frame
+            mode = ALIGNED_DRAWS
+        frame = reconcile_pgm_to_cm(pgm_frame, cm, self._map_keys, self._map_vals)
+        return ReconciliationResult(frame=frame, mode=mode, method=METHOD_PROPORTIONAL)
+
+    def reconcile(
+        self, cm_frame: PredictionFrame, pgm_frame: PredictionFrame
+    ) -> PredictionFrame:
+        """Validate the inputs, then return a new pgm frame reconciled to cm totals.
+
+        Point/aligned handling and fail-loud are as :meth:`reconcile_result`; this
+        returns only the reconciled frame. Call :meth:`reconcile_result` when you also
+        need the reconciliation *mode* (point-broadcast vs aligned-draws).
+
+        Raises:
+            ValueError: the inputs fail validation (level / sample-count — cm must be 1
+                or pgm's ``S`` / time coverage / missing country forecast).
+        """
+        return self.reconcile_result(cm_frame, pgm_frame).frame

views_frames-1.8.0/src/views_frames_reconcile/proportional.py

@@ -0,0 +1,77 @@
+"""Top-down proportional reconciliation (numpy port — phase 2, slice 1).
+
+Makes PRIO-GRID-month (pgm) forecasts sum to their country-month (cm) total by
+**top-down disaggregation using forecast proportions** (FPP3 terminology),
+applied **per posterior draw**: within a draw, each grid cell keeps its relative
+share and the cells are rescaled so they sum to that draw's country total. Zeros
+stay zero; country totals are authoritative; the result is non-negative.
+
+This is a *faithful, numpy-only* port of views-reporting's
+``ForecastReconciler.reconcile_forecast`` (torch), migrated here because the
+algorithm belongs in post-processing, not reporting (views-reporting issue #72).
+It is intentionally the **same** method — a pragmatic per-draw approximation, not
+principled joint probabilistic reconciliation. The upgrade to the latter is designed
+in **ADR-024** (register **C-62**; the cross-repo lineage is views-postprocessing
+C-37) and is deliberately **deferred**: per-draw pairing of independently-trained
+grid and country draws has no shared draw identity, so the principled method waits on
+a defined draw-identity/coupling contract and a consumer that needs calibrated joint
+tails.
+
+No torch, no pandas — numpy only.
+"""
+
+from __future__ import annotations
+
+from typing import Any
+
+import numpy as np
+from numpy.typing import NDArray
+
+_EPS = np.float32(1e-8)
+
+
+def reconcile_proportional(
+    grid: NDArray[np.floating[Any]] | object,
+    country: NDArray[np.floating[Any]] | float | object,
+) -> NDArray[np.float32]:
+    """Rescale grid forecasts so each draw sums to its country total.
+
+    Args:
+        grid: Grid-level forecasts, float32-coercible. Either
+            ``(num_samples, num_grid_cells)`` (probabilistic) or
+            ``(num_grid_cells,)`` (point).
+        country: Country-level total. Either ``(num_samples,)`` (probabilistic)
+            or a scalar (point). Must align with ``grid``'s sample axis.
+
+    Returns:
+        Adjusted grid forecasts, float32, same shape as ``grid``. ``sum`` over
+        grid cells equals ``country`` per sample; zero cells stay zero; values
+        are clamped to be non-negative.
+
+    Raises:
+        ValueError: the grid and country sample counts disagree.
+    """
+    grid_arr = np.asarray(grid, dtype=np.float32)
+    is_point = grid_arr.ndim == 1
+
+    if is_point:
+        grid_arr = grid_arr[np.newaxis, :]  # (1, N)
+        country_arr = np.asarray([country], dtype=np.float32)
+    else:
+        country_arr = np.asarray(country, dtype=np.float32).reshape(-1)
+
+    if grid_arr.shape[0] != country_arr.shape[0]:
+        raise ValueError(
+            f"Mismatch in sample count: grid has {grid_arr.shape[0]}, "
+            f"country has {country_arr.shape[0]}"
+        )
+
+    # Preserve zeros: only strictly-positive cells carry probability mass.
+    nonzero = np.where(grid_arr > 0, grid_arr, np.float32(0.0))
+
+    # Per-draw proportional scaling to the (authoritative) country total.
+    sum_nonzero = nonzero.sum(axis=1, keepdims=True)  # (S, 1)
+    scaling = country_arr.reshape(-1, 1) / (sum_nonzero + _EPS)  # (S, 1)
+    adjusted = np.clip(nonzero * scaling, 0.0, None).astype(np.float32)
+
+    return np.asarray(adjusted[0] if is_point else adjusted, dtype=np.float32)

views_frames-1.8.0/src/views_frames_reconcile/result.py

@@ -0,0 +1,55 @@
+"""The reconciliation result — the reconciled frame plus *how* it was produced (#144).
+
+The reconciliation **mode** (`point-broadcast` vs `aligned-draws`) and **method** are
+reported here, on a reconcile-package result object — deliberately **not** stamped onto
+the leaf's generic ``FrameMetadata``. That header is governed *generic-only* (ADR-020 /
+register C-47): the numpy leaf carries provenance meaningful for *any* frame (`run_id`,
+`data_version`) and must never carry domain/operation vocabulary it cannot know — as
+evaluation provenance lives in views-evaluation's ``MetricFrame``, not the leaf.
+Reconciliation is a sibling operation, so its provenance is reported by the sibling.
+
+A caller that needs the mode reads it off :class:`ReconciliationResult`
+(``ReconciliationModule.reconcile_result``); a caller that only needs the frame uses
+``ReconciliationModule.reconcile``, which returns the frame directly.
+
+The mode reflects **what this reconcile call did** (broadcast a point, or scaled aligned
+draws) — not upstream provenance: a caller that pre-tiles a point country to ``S`` draws
+before calling reconciles in ``aligned-draws`` mode. The string values match
+pipeline-core's ``reconcile_frames`` constants verbatim, so the *vocabulary* is shared
+across the repos that produce and consume the mode.
+"""
+
+from __future__ import annotations
+
+from dataclasses import dataclass
+
+from views_frames import PredictionFrame
+
+#: Mode — the call **broadcast a point**: the country arrived as a point
+#: (``cm.sample_count == 1``) against a multi-draw grid and was tiled across the grid's
+#: ``S`` draws (every draw rescaled to the same total).
+POINT_BROADCAST = "point-broadcast"
+#: Mode — the call **scaled aligned draws**: the country already carried the grid's draw
+#: count (``cm.sample_count == S``) and was scaled draw-for-draw — the per-draw
+#: approximation (the principled joint upgrade is a separate design, #145). The mode
+#: describes *what this call did*: a point against a single-draw grid, or a point the
+#: caller pre-tiled to ``S``, also reads as aligned-draws (nothing was broadcast).
+ALIGNED_DRAWS = "aligned-draws"
+#: The reconciliation algorithm — top-down proportional, per draw.
+METHOD_PROPORTIONAL = "proportional"
+
+
+@dataclass(frozen=True)
+class ReconciliationResult:
+    """A reconciled grid frame plus how it was produced.
+
+    Attributes:
+        frame: the reconciled pgm ``PredictionFrame`` (identical to what ``reconcile``
+            returns).
+        mode: :data:`POINT_BROADCAST` or :data:`ALIGNED_DRAWS`.
+        method: the reconciliation method, e.g. :data:`METHOD_PROPORTIONAL`.
+    """
+
+    frame: PredictionFrame
+    mode: str
+    method: str

views_frames-1.8.0/src/views_frames_reconcile/validation.py

@@ -0,0 +1,81 @@
+"""Fail-loud validation for reconciliation inputs (epic #31, story #35).
+
+Ports views-reporting `ReconciliationModule.__init__`'s guards to frames-native
+checks, run before any work. SRP: small, independently testable helpers — not
+buried in the orchestrator. The original's intents map as:
+
+  - dataset type checks            -> spatial-level guard (cm@CM, pgm@PGM)
+  - same time steps + exact overlap -> identical set of time values
+  - (per-draw scaling needs it)     -> equal `sample_count`, or a point cm
+                                       (`sample_count == 1`) broadcast across the draws
+  - valid countries                 -> every (time, country) the grid maps to has
+                                       a country forecast in the cm frame
+
+The original's "different time units" (e.g. month_id vs year_id) check is
+subsumed by the level guard; per-target intersection is handled by the
+orchestrator, since frames here are single-target.
+"""
+
+from __future__ import annotations
+
+from typing import Any
+
+import numpy as np
+from numpy.typing import NDArray
+
+from views_frames import PredictionFrame, SpatialLevel
+
+
+def validate_reconciliation_inputs(
+    cm_frame: PredictionFrame,
+    pgm_frame: PredictionFrame,
+    map_keys: NDArray[np.integer[Any]] | object,
+    map_vals: NDArray[np.integer[Any]] | object,
+) -> None:
+    """Raise ``ValueError`` if the reconciliation inputs are inconsistent.
+
+    Checks spatial levels, sample-count alignment, identical time coverage, and
+    that every country the grid maps to has a forecast in ``cm_frame``.
+    """
+    if cm_frame.index.level is not SpatialLevel.CM:
+        raise ValueError(
+            f"country frame must be at SpatialLevel.CM, got {cm_frame.index.level}"
+        )
+    if pgm_frame.index.level is not SpatialLevel.PGM:
+        raise ValueError(
+            f"grid frame must be at SpatialLevel.PGM, got {pgm_frame.index.level}"
+        )
+    if cm_frame.sample_count not in (1, pgm_frame.sample_count):
+        raise ValueError(
+            f"sample-count mismatch: cm has {cm_frame.sample_count}, pgm has "
+            f"{pgm_frame.sample_count}; cm must be 1 (point, broadcast across draws) "
+            f"or {pgm_frame.sample_count} (aligned draws)"
+        )
+
+    cm_times = {int(t) for t in np.unique(cm_frame.index.time)}
+    pg_times = {int(t) for t in np.unique(pgm_frame.index.time)}
+    if cm_times != pg_times:
+        raise ValueError(
+            "cm and pgm cover different time steps: "
+            f"cm-only={sorted(cm_times - pg_times)}, "
+            f"pgm-only={sorted(pg_times - cm_times)}"
+        )
+
+    # Valid countries: every (time, country) the grid maps to must have a forecast.
+    cm_units = pgm_frame.index.cross_level_align_arrays(
+        np.asarray(map_keys), np.asarray(map_vals), SpatialLevel.CM
+    ).unit
+    needed = {
+        (int(t), int(c))
+        for t, c in zip(pgm_frame.index.time, cm_units, strict=True)
+    }
+    have = {
+        (int(t), int(c))
+        for t, c in zip(cm_frame.index.time, cm_frame.index.unit, strict=True)
+    }
+    missing = needed - have
+    if missing:
+        raise ValueError(
+            f"{len(missing)} grid group(s) have no country forecast in cm_frame, "
+            f"e.g. {sorted(missing)[:5]}"
+        )