data-sampler 3.4.0__tar.gz → 3.4.1__tar.gz

{data_sampler-3.4.0 → data_sampler-3.4.1}/CHANGELOG.md

@@ -1,5 +1,32 @@
 # Changelog
 
+## v3.4.1 — 2026-07-24
+
+- **TUI columns table now breaks the single summary cell into separate
+  `mean` / `median` / `mode` / `sd` columns.** Numeric columns fill all four;
+  non-numeric columns show `mode` (their most frequent value) with dashes for
+  the numeric-only stats. `ColumnStats` gained a `mode` field, populated for
+  every column kind by `compute_column_stats`.
+- **Bulk configuration via multi-select on the columns screen.** Ctrl-click
+  toggles individual rows, shift-click selects a contiguous range (keyboard:
+  `space` toggles the cursor row, `x` clears the selection). Any anonymizer
+  choice, stratification-skip, or reduction-skip then applies to every
+  selected column at once; the panel title shows the selection count.
+- **Columns can now be excluded from the PCA reduction from the TUI.** A new
+  “skip from reduction (PCA)” switch (and the `d` key) sets a per-column
+  `skip_reduce` flag that is passed to `reduce_columns(exclude=…)`, so chosen
+  numeric columns pass through the reduction unchanged. The columns table
+  gained a `reduce` column showing each column's candidacy / skip state, and
+  excluded columns are listed in the run report.
+- **Undo / redo for column configuration** (`ctrl+z` / `ctrl+y`), keeping well
+  over the last ten steps. Bursts of edits to one option field coalesce into a
+  single undo step.
+- **File screen: refresh the directory browser** with `ctrl+r` or the new
+  ⟳ refresh button, so files created after launch appear without restarting.
+- **Report screen: save the report + column histograms to a text file** with
+  `ctrl+s` or the 💾 save .txt button; it writes `<sample-name>_report.txt`
+  next to the sample output.
+
 ## v3.4.0 — 2026-07-24
 
 - **Added optional PCA column reduction** (`data_sampler.reduce`): after

{data_sampler-3.4.0 → data_sampler-3.4.1}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: data-sampler
-Version: 3.4.0
+Version: 3.4.1
 Summary: Hand someone data that looks and behaves like your production data, isn't your production data, and provably kept its statistical variety — stratified sampling + consistent anonymization, with a terminal UI.
 Project-URL: Homepage, https://github.com/aaronified/data-sampler
 Project-URL: Changelog, https://github.com/aaronified/data-sampler/blob/main/CHANGELOG.md
@@ -120,24 +120,35 @@ data_sampler.run_tui("data.csv")       # pre-load a file
 
 The TUI is a panel-based dashboard (think btop / lazydocker):
 
-1. **File screen** — type a path or pick a file from the directory browser;
-   Excel files take an optional sheet name.
+1. **File screen** — type a path or pick a file from the directory browser
+   (**`ctrl+r`** or the **⟳ refresh** button re-scans the folder so files
+   created since launch show up); Excel files take an optional sheet name.
 2. **Columns screen** — every column with its type, missing %, unique count,
-   distribution sparkline, and summary (modelled after the Data Wrangler
-   VS Code extension). Select a column to see full stats and distribution
-   bars, choose an anonymizer for it, and toggle whether it should be
-   skipped when preserving statistical variety (stratification). Set the
-   sample size, output folder, optional seed, an optional PCA column
-   reduction (`reduce`: N components or a variance target), and run.
+   distribution sparkline, and per-stat **mean / median / mode / sd** columns
+   (modelled after the Data Wrangler VS Code extension). Select a column to
+   see full stats and distribution bars, choose an anonymizer for it, and
+   toggle whether it should be skipped when preserving statistical variety
+   (stratification) or excluded from the PCA reduction. **Multi-select** rows
+   to configure them in bulk: **ctrl-click** toggles individual rows,
+   **shift-click** selects a range (**space** toggles the cursor row from the
+   keyboard, **`x`** clears) — then any anonymizer / skip / reduce choice
+   applies to every selected column at once. **`ctrl+z` / `ctrl+y`** undo and
+   redo column-config changes (at least the last ten steps). Set the sample
+   size, output folder, optional seed, an optional PCA column reduction
+   (`reduce`: N components or a variance target), and run.
 3. **Report screen** — the stratification comparison and anonymization summary
    on the left, and a **column histograms** panel on the right showing every
    column's source-vs-sample distribution (numeric columns share bin edges;
    others use the source's top categories) so you can see at a glance how well
-   the sample preserved each column. The output path is shown too.
-
-Key bindings: `ctrl+r` run sample, `a` auto-suggest anonymizer types,
-`s` toggle stratification skip,
-`escape` back, `ctrl+q` quit.
+   the sample preserved each column. The output path is shown too, and
+   **`ctrl+s`** (or **💾 save .txt**) writes the report and histograms to a
+   `*_report.txt` beside the sample.
+
+Key bindings — columns screen: `ctrl+r` run sample, `a` auto-suggest
+anonymizer types, `s` toggle stratification skip, `d` toggle reduction skip,
+`space` select row, `x` clear selection, `ctrl+z`/`ctrl+y` undo/redo,
+`escape` back. Report screen: `ctrl+s` save report to text, `n` new file.
+Everywhere: `ctrl+q` quit.
 
 ## CLI (headless)
 

{data_sampler-3.4.0 → data_sampler-3.4.1}/README.md

@@ -65,24 +65,35 @@ data_sampler.run_tui("data.csv")       # pre-load a file
 
 The TUI is a panel-based dashboard (think btop / lazydocker):
 
-1. **File screen** — type a path or pick a file from the directory browser;
-   Excel files take an optional sheet name.
+1. **File screen** — type a path or pick a file from the directory browser
+   (**`ctrl+r`** or the **⟳ refresh** button re-scans the folder so files
+   created since launch show up); Excel files take an optional sheet name.
 2. **Columns screen** — every column with its type, missing %, unique count,
-   distribution sparkline, and summary (modelled after the Data Wrangler
-   VS Code extension). Select a column to see full stats and distribution
-   bars, choose an anonymizer for it, and toggle whether it should be
-   skipped when preserving statistical variety (stratification). Set the
-   sample size, output folder, optional seed, an optional PCA column
-   reduction (`reduce`: N components or a variance target), and run.
+   distribution sparkline, and per-stat **mean / median / mode / sd** columns
+   (modelled after the Data Wrangler VS Code extension). Select a column to
+   see full stats and distribution bars, choose an anonymizer for it, and
+   toggle whether it should be skipped when preserving statistical variety
+   (stratification) or excluded from the PCA reduction. **Multi-select** rows
+   to configure them in bulk: **ctrl-click** toggles individual rows,
+   **shift-click** selects a range (**space** toggles the cursor row from the
+   keyboard, **`x`** clears) — then any anonymizer / skip / reduce choice
+   applies to every selected column at once. **`ctrl+z` / `ctrl+y`** undo and
+   redo column-config changes (at least the last ten steps). Set the sample
+   size, output folder, optional seed, an optional PCA column reduction
+   (`reduce`: N components or a variance target), and run.
 3. **Report screen** — the stratification comparison and anonymization summary
    on the left, and a **column histograms** panel on the right showing every
    column's source-vs-sample distribution (numeric columns share bin edges;
    others use the source's top categories) so you can see at a glance how well
-   the sample preserved each column. The output path is shown too.
-
-Key bindings: `ctrl+r` run sample, `a` auto-suggest anonymizer types,
-`s` toggle stratification skip,
-`escape` back, `ctrl+q` quit.
+   the sample preserved each column. The output path is shown too, and
+   **`ctrl+s`** (or **💾 save .txt**) writes the report and histograms to a
+   `*_report.txt` beside the sample.
+
+Key bindings — columns screen: `ctrl+r` run sample, `a` auto-suggest
+anonymizer types, `s` toggle stratification skip, `d` toggle reduction skip,
+`space` select row, `x` clear selection, `ctrl+z`/`ctrl+y` undo/redo,
+`escape` back. Report screen: `ctrl+s` save report to text, `n` new file.
+Everywhere: `ctrl+q` quit.
 
 ## CLI (headless)
 

{data_sampler-3.4.0 → data_sampler-3.4.1}/pyproject.toml

@@ -4,7 +4,7 @@ build-backend = "hatchling.build"
 
 [project]
 name = "data-sampler"
-version = "3.4.0"
+version = "3.4.1"
 description = "Hand someone data that looks and behaves like your production data, isn't your production data, and provably kept its statistical variety — stratified sampling + consistent anonymization, with a terminal UI."
 readme = "README.md"
 license = { file = "LICENSE" }

{data_sampler-3.4.0 → data_sampler-3.4.1}/src/data_sampler/__init__.py

@@ -18,7 +18,7 @@ Public API::
 
 from __future__ import annotations
 
-__version__ = "3.4.0"
+__version__ = "3.4.1"
 
 from .io import SUPPORTED_EXTENSIONS, list_sheets, load_file, save_output
 from .reduce import ReductionResult, reduce_columns

{data_sampler-3.4.0 → data_sampler-3.4.1}/src/data_sampler/stats.py

@@ -28,6 +28,9 @@ class ColumnStats:
     mean: float | None = None
     std: float | None = None
     median: float | None = None
+    # most frequent value: a float for numeric columns, a string otherwise
+    # (None when the column is empty). Populated for every kind.
+    mode: object | None = None
     # most frequent values as (value, count), up to 8
     top_values: list[tuple[str, int]] = field(default_factory=list)
     # distribution: 10-bin histogram counts for numeric, top-8 category counts otherwise
@@ -146,6 +149,8 @@ def compute_column_stats(series: pd.Series, n_rows: int | None = None) -> Column
         stats.mean = float(non_null.mean())
         stats.std = float(non_null.std()) if count > 1 else 0.0
         stats.median = float(non_null.median())
+        m = non_null.mode()
+        stats.mode = float(m.iloc[0]) if len(m) else None
         finite = non_null.astype(float)
         finite = finite[np.isfinite(finite)]
         if len(finite) > 0:
@@ -164,6 +169,8 @@ def compute_column_stats(series: pd.Series, n_rows: int | None = None) -> Column
         stats.top_values = [(str(v), int(c)) for v, c in vc.items()]
         stats.histogram = [int(c) for c in vc.values]
         stats.histogram_labels = [str(v) for v in vc.index]
+        # the most frequent category is the first entry of value_counts
+        stats.mode = stats.top_values[0][0] if stats.top_values else None
 
     return stats