dataframe-toolkit 0.4.1__tar.gz

dataframe_toolkit-0.4.1/PKG-INFO

@@ -0,0 +1,230 @@
+Metadata-Version: 2.3
+Name: dataframe-toolkit
+Version: 0.4.1
+Summary: A command-line toolkit for DataFrame analysis and manipulation
+Keywords: dataframe,statistics,data analysis,CLI,TSV,pandas
+Author: Gunnar Pálsson
+Author-email: Gunnar Pálsson <hemingur@gmail.com>
+License: MIT
+Classifier: Development Status :: 3 - Alpha
+Classifier: Intended Audience :: Science/Research
+Classifier: Intended Audience :: Developers
+Classifier: Topic :: Scientific/Engineering :: Information Analysis
+Classifier: Topic :: Utilities
+Classifier: Programming Language :: Python :: 3
+Requires-Dist: pandas>=2.1
+Requires-Dist: numpy>=1.24
+Requires-Dist: pyarrow>=12.0
+Requires-Dist: scipy>=1.10
+Requires-Dist: statsmodels>=0.14
+Requires-Dist: duckdb>=0.8
+Requires-Dist: matplotlib>=3.7
+Requires-Dist: seaborn>=0.12
+Requires-Dist: tqdm>=4.65
+Requires-Python: >=3.12
+Project-URL: Homepage, https://github.com/hemingur/dataframe-toolkit
+Project-URL: Repository, https://github.com/hemingur/dataframe-toolkit
+Description-Content-Type: text/markdown
+
+# dftk — DataFrame analysis and manipulation toolkit
+
+`dftk` is a command-line toolkit for exploratory data analysis on TSV files.
+Each subcommand reads tabular data, performs one operation, and writes TSV to
+stdout, making it easy to chain commands in pipelines.
+
+`dftk` was developed during computational genomics research as a fast,
+composable alternative to writing one-off pandas scripts. It is designed
+for analysts who live in the terminal and want a consistent, pipeable toolkit
+for the full data analysis pipeline — from initial exploration through
+statistical modelling and publication-quality figures.
+
+## Installation
+
+```bash
+uv tool install dataframe-toolkit
+dftk --help
+```
+
+Or with `pip`:
+
+```bash
+pip install dataframe-toolkit
+```
+
+To install the latest `main` branch directly from GitHub:
+
+```bash
+uv tool install git+https://github.com/hemingur/dataframe-toolkit.git
+```
+
+To install from a local clone:
+
+```bash
+git clone https://github.com/hemingur/dataframe-toolkit.git
+cd dataframe-toolkit
+uv tool install .
+```
+
+## Quick example
+
+```bash
+dftk stat data.tsv -c height weight -g sex
+dftk stat data.tsv -c value -g group -o \
+  | dftk pivot -i group -v value_mean -o \
+  | dftk print
+```
+
+## Subcommands
+
+### Data transformation
+
+| Command   | Description                                                                          |
+|-----------|--------------------------------------------------------------------------------------|
+| `eval`    | Add or modify columns: eval expressions, string/path functions, statistical ops      |
+| `query`   | Filter rows with pandas query expressions or SQL (`--sql` via DuckDB)                |
+| `merge`   | Join two tables on key columns (inner/left/right/outer)                              |
+| `concat`  | Concatenate two or more tables row-wise                                              |
+| `melt`    | Reshape wide-to-long (`pd.melt`)                                                     |
+| `pivot`   | Reshape long-to-wide with per-cell aggregation                                       |
+| `func`    | Column transforms: cumsum, group mean/sum/min/max/count/median/std, rank, qcut:N     |
+| `scale`   | Normalise: z-score, min-shift, sum/max/mean scaling, Blom rank, regression residuals |
+| `interp`  | Interpolate values from a reference curve into a table (1-D lookup)                  |
+| `binx`    | Assign bin indices to a column based on explicit or generated edges                  |
+
+### Statistics
+
+| Command    | Description                                                                                         |
+|------------|-----------------------------------------------------------------------------------------------------|
+| `stat`     | Descriptive statistics (count/mean/std/CI/SEM/skew/kurtosis) with grouping and bootstrap            |
+| `wstat`    | Weighted descriptive statistics (wmean, wstd, weighted quantile CI)                                 |
+| `fit`      | OLS/robust/weighted regression via R-style formulas; tidy table, `--summary`, `--anova`             |
+| `test`     | P-values between column pairs: t-test, Mann-Whitney, Wilcoxon, KS, correlations, bootstrap; groups  |
+| `corr`     | Pairwise column correlations (Pearson/Spearman/Kendall) with optional BCa bootstrap CI              |
+| `describe` | Quick column-level summary (dtype, n, n_unique, n_null, sample values)                              |
+| `randvar`  | Sample from a distribution and append as a new column (norm, alpha, beta, …)                        |
+
+### Plots
+
+All plot commands write a PNG/PDF when `-f FILE` is given, or display
+interactively otherwise. They support `--groupcol` for colour grouping,
+`--subgraphcol` for subplot grids, and figure/font presets for
+publication-quality output.
+
+| Command | Description                                                                                     |
+|---------|-------------------------------------------------------------------------------------------------|
+| `scat`  | Scatter plot; optional OLS/robust fit overlay, bubble size (`--sizecol`), colour (`--colorcol`) |
+| `line`  | Line plot; optional error bars (`--yerr`) or CI bands (`--yci lo,hi`) and fit overlay           |
+| `hist`  | Histogram or KDE (`--kde`); normalisation, cumulative mode, mean±σ annotation (`--stats`)       |
+
+### Utilities
+
+| Command    | Description                                                              |
+|------------|--------------------------------------------------------------------------|
+| `dataset`  | Load a curated example dataset from seaborn, statsmodels, or pydataset   |
+| `sample`   | Random row sampling (with or without replacement, by count or fraction)   |
+| `split`    | Split a dataframe into one file per group                                 |
+| `annotate` | Read and write provenance metadata (genome, source, …) in parquet files  |
+| `print`    | Read any dftk input (TSV, stdin, `...` parquet pipe) and write TSV     |
+| `clean`    | Remove leftover temp parquet pipe files from interrupted pipelines       |
+| `help`     | List all subcommands or show full help for one: `dftk help stat`       |
+
+## Common patterns
+
+### Chaining commands
+
+```bash
+# z-score within group, then fit a model
+dftk scale data.tsv -c expr -g condition -o \
+  | dftk fit - -f "expr_z ~ time + batch" -g condition
+```
+
+### Group summary then plot
+
+```bash
+dftk stat results.tsv -c value -g group -o \
+  | dftk line - -x group -y value_mean --yerr value_sem -f fig.png
+```
+
+### Wide-to-long then plot overlaid histograms
+
+```bash
+dftk melt data.tsv -i sample -d gene -v expression \
+  | dftk hist - -x expression -g gene -k -f dist.png
+```
+
+### Interpolation (standard curve lookup)
+
+```bash
+dftk interp samples.tsv --ref stdcurve.tsv \
+    -x fluorescence -v concentration -d conc_ng_ul
+```
+
+### Bootstrap confidence intervals
+
+```bash
+dftk stat data.tsv -c value -g group --bootstrap 1000 --randomseed 42 -o \
+  | dftk pivot -i group -v value_mean -f mean -o \
+  | dftk stat - -c group_A group_B
+```
+
+## Input/output
+
+All commands accept:
+
+- A TSV filename as a positional argument
+- `-` to read TSV from stdin
+- `...` to receive a parquet path from stdin (written by a previous `-o` command)
+- A `.parquet` filename to read a named parquet file directly
+
+Standard output options (available on all tabular commands):
+
+- `-o` / `--output` — write a temp parquet for the next piped command instead of TSV to stdout
+- `--select col1 col2 …` — keep only these columns
+- `--drop col1 col2 …` — remove these columns
+- `--round N` — round numeric output
+- `--postquery EXPR` — filter output rows after processing
+- `--meta KEY=VALUE` — embed provenance metadata in parquet output (repeatable)
+
+### Provenance annotations
+
+Metadata embedded with `--meta` is stored in the parquet file schema and propagates
+automatically through the pipe: every subsequent `-o` write re-embeds it alongside
+any new `--meta` values.
+
+```bash
+# Tag a file at creation
+dftk eval raw.tsv -f "z = x + y" -o results.parquet \
+    --meta genome=hg38 --meta source=gwas_2024
+
+# Inspect annotations
+dftk annotate results.parquet
+# genome   hg38
+# source   gwas_2024
+
+# Add or update an annotation in-place
+dftk annotate results.parquet --set step=qc_filtered
+
+# Annotations survive piping
+dftk eval results.parquet -f "z_scaled = z / 2" -o | dftk scale ... -c z -o scaled.parquet
+dftk annotate scaled.parquet   # genome and source still present
+```
+
+## Figure options (plot commands)
+
+```text
+--size single|double|full|WxH    figure size (single ≈ 3.5", double ≈ 7.2")
+--fontsize screen|publication|presentation
+-f FILE                          save to file (PNG/PDF/SVG); omit to display
+--groupcol COL                   colour-code by this column
+--subgraphcol COL                split into subplot grid by this column
+--ncols N                        columns in subplot grid (default: auto)
+--legend TEXT                    legend label for ungrouped series
+```
+
+## Dependencies
+
+- `pandas`, `numpy`, `scipy` — core data handling and statistics
+- `statsmodels` — regression (`fit`, `scale --resid`, `wstat`)
+- `duckdb` — SQL queries (`query --sql`)
+- `matplotlib`, `seaborn` — plots
+- `pyarrow` — parquet I/O backend

dataframe_toolkit-0.4.1/README.md

@@ -0,0 +1,202 @@
+# dftk — DataFrame analysis and manipulation toolkit
+
+`dftk` is a command-line toolkit for exploratory data analysis on TSV files.
+Each subcommand reads tabular data, performs one operation, and writes TSV to
+stdout, making it easy to chain commands in pipelines.
+
+`dftk` was developed during computational genomics research as a fast,
+composable alternative to writing one-off pandas scripts. It is designed
+for analysts who live in the terminal and want a consistent, pipeable toolkit
+for the full data analysis pipeline — from initial exploration through
+statistical modelling and publication-quality figures.
+
+## Installation
+
+```bash
+uv tool install dataframe-toolkit
+dftk --help
+```
+
+Or with `pip`:
+
+```bash
+pip install dataframe-toolkit
+```
+
+To install the latest `main` branch directly from GitHub:
+
+```bash
+uv tool install git+https://github.com/hemingur/dataframe-toolkit.git
+```
+
+To install from a local clone:
+
+```bash
+git clone https://github.com/hemingur/dataframe-toolkit.git
+cd dataframe-toolkit
+uv tool install .
+```
+
+## Quick example
+
+```bash
+dftk stat data.tsv -c height weight -g sex
+dftk stat data.tsv -c value -g group -o \
+  | dftk pivot -i group -v value_mean -o \
+  | dftk print
+```
+
+## Subcommands
+
+### Data transformation
+
+| Command   | Description                                                                          |
+|-----------|--------------------------------------------------------------------------------------|
+| `eval`    | Add or modify columns: eval expressions, string/path functions, statistical ops      |
+| `query`   | Filter rows with pandas query expressions or SQL (`--sql` via DuckDB)                |
+| `merge`   | Join two tables on key columns (inner/left/right/outer)                              |
+| `concat`  | Concatenate two or more tables row-wise                                              |
+| `melt`    | Reshape wide-to-long (`pd.melt`)                                                     |
+| `pivot`   | Reshape long-to-wide with per-cell aggregation                                       |
+| `func`    | Column transforms: cumsum, group mean/sum/min/max/count/median/std, rank, qcut:N     |
+| `scale`   | Normalise: z-score, min-shift, sum/max/mean scaling, Blom rank, regression residuals |
+| `interp`  | Interpolate values from a reference curve into a table (1-D lookup)                  |
+| `binx`    | Assign bin indices to a column based on explicit or generated edges                  |
+
+### Statistics
+
+| Command    | Description                                                                                         |
+|------------|-----------------------------------------------------------------------------------------------------|
+| `stat`     | Descriptive statistics (count/mean/std/CI/SEM/skew/kurtosis) with grouping and bootstrap            |
+| `wstat`    | Weighted descriptive statistics (wmean, wstd, weighted quantile CI)                                 |
+| `fit`      | OLS/robust/weighted regression via R-style formulas; tidy table, `--summary`, `--anova`             |
+| `test`     | P-values between column pairs: t-test, Mann-Whitney, Wilcoxon, KS, correlations, bootstrap; groups  |
+| `corr`     | Pairwise column correlations (Pearson/Spearman/Kendall) with optional BCa bootstrap CI              |
+| `describe` | Quick column-level summary (dtype, n, n_unique, n_null, sample values)                              |
+| `randvar`  | Sample from a distribution and append as a new column (norm, alpha, beta, …)                        |
+
+### Plots
+
+All plot commands write a PNG/PDF when `-f FILE` is given, or display
+interactively otherwise. They support `--groupcol` for colour grouping,
+`--subgraphcol` for subplot grids, and figure/font presets for
+publication-quality output.
+
+| Command | Description                                                                                     |
+|---------|-------------------------------------------------------------------------------------------------|
+| `scat`  | Scatter plot; optional OLS/robust fit overlay, bubble size (`--sizecol`), colour (`--colorcol`) |
+| `line`  | Line plot; optional error bars (`--yerr`) or CI bands (`--yci lo,hi`) and fit overlay           |
+| `hist`  | Histogram or KDE (`--kde`); normalisation, cumulative mode, mean±σ annotation (`--stats`)       |
+
+### Utilities
+
+| Command    | Description                                                              |
+|------------|--------------------------------------------------------------------------|
+| `dataset`  | Load a curated example dataset from seaborn, statsmodels, or pydataset   |
+| `sample`   | Random row sampling (with or without replacement, by count or fraction)   |
+| `split`    | Split a dataframe into one file per group                                 |
+| `annotate` | Read and write provenance metadata (genome, source, …) in parquet files  |
+| `print`    | Read any dftk input (TSV, stdin, `...` parquet pipe) and write TSV     |
+| `clean`    | Remove leftover temp parquet pipe files from interrupted pipelines       |
+| `help`     | List all subcommands or show full help for one: `dftk help stat`       |
+
+## Common patterns
+
+### Chaining commands
+
+```bash
+# z-score within group, then fit a model
+dftk scale data.tsv -c expr -g condition -o \
+  | dftk fit - -f "expr_z ~ time + batch" -g condition
+```
+
+### Group summary then plot
+
+```bash
+dftk stat results.tsv -c value -g group -o \
+  | dftk line - -x group -y value_mean --yerr value_sem -f fig.png
+```
+
+### Wide-to-long then plot overlaid histograms
+
+```bash
+dftk melt data.tsv -i sample -d gene -v expression \
+  | dftk hist - -x expression -g gene -k -f dist.png
+```
+
+### Interpolation (standard curve lookup)
+
+```bash
+dftk interp samples.tsv --ref stdcurve.tsv \
+    -x fluorescence -v concentration -d conc_ng_ul
+```
+
+### Bootstrap confidence intervals
+
+```bash
+dftk stat data.tsv -c value -g group --bootstrap 1000 --randomseed 42 -o \
+  | dftk pivot -i group -v value_mean -f mean -o \
+  | dftk stat - -c group_A group_B
+```
+
+## Input/output
+
+All commands accept:
+
+- A TSV filename as a positional argument
+- `-` to read TSV from stdin
+- `...` to receive a parquet path from stdin (written by a previous `-o` command)
+- A `.parquet` filename to read a named parquet file directly
+
+Standard output options (available on all tabular commands):
+
+- `-o` / `--output` — write a temp parquet for the next piped command instead of TSV to stdout
+- `--select col1 col2 …` — keep only these columns
+- `--drop col1 col2 …` — remove these columns
+- `--round N` — round numeric output
+- `--postquery EXPR` — filter output rows after processing
+- `--meta KEY=VALUE` — embed provenance metadata in parquet output (repeatable)
+
+### Provenance annotations
+
+Metadata embedded with `--meta` is stored in the parquet file schema and propagates
+automatically through the pipe: every subsequent `-o` write re-embeds it alongside
+any new `--meta` values.
+
+```bash
+# Tag a file at creation
+dftk eval raw.tsv -f "z = x + y" -o results.parquet \
+    --meta genome=hg38 --meta source=gwas_2024
+
+# Inspect annotations
+dftk annotate results.parquet
+# genome   hg38
+# source   gwas_2024
+
+# Add or update an annotation in-place
+dftk annotate results.parquet --set step=qc_filtered
+
+# Annotations survive piping
+dftk eval results.parquet -f "z_scaled = z / 2" -o | dftk scale ... -c z -o scaled.parquet
+dftk annotate scaled.parquet   # genome and source still present
+```
+
+## Figure options (plot commands)
+
+```text
+--size single|double|full|WxH    figure size (single ≈ 3.5", double ≈ 7.2")
+--fontsize screen|publication|presentation
+-f FILE                          save to file (PNG/PDF/SVG); omit to display
+--groupcol COL                   colour-code by this column
+--subgraphcol COL                split into subplot grid by this column
+--ncols N                        columns in subplot grid (default: auto)
+--legend TEXT                    legend label for ungrouped series
+```
+
+## Dependencies
+
+- `pandas`, `numpy`, `scipy` — core data handling and statistics
+- `statsmodels` — regression (`fit`, `scale --resid`, `wstat`)
+- `duckdb` — SQL queries (`query --sql`)
+- `matplotlib`, `seaborn` — plots
+- `pyarrow` — parquet I/O backend

dataframe_toolkit-0.4.1/pyproject.toml

@@ -0,0 +1,72 @@
+[project]
+name = "dataframe-toolkit"
+version = "0.4.1"
+description = "A command-line toolkit for DataFrame analysis and manipulation"
+readme = "README.md"
+authors = [
+    { name = "Gunnar Pálsson", email = "hemingur@gmail.com" }
+]
+license = { text = "MIT" }
+keywords = ["dataframe", "statistics", "data analysis", "CLI", "TSV", "pandas"]
+classifiers = [
+    "Development Status :: 3 - Alpha",
+    "Intended Audience :: Science/Research",
+    "Intended Audience :: Developers",
+    "Topic :: Scientific/Engineering :: Information Analysis",
+    "Topic :: Utilities",
+    "Programming Language :: Python :: 3",
+]
+requires-python = ">=3.12"
+dependencies = [
+    "pandas>=2.1",
+    "numpy>=1.24",
+    "pyarrow>=12.0",
+    "scipy>=1.10",
+    "statsmodels>=0.14",
+    "duckdb>=0.8",
+    "matplotlib>=3.7",
+    "seaborn>=0.12",
+    "tqdm>=4.65",
+]
+
+[project.urls]
+Homepage = "https://github.com/hemingur/dataframe-toolkit"
+Repository = "https://github.com/hemingur/dataframe-toolkit"
+
+[project.scripts]
+dftk = "dftk.cli:main"
+
+[build-system]
+requires = ["uv_build>=0.10.4,<0.11.0"]
+build-backend = "uv_build"
+
+[tool.uv.build-backend]
+module-name = "dftk"
+
+[dependency-groups]
+dev = [
+    "pre-commit>=4.6.0",
+    "pytest>=8.0",
+    "pytest-cov>=7.1.0",
+    "ruff>=0.15.12",
+]
+
+[tool.pytest.ini_options]
+testpaths = ["tests"]
+
+[tool.ruff]
+line-length = 88
+target-version = "py312"
+
+[tool.ruff.lint]
+select = [
+    "E",   # pycodestyle errors
+    "W",   # pycodestyle warnings
+    "F",   # pyflakes
+    "I",   # isort
+    "UP",  # pyupgrade
+    "B",   # flake8-bugbear
+]
+
+[tool.ruff.lint.isort]
+known-first-party = ["dftk"]

dataframe_toolkit-0.4.1/src/dftk/__init__.py

@@ -0,0 +1,4 @@
+# dftk — DataFrame analysis and manipulation toolkit
+from importlib.metadata import version
+
+__version__ = version("dataframe-toolkit")

dataframe_toolkit-0.4.1/src/dftk/cli.py

@@ -0,0 +1,72 @@
+"""
+dftk.cli — entry point for the ``dftk`` command.
+
+All subcommands are discovered through the COMMANDS list in
+dftk/commands/__init__.py.  This file contains no command-specific
+logic and never needs to change when a new subcommand is added.
+"""
+
+import argparse
+import logging
+import sys
+
+from dftk import __version__
+from dftk.commands import COMMANDS
+from dftk.common.io import DFTK_TMPDIR
+
+logger = logging.getLogger("dftk")
+logging.basicConfig(format="%(asctime)s %(module)s %(message)s", level=logging.INFO)
+
+
+def main() -> None:
+    parser = argparse.ArgumentParser(
+        prog="dftk",
+        description="DataFrame analysis and manipulation toolkit.",
+        formatter_class=argparse.RawDescriptionHelpFormatter,
+        epilog=(
+            "Pipe mode — use -o alone to pass data between commands:\n"
+            "  dftk stat -g grp -s val -o \\\n"
+            "    | dftk pivot -i grp -v val_mean -o \\\n"
+            "    | dftk print\n\n"
+            f"Temp pipe files are stored in {DFTK_TMPDIR}\n"
+            "Run 'dftk clean' to remove any leftover pipe files."
+        ),
+    )
+
+    parser.add_argument("--version", action="version", version=f"dftk {__version__}")
+
+    subparsers = parser.add_subparsers(dest="command", metavar="COMMAND")
+    subparsers.required = True
+
+    for cmd in COMMANDS:
+        cmd_parser = subparsers.add_parser(cmd.name, help=cmd.help)
+        cmd.add_arguments(cmd_parser)
+        cmd_parser.set_defaults(command_instance=cmd)
+
+    args = parser.parse_args()
+
+    try:
+        args.command_instance.execute(args)
+    except FileNotFoundError as exc:
+        print(f"File error: {exc}", file=sys.stderr)
+        sys.exit(1)
+    except ValueError as exc:
+        print(f"Input error: {exc}", file=sys.stderr)
+        sys.exit(1)
+    except RuntimeError as exc:
+        print(f"Processing error: {exc}", file=sys.stderr)
+        sys.exit(1)
+    except Exception as exc:
+        import traceback
+
+        print(
+            f"Unexpected error ({type(exc).__name__}): {exc}\n"
+            "Please report this with the full traceback below.",
+            file=sys.stderr,
+        )
+        traceback.print_exc(file=sys.stderr)
+        sys.exit(1)
+
+
+if __name__ == "__main__":
+    main()

dataframe_toolkit-0.4.1/src/dftk/commands/__init__.py

@@ -0,0 +1,100 @@
+# dftk.commands — explicit registry of all dftk subcommands.
+#
+# To add a new subcommand:
+#   1. Create src/dftk/commands/<name>.py with a class that inherits
+#      from BaseCommand (see base.py for the contract and an example skeleton).
+#   2. Import the class here and add an instance to command_list below.
+#   That's it — cli.py discovers commands solely through this COMMANDS list.
+
+from dftk.commands.annotate_cmd import AnnotateCommand
+from dftk.commands.binx_cmd import BinxCommand
+from dftk.commands.clean_cmd import CleanCommand
+from dftk.commands.concat_cmd import ConcatCommand
+from dftk.commands.corr_cmd import CorrCommand
+from dftk.commands.dataset_cmd import DatasetCommand
+from dftk.commands.describe_cmd import DescribeCommand
+from dftk.commands.eval_cmd import EvalCommand
+from dftk.commands.fit_cmd import FitCommand
+from dftk.commands.func_cmd import FuncCommand
+from dftk.commands.help import HelpCommand
+from dftk.commands.hist_cmd import HistCommand
+from dftk.commands.interp_cmd import InterpCommand
+from dftk.commands.line_cmd import LineCommand
+from dftk.commands.melt_cmd import MeltCommand
+from dftk.commands.merge_cmd import MergeCommand
+from dftk.commands.pivot_cmd import PivotCommand
+from dftk.commands.print_cmd import PrintCommand
+from dftk.commands.query_cmd import QueryCommand
+from dftk.commands.randvar_cmd import RandvarCommand
+from dftk.commands.sample_cmd import SampleCommand
+from dftk.commands.scale_cmd import ScaleCommand
+from dftk.commands.scat_cmd import ScatCommand
+from dftk.commands.split_cmd import SplitCommand
+from dftk.commands.stat_cmd import StatCommand
+from dftk.commands.test_cmd import TestCommand
+from dftk.commands.wstat_cmd import WstatCommand
+
+# Ported subcommands — uncomment as each one is added:
+# from dftk.commands.segid     import SegidCommand
+# from dftk.commands.info      import InfoCommand
+# from dftk.commands.transpose import TransposeCommand
+# from dftk.commands.color     import ColorCommand
+# from dftk.commands.wavelet   import WaveletCommand
+# from dftk.commands.fisher    import FisherCommand  # superseded by eval's
+#                                                         # fisher_test/fisher_OR
+
+COMMAND_GROUPS: list[tuple[str, list]] = [
+    (
+        "Data transformation",
+        [
+            EvalCommand(),
+            QueryCommand(),
+            MergeCommand(),
+            ConcatCommand(),
+            MeltCommand(),
+            PivotCommand(),
+            FuncCommand(),
+            ScaleCommand(),
+            InterpCommand(),
+            BinxCommand(),
+        ],
+    ),
+    (
+        "Statistics",
+        [
+            StatCommand(),
+            WstatCommand(),
+            FitCommand(),
+            TestCommand(),
+            CorrCommand(),
+            DescribeCommand(),
+            RandvarCommand(),
+        ],
+    ),
+    (
+        "Plots",
+        [
+            ScatCommand(),
+            LineCommand(),
+            HistCommand(),
+        ],
+    ),
+    (
+        "Utilities",
+        [
+            DatasetCommand(),
+            SampleCommand(),
+            SplitCommand(),
+            AnnotateCommand(),
+            PrintCommand(),
+            CleanCommand(),
+        ],
+    ),
+]
+
+command_list = [cmd for _, cmds in COMMAND_GROUPS for cmd in cmds]
+
+# HelpCommand receives the live list and groups so it can introspect any peer.
+help_command = HelpCommand(command_list, COMMAND_GROUPS)
+
+COMMANDS = command_list + [help_command]