pytae 3.7.2__tar.gz → 3.7.3__tar.gz

{pytae-3.7.2 → pytae-3.7.3}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.5
 Name: pytae
-Version: 3.7.2
+Version: 3.7.3
 Summary: Fast, ergonomic pandas tools and zero-code CLI for tabular data manipulation and plotting
 Project-URL: Homepage, https://github.com/maddytae/pytae
 Project-URL: Bug Tracker, https://github.com/maddytae/pytae/issues

{pytae-3.7.2 → pytae-3.7.3}/changelog.md

@@ -2,6 +2,38 @@
 
 All notable changes to this project are documented in this file.
 
+## [3.7.3] - 2026-10-04
+
+### Added
+- **Transposed Summary (`glimpse`)**:
+  - Added `-glimpse` to the CLI and `df.pt.glimpse(width=None)` / `pt.glimpse(df)` to the Python library (inspired by `dplyr::glimpse` and Polars).
+  - Provides a transposed overview of rows count, columns count, column data types, and inline sample values.
+  - In Python, returns the original DataFrame `self` for non-destructive inspection mid-pipeline.
+- **Auto-Pipe Detection (CLI)**:
+  - `pytae` automatically detects when data is piped via standard input (`stdin`) or redirected via shell, eliminating the requirement to pass a trailing `-` (e.g. `cat file.csv | pytae -head 5` works directly).
+  - Explicit `-` continues to be fully supported for standard unix pipeline workflows.
+- **Clipboard Ingestion (`pytae clip`)**:
+  - Added `clip` as the canonical input target (`pytae clip [flags...]`).
+  - Reads tabular data directly from the system clipboard into the pipeline via `pd.read_clipboard()`, with optional delimiter override via `-dlim`.
+  - Strictly adheres to the "one and only one right way" philosophy: backward compatibility aliases `from_clip` and `clipboard` are removed.
+- **Dedicated Row-Dropping Flag (`-drop_na`)**:
+  - Added `-drop_na [COLS]` to the CLI pipeline.
+  - Bare `-drop_na` drops rows containing `NaN` across any column; `-drop_na col1,col2` drops rows where specified columns are `NaN`.
+  - Runs in the cleaning/filtering stage before aggregations and transformations.
+
+## [3.7.2] - 2026-10-04
+
+### Fixed
+- **Documentation & PyPI Link Targets**:
+  - Converted relative links in `readme.md` to absolute GitHub URLs so that documentation and Jupyter tutorial links resolve correctly on PyPI.
+
+## [3.7.1] - 2026-10-04
+
+### Documentation
+- **Explicit Literal Constants with `pt.lit()`**:
+  - Clarified that `pt.lit("str")` is used exclusively in Python `pt.mutate()` when assigning string constants that match existing column names to avoid column aliasing.
+  - Clarified that `pt.lit()` is never required in the CLI or inside conditional expressions (`if_else`, `case_when`).
+
 ## [3.7.0] - 2026-09-29
 
 ### Added

{pytae-3.7.2 → pytae-3.7.3}/docs/cli/clean_replace.md

@@ -17,6 +17,7 @@ Standardize messy column headers (`-clean_columns`), replace cell values (`-repl
   - [Restricting to Columns (`c=`)](#restricting-to-columns-c)
   - [Substring Replacement (`exact=false`)](#substring-replacement-exactfalse)
 - [Imputing Missing Values (`-handle_missing`)](#imputing-missing-values--handle_missing)
+- [Dropping Missing Values (`-drop_na`)](#dropping-missing-values--drop_na)
 - [Column Renaming (`-rename`)](#column-renaming--rename)
 
 ---
@@ -28,6 +29,7 @@ Standardize messy column headers (`-clean_columns`), replace cell values (`-repl
 | `-clean_columns SPEC` | Column headers | `,` / `=` | Standardizes headers (strip, squeeze, fill, case, dedupe) |
 | `-replace_values SPEC` | Cell contents | `old:new` | Swaps values inside cells |
 | `-handle_missing [FILL]` | Cell contents | String value | Imputes `NaN` (defaults to `.` for text, `0` for numeric) |
+| `-drop_na [COLS]` | Rows | `,` | Drops rows with `NaN` (bare for any column, or comma-separated columns) |
 | `-rename OLD:NEW,...` | Column headers | `old:new` | Explicitly renames column names |
 
 ---
@@ -126,6 +128,26 @@ pytae dataset.parquet -handle_missing "UNKNOWN"
 
 ---
 
+## Dropping Missing Values (`-drop_na`)
+
+Drop rows containing missing values (`NaN`). Can be run bare to drop rows with `NaN` across any column, or scoped to specific target columns:
+
+```bash
+# Drop rows with NaN in any column
+pytae penguins.parquet -drop_na
+
+# Drop rows with NaN in specific column(s)
+pytae penguins.parquet -drop_na body_mass_g
+pytae penguins.parquet -drop_na "body_mass_g,sex"
+```
+
+> [!NOTE]
+> **Difference between `-drop_na` and `-dropna`**:
+> - **`-drop_na [cols]`**: Directly drops rows containing `NaN` from the dataset.
+> - **`-dropna true|false`**: Controls whether group-by aggregations (`-by`, `-pivot`) include or drop a category for missing `NaN` keys.
+
+---
+
 ## Column Renaming (`-rename`)
 
 Rename columns explicitly at any point in the pipeline using the `old:new` mapping convention:

{pytae-3.7.2 → pytae-3.7.3}/docs/cli/export_io.md

@@ -55,14 +55,16 @@ Export pipeline results, batch-convert datasets, route outputs to dedicated dire
 
 ## Reading from STDIN & Pipes (`-`, `-fmt`)
 
-`pytae` can read tabular streams directly from standard input (STDIN) using `-` as the input path, allowing seamless integration with UNIX pipes and shell pipelines:
+`pytae` can read tabular streams directly from standard input (STDIN). With **auto-pipe detection**, you can pipe directly into `pytae` without typing an explicit `-`:
 
 ```bash
-# Pipe CSV stream into pytae
-cat penguins.csv | pytae - -head 5
+# Direct pipe (no dash needed!)
+cat penguins.csv | pytae -head 5
+curl -s https://example.com/events.csv | pytae -by event_type -agg "count=n"
 
-# Stream from curl with explicit format
-curl -s https://example.com/events.jsonl | pytae - -fmt jsonl -by event_type -agg n
+# Explicit dash also fully supported
+cat penguins.csv | pytae - -head 5
+curl -s https://example.com/events.jsonl | pytae - -fmt jsonl -by event_type -agg "count=n"
 ```
 
 When reading from STDIN, `pytae` automatically inspects the first chunk to sniff the format (`csv` vs `jsonl`). You can explicitly specify or force the input format using `-fmt`:
@@ -107,12 +109,22 @@ Wrote 344 rows to penguins.csv
 
 ### System Clipboard (`clip`)
 
+#### Exporting to Clipboard (`-o clip`)
 Copies the output table or report directly to the system clipboard (suppressing stdout printing):
 
 ```bash
 pytae penguins.parquet -head 5 -o clip
 ```
 
+#### Ingesting from Clipboard (`pytae clip`)
+Directly read and analyze tabular data copied to your system clipboard (e.g. from Excel, web tables, or Slack) without creating a temporary file:
+
+```bash
+# Copy a table in your browser/Excel, then immediately query it:
+pytae clip -head 5
+pytae clip -qry "sales > 100" -by region -agg "total = sales:sum"
+```
+
 ---
 
 ## Target Output Directory (`-out_dir` / `-od`)

{pytae-3.7.2 → pytae-3.7.3}/docs/cli/inspect.md

@@ -41,6 +41,7 @@ Inspection flags let you understand a dataset's layout and content instantly fro
 | `-nulls [ORDER]` | Print count of missing / NaN values per column | **Yes** (terminal) |
 | `-meta` | Zero-scan Parquet metadata (row groups, compression, schema) | **Yes** (terminal) |
 | `-info` | Pandas `info()` memory and non-null summary | **Yes** (terminal) |
+| `-glimpse` | Transposed column overview with dtypes and inline sample values | **Yes** (terminal) |
 | `-describe` | Pandas `describe()` statistical summary | No (returns DataFrame) |
 | `-pager` | Pipe long outputs through system pager (`$PAGER` or `less`) | Display flag |
 | `-pretty` | Render plain tables with bordered markdown formatting | Display flag |
@@ -334,6 +335,30 @@ Prints columns, non-null counts, dtypes, and memory usage:
 pytae penguins.parquet -info
 ```
 
+### Transposed Summary (`-glimpse`)
+
+Inspired by `dplyr::glimpse()` and Polars, `-glimpse` provides an immediate, transposed view of all columns, displaying row count, column count, dtypes, and an inline preview of first values:
+
+```bash
+pytae penguins.parquet -glimpse
+```
+
+**Output:**
+```text
+Rows: 344
+Columns: 7
+$ species           <str>     'Adelie', 'Adelie', 'Adelie', 'Adelie', 'Adelie...
+$ island            <str>     'Torgersen', 'Torgersen', 'Torgersen', 'Torgers...
+$ bill_length_mm    <float64> 39.1, 39.5, 40.3, NA, 36.7, 39.3, 38.9, 39.2, 3...
+$ bill_depth_mm     <float64> 18.7, 17.4, 18.0, NA, 19.3, 20.6, 17.8, 19.6, 1...
+$ flipper_length_mm <float64> 181.0, 186.0, 195.0, NA, 193.0, 190.0, 181.0, 1...
+$ body_mass_g       <float64> 3750.0, 3800.0, 3250.0, NA, 3450.0, 3650.0, 362...
+$ sex               <str>     'Male', 'Female', 'Female', NA, 'Female', 'Male...
+```
+
+> [!TIP]
+> Unlike `-head`, which wraps across screen lines when dealing with wide tables (20–100+ columns), `-glimpse` guarantees that every column and its data type fit neatly on one line. It is also available in Python via `df.pt.glimpse()`.
+
 ---
 
 ## Terminal Paging (`-pager`)

{pytae-3.7.2 → pytae-3.7.3}/docs/cli.md

@@ -66,17 +66,17 @@ For in-depth syntax rules, comprehensive parameter tables, corner cases, and ter
 
 | Feature Area | Documentation Guide | Key Flags & Capabilities |
 |---|---|---|
-| **Inspection & Metadata** | [Inspection & Metadata Guide](cli/inspect.md) | `-head`, `-tail`, `-sample`, `-shape`, `-cols`, `-dtype`, `-nulls`, `-describe`, `-info`, `-meta`, `-pager` |
+| **Inspection & Metadata** | [Inspection & Metadata Guide](cli/inspect.md) | `-head`, `-tail`, `-sample`, `-shape`, `-cols`, `-dtype`, `-nulls`, `-describe`, `-info`, `-glimpse`, `-meta`, `-pager` |
 | **Column Selection** | [Column Selection Guide](cli/select.md) | `-select`, slices `a:b`, negative `-col`/`~col`, `exclude=`, `contains=`, `startswith=`, `regex=`, `dtype=numeric` |
 | **Row Filtering** | [Row Filtering Guide](cli/filter.md) | `-qry`, `-query`, `-dropna`, intervals `[min, max]`, set membership, comparisons |
 | **Feature Engineering** | [Mutating & Computing Guide](cli/mutate.md) | `-mutate`, formulas, arithmetic, boolean indicators, `@specs.txt`, functional helpers, `-by` grouped transforms |
 | **SQL Engine** | [DuckDB SQL Engine Guide](cli/sql.md) | `-sql`, querying table `data`, window functions, CTEs, `@query.sql`, zero-copy scan |
-| **Data Cleaning** | [Data Cleaning & Value Replacement Guide](cli/clean_replace.md) | `-clean_columns` (strip, squeeze, fill, case, dedupe), `-replace_values`, `-handle_missing`, `-rename` |
+| **Data Cleaning** | [Data Cleaning & Value Replacement Guide](cli/clean_replace.md) | `-clean_columns` (strip, squeeze, fill, case, dedupe), `-replace_values`, `-handle_missing`, `-drop_na`, `-rename` |
 | **Aggregations & Grouping** | [Aggregations & Grouping Guide](cli/aggregate.md) | `-by` + `-agg` (group summaries & grand totals), `-by` + `-mutate` (grouped window transforms) |
 | **Reshaping & Matrices** | [Reshaping Guide](cli/reshape.md) • [2D Pivot Guide](cli/pivot.md) | `-long` (melt), `-wide` (pure reshape), `-pivot` (2D pivot table), `-value_counts`, `-unique`, `-sort_by` |
 | **Visualizations & Plots** | [Plotting Guide](cli/plotting.md) | `-freq` (ASCII bars), `-hist` (ASCII bins), `-plot` (export charts), `-finalize` |
 | **Dataset Comparison** | [Dataset & Schema Diffing Guide](cli/diff.md) | `-diff`, shape deltas, column changes, schema drift, null count variations, cell mismatches |
-| **File I/O & Compression** | [File I/O, Export, & Compression Guide](cli/export_io.md) | `-o`, `-out_dir`, STDIN (`-`), `-fmt`, `.parquet`, `.csv`, `.jsonl`, `.csv.gz`, `-progress` |
+| **File I/O & Compression** | [File I/O, Export, & Compression Guide](cli/export_io.md) | `-o`, `-out_dir`, STDIN (`-`, auto-pipe), `clip`, `-fmt`, `.parquet`, `.csv`, `.jsonl`, `.csv.gz`, `-progress` |
 | **Multi-File Pipelines** | [Multi-File Pipelines Guide](cli/multi_file.md) | `-file`, `-merge` (joins), `-concat` (stacking), cross-file `-sql` |
 
 ---
@@ -326,6 +326,7 @@ pytae -file "jan.parquet=m1; feb.parquet=m2" \
 | `-nulls [asc\|desc]` | Inspect | Report null counts per column | [cli/inspect.md](cli/inspect.md) |
 | `-describe` | Inspect | Summary statistics (returns DataFrame) | [cli/inspect.md](cli/inspect.md) |
 | `-info` | Inspect | Pandas `info()` memory and non-null summary | [cli/inspect.md](cli/inspect.md) |
+| `-glimpse` | Inspect | Transposed overview of columns, dtypes, and sample values | [cli/inspect.md](cli/inspect.md) |
 | `-meta` | Inspect | Zero-scan Parquet metadata (compression, row groups, schema) | [cli/inspect.md](cli/inspect.md) |
 | `-pager` | Inspect | Pipe terminal output through `$PAGER` or `less` | [cli/inspect.md](cli/inspect.md) |
 | `-pretty` | Inspect | Format output as bordered markdown table | [cli/inspect.md](cli/inspect.md) |
@@ -334,6 +335,7 @@ pytae -file "jan.parquet=m1; feb.parquet=m2" \
 | `-select SPEC` | Select & Filter | Filter, reorder, or exclude columns (names, slices, negative prefixes `-col`/`~col`, `exclude=`, regex, dtype) | [cli/select.md](cli/select.md) |
 | `-qry CONDITIONS` | Select & Filter | Filter rows using pytae keyword syntax and intervals | [cli/filter.md](cli/filter.md) |
 | `-query EXPR` | Select & Filter | Filter rows using pandas `df.query()` expression | [cli/filter.md](cli/filter.md) |
+| `-drop_na [COLS]` | Select & Filter | Drop rows containing NaN (bare for any column, or comma-separated columns) | [cli/clean_replace.md](cli/clean_replace.md) |
 | `-dropna BOOL` | Select & Filter | Control whether NA grouping keys are dropped in aggregations, mutations, value counts, and pivots (default: false) | [cli/filter.md](cli/filter.md) |
 | `-mutate SPEC` | Transform | Create or overwrite columns via formulas / helpers | [cli/mutate.md](cli/mutate.md) |
 | `-sql QUERY` | Transform | Execute SQL query via DuckDB against table `data` | [cli/sql.md](cli/sql.md) |