robin-sparkless 0.1.0__cp38-abi3-musllinux_1_2_x86_64.whl

robin_sparkless/__init__.py

@@ -0,0 +1,5 @@
+from .robin_sparkless import *
+
+__doc__ = robin_sparkless.__doc__
+if hasattr(robin_sparkless, "__all__"):
+    __all__ = robin_sparkless.__all__

robin_sparkless-0.1.0.dist-info/METADATA

@@ -0,0 +1,166 @@
+Metadata-Version: 2.4
+Name: robin-sparkless
+Version: 0.1.0
+Classifier: Development Status :: 3 - Alpha
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Rust
+Classifier: Topic :: Scientific/Engineering
+Summary: PySpark-like DataFrame API in Rust (Polars backend), with Python bindings via PyO3
+Author: Robin Sparkless contributors
+License: MIT
+Requires-Python: >=3.8
+Description-Content-Type: text/markdown; charset=UTF-8; variant=GFM
+
+# Robin Sparkless
+
+**PySpark-style DataFrames in Rust—no JVM.** A DataFrame library that mirrors PySpark’s API and semantics while using [Polars](https://www.pola.rs/) as the execution engine.
+
+[![crates.io](https://img.shields.io/crates/v/robin-sparkless.svg)](https://crates.io/crates/robin-sparkless)
+[![docs.rs](https://docs.rs/robin-sparkless/badge.svg)](https://docs.rs/robin-sparkless)
+[![Documentation](https://readthedocs.org/projects/robin-sparkless/badge/?version=latest)](https://robin-sparkless.readthedocs.io/en/latest/)
+[![License: MIT](https://img.shields.io/badge/License-MIT-blue.svg)](LICENSE)
+
+---
+
+## Why Robin Sparkless?
+
+- **Familiar API** — `SparkSession`, `DataFrame`, `Column`, and PySpark-like functions so you can reuse patterns without the JVM.
+- **Polars under the hood** — Fast, native Rust execution with Polars for IO, expressions, and aggregations.
+- **Rust-first, Python optional** — Use it as a Rust library or build the Python extension via PyO3 for a drop-in style API.
+- **Sparkless backend target** — Designed to power [Sparkless](https://github.com/eddiethedean/sparkless) (the Python PySpark replacement) so Sparkless can run on this engine via PyO3.
+
+---
+
+## Features
+
+| Area | What’s included |
+|------|------------------|
+| **Core** | `SparkSession`, `DataFrame`, `Column`; `filter`, `select`, `with_column`, `order_by`, `group_by`, joins |
+| **IO** | CSV, Parquet, JSON via `SparkSession::read_*` |
+| **Expressions** | `col()`, `lit()`, `when`/`then`/`otherwise`, `coalesce`, cast, type/conditional helpers |
+| **Aggregates** | `count`, `sum`, `avg`, `min`, `max`, and more; multi-column groupBy |
+| **Window** | `row_number`, `rank`, `dense_rank`, `lag`, `lead`, `first_value`, `last_value`, and others with `.over()` |
+| **Arrays & maps** | `array_*`, `explode`, `create_map`, `map_keys`, `map_values`, and related functions |
+| **Strings & JSON** | String functions (`upper`, `lower`, `substring`, `regexp_*`, etc.), `get_json_object`, `from_json`, `to_json` |
+| **Datetime & math** | Date/time extractors and arithmetic, `year`/`month`/`day`, math (`sin`, `cos`, `sqrt`, `pow`, …) |
+| **Optional SQL** | `spark.sql("SELECT ...")` with temp views (`createOrReplaceTempView`, `table`) — enable with `--features sql` |
+| **Optional Delta** | `read_delta`, `read_delta_with_version`, `write_delta` — enable with `--features delta` |
+
+Known differences from PySpark are documented in [docs/PYSPARK_DIFFERENCES.md](docs/PYSPARK_DIFFERENCES.md). Parity status and roadmap are in [docs/PARITY_STATUS.md](docs/PARITY_STATUS.md) and [docs/ROADMAP.md](docs/ROADMAP.md).
+
+---
+
+## Installation
+
+### Rust
+
+Add to your `Cargo.toml`:
+
+```toml
+[dependencies]
+robin-sparkless = "0.1.0"
+```
+
+Optional features:
+
+```toml
+robin-sparkless = { version = "0.1.0", features = ["sql"] }   # spark.sql(), temp views
+robin-sparkless = { version = "0.1.0", features = ["delta"] }  # Delta Lake read/write
+```
+
+### Python (PyO3)
+
+Build the Python extension with [maturin](https://www.maturin.rs/) (Rust + Python 3.8+):
+
+```bash
+pip install maturin
+maturin develop --features pyo3
+# With optional SQL and/or Delta:
+maturin develop --features "pyo3,sql"
+maturin develop --features "pyo3,delta"
+maturin develop --features "pyo3,sql,delta"
+```
+
+Then use the `robin_sparkless` module; see [docs/PYTHON_API.md](docs/PYTHON_API.md).
+
+---
+
+## Quick start
+
+### Rust
+
+```rust
+use robin_sparkless::{col, lit_i64, SparkSession};
+
+fn main() -> Result<(), Box<dyn std::error::Error>> {
+    let spark = SparkSession::builder().app_name("demo").get_or_create();
+
+    // Create a DataFrame from rows (id, age, name)
+    let df = spark.create_dataframe(
+        vec![
+            (1, 25, "Alice".to_string()),
+            (2, 30, "Bob".to_string()),
+            (3, 35, "Charlie".to_string()),
+        ],
+        vec!["id", "age", "name"],
+    )?;
+
+    // Filter and show
+    let adults = df.filter(col("age").gt(lit_i64(26)))?;
+    adults.show(Some(10))?;
+
+    Ok(())
+}
+```
+
+You can also wrap an existing Polars `DataFrame` with `DataFrame::from_polars(polars_df)`. See [docs/QUICKSTART.md](docs/QUICKSTART.md) for joins, window functions, and more.
+
+### Python
+
+```python
+import robin_sparkless as rs
+
+spark = rs.SparkSession.builder().app_name("demo").get_or_create()
+df = spark.create_dataframe([(1, 25, "Alice"), (2, 30, "Bob")], ["id", "age", "name"])
+filtered = df.filter(rs.col("age").gt(rs.lit(26)))
+print(filtered.collect())  # [{"id": 2, "age": 30, "name": "Bob"}]
+```
+
+---
+
+## Development
+
+**Prerequisites:** Rust (see [rust-toolchain.toml](rust-toolchain.toml)), and for Python tests: Python 3.8+, `maturin`, `pytest`.
+
+| Command | Description |
+|---------|-------------|
+| `cargo build` | Build (Rust only) |
+| `cargo build --features pyo3` | Build with Python extension |
+| `cargo test` | Run Rust tests |
+| `make test` | Run Rust + Python tests (creates venv, `maturin develop`, `pytest`) |
+| `make check` | Format, clippy, audit, deny, tests |
+| `cargo bench` | Benchmarks (robin-sparkless vs Polars) |
+| `cargo doc --open` | Build and open API docs |
+
+CI runs the same checks on push/PR (see [.github/workflows/ci.yml](.github/workflows/ci.yml)).
+
+---
+
+## Documentation
+
+- [**Full documentation (Read the Docs)**](https://robin-sparkless.readthedocs.io/) — Quickstart, Python API, reference, and Sparkless integration (MkDocs)
+- [**API reference (docs.rs)**](https://docs.rs/robin-sparkless) — Crate API
+- [**QUICKSTART**](docs/QUICKSTART.md) — Build, usage, optional features, benchmarks
+- [**ROADMAP**](docs/ROADMAP.md) — Development roadmap and Sparkless integration
+- [**PYSPARK_DIFFERENCES**](docs/PYSPARK_DIFFERENCES.md) — Known divergences from PySpark
+- [**RELEASING**](docs/RELEASING.md) — Releasing and publishing to crates.io
+
+See also [CHANGELOG.md](CHANGELOG.md) for version history.
+
+---
+
+## License
+
+MIT
+

robin_sparkless-0.1.0.dist-info/RECORD

@@ -0,0 +1,8 @@
+robin_sparkless/__init__.py,sha256=h26i0kv9czksgzJ0zbFJvX-5IZV8hrWVEerFQOVG3fA,143
+robin_sparkless/robin_sparkless.abi3.so,sha256=LgYbC0ck-hnzaNqG208BKlzGgIeRSgJf7Ilc-XbRpac,54156865
+robin_sparkless-0.1.0.dist-info/METADATA,sha256=gyXRM6eaUer-zATnUJx5ByeY7f6JwhY48a9yiEMOvDU,6393
+robin_sparkless-0.1.0.dist-info/WHEEL,sha256=YwiRh-q2ktXDNZBtnkQS-JaPjD72S6lWu37XiLW5Pm0,106
+robin_sparkless.libs/libexpat-7ae38be4.so.1,sha256=KOWJvypweOLfupaM-rmzYULyN-QPKqkDH7psH23MMsU,178857
+robin_sparkless.libs/libm-f06f2ce1.so.6,sha256=2wYyVUqIYZsl3KkeAe_0J6cSp8q3TVkTP0WHjBq0KLs,973721
+robin_sparkless.libs/libpython3-e1b05735.12.so.1.0,sha256=neiMNBnO3c7o2TFchyHGNpBmozMk6Q4m2mjGa7w1AvY,9159497
+robin_sparkless-0.1.0.dist-info/RECORD,,

robin_sparkless-0.1.0.dist-info/WHEEL

@@ -0,0 +1,4 @@
+Wheel-Version: 1.0
+Generator: maturin (1.11.5)
+Root-Is-Purelib: false
+Tag: cp38-abi3-musllinux_1_2_x86_64