tigrbl_engine_pyspark 0.4.1.dev6__tar.gz → 0.4.2.dev3__tar.gz
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- {tigrbl_engine_pyspark-0.4.1.dev6 → tigrbl_engine_pyspark-0.4.2.dev3}/PKG-INFO +43 -100
- tigrbl_engine_pyspark-0.4.2.dev3/README.md +69 -0
- {tigrbl_engine_pyspark-0.4.1.dev6 → tigrbl_engine_pyspark-0.4.2.dev3}/pyproject.toml +1 -1
- tigrbl_engine_pyspark-0.4.1.dev6/README.md +0 -126
- {tigrbl_engine_pyspark-0.4.1.dev6 → tigrbl_engine_pyspark-0.4.2.dev3}/.gitignore +0 -0
- {tigrbl_engine_pyspark-0.4.1.dev6 → tigrbl_engine_pyspark-0.4.2.dev3}/LICENSE +0 -0
- {tigrbl_engine_pyspark-0.4.1.dev6 → tigrbl_engine_pyspark-0.4.2.dev3}/src/tigrbl_engine_pyspark/__init__.py +0 -0
- {tigrbl_engine_pyspark-0.4.1.dev6 → tigrbl_engine_pyspark-0.4.2.dev3}/src/tigrbl_engine_pyspark/engine.py +0 -0
- {tigrbl_engine_pyspark-0.4.1.dev6 → tigrbl_engine_pyspark-0.4.2.dev3}/src/tigrbl_engine_pyspark/session.py +0 -0
- {tigrbl_engine_pyspark-0.4.1.dev6 → tigrbl_engine_pyspark-0.4.2.dev3}/tests/test_smoke.py +0 -0
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
Metadata-Version: 2.4
|
|
2
2
|
Name: tigrbl_engine_pyspark
|
|
3
|
-
Version: 0.4.
|
|
3
|
+
Version: 0.4.2.dev3
|
|
4
4
|
Summary: PySpark engine plugin for distributed DataFrame integration, analytics workloads, and Tigrbl data workflows.
|
|
5
5
|
Project-URL: Organization, https://github.com/tigrbl
|
|
6
6
|
Project-URL: Discord, https://discord.gg/K4YTAPapjR
|
|
@@ -233,113 +233,59 @@ Requires-Dist: pyspark>=3.4
|
|
|
233
233
|
Requires-Dist: tigrbl>=0.3.0.dev4
|
|
234
234
|
Description-Content-Type: text/markdown
|
|
235
235
|
|
|
236
|
-
|
|
236
|
+
<div align="center">
|
|
237
|
+
<h1>tigrbl_engine_pyspark</h1>
|
|
238
|
+
<img src="https://raw.githubusercontent.com/swarmauri/swarmauri-sdk/master/assets/tigrbl_full_logo.png" alt="Tigrbl logo" width="140"/>
|
|
239
|
+
<p><strong>PySpark engine plugin for distributed DataFrame integration, analytics workloads, and Tigrbl data workflows.</strong></p>
|
|
240
|
+
<a href="https://pypi.org/project/tigrbl_engine_pyspark/"><img src="https://img.shields.io/pypi/v/tigrbl_engine_pyspark?label=PyPI" alt="PyPI version for tigrbl_engine_pyspark"/></a>
|
|
241
|
+
<a href="https://pypi.org/project/tigrbl_engine_pyspark/"><img src="https://static.pepy.tech/badge/tigrbl_engine_pyspark" alt="Downloads for tigrbl_engine_pyspark"/></a>
|
|
242
|
+
<a href="https://github.com/tigrbl/tigrbl/blob/master/pkgs/engines/tigrbl_engine_pyspark/README.md"><img src="https://hits.sh/github.com/tigrbl/tigrbl/blob/master/pkgs/engines/tigrbl_engine_pyspark/README.md.svg?label=hits" alt="Repository hits for tigrbl_engine_pyspark README"/></a>
|
|
243
|
+
<a href="LICENSE"><img src="https://img.shields.io/badge/license-Apache%202.0-525252" alt="Apache 2.0 license"/></a>
|
|
244
|
+
<a href="pyproject.toml"><img src="https://img.shields.io/badge/python-3.10%20to%203.15-3776ab" alt="Python requirement for tigrbl_engine_pyspark"/></a>
|
|
245
|
+
<a href="https://github.com/tigrbl/tigrbl/blob/master/docs/README.md"><img src="https://img.shields.io/badge/workspace-engines-1f6feb" alt="Workspace group for tigrbl_engine_pyspark"/></a>
|
|
246
|
+
</div>
|
|
237
247
|
|
|
238
|
-
|
|
239
|
-
<a href="https://pepy.tech/project/tigrbl_engine_pyspark">
|
|
240
|
-
<img src="https://static.pepy.tech/badge/tigrbl_engine_pyspark" alt="Pepy downloads for tigrbl_engine_pyspark"/></a>
|
|
241
|
-
<a href="https://hits.sh/github.com/tigrbl/tigrbl/tree/master/pkgs/engines/tigrbl_engine_pyspark/">
|
|
242
|
-
<img src="https://hits.sh/github.com/tigrbl/tigrbl/tree/master/pkgs/engines/tigrbl_engine_pyspark.svg" alt="Repository views for tigrbl_engine_pyspark"/></a>
|
|
243
|
-
<a href="https://pypi.org/project/tigrbl_engine_pyspark/">
|
|
244
|
-
<img src="https://img.shields.io/badge/python-3.10--3.14-blue" alt="Python 3.10 through 3.14"/></a>
|
|
245
|
-
<a href="https://pypi.org/project/tigrbl_engine_pyspark/">
|
|
246
|
-
<img src="https://img.shields.io/pypi/l/tigrbl_engine_pyspark" alt="PyPI license metadata for tigrbl_engine_pyspark"/></a>
|
|
247
|
-
<a href="https://pypi.org/project/tigrbl_engine_pyspark/">
|
|
248
|
-
<img src="https://img.shields.io/pypi/v/tigrbl_engine_pyspark?label=tigrbl_engine_pyspark&color=green" alt="PyPI version for tigrbl_engine_pyspark"/></a>
|
|
249
|
-
</p>
|
|
250
|
-
|
|
251
|
-
---
|
|
252
|
-
|
|
253
|
-
<h1 align="center">Tigrbl engine-pyspark</h1>
|
|
254
|
-
|
|
255
|
-
**Install and inspect `tigrbl_engine_pyspark`: [download `tigrbl_engine_pyspark` from PyPI](https://pypi.org/project/tigrbl_engine_pyspark/) or [open the package source](https://github.com/tigrbl/tigrbl/tree/master/pkgs/engines/tigrbl_engine_pyspark).**
|
|
256
|
-
|
|
257
|
-
tigrbl_engine_pyspark is a PySpark engine plugin for PySpark DataFrame integration for distributed Tigrbl analytics workflows.
|
|
258
|
-
|
|
259
|
-
`tigrbl_engine_pyspark` is part of the Tigrbl package graph. It documents package-resident classes, concepts, extension points, and execution responsibilities while cross-linking to the facade, core specs, canonical mapping, runtime phases, concrete objects, operation packages, engine plugins, OpenAPI/OpenRPC documentation surfaces, and PyPI distributions that complete the system.
|
|
260
|
-
|
|
261
|
-
## Engine ownership and database guards
|
|
262
|
-
|
|
263
|
-
- PySpark DataFrame integration, distributed analytics setup, session handoff, and cluster execution guardrails.
|
|
264
|
-
- Engine packages document backend-specific connection settings, session construction, transaction behavior, persistence boundaries, and operational guardrails. Transport routing and operation semantics remain in the facade/canon/runtime/ops packages.
|
|
265
|
-
- Register this engine through the package entry point or the Tigrbl engine context so API code can select the backend without embedding backend-specific logic in model definitions.
|
|
248
|
+
## Install
|
|
266
249
|
|
|
267
|
-
|
|
250
|
+
```bash
|
|
251
|
+
uv add tigrbl_engine_pyspark
|
|
252
|
+
```
|
|
268
253
|
|
|
269
|
-
|
|
254
|
+
```bash
|
|
255
|
+
pip install tigrbl_engine_pyspark
|
|
256
|
+
```
|
|
270
257
|
|
|
271
|
-
|
|
272
|
-
- [`tigrbl`](https://pypi.org/project/tigrbl/) - Schema-first ASGI API framework for REST, JSON-RPC, OpenAPI, OpenRPC, SQLAlchemy models, typed validation, lifecycle hooks, and engine plugins.
|
|
273
|
-
- [`tigrbl-atoms`](https://pypi.org/project/tigrbl-atoms/) - Runtime atom utilities for Tigrbl planning, dispatch, transport ingress, egress, and high-throughput ASGI execution pipelines.
|
|
274
|
-
- [`tigrbl-base`](https://pypi.org/project/tigrbl-base/) - Abstract base interfaces for Tigrbl APIs, engines, providers, sessions, transports, and reusable runtime components.
|
|
275
|
-
- [`tigrbl-canon`](https://pypi.org/project/tigrbl-canon/) - Canonical mapping, routing, symbol resolution, and naming utilities for Tigrbl framework packages and generated API surfaces.
|
|
276
|
-
- [`tigrbl_client`](https://pypi.org/project/tigrbl_client/) - Typed Python client helpers for calling Tigrbl REST, JSON-RPC, OpenAPI, and generated schema-first API surfaces.
|
|
277
|
-
- [`tigrbl-concrete`](https://pypi.org/project/tigrbl-concrete/) - Concrete Tigrbl implementations for reusable framework behavior, sessions, routes, responses, and base abstraction adapters.
|
|
278
|
-
- [`tigrbl-core`](https://pypi.org/project/tigrbl-core/) - Core Tigrbl framework specifications, decorators, schemas, hooks, operations, and primitives for schema-first APIs.
|
|
279
|
-
- [`tigrbl-kernel`](https://pypi.org/project/tigrbl-kernel/) - Kernel orchestration for composing Tigrbl runtime plans, bindings, operation dispatch, and optimized ASGI execution.
|
|
280
|
-
- [`tigrbl-ops-olap`](https://pypi.org/project/tigrbl-ops-olap/) - Analytical OLAP operation boundaries for Tigrbl workloads, query-oriented APIs, and engine integrations.
|
|
281
|
-
- [`tigrbl-ops-oltp`](https://pypi.org/project/tigrbl-ops-oltp/) - Transactional OLTP operation handlers for Tigrbl CRUD, bulk, REST, JSON-RPC, and database-backed workloads.
|
|
282
|
-
- [`tigrbl-ops-realtime`](https://pypi.org/project/tigrbl-ops-realtime/) - Realtime, streaming, datagram, websocket, and event operation handlers for Tigrbl ASGI runtimes.
|
|
283
|
-
- [`tigrbl-orm`](https://pypi.org/project/tigrbl-orm/) - SQLAlchemy ORM tables, mixins, columns, model helpers, and persistence primitives for Tigrbl applications.
|
|
284
|
-
- [`tigrbl-runtime`](https://pypi.org/project/tigrbl-runtime/) - Runtime pipeline helpers and execution bridge surfaces for Tigrbl ASGI applications, transports, and operation dispatch.
|
|
285
|
-
- [`tigrbl_spec`](https://pypi.org/project/tigrbl_spec/) - Shared Tigrbl interfaces, protocol definitions, compatibility targets, and specification artifacts for framework integration.
|
|
286
|
-
- [`tigrbl_tests`](https://pypi.org/project/tigrbl_tests/) - Reusable Tigrbl pytest fixtures, conformance assertions, integration helpers, and package test utilities.
|
|
287
|
-
- [`tigrbl-typing`](https://pypi.org/project/tigrbl-typing/) - Typing protocols, aliases, generics, and shared type helpers for Tigrbl framework packages and extensions.
|
|
258
|
+
## What It Owns
|
|
288
259
|
|
|
289
|
-
|
|
290
|
-
- [`tigrbl_engine_bigquery`](https://pypi.org/project/tigrbl_engine_bigquery/) - BigQuery engine plugin for Google BigQuery warehouse sessions, analytics workloads, and Tigrbl engine registration.
|
|
291
|
-
- [`tigrbl_engine_clickhouse`](https://pypi.org/project/tigrbl_engine_clickhouse/) - ClickHouse engine plugin for analytical database sessions, warehouse workloads, and Tigrbl engine registration.
|
|
292
|
-
- [`tigrbl_engine_csv`](https://pypi.org/project/tigrbl_engine_csv/) - CSV engine plugin for file-backed tables, pandas DataFrames, and lightweight Tigrbl data workflows.
|
|
293
|
-
- [`tigrbl_engine_dataframe`](https://pypi.org/project/tigrbl_engine_dataframe/) - DataFrame engine plugin for transactional pandas sessions and in-process Tigrbl analytics workloads.
|
|
294
|
-
- [`tigrbl_engine_duckdb`](https://pypi.org/project/tigrbl_engine_duckdb/) - DuckDB engine plugin for embedded analytical database sessions, OLAP workloads, and Tigrbl engine registration.
|
|
295
|
-
- [`tigrbl_engine_inmemcache`](https://pypi.org/project/tigrbl_engine_inmemcache/) - In-memory cache engine plugin for process-local TTL, LRU, and fast Tigrbl cache workflows.
|
|
296
|
-
- [`tigrbl_engine_inmemory`](https://pypi.org/project/tigrbl_engine_inmemory/) - In-memory database engine plugin for process-local transactional storage, copy-on-write snapshots, and Tigrbl testing.
|
|
297
|
-
- [`tigrbl_engine_membloom`](https://pypi.org/project/tigrbl_engine_membloom/) - In-memory Bloom filter engine plugin for membership checks, rotating TTL windows, and Tigrbl API workflows.
|
|
298
|
-
- [`tigrbl_engine_memdedupe`](https://pypi.org/project/tigrbl_engine_memdedupe/) - In-memory dedupe engine plugin for idempotency tracking, duplicate suppression, and Tigrbl workflow coordination.
|
|
299
|
-
- [`tigrbl_engine_memkv`](https://pypi.org/project/tigrbl_engine_memkv/) - In-memory key-value engine plugin for process-local KV storage, cache workflows, and lightweight Tigrbl services.
|
|
300
|
-
- [`tigrbl_engine_memlru`](https://pypi.org/project/tigrbl_engine_memlru/) - In-memory LRU engine plugin for least-recently-used cache behavior and process-local Tigrbl data workflows.
|
|
301
|
-
- [`tigrbl_engine_mempubsub`](https://pypi.org/project/tigrbl_engine_mempubsub/) - In-memory pub/sub engine plugin for process-local publish-subscribe channels, events, and Tigrbl realtime workflows.
|
|
302
|
-
- [`tigrbl_engine_memqueue`](https://pypi.org/project/tigrbl_engine_memqueue/) - In-memory queue engine plugin for process-local tasks, message workflows, and Tigrbl runtime coordination.
|
|
303
|
-
- [`tigrbl_engine_memrate`](https://pypi.org/project/tigrbl_engine_memrate/) - In-memory rate-limit engine plugin for API quotas, counters, windows, and Tigrbl governance workflows.
|
|
304
|
-
- [`tigrbl_engine_numpy`](https://pypi.org/project/tigrbl_engine_numpy/) - NumPy engine plugin for array-to-table helpers, analytical workflows, and Tigrbl data integration.
|
|
305
|
-
- [`tigrbl_engine_pandas`](https://pypi.org/project/tigrbl_engine_pandas/) - Pandas engine plugin for transactional DataFrame sessions, tabular workflows, and Tigrbl data integration.
|
|
306
|
-
- [`tigrbl_engine_pgsqli_wal`](https://pypi.org/project/tigrbl_engine_pgsqli_wal/) - PostgreSQL and SQLite WAL engine plugin for transactional Tigrbl workflows and database-backed engine registration.
|
|
307
|
-
- [`tigrbl_engine_postgres`](https://pypi.org/project/tigrbl_engine_postgres/) - PostgreSQL engine plugin for SQLAlchemy sessions, async database workflows, and Tigrbl application persistence.
|
|
308
|
-
- [`tigrbl_engine_pyspark`](https://pypi.org/project/tigrbl_engine_pyspark/) (this package) - PySpark engine plugin for distributed DataFrame integration, analytics workloads, and Tigrbl data workflows.
|
|
309
|
-
- [`tigrbl_engine_redis`](https://pypi.org/project/tigrbl_engine_redis/) - Redis engine plugin for cache, data structures, and Tigrbl engine workflows backed by Redis.
|
|
310
|
-
- [`tigrbl_engine_rediscachethrough`](https://pypi.org/project/tigrbl_engine_rediscachethrough/) - Redis cache-through engine plugin for Redis, PostgreSQL, and Tigrbl data-access acceleration workflows.
|
|
311
|
-
- [`tigrbl_engine_snowflake`](https://pypi.org/project/tigrbl_engine_snowflake/) - Snowflake engine plugin for warehouse sessions, analytical workloads, and Tigrbl engine registration.
|
|
312
|
-
- [`tigrbl_engine_sqlite`](https://pypi.org/project/tigrbl_engine_sqlite/) - SQLite engine plugin for SQLAlchemy sessions, local transactional storage, and Tigrbl application persistence.
|
|
313
|
-
- [`tigrbl_engine_xlsx`](https://pypi.org/project/tigrbl_engine_xlsx/) - XLSX engine plugin for Excel workbook-backed tables, worksheet data access, and Tigrbl tabular workflows.
|
|
260
|
+
`tigrbl_engine_pyspark` owns the engine pyspark backend boundary for Tigrbl, including engine registration, session adapters, and backend-specific helpers. Key implementation roots include `tigrbl_engine_pyspark` with `engine, session`.
|
|
314
261
|
|
|
315
|
-
|
|
316
|
-
- [`tigrbl_acme_ca`](https://pypi.org/project/tigrbl_acme_ca/) - ACME v2 certificate authority app for Tigrbl tables, certificate automation, TLS workflows, and API surfaces.
|
|
317
|
-
- [`tigrbl_spiffe`](https://pypi.org/project/tigrbl_spiffe/) - SPIFFE and SPIRE identity app for Tigrbl with workload identity tables, UDS transport, and HTTP API surfaces.
|
|
262
|
+
## Use It When
|
|
318
263
|
|
|
319
|
-
|
|
264
|
+
Use `tigrbl_engine_pyspark` when you want the engine pyspark backend installed as an isolated dependency instead of pulling every engine into your environment.
|
|
320
265
|
|
|
321
|
-
##
|
|
266
|
+
## Public Surface
|
|
322
267
|
|
|
323
|
-
|
|
324
|
-
pip install tigrbl_engine_pyspark
|
|
325
|
-
```
|
|
268
|
+
- `tigrbl_engine_pyspark` exposes `pyspark_capabilities, pyspark_engine, PySparkSession, register`.
|
|
326
269
|
|
|
327
|
-
##
|
|
270
|
+
## Internal Layout
|
|
328
271
|
|
|
329
|
-
|
|
272
|
+
- Workspace path: `pkgs/engines/tigrbl_engine_pyspark`.
|
|
273
|
+
- Package class: `engine plugin`.
|
|
274
|
+
- Python requirement: `>=3.10,<3.15`.
|
|
275
|
+
- `tigrbl_engine_pyspark` modules: `engine, session`.
|
|
330
276
|
|
|
331
|
-
|
|
277
|
+
## Dependency Surface
|
|
332
278
|
|
|
333
|
-
|
|
279
|
+
- Workspace package dependencies: none declared.
|
|
280
|
+
- External runtime dependencies: `pyspark>=3.4`, `tigrbl>=0.3.0.dev4`.
|
|
281
|
+
- Optional extras: none declared.
|
|
334
282
|
|
|
335
|
-
##
|
|
283
|
+
## Related Packages
|
|
336
284
|
|
|
337
|
-
|
|
338
|
-
It is not the authoritative location for repository governance, current target status, current state reporting, certification claims, or release evidence.
|
|
285
|
+
- [`tigrbl`](https://pypi.org/project/tigrbl/)
|
|
339
286
|
|
|
340
|
-
## Canonical
|
|
287
|
+
## Canonical Repository Docs
|
|
341
288
|
|
|
342
|
-
- `README.md`
|
|
343
289
|
- `docs/README.md`
|
|
344
290
|
- `docs/conformance/CURRENT_TARGET.md`
|
|
345
291
|
- `docs/conformance/CURRENT_STATE.md`
|
|
@@ -348,14 +294,11 @@ It is not the authoritative location for repository governance, current target s
|
|
|
348
294
|
- `docs/developer/PACKAGE_CATALOG.md`
|
|
349
295
|
- `docs/developer/PACKAGE_LAYOUT.md`
|
|
350
296
|
|
|
351
|
-
## Package
|
|
297
|
+
## Package-local Boundary
|
|
298
|
+
|
|
299
|
+
This file is a package-local distribution entry point.
|
|
300
|
+
Use this page for package installation and boundary orientation. Repository governance, conformance state, target status, and release evidence remain governed from `docs/` and `.ssot/`.
|
|
352
301
|
|
|
353
|
-
|
|
354
|
-
- organization: `https://github.com/tigrbl`
|
|
355
|
-
- social: `https://discord.gg/K4YTAPapjR`
|
|
356
|
-
- package path: `https://github.com/tigrbl/tigrbl/tree/master/pkgs/engines/tigrbl_engine_pyspark`
|
|
357
|
-
- workspace path: `pkgs/engines/tigrbl_engine_pyspark`
|
|
358
|
-
- workspace class: engine package
|
|
359
|
-
- implementation layout: `src/tigrbl_engine_pyspark/`
|
|
302
|
+
## License
|
|
360
303
|
|
|
361
|
-
|
|
304
|
+
Licensed under the Apache License, Version 2.0. See `LICENSE` and the official [Apache 2.0 license text](https://www.apache.org/licenses/LICENSE-2.0).
|
|
@@ -0,0 +1,69 @@
|
|
|
1
|
+
<div align="center">
|
|
2
|
+
<h1>tigrbl_engine_pyspark</h1>
|
|
3
|
+
<img src="https://raw.githubusercontent.com/swarmauri/swarmauri-sdk/master/assets/tigrbl_full_logo.png" alt="Tigrbl logo" width="140"/>
|
|
4
|
+
<p><strong>PySpark engine plugin for distributed DataFrame integration, analytics workloads, and Tigrbl data workflows.</strong></p>
|
|
5
|
+
<a href="https://pypi.org/project/tigrbl_engine_pyspark/"><img src="https://img.shields.io/pypi/v/tigrbl_engine_pyspark?label=PyPI" alt="PyPI version for tigrbl_engine_pyspark"/></a>
|
|
6
|
+
<a href="https://pypi.org/project/tigrbl_engine_pyspark/"><img src="https://static.pepy.tech/badge/tigrbl_engine_pyspark" alt="Downloads for tigrbl_engine_pyspark"/></a>
|
|
7
|
+
<a href="https://github.com/tigrbl/tigrbl/blob/master/pkgs/engines/tigrbl_engine_pyspark/README.md"><img src="https://hits.sh/github.com/tigrbl/tigrbl/blob/master/pkgs/engines/tigrbl_engine_pyspark/README.md.svg?label=hits" alt="Repository hits for tigrbl_engine_pyspark README"/></a>
|
|
8
|
+
<a href="LICENSE"><img src="https://img.shields.io/badge/license-Apache%202.0-525252" alt="Apache 2.0 license"/></a>
|
|
9
|
+
<a href="pyproject.toml"><img src="https://img.shields.io/badge/python-3.10%20to%203.15-3776ab" alt="Python requirement for tigrbl_engine_pyspark"/></a>
|
|
10
|
+
<a href="https://github.com/tigrbl/tigrbl/blob/master/docs/README.md"><img src="https://img.shields.io/badge/workspace-engines-1f6feb" alt="Workspace group for tigrbl_engine_pyspark"/></a>
|
|
11
|
+
</div>
|
|
12
|
+
|
|
13
|
+
## Install
|
|
14
|
+
|
|
15
|
+
```bash
|
|
16
|
+
uv add tigrbl_engine_pyspark
|
|
17
|
+
```
|
|
18
|
+
|
|
19
|
+
```bash
|
|
20
|
+
pip install tigrbl_engine_pyspark
|
|
21
|
+
```
|
|
22
|
+
|
|
23
|
+
## What It Owns
|
|
24
|
+
|
|
25
|
+
`tigrbl_engine_pyspark` owns the engine pyspark backend boundary for Tigrbl, including engine registration, session adapters, and backend-specific helpers. Key implementation roots include `tigrbl_engine_pyspark` with `engine, session`.
|
|
26
|
+
|
|
27
|
+
## Use It When
|
|
28
|
+
|
|
29
|
+
Use `tigrbl_engine_pyspark` when you want the engine pyspark backend installed as an isolated dependency instead of pulling every engine into your environment.
|
|
30
|
+
|
|
31
|
+
## Public Surface
|
|
32
|
+
|
|
33
|
+
- `tigrbl_engine_pyspark` exposes `pyspark_capabilities, pyspark_engine, PySparkSession, register`.
|
|
34
|
+
|
|
35
|
+
## Internal Layout
|
|
36
|
+
|
|
37
|
+
- Workspace path: `pkgs/engines/tigrbl_engine_pyspark`.
|
|
38
|
+
- Package class: `engine plugin`.
|
|
39
|
+
- Python requirement: `>=3.10,<3.15`.
|
|
40
|
+
- `tigrbl_engine_pyspark` modules: `engine, session`.
|
|
41
|
+
|
|
42
|
+
## Dependency Surface
|
|
43
|
+
|
|
44
|
+
- Workspace package dependencies: none declared.
|
|
45
|
+
- External runtime dependencies: `pyspark>=3.4`, `tigrbl>=0.3.0.dev4`.
|
|
46
|
+
- Optional extras: none declared.
|
|
47
|
+
|
|
48
|
+
## Related Packages
|
|
49
|
+
|
|
50
|
+
- [`tigrbl`](https://pypi.org/project/tigrbl/)
|
|
51
|
+
|
|
52
|
+
## Canonical Repository Docs
|
|
53
|
+
|
|
54
|
+
- `docs/README.md`
|
|
55
|
+
- `docs/conformance/CURRENT_TARGET.md`
|
|
56
|
+
- `docs/conformance/CURRENT_STATE.md`
|
|
57
|
+
- `docs/conformance/NEXT_STEPS.md`
|
|
58
|
+
- `docs/governance/DOC_POINTERS.md`
|
|
59
|
+
- `docs/developer/PACKAGE_CATALOG.md`
|
|
60
|
+
- `docs/developer/PACKAGE_LAYOUT.md`
|
|
61
|
+
|
|
62
|
+
## Package-local Boundary
|
|
63
|
+
|
|
64
|
+
This file is a package-local distribution entry point.
|
|
65
|
+
Use this page for package installation and boundary orientation. Repository governance, conformance state, target status, and release evidence remain governed from `docs/` and `.ssot/`.
|
|
66
|
+
|
|
67
|
+
## License
|
|
68
|
+
|
|
69
|
+
Licensed under the Apache License, Version 2.0. See `LICENSE` and the official [Apache 2.0 license text](https://www.apache.org/licenses/LICENSE-2.0).
|
|
@@ -4,7 +4,7 @@ build-backend = "hatchling.build"
|
|
|
4
4
|
|
|
5
5
|
[project]
|
|
6
6
|
name = "tigrbl_engine_pyspark"
|
|
7
|
-
version = "0.4.
|
|
7
|
+
version = "0.4.2.dev3"
|
|
8
8
|
description = "PySpark engine plugin for distributed DataFrame integration, analytics workloads, and Tigrbl data workflows."
|
|
9
9
|
readme = "README.md"
|
|
10
10
|
license = { file = "LICENSE" }
|
|
@@ -1,126 +0,0 @@
|
|
|
1
|
-

|
|
2
|
-
|
|
3
|
-
<p align="center">
|
|
4
|
-
<a href="https://pepy.tech/project/tigrbl_engine_pyspark">
|
|
5
|
-
<img src="https://static.pepy.tech/badge/tigrbl_engine_pyspark" alt="Pepy downloads for tigrbl_engine_pyspark"/></a>
|
|
6
|
-
<a href="https://hits.sh/github.com/tigrbl/tigrbl/tree/master/pkgs/engines/tigrbl_engine_pyspark/">
|
|
7
|
-
<img src="https://hits.sh/github.com/tigrbl/tigrbl/tree/master/pkgs/engines/tigrbl_engine_pyspark.svg" alt="Repository views for tigrbl_engine_pyspark"/></a>
|
|
8
|
-
<a href="https://pypi.org/project/tigrbl_engine_pyspark/">
|
|
9
|
-
<img src="https://img.shields.io/badge/python-3.10--3.14-blue" alt="Python 3.10 through 3.14"/></a>
|
|
10
|
-
<a href="https://pypi.org/project/tigrbl_engine_pyspark/">
|
|
11
|
-
<img src="https://img.shields.io/pypi/l/tigrbl_engine_pyspark" alt="PyPI license metadata for tigrbl_engine_pyspark"/></a>
|
|
12
|
-
<a href="https://pypi.org/project/tigrbl_engine_pyspark/">
|
|
13
|
-
<img src="https://img.shields.io/pypi/v/tigrbl_engine_pyspark?label=tigrbl_engine_pyspark&color=green" alt="PyPI version for tigrbl_engine_pyspark"/></a>
|
|
14
|
-
</p>
|
|
15
|
-
|
|
16
|
-
---
|
|
17
|
-
|
|
18
|
-
<h1 align="center">Tigrbl engine-pyspark</h1>
|
|
19
|
-
|
|
20
|
-
**Install and inspect `tigrbl_engine_pyspark`: [download `tigrbl_engine_pyspark` from PyPI](https://pypi.org/project/tigrbl_engine_pyspark/) or [open the package source](https://github.com/tigrbl/tigrbl/tree/master/pkgs/engines/tigrbl_engine_pyspark).**
|
|
21
|
-
|
|
22
|
-
tigrbl_engine_pyspark is a PySpark engine plugin for PySpark DataFrame integration for distributed Tigrbl analytics workflows.
|
|
23
|
-
|
|
24
|
-
`tigrbl_engine_pyspark` is part of the Tigrbl package graph. It documents package-resident classes, concepts, extension points, and execution responsibilities while cross-linking to the facade, core specs, canonical mapping, runtime phases, concrete objects, operation packages, engine plugins, OpenAPI/OpenRPC documentation surfaces, and PyPI distributions that complete the system.
|
|
25
|
-
|
|
26
|
-
## Engine ownership and database guards
|
|
27
|
-
|
|
28
|
-
- PySpark DataFrame integration, distributed analytics setup, session handoff, and cluster execution guardrails.
|
|
29
|
-
- Engine packages document backend-specific connection settings, session construction, transaction behavior, persistence boundaries, and operational guardrails. Transport routing and operation semantics remain in the facade/canon/runtime/ops packages.
|
|
30
|
-
- Register this engine through the package entry point or the Tigrbl engine context so API code can select the backend without embedding backend-specific logic in model definitions.
|
|
31
|
-
|
|
32
|
-
## Package ecosystem cross-links
|
|
33
|
-
|
|
34
|
-
Every Tigrbl Python package links to its sibling distributions on PyPI so package indexes, search engines, answer engines, dependency scanners, and human readers can move through the installable package graph without falling back to source-tree paths.
|
|
35
|
-
|
|
36
|
-
Core packages:
|
|
37
|
-
- [`tigrbl`](https://pypi.org/project/tigrbl/) - Schema-first ASGI API framework for REST, JSON-RPC, OpenAPI, OpenRPC, SQLAlchemy models, typed validation, lifecycle hooks, and engine plugins.
|
|
38
|
-
- [`tigrbl-atoms`](https://pypi.org/project/tigrbl-atoms/) - Runtime atom utilities for Tigrbl planning, dispatch, transport ingress, egress, and high-throughput ASGI execution pipelines.
|
|
39
|
-
- [`tigrbl-base`](https://pypi.org/project/tigrbl-base/) - Abstract base interfaces for Tigrbl APIs, engines, providers, sessions, transports, and reusable runtime components.
|
|
40
|
-
- [`tigrbl-canon`](https://pypi.org/project/tigrbl-canon/) - Canonical mapping, routing, symbol resolution, and naming utilities for Tigrbl framework packages and generated API surfaces.
|
|
41
|
-
- [`tigrbl_client`](https://pypi.org/project/tigrbl_client/) - Typed Python client helpers for calling Tigrbl REST, JSON-RPC, OpenAPI, and generated schema-first API surfaces.
|
|
42
|
-
- [`tigrbl-concrete`](https://pypi.org/project/tigrbl-concrete/) - Concrete Tigrbl implementations for reusable framework behavior, sessions, routes, responses, and base abstraction adapters.
|
|
43
|
-
- [`tigrbl-core`](https://pypi.org/project/tigrbl-core/) - Core Tigrbl framework specifications, decorators, schemas, hooks, operations, and primitives for schema-first APIs.
|
|
44
|
-
- [`tigrbl-kernel`](https://pypi.org/project/tigrbl-kernel/) - Kernel orchestration for composing Tigrbl runtime plans, bindings, operation dispatch, and optimized ASGI execution.
|
|
45
|
-
- [`tigrbl-ops-olap`](https://pypi.org/project/tigrbl-ops-olap/) - Analytical OLAP operation boundaries for Tigrbl workloads, query-oriented APIs, and engine integrations.
|
|
46
|
-
- [`tigrbl-ops-oltp`](https://pypi.org/project/tigrbl-ops-oltp/) - Transactional OLTP operation handlers for Tigrbl CRUD, bulk, REST, JSON-RPC, and database-backed workloads.
|
|
47
|
-
- [`tigrbl-ops-realtime`](https://pypi.org/project/tigrbl-ops-realtime/) - Realtime, streaming, datagram, websocket, and event operation handlers for Tigrbl ASGI runtimes.
|
|
48
|
-
- [`tigrbl-orm`](https://pypi.org/project/tigrbl-orm/) - SQLAlchemy ORM tables, mixins, columns, model helpers, and persistence primitives for Tigrbl applications.
|
|
49
|
-
- [`tigrbl-runtime`](https://pypi.org/project/tigrbl-runtime/) - Runtime pipeline helpers and execution bridge surfaces for Tigrbl ASGI applications, transports, and operation dispatch.
|
|
50
|
-
- [`tigrbl_spec`](https://pypi.org/project/tigrbl_spec/) - Shared Tigrbl interfaces, protocol definitions, compatibility targets, and specification artifacts for framework integration.
|
|
51
|
-
- [`tigrbl_tests`](https://pypi.org/project/tigrbl_tests/) - Reusable Tigrbl pytest fixtures, conformance assertions, integration helpers, and package test utilities.
|
|
52
|
-
- [`tigrbl-typing`](https://pypi.org/project/tigrbl-typing/) - Typing protocols, aliases, generics, and shared type helpers for Tigrbl framework packages and extensions.
|
|
53
|
-
|
|
54
|
-
Engine packages:
|
|
55
|
-
- [`tigrbl_engine_bigquery`](https://pypi.org/project/tigrbl_engine_bigquery/) - BigQuery engine plugin for Google BigQuery warehouse sessions, analytics workloads, and Tigrbl engine registration.
|
|
56
|
-
- [`tigrbl_engine_clickhouse`](https://pypi.org/project/tigrbl_engine_clickhouse/) - ClickHouse engine plugin for analytical database sessions, warehouse workloads, and Tigrbl engine registration.
|
|
57
|
-
- [`tigrbl_engine_csv`](https://pypi.org/project/tigrbl_engine_csv/) - CSV engine plugin for file-backed tables, pandas DataFrames, and lightweight Tigrbl data workflows.
|
|
58
|
-
- [`tigrbl_engine_dataframe`](https://pypi.org/project/tigrbl_engine_dataframe/) - DataFrame engine plugin for transactional pandas sessions and in-process Tigrbl analytics workloads.
|
|
59
|
-
- [`tigrbl_engine_duckdb`](https://pypi.org/project/tigrbl_engine_duckdb/) - DuckDB engine plugin for embedded analytical database sessions, OLAP workloads, and Tigrbl engine registration.
|
|
60
|
-
- [`tigrbl_engine_inmemcache`](https://pypi.org/project/tigrbl_engine_inmemcache/) - In-memory cache engine plugin for process-local TTL, LRU, and fast Tigrbl cache workflows.
|
|
61
|
-
- [`tigrbl_engine_inmemory`](https://pypi.org/project/tigrbl_engine_inmemory/) - In-memory database engine plugin for process-local transactional storage, copy-on-write snapshots, and Tigrbl testing.
|
|
62
|
-
- [`tigrbl_engine_membloom`](https://pypi.org/project/tigrbl_engine_membloom/) - In-memory Bloom filter engine plugin for membership checks, rotating TTL windows, and Tigrbl API workflows.
|
|
63
|
-
- [`tigrbl_engine_memdedupe`](https://pypi.org/project/tigrbl_engine_memdedupe/) - In-memory dedupe engine plugin for idempotency tracking, duplicate suppression, and Tigrbl workflow coordination.
|
|
64
|
-
- [`tigrbl_engine_memkv`](https://pypi.org/project/tigrbl_engine_memkv/) - In-memory key-value engine plugin for process-local KV storage, cache workflows, and lightweight Tigrbl services.
|
|
65
|
-
- [`tigrbl_engine_memlru`](https://pypi.org/project/tigrbl_engine_memlru/) - In-memory LRU engine plugin for least-recently-used cache behavior and process-local Tigrbl data workflows.
|
|
66
|
-
- [`tigrbl_engine_mempubsub`](https://pypi.org/project/tigrbl_engine_mempubsub/) - In-memory pub/sub engine plugin for process-local publish-subscribe channels, events, and Tigrbl realtime workflows.
|
|
67
|
-
- [`tigrbl_engine_memqueue`](https://pypi.org/project/tigrbl_engine_memqueue/) - In-memory queue engine plugin for process-local tasks, message workflows, and Tigrbl runtime coordination.
|
|
68
|
-
- [`tigrbl_engine_memrate`](https://pypi.org/project/tigrbl_engine_memrate/) - In-memory rate-limit engine plugin for API quotas, counters, windows, and Tigrbl governance workflows.
|
|
69
|
-
- [`tigrbl_engine_numpy`](https://pypi.org/project/tigrbl_engine_numpy/) - NumPy engine plugin for array-to-table helpers, analytical workflows, and Tigrbl data integration.
|
|
70
|
-
- [`tigrbl_engine_pandas`](https://pypi.org/project/tigrbl_engine_pandas/) - Pandas engine plugin for transactional DataFrame sessions, tabular workflows, and Tigrbl data integration.
|
|
71
|
-
- [`tigrbl_engine_pgsqli_wal`](https://pypi.org/project/tigrbl_engine_pgsqli_wal/) - PostgreSQL and SQLite WAL engine plugin for transactional Tigrbl workflows and database-backed engine registration.
|
|
72
|
-
- [`tigrbl_engine_postgres`](https://pypi.org/project/tigrbl_engine_postgres/) - PostgreSQL engine plugin for SQLAlchemy sessions, async database workflows, and Tigrbl application persistence.
|
|
73
|
-
- [`tigrbl_engine_pyspark`](https://pypi.org/project/tigrbl_engine_pyspark/) (this package) - PySpark engine plugin for distributed DataFrame integration, analytics workloads, and Tigrbl data workflows.
|
|
74
|
-
- [`tigrbl_engine_redis`](https://pypi.org/project/tigrbl_engine_redis/) - Redis engine plugin for cache, data structures, and Tigrbl engine workflows backed by Redis.
|
|
75
|
-
- [`tigrbl_engine_rediscachethrough`](https://pypi.org/project/tigrbl_engine_rediscachethrough/) - Redis cache-through engine plugin for Redis, PostgreSQL, and Tigrbl data-access acceleration workflows.
|
|
76
|
-
- [`tigrbl_engine_snowflake`](https://pypi.org/project/tigrbl_engine_snowflake/) - Snowflake engine plugin for warehouse sessions, analytical workloads, and Tigrbl engine registration.
|
|
77
|
-
- [`tigrbl_engine_sqlite`](https://pypi.org/project/tigrbl_engine_sqlite/) - SQLite engine plugin for SQLAlchemy sessions, local transactional storage, and Tigrbl application persistence.
|
|
78
|
-
- [`tigrbl_engine_xlsx`](https://pypi.org/project/tigrbl_engine_xlsx/) - XLSX engine plugin for Excel workbook-backed tables, worksheet data access, and Tigrbl tabular workflows.
|
|
79
|
-
|
|
80
|
-
Application packages:
|
|
81
|
-
- [`tigrbl_acme_ca`](https://pypi.org/project/tigrbl_acme_ca/) - ACME v2 certificate authority app for Tigrbl tables, certificate automation, TLS workflows, and API surfaces.
|
|
82
|
-
- [`tigrbl_spiffe`](https://pypi.org/project/tigrbl_spiffe/) - SPIFFE and SPIRE identity app for Tigrbl with workload identity tables, UDS transport, and HTTP API surfaces.
|
|
83
|
-
|
|
84
|
-
Source-tree links remain available from each package identity section; this ecosystem section is intentionally PyPI-first for package discovery and installation routing.
|
|
85
|
-
|
|
86
|
-
## Install
|
|
87
|
-
|
|
88
|
-
```bash
|
|
89
|
-
pip install tigrbl_engine_pyspark
|
|
90
|
-
```
|
|
91
|
-
|
|
92
|
-
## Package discovery
|
|
93
|
-
|
|
94
|
-
`tigrbl_engine_pyspark` is described for package indexes, search engines, answer engines, and AI coding tools as: PySpark engine plugin for distributed DataFrame integration, analytics workloads, and Tigrbl data workflows.
|
|
95
|
-
|
|
96
|
-
Use `tigrbl_engine_pyspark` when you need Tigrbl's schema-first ASGI package graph for REST APIs, JSON-RPC APIs, OpenAPI documentation, OpenRPC documentation, SQLAlchemy-backed models, Pydantic validation, typed operation specs, runtime dispatch, and installable engine or application extensions.
|
|
97
|
-
|
|
98
|
-
Discovery terms: tigrbl, ASGI, schema-first API framework, REST API, JSON-RPC API, OpenAPI documentation, OpenRPC documentation, SQLAlchemy models, Pydantic validation, typed validation, operation dispatch, engine plugins, api, json-rpc, rest, sqlalchemy, pydantic, engine, plugin, database, pyspark, spark, distributed, analytics, openapi, openrpc, schema-first.
|
|
99
|
-
|
|
100
|
-
## Package-local entry point
|
|
101
|
-
|
|
102
|
-
This file is a package-local distribution entry point.
|
|
103
|
-
It is not the authoritative location for repository governance, current target status, current state reporting, certification claims, or release evidence.
|
|
104
|
-
|
|
105
|
-
## Canonical repository docs
|
|
106
|
-
|
|
107
|
-
- `README.md`
|
|
108
|
-
- `docs/README.md`
|
|
109
|
-
- `docs/conformance/CURRENT_TARGET.md`
|
|
110
|
-
- `docs/conformance/CURRENT_STATE.md`
|
|
111
|
-
- `docs/conformance/NEXT_STEPS.md`
|
|
112
|
-
- `docs/governance/DOC_POINTERS.md`
|
|
113
|
-
- `docs/developer/PACKAGE_CATALOG.md`
|
|
114
|
-
- `docs/developer/PACKAGE_LAYOUT.md`
|
|
115
|
-
|
|
116
|
-
## Package identity
|
|
117
|
-
|
|
118
|
-
- canonical repository: `https://github.com/tigrbl/tigrbl`
|
|
119
|
-
- organization: `https://github.com/tigrbl`
|
|
120
|
-
- social: `https://discord.gg/K4YTAPapjR`
|
|
121
|
-
- package path: `https://github.com/tigrbl/tigrbl/tree/master/pkgs/engines/tigrbl_engine_pyspark`
|
|
122
|
-
- workspace path: `pkgs/engines/tigrbl_engine_pyspark`
|
|
123
|
-
- workspace class: engine package
|
|
124
|
-
- implementation layout: `src/tigrbl_engine_pyspark/`
|
|
125
|
-
|
|
126
|
-
Long-form repository documentation is governed from `docs/`.
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|
|
File without changes
|