tigrbl_engine_pyspark 0.4.1.dev6__tar.gz → 0.4.2.dev3__tar.gz

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
@@ -1,6 +1,6 @@
1
1
  Metadata-Version: 2.4
2
2
  Name: tigrbl_engine_pyspark
3
- Version: 0.4.1.dev6
3
+ Version: 0.4.2.dev3
4
4
  Summary: PySpark engine plugin for distributed DataFrame integration, analytics workloads, and Tigrbl data workflows.
5
5
  Project-URL: Organization, https://github.com/tigrbl
6
6
  Project-URL: Discord, https://discord.gg/K4YTAPapjR
@@ -233,113 +233,59 @@ Requires-Dist: pyspark>=3.4
233
233
  Requires-Dist: tigrbl>=0.3.0.dev4
234
234
  Description-Content-Type: text/markdown
235
235
 
236
- ![Tigrbl Logo](https://raw.githubusercontent.com/swarmauri/swarmauri-sdk/master/assets/tigrbl_full_logo.png)
236
+ <div align="center">
237
+ <h1>tigrbl_engine_pyspark</h1>
238
+ <img src="https://raw.githubusercontent.com/swarmauri/swarmauri-sdk/master/assets/tigrbl_full_logo.png" alt="Tigrbl logo" width="140"/>
239
+ <p><strong>PySpark engine plugin for distributed DataFrame integration, analytics workloads, and Tigrbl data workflows.</strong></p>
240
+ <a href="https://pypi.org/project/tigrbl_engine_pyspark/"><img src="https://img.shields.io/pypi/v/tigrbl_engine_pyspark?label=PyPI" alt="PyPI version for tigrbl_engine_pyspark"/></a>
241
+ <a href="https://pypi.org/project/tigrbl_engine_pyspark/"><img src="https://static.pepy.tech/badge/tigrbl_engine_pyspark" alt="Downloads for tigrbl_engine_pyspark"/></a>
242
+ <a href="https://github.com/tigrbl/tigrbl/blob/master/pkgs/engines/tigrbl_engine_pyspark/README.md"><img src="https://hits.sh/github.com/tigrbl/tigrbl/blob/master/pkgs/engines/tigrbl_engine_pyspark/README.md.svg?label=hits" alt="Repository hits for tigrbl_engine_pyspark README"/></a>
243
+ <a href="LICENSE"><img src="https://img.shields.io/badge/license-Apache%202.0-525252" alt="Apache 2.0 license"/></a>
244
+ <a href="pyproject.toml"><img src="https://img.shields.io/badge/python-3.10%20to%203.15-3776ab" alt="Python requirement for tigrbl_engine_pyspark"/></a>
245
+ <a href="https://github.com/tigrbl/tigrbl/blob/master/docs/README.md"><img src="https://img.shields.io/badge/workspace-engines-1f6feb" alt="Workspace group for tigrbl_engine_pyspark"/></a>
246
+ </div>
237
247
 
238
- <p align="center">
239
- <a href="https://pepy.tech/project/tigrbl_engine_pyspark">
240
- <img src="https://static.pepy.tech/badge/tigrbl_engine_pyspark" alt="Pepy downloads for tigrbl_engine_pyspark"/></a>
241
- <a href="https://hits.sh/github.com/tigrbl/tigrbl/tree/master/pkgs/engines/tigrbl_engine_pyspark/">
242
- <img src="https://hits.sh/github.com/tigrbl/tigrbl/tree/master/pkgs/engines/tigrbl_engine_pyspark.svg" alt="Repository views for tigrbl_engine_pyspark"/></a>
243
- <a href="https://pypi.org/project/tigrbl_engine_pyspark/">
244
- <img src="https://img.shields.io/badge/python-3.10--3.14-blue" alt="Python 3.10 through 3.14"/></a>
245
- <a href="https://pypi.org/project/tigrbl_engine_pyspark/">
246
- <img src="https://img.shields.io/pypi/l/tigrbl_engine_pyspark" alt="PyPI license metadata for tigrbl_engine_pyspark"/></a>
247
- <a href="https://pypi.org/project/tigrbl_engine_pyspark/">
248
- <img src="https://img.shields.io/pypi/v/tigrbl_engine_pyspark?label=tigrbl_engine_pyspark&color=green" alt="PyPI version for tigrbl_engine_pyspark"/></a>
249
- </p>
250
-
251
- ---
252
-
253
- <h1 align="center">Tigrbl engine-pyspark</h1>
254
-
255
- **Install and inspect `tigrbl_engine_pyspark`: [download `tigrbl_engine_pyspark` from PyPI](https://pypi.org/project/tigrbl_engine_pyspark/) or [open the package source](https://github.com/tigrbl/tigrbl/tree/master/pkgs/engines/tigrbl_engine_pyspark).**
256
-
257
- tigrbl_engine_pyspark is a PySpark engine plugin for PySpark DataFrame integration for distributed Tigrbl analytics workflows.
258
-
259
- `tigrbl_engine_pyspark` is part of the Tigrbl package graph. It documents package-resident classes, concepts, extension points, and execution responsibilities while cross-linking to the facade, core specs, canonical mapping, runtime phases, concrete objects, operation packages, engine plugins, OpenAPI/OpenRPC documentation surfaces, and PyPI distributions that complete the system.
260
-
261
- ## Engine ownership and database guards
262
-
263
- - PySpark DataFrame integration, distributed analytics setup, session handoff, and cluster execution guardrails.
264
- - Engine packages document backend-specific connection settings, session construction, transaction behavior, persistence boundaries, and operational guardrails. Transport routing and operation semantics remain in the facade/canon/runtime/ops packages.
265
- - Register this engine through the package entry point or the Tigrbl engine context so API code can select the backend without embedding backend-specific logic in model definitions.
248
+ ## Install
266
249
 
267
- ## Package ecosystem cross-links
250
+ ```bash
251
+ uv add tigrbl_engine_pyspark
252
+ ```
268
253
 
269
- Every Tigrbl Python package links to its sibling distributions on PyPI so package indexes, search engines, answer engines, dependency scanners, and human readers can move through the installable package graph without falling back to source-tree paths.
254
+ ```bash
255
+ pip install tigrbl_engine_pyspark
256
+ ```
270
257
 
271
- Core packages:
272
- - [`tigrbl`](https://pypi.org/project/tigrbl/) - Schema-first ASGI API framework for REST, JSON-RPC, OpenAPI, OpenRPC, SQLAlchemy models, typed validation, lifecycle hooks, and engine plugins.
273
- - [`tigrbl-atoms`](https://pypi.org/project/tigrbl-atoms/) - Runtime atom utilities for Tigrbl planning, dispatch, transport ingress, egress, and high-throughput ASGI execution pipelines.
274
- - [`tigrbl-base`](https://pypi.org/project/tigrbl-base/) - Abstract base interfaces for Tigrbl APIs, engines, providers, sessions, transports, and reusable runtime components.
275
- - [`tigrbl-canon`](https://pypi.org/project/tigrbl-canon/) - Canonical mapping, routing, symbol resolution, and naming utilities for Tigrbl framework packages and generated API surfaces.
276
- - [`tigrbl_client`](https://pypi.org/project/tigrbl_client/) - Typed Python client helpers for calling Tigrbl REST, JSON-RPC, OpenAPI, and generated schema-first API surfaces.
277
- - [`tigrbl-concrete`](https://pypi.org/project/tigrbl-concrete/) - Concrete Tigrbl implementations for reusable framework behavior, sessions, routes, responses, and base abstraction adapters.
278
- - [`tigrbl-core`](https://pypi.org/project/tigrbl-core/) - Core Tigrbl framework specifications, decorators, schemas, hooks, operations, and primitives for schema-first APIs.
279
- - [`tigrbl-kernel`](https://pypi.org/project/tigrbl-kernel/) - Kernel orchestration for composing Tigrbl runtime plans, bindings, operation dispatch, and optimized ASGI execution.
280
- - [`tigrbl-ops-olap`](https://pypi.org/project/tigrbl-ops-olap/) - Analytical OLAP operation boundaries for Tigrbl workloads, query-oriented APIs, and engine integrations.
281
- - [`tigrbl-ops-oltp`](https://pypi.org/project/tigrbl-ops-oltp/) - Transactional OLTP operation handlers for Tigrbl CRUD, bulk, REST, JSON-RPC, and database-backed workloads.
282
- - [`tigrbl-ops-realtime`](https://pypi.org/project/tigrbl-ops-realtime/) - Realtime, streaming, datagram, websocket, and event operation handlers for Tigrbl ASGI runtimes.
283
- - [`tigrbl-orm`](https://pypi.org/project/tigrbl-orm/) - SQLAlchemy ORM tables, mixins, columns, model helpers, and persistence primitives for Tigrbl applications.
284
- - [`tigrbl-runtime`](https://pypi.org/project/tigrbl-runtime/) - Runtime pipeline helpers and execution bridge surfaces for Tigrbl ASGI applications, transports, and operation dispatch.
285
- - [`tigrbl_spec`](https://pypi.org/project/tigrbl_spec/) - Shared Tigrbl interfaces, protocol definitions, compatibility targets, and specification artifacts for framework integration.
286
- - [`tigrbl_tests`](https://pypi.org/project/tigrbl_tests/) - Reusable Tigrbl pytest fixtures, conformance assertions, integration helpers, and package test utilities.
287
- - [`tigrbl-typing`](https://pypi.org/project/tigrbl-typing/) - Typing protocols, aliases, generics, and shared type helpers for Tigrbl framework packages and extensions.
258
+ ## What It Owns
288
259
 
289
- Engine packages:
290
- - [`tigrbl_engine_bigquery`](https://pypi.org/project/tigrbl_engine_bigquery/) - BigQuery engine plugin for Google BigQuery warehouse sessions, analytics workloads, and Tigrbl engine registration.
291
- - [`tigrbl_engine_clickhouse`](https://pypi.org/project/tigrbl_engine_clickhouse/) - ClickHouse engine plugin for analytical database sessions, warehouse workloads, and Tigrbl engine registration.
292
- - [`tigrbl_engine_csv`](https://pypi.org/project/tigrbl_engine_csv/) - CSV engine plugin for file-backed tables, pandas DataFrames, and lightweight Tigrbl data workflows.
293
- - [`tigrbl_engine_dataframe`](https://pypi.org/project/tigrbl_engine_dataframe/) - DataFrame engine plugin for transactional pandas sessions and in-process Tigrbl analytics workloads.
294
- - [`tigrbl_engine_duckdb`](https://pypi.org/project/tigrbl_engine_duckdb/) - DuckDB engine plugin for embedded analytical database sessions, OLAP workloads, and Tigrbl engine registration.
295
- - [`tigrbl_engine_inmemcache`](https://pypi.org/project/tigrbl_engine_inmemcache/) - In-memory cache engine plugin for process-local TTL, LRU, and fast Tigrbl cache workflows.
296
- - [`tigrbl_engine_inmemory`](https://pypi.org/project/tigrbl_engine_inmemory/) - In-memory database engine plugin for process-local transactional storage, copy-on-write snapshots, and Tigrbl testing.
297
- - [`tigrbl_engine_membloom`](https://pypi.org/project/tigrbl_engine_membloom/) - In-memory Bloom filter engine plugin for membership checks, rotating TTL windows, and Tigrbl API workflows.
298
- - [`tigrbl_engine_memdedupe`](https://pypi.org/project/tigrbl_engine_memdedupe/) - In-memory dedupe engine plugin for idempotency tracking, duplicate suppression, and Tigrbl workflow coordination.
299
- - [`tigrbl_engine_memkv`](https://pypi.org/project/tigrbl_engine_memkv/) - In-memory key-value engine plugin for process-local KV storage, cache workflows, and lightweight Tigrbl services.
300
- - [`tigrbl_engine_memlru`](https://pypi.org/project/tigrbl_engine_memlru/) - In-memory LRU engine plugin for least-recently-used cache behavior and process-local Tigrbl data workflows.
301
- - [`tigrbl_engine_mempubsub`](https://pypi.org/project/tigrbl_engine_mempubsub/) - In-memory pub/sub engine plugin for process-local publish-subscribe channels, events, and Tigrbl realtime workflows.
302
- - [`tigrbl_engine_memqueue`](https://pypi.org/project/tigrbl_engine_memqueue/) - In-memory queue engine plugin for process-local tasks, message workflows, and Tigrbl runtime coordination.
303
- - [`tigrbl_engine_memrate`](https://pypi.org/project/tigrbl_engine_memrate/) - In-memory rate-limit engine plugin for API quotas, counters, windows, and Tigrbl governance workflows.
304
- - [`tigrbl_engine_numpy`](https://pypi.org/project/tigrbl_engine_numpy/) - NumPy engine plugin for array-to-table helpers, analytical workflows, and Tigrbl data integration.
305
- - [`tigrbl_engine_pandas`](https://pypi.org/project/tigrbl_engine_pandas/) - Pandas engine plugin for transactional DataFrame sessions, tabular workflows, and Tigrbl data integration.
306
- - [`tigrbl_engine_pgsqli_wal`](https://pypi.org/project/tigrbl_engine_pgsqli_wal/) - PostgreSQL and SQLite WAL engine plugin for transactional Tigrbl workflows and database-backed engine registration.
307
- - [`tigrbl_engine_postgres`](https://pypi.org/project/tigrbl_engine_postgres/) - PostgreSQL engine plugin for SQLAlchemy sessions, async database workflows, and Tigrbl application persistence.
308
- - [`tigrbl_engine_pyspark`](https://pypi.org/project/tigrbl_engine_pyspark/) (this package) - PySpark engine plugin for distributed DataFrame integration, analytics workloads, and Tigrbl data workflows.
309
- - [`tigrbl_engine_redis`](https://pypi.org/project/tigrbl_engine_redis/) - Redis engine plugin for cache, data structures, and Tigrbl engine workflows backed by Redis.
310
- - [`tigrbl_engine_rediscachethrough`](https://pypi.org/project/tigrbl_engine_rediscachethrough/) - Redis cache-through engine plugin for Redis, PostgreSQL, and Tigrbl data-access acceleration workflows.
311
- - [`tigrbl_engine_snowflake`](https://pypi.org/project/tigrbl_engine_snowflake/) - Snowflake engine plugin for warehouse sessions, analytical workloads, and Tigrbl engine registration.
312
- - [`tigrbl_engine_sqlite`](https://pypi.org/project/tigrbl_engine_sqlite/) - SQLite engine plugin for SQLAlchemy sessions, local transactional storage, and Tigrbl application persistence.
313
- - [`tigrbl_engine_xlsx`](https://pypi.org/project/tigrbl_engine_xlsx/) - XLSX engine plugin for Excel workbook-backed tables, worksheet data access, and Tigrbl tabular workflows.
260
+ `tigrbl_engine_pyspark` owns the engine pyspark backend boundary for Tigrbl, including engine registration, session adapters, and backend-specific helpers. Key implementation roots include `tigrbl_engine_pyspark` with `engine, session`.
314
261
 
315
- Application packages:
316
- - [`tigrbl_acme_ca`](https://pypi.org/project/tigrbl_acme_ca/) - ACME v2 certificate authority app for Tigrbl tables, certificate automation, TLS workflows, and API surfaces.
317
- - [`tigrbl_spiffe`](https://pypi.org/project/tigrbl_spiffe/) - SPIFFE and SPIRE identity app for Tigrbl with workload identity tables, UDS transport, and HTTP API surfaces.
262
+ ## Use It When
318
263
 
319
- Source-tree links remain available from each package identity section; this ecosystem section is intentionally PyPI-first for package discovery and installation routing.
264
+ Use `tigrbl_engine_pyspark` when you want the engine pyspark backend installed as an isolated dependency instead of pulling every engine into your environment.
320
265
 
321
- ## Install
266
+ ## Public Surface
322
267
 
323
- ```bash
324
- pip install tigrbl_engine_pyspark
325
- ```
268
+ - `tigrbl_engine_pyspark` exposes `pyspark_capabilities, pyspark_engine, PySparkSession, register`.
326
269
 
327
- ## Package discovery
270
+ ## Internal Layout
328
271
 
329
- `tigrbl_engine_pyspark` is described for package indexes, search engines, answer engines, and AI coding tools as: PySpark engine plugin for distributed DataFrame integration, analytics workloads, and Tigrbl data workflows.
272
+ - Workspace path: `pkgs/engines/tigrbl_engine_pyspark`.
273
+ - Package class: `engine plugin`.
274
+ - Python requirement: `>=3.10,<3.15`.
275
+ - `tigrbl_engine_pyspark` modules: `engine, session`.
330
276
 
331
- Use `tigrbl_engine_pyspark` when you need Tigrbl's schema-first ASGI package graph for REST APIs, JSON-RPC APIs, OpenAPI documentation, OpenRPC documentation, SQLAlchemy-backed models, Pydantic validation, typed operation specs, runtime dispatch, and installable engine or application extensions.
277
+ ## Dependency Surface
332
278
 
333
- Discovery terms: tigrbl, ASGI, schema-first API framework, REST API, JSON-RPC API, OpenAPI documentation, OpenRPC documentation, SQLAlchemy models, Pydantic validation, typed validation, operation dispatch, engine plugins, api, json-rpc, rest, sqlalchemy, pydantic, engine, plugin, database, pyspark, spark, distributed, analytics, openapi, openrpc, schema-first.
279
+ - Workspace package dependencies: none declared.
280
+ - External runtime dependencies: `pyspark>=3.4`, `tigrbl>=0.3.0.dev4`.
281
+ - Optional extras: none declared.
334
282
 
335
- ## Package-local entry point
283
+ ## Related Packages
336
284
 
337
- This file is a package-local distribution entry point.
338
- It is not the authoritative location for repository governance, current target status, current state reporting, certification claims, or release evidence.
285
+ - [`tigrbl`](https://pypi.org/project/tigrbl/)
339
286
 
340
- ## Canonical repository docs
287
+ ## Canonical Repository Docs
341
288
 
342
- - `README.md`
343
289
  - `docs/README.md`
344
290
  - `docs/conformance/CURRENT_TARGET.md`
345
291
  - `docs/conformance/CURRENT_STATE.md`
@@ -348,14 +294,11 @@ It is not the authoritative location for repository governance, current target s
348
294
  - `docs/developer/PACKAGE_CATALOG.md`
349
295
  - `docs/developer/PACKAGE_LAYOUT.md`
350
296
 
351
- ## Package identity
297
+ ## Package-local Boundary
298
+
299
+ This file is a package-local distribution entry point.
300
+ Use this page for package installation and boundary orientation. Repository governance, conformance state, target status, and release evidence remain governed from `docs/` and `.ssot/`.
352
301
 
353
- - canonical repository: `https://github.com/tigrbl/tigrbl`
354
- - organization: `https://github.com/tigrbl`
355
- - social: `https://discord.gg/K4YTAPapjR`
356
- - package path: `https://github.com/tigrbl/tigrbl/tree/master/pkgs/engines/tigrbl_engine_pyspark`
357
- - workspace path: `pkgs/engines/tigrbl_engine_pyspark`
358
- - workspace class: engine package
359
- - implementation layout: `src/tigrbl_engine_pyspark/`
302
+ ## License
360
303
 
361
- Long-form repository documentation is governed from `docs/`.
304
+ Licensed under the Apache License, Version 2.0. See `LICENSE` and the official [Apache 2.0 license text](https://www.apache.org/licenses/LICENSE-2.0).
@@ -0,0 +1,69 @@
1
+ <div align="center">
2
+ <h1>tigrbl_engine_pyspark</h1>
3
+ <img src="https://raw.githubusercontent.com/swarmauri/swarmauri-sdk/master/assets/tigrbl_full_logo.png" alt="Tigrbl logo" width="140"/>
4
+ <p><strong>PySpark engine plugin for distributed DataFrame integration, analytics workloads, and Tigrbl data workflows.</strong></p>
5
+ <a href="https://pypi.org/project/tigrbl_engine_pyspark/"><img src="https://img.shields.io/pypi/v/tigrbl_engine_pyspark?label=PyPI" alt="PyPI version for tigrbl_engine_pyspark"/></a>
6
+ <a href="https://pypi.org/project/tigrbl_engine_pyspark/"><img src="https://static.pepy.tech/badge/tigrbl_engine_pyspark" alt="Downloads for tigrbl_engine_pyspark"/></a>
7
+ <a href="https://github.com/tigrbl/tigrbl/blob/master/pkgs/engines/tigrbl_engine_pyspark/README.md"><img src="https://hits.sh/github.com/tigrbl/tigrbl/blob/master/pkgs/engines/tigrbl_engine_pyspark/README.md.svg?label=hits" alt="Repository hits for tigrbl_engine_pyspark README"/></a>
8
+ <a href="LICENSE"><img src="https://img.shields.io/badge/license-Apache%202.0-525252" alt="Apache 2.0 license"/></a>
9
+ <a href="pyproject.toml"><img src="https://img.shields.io/badge/python-3.10%20to%203.15-3776ab" alt="Python requirement for tigrbl_engine_pyspark"/></a>
10
+ <a href="https://github.com/tigrbl/tigrbl/blob/master/docs/README.md"><img src="https://img.shields.io/badge/workspace-engines-1f6feb" alt="Workspace group for tigrbl_engine_pyspark"/></a>
11
+ </div>
12
+
13
+ ## Install
14
+
15
+ ```bash
16
+ uv add tigrbl_engine_pyspark
17
+ ```
18
+
19
+ ```bash
20
+ pip install tigrbl_engine_pyspark
21
+ ```
22
+
23
+ ## What It Owns
24
+
25
+ `tigrbl_engine_pyspark` owns the engine pyspark backend boundary for Tigrbl, including engine registration, session adapters, and backend-specific helpers. Key implementation roots include `tigrbl_engine_pyspark` with `engine, session`.
26
+
27
+ ## Use It When
28
+
29
+ Use `tigrbl_engine_pyspark` when you want the engine pyspark backend installed as an isolated dependency instead of pulling every engine into your environment.
30
+
31
+ ## Public Surface
32
+
33
+ - `tigrbl_engine_pyspark` exposes `pyspark_capabilities, pyspark_engine, PySparkSession, register`.
34
+
35
+ ## Internal Layout
36
+
37
+ - Workspace path: `pkgs/engines/tigrbl_engine_pyspark`.
38
+ - Package class: `engine plugin`.
39
+ - Python requirement: `>=3.10,<3.15`.
40
+ - `tigrbl_engine_pyspark` modules: `engine, session`.
41
+
42
+ ## Dependency Surface
43
+
44
+ - Workspace package dependencies: none declared.
45
+ - External runtime dependencies: `pyspark>=3.4`, `tigrbl>=0.3.0.dev4`.
46
+ - Optional extras: none declared.
47
+
48
+ ## Related Packages
49
+
50
+ - [`tigrbl`](https://pypi.org/project/tigrbl/)
51
+
52
+ ## Canonical Repository Docs
53
+
54
+ - `docs/README.md`
55
+ - `docs/conformance/CURRENT_TARGET.md`
56
+ - `docs/conformance/CURRENT_STATE.md`
57
+ - `docs/conformance/NEXT_STEPS.md`
58
+ - `docs/governance/DOC_POINTERS.md`
59
+ - `docs/developer/PACKAGE_CATALOG.md`
60
+ - `docs/developer/PACKAGE_LAYOUT.md`
61
+
62
+ ## Package-local Boundary
63
+
64
+ This file is a package-local distribution entry point.
65
+ Use this page for package installation and boundary orientation. Repository governance, conformance state, target status, and release evidence remain governed from `docs/` and `.ssot/`.
66
+
67
+ ## License
68
+
69
+ Licensed under the Apache License, Version 2.0. See `LICENSE` and the official [Apache 2.0 license text](https://www.apache.org/licenses/LICENSE-2.0).
@@ -4,7 +4,7 @@ build-backend = "hatchling.build"
4
4
 
5
5
  [project]
6
6
  name = "tigrbl_engine_pyspark"
7
- version = "0.4.1.dev6"
7
+ version = "0.4.2.dev3"
8
8
  description = "PySpark engine plugin for distributed DataFrame integration, analytics workloads, and Tigrbl data workflows."
9
9
  readme = "README.md"
10
10
  license = { file = "LICENSE" }
@@ -1,126 +0,0 @@
1
- ![Tigrbl Logo](https://raw.githubusercontent.com/swarmauri/swarmauri-sdk/master/assets/tigrbl_full_logo.png)
2
-
3
- <p align="center">
4
- <a href="https://pepy.tech/project/tigrbl_engine_pyspark">
5
- <img src="https://static.pepy.tech/badge/tigrbl_engine_pyspark" alt="Pepy downloads for tigrbl_engine_pyspark"/></a>
6
- <a href="https://hits.sh/github.com/tigrbl/tigrbl/tree/master/pkgs/engines/tigrbl_engine_pyspark/">
7
- <img src="https://hits.sh/github.com/tigrbl/tigrbl/tree/master/pkgs/engines/tigrbl_engine_pyspark.svg" alt="Repository views for tigrbl_engine_pyspark"/></a>
8
- <a href="https://pypi.org/project/tigrbl_engine_pyspark/">
9
- <img src="https://img.shields.io/badge/python-3.10--3.14-blue" alt="Python 3.10 through 3.14"/></a>
10
- <a href="https://pypi.org/project/tigrbl_engine_pyspark/">
11
- <img src="https://img.shields.io/pypi/l/tigrbl_engine_pyspark" alt="PyPI license metadata for tigrbl_engine_pyspark"/></a>
12
- <a href="https://pypi.org/project/tigrbl_engine_pyspark/">
13
- <img src="https://img.shields.io/pypi/v/tigrbl_engine_pyspark?label=tigrbl_engine_pyspark&color=green" alt="PyPI version for tigrbl_engine_pyspark"/></a>
14
- </p>
15
-
16
- ---
17
-
18
- <h1 align="center">Tigrbl engine-pyspark</h1>
19
-
20
- **Install and inspect `tigrbl_engine_pyspark`: [download `tigrbl_engine_pyspark` from PyPI](https://pypi.org/project/tigrbl_engine_pyspark/) or [open the package source](https://github.com/tigrbl/tigrbl/tree/master/pkgs/engines/tigrbl_engine_pyspark).**
21
-
22
- tigrbl_engine_pyspark is a PySpark engine plugin for PySpark DataFrame integration for distributed Tigrbl analytics workflows.
23
-
24
- `tigrbl_engine_pyspark` is part of the Tigrbl package graph. It documents package-resident classes, concepts, extension points, and execution responsibilities while cross-linking to the facade, core specs, canonical mapping, runtime phases, concrete objects, operation packages, engine plugins, OpenAPI/OpenRPC documentation surfaces, and PyPI distributions that complete the system.
25
-
26
- ## Engine ownership and database guards
27
-
28
- - PySpark DataFrame integration, distributed analytics setup, session handoff, and cluster execution guardrails.
29
- - Engine packages document backend-specific connection settings, session construction, transaction behavior, persistence boundaries, and operational guardrails. Transport routing and operation semantics remain in the facade/canon/runtime/ops packages.
30
- - Register this engine through the package entry point or the Tigrbl engine context so API code can select the backend without embedding backend-specific logic in model definitions.
31
-
32
- ## Package ecosystem cross-links
33
-
34
- Every Tigrbl Python package links to its sibling distributions on PyPI so package indexes, search engines, answer engines, dependency scanners, and human readers can move through the installable package graph without falling back to source-tree paths.
35
-
36
- Core packages:
37
- - [`tigrbl`](https://pypi.org/project/tigrbl/) - Schema-first ASGI API framework for REST, JSON-RPC, OpenAPI, OpenRPC, SQLAlchemy models, typed validation, lifecycle hooks, and engine plugins.
38
- - [`tigrbl-atoms`](https://pypi.org/project/tigrbl-atoms/) - Runtime atom utilities for Tigrbl planning, dispatch, transport ingress, egress, and high-throughput ASGI execution pipelines.
39
- - [`tigrbl-base`](https://pypi.org/project/tigrbl-base/) - Abstract base interfaces for Tigrbl APIs, engines, providers, sessions, transports, and reusable runtime components.
40
- - [`tigrbl-canon`](https://pypi.org/project/tigrbl-canon/) - Canonical mapping, routing, symbol resolution, and naming utilities for Tigrbl framework packages and generated API surfaces.
41
- - [`tigrbl_client`](https://pypi.org/project/tigrbl_client/) - Typed Python client helpers for calling Tigrbl REST, JSON-RPC, OpenAPI, and generated schema-first API surfaces.
42
- - [`tigrbl-concrete`](https://pypi.org/project/tigrbl-concrete/) - Concrete Tigrbl implementations for reusable framework behavior, sessions, routes, responses, and base abstraction adapters.
43
- - [`tigrbl-core`](https://pypi.org/project/tigrbl-core/) - Core Tigrbl framework specifications, decorators, schemas, hooks, operations, and primitives for schema-first APIs.
44
- - [`tigrbl-kernel`](https://pypi.org/project/tigrbl-kernel/) - Kernel orchestration for composing Tigrbl runtime plans, bindings, operation dispatch, and optimized ASGI execution.
45
- - [`tigrbl-ops-olap`](https://pypi.org/project/tigrbl-ops-olap/) - Analytical OLAP operation boundaries for Tigrbl workloads, query-oriented APIs, and engine integrations.
46
- - [`tigrbl-ops-oltp`](https://pypi.org/project/tigrbl-ops-oltp/) - Transactional OLTP operation handlers for Tigrbl CRUD, bulk, REST, JSON-RPC, and database-backed workloads.
47
- - [`tigrbl-ops-realtime`](https://pypi.org/project/tigrbl-ops-realtime/) - Realtime, streaming, datagram, websocket, and event operation handlers for Tigrbl ASGI runtimes.
48
- - [`tigrbl-orm`](https://pypi.org/project/tigrbl-orm/) - SQLAlchemy ORM tables, mixins, columns, model helpers, and persistence primitives for Tigrbl applications.
49
- - [`tigrbl-runtime`](https://pypi.org/project/tigrbl-runtime/) - Runtime pipeline helpers and execution bridge surfaces for Tigrbl ASGI applications, transports, and operation dispatch.
50
- - [`tigrbl_spec`](https://pypi.org/project/tigrbl_spec/) - Shared Tigrbl interfaces, protocol definitions, compatibility targets, and specification artifacts for framework integration.
51
- - [`tigrbl_tests`](https://pypi.org/project/tigrbl_tests/) - Reusable Tigrbl pytest fixtures, conformance assertions, integration helpers, and package test utilities.
52
- - [`tigrbl-typing`](https://pypi.org/project/tigrbl-typing/) - Typing protocols, aliases, generics, and shared type helpers for Tigrbl framework packages and extensions.
53
-
54
- Engine packages:
55
- - [`tigrbl_engine_bigquery`](https://pypi.org/project/tigrbl_engine_bigquery/) - BigQuery engine plugin for Google BigQuery warehouse sessions, analytics workloads, and Tigrbl engine registration.
56
- - [`tigrbl_engine_clickhouse`](https://pypi.org/project/tigrbl_engine_clickhouse/) - ClickHouse engine plugin for analytical database sessions, warehouse workloads, and Tigrbl engine registration.
57
- - [`tigrbl_engine_csv`](https://pypi.org/project/tigrbl_engine_csv/) - CSV engine plugin for file-backed tables, pandas DataFrames, and lightweight Tigrbl data workflows.
58
- - [`tigrbl_engine_dataframe`](https://pypi.org/project/tigrbl_engine_dataframe/) - DataFrame engine plugin for transactional pandas sessions and in-process Tigrbl analytics workloads.
59
- - [`tigrbl_engine_duckdb`](https://pypi.org/project/tigrbl_engine_duckdb/) - DuckDB engine plugin for embedded analytical database sessions, OLAP workloads, and Tigrbl engine registration.
60
- - [`tigrbl_engine_inmemcache`](https://pypi.org/project/tigrbl_engine_inmemcache/) - In-memory cache engine plugin for process-local TTL, LRU, and fast Tigrbl cache workflows.
61
- - [`tigrbl_engine_inmemory`](https://pypi.org/project/tigrbl_engine_inmemory/) - In-memory database engine plugin for process-local transactional storage, copy-on-write snapshots, and Tigrbl testing.
62
- - [`tigrbl_engine_membloom`](https://pypi.org/project/tigrbl_engine_membloom/) - In-memory Bloom filter engine plugin for membership checks, rotating TTL windows, and Tigrbl API workflows.
63
- - [`tigrbl_engine_memdedupe`](https://pypi.org/project/tigrbl_engine_memdedupe/) - In-memory dedupe engine plugin for idempotency tracking, duplicate suppression, and Tigrbl workflow coordination.
64
- - [`tigrbl_engine_memkv`](https://pypi.org/project/tigrbl_engine_memkv/) - In-memory key-value engine plugin for process-local KV storage, cache workflows, and lightweight Tigrbl services.
65
- - [`tigrbl_engine_memlru`](https://pypi.org/project/tigrbl_engine_memlru/) - In-memory LRU engine plugin for least-recently-used cache behavior and process-local Tigrbl data workflows.
66
- - [`tigrbl_engine_mempubsub`](https://pypi.org/project/tigrbl_engine_mempubsub/) - In-memory pub/sub engine plugin for process-local publish-subscribe channels, events, and Tigrbl realtime workflows.
67
- - [`tigrbl_engine_memqueue`](https://pypi.org/project/tigrbl_engine_memqueue/) - In-memory queue engine plugin for process-local tasks, message workflows, and Tigrbl runtime coordination.
68
- - [`tigrbl_engine_memrate`](https://pypi.org/project/tigrbl_engine_memrate/) - In-memory rate-limit engine plugin for API quotas, counters, windows, and Tigrbl governance workflows.
69
- - [`tigrbl_engine_numpy`](https://pypi.org/project/tigrbl_engine_numpy/) - NumPy engine plugin for array-to-table helpers, analytical workflows, and Tigrbl data integration.
70
- - [`tigrbl_engine_pandas`](https://pypi.org/project/tigrbl_engine_pandas/) - Pandas engine plugin for transactional DataFrame sessions, tabular workflows, and Tigrbl data integration.
71
- - [`tigrbl_engine_pgsqli_wal`](https://pypi.org/project/tigrbl_engine_pgsqli_wal/) - PostgreSQL and SQLite WAL engine plugin for transactional Tigrbl workflows and database-backed engine registration.
72
- - [`tigrbl_engine_postgres`](https://pypi.org/project/tigrbl_engine_postgres/) - PostgreSQL engine plugin for SQLAlchemy sessions, async database workflows, and Tigrbl application persistence.
73
- - [`tigrbl_engine_pyspark`](https://pypi.org/project/tigrbl_engine_pyspark/) (this package) - PySpark engine plugin for distributed DataFrame integration, analytics workloads, and Tigrbl data workflows.
74
- - [`tigrbl_engine_redis`](https://pypi.org/project/tigrbl_engine_redis/) - Redis engine plugin for cache, data structures, and Tigrbl engine workflows backed by Redis.
75
- - [`tigrbl_engine_rediscachethrough`](https://pypi.org/project/tigrbl_engine_rediscachethrough/) - Redis cache-through engine plugin for Redis, PostgreSQL, and Tigrbl data-access acceleration workflows.
76
- - [`tigrbl_engine_snowflake`](https://pypi.org/project/tigrbl_engine_snowflake/) - Snowflake engine plugin for warehouse sessions, analytical workloads, and Tigrbl engine registration.
77
- - [`tigrbl_engine_sqlite`](https://pypi.org/project/tigrbl_engine_sqlite/) - SQLite engine plugin for SQLAlchemy sessions, local transactional storage, and Tigrbl application persistence.
78
- - [`tigrbl_engine_xlsx`](https://pypi.org/project/tigrbl_engine_xlsx/) - XLSX engine plugin for Excel workbook-backed tables, worksheet data access, and Tigrbl tabular workflows.
79
-
80
- Application packages:
81
- - [`tigrbl_acme_ca`](https://pypi.org/project/tigrbl_acme_ca/) - ACME v2 certificate authority app for Tigrbl tables, certificate automation, TLS workflows, and API surfaces.
82
- - [`tigrbl_spiffe`](https://pypi.org/project/tigrbl_spiffe/) - SPIFFE and SPIRE identity app for Tigrbl with workload identity tables, UDS transport, and HTTP API surfaces.
83
-
84
- Source-tree links remain available from each package identity section; this ecosystem section is intentionally PyPI-first for package discovery and installation routing.
85
-
86
- ## Install
87
-
88
- ```bash
89
- pip install tigrbl_engine_pyspark
90
- ```
91
-
92
- ## Package discovery
93
-
94
- `tigrbl_engine_pyspark` is described for package indexes, search engines, answer engines, and AI coding tools as: PySpark engine plugin for distributed DataFrame integration, analytics workloads, and Tigrbl data workflows.
95
-
96
- Use `tigrbl_engine_pyspark` when you need Tigrbl's schema-first ASGI package graph for REST APIs, JSON-RPC APIs, OpenAPI documentation, OpenRPC documentation, SQLAlchemy-backed models, Pydantic validation, typed operation specs, runtime dispatch, and installable engine or application extensions.
97
-
98
- Discovery terms: tigrbl, ASGI, schema-first API framework, REST API, JSON-RPC API, OpenAPI documentation, OpenRPC documentation, SQLAlchemy models, Pydantic validation, typed validation, operation dispatch, engine plugins, api, json-rpc, rest, sqlalchemy, pydantic, engine, plugin, database, pyspark, spark, distributed, analytics, openapi, openrpc, schema-first.
99
-
100
- ## Package-local entry point
101
-
102
- This file is a package-local distribution entry point.
103
- It is not the authoritative location for repository governance, current target status, current state reporting, certification claims, or release evidence.
104
-
105
- ## Canonical repository docs
106
-
107
- - `README.md`
108
- - `docs/README.md`
109
- - `docs/conformance/CURRENT_TARGET.md`
110
- - `docs/conformance/CURRENT_STATE.md`
111
- - `docs/conformance/NEXT_STEPS.md`
112
- - `docs/governance/DOC_POINTERS.md`
113
- - `docs/developer/PACKAGE_CATALOG.md`
114
- - `docs/developer/PACKAGE_LAYOUT.md`
115
-
116
- ## Package identity
117
-
118
- - canonical repository: `https://github.com/tigrbl/tigrbl`
119
- - organization: `https://github.com/tigrbl`
120
- - social: `https://discord.gg/K4YTAPapjR`
121
- - package path: `https://github.com/tigrbl/tigrbl/tree/master/pkgs/engines/tigrbl_engine_pyspark`
122
- - workspace path: `pkgs/engines/tigrbl_engine_pyspark`
123
- - workspace class: engine package
124
- - implementation layout: `src/tigrbl_engine_pyspark/`
125
-
126
- Long-form repository documentation is governed from `docs/`.