serverless-data-mesh 1.0.0__tar.gz → 1.3.0__tar.gz

{serverless_data_mesh-1.0.0 → serverless_data_mesh-1.3.0}/.gitignore

@@ -64,3 +64,8 @@ agent-transcripts/
 examples/retail-mesh/generated/
 examples/medallion-e2e/generated/
 domains/
+infrastructure/terraform/fixtures/generated-mesh/
+
+# Keep VS Code YAML schema mapping
+!.vscode/
+!.vscode/settings.json

{serverless_data_mesh-1.0.0 → serverless_data_mesh-1.3.0}/CHANGELOG.md

@@ -4,6 +4,59 @@ All notable changes to this project will be documented in this file.
 
 ## [Unreleased]
 
+## [1.3.0] - 2026-09-19
+
+### Added
+
+- **Lambda Managed Instances (LMI) opt-in**: segments up to **90 minutes** for async/ESM via `enable_lambda_managed_instances` + capacity provider ARN
+- **`execution_timeouts` module** with unit tests validating on-demand (≤15 min) vs LMI (≤90 min), SFN sync cap, IceGuard rollback scaling, and durable budget coherence
+- **Docs**: `docs/lambda-managed-instances.md` — industry-standard 15–90 min segments with IceGuard/VRP Iceberg safety
+
+### Changed
+
+- Terraform lambda module / prod / medallion / multi-account: timeout ceiling **900 or 5400** by capacity mode; SFN invoke wait capped at sync 15 min
+- README / architecture / terraform guides: dual clocks + LMI; IceGuard prevents corrupt Iceberg publication
+- PyPI download badges: use live **pypistats** monthly/weekly counts (shields `pypi/dm` and pe.py static badges were unreliable)
+
+## [1.2.0] - 2026-07-21
+
+### Added
+
+- **PVDM-A Decision Attestation** + CLI `attest` + coordinator/local wiring
+- **Optional KMS VRP envelopes** (`VRP_KMS_KEY_ID`)
+- **Pre-physical rules gate** (`SDM_RULES_GATE` / SparkRules)
+- **Mesh control center UI** with dashboards, `/walkthrough` GIF demo, one-click demos
+- **README GIF walkthrough** + durable-compute example + Docker image (`ghcr.io`)
+- **100% coverage gate** for attestation / kms_sign / rules.gate / ui.data (`scripts/coverage_gate.py`)
+
+### Fixed
+
+- **Lambda VERSION path**: `__init__.py` tries `serverless_data_mesh/VERSION`, repo root, and metadata; wheel bundles `VERSION` in package
+- **IAM**: `cloudwatch:PutMetricData` for `ServerlessDataMesh*` namespace on domain writer role
+- **Terraform storage**: lifecycle `for_each` uses static bucket keys (not computed `.id` map keys)
+- **Metrics**: `SDM_METRICS_ENABLED` / `SDM_DISABLE_METRICS` opt-out; PutMetricData failures are non-fatal
+- **Lambda packaging**: `SDM_PIPELINE_SRC` overlays compiled `handler.py` at zip root; `handler.lambda_handler` in manifest and Terraform
+- **Observability:** structured `pvdm_outcome` JSON logs; LocalPVDMRuntime S3 proofs when `VRP_PROOF_BUCKET` set
+- **Monitoring:** ops dashboard widgets (invocations, errors, duration, DLQ); DLQ alarm; JSON log metric filters
+- **Scripts:** `aws_observability_smoke.sh`, `aws_dlq_smoke_test.sh`; [observability-production.md](docs/observability-production.md)
+
+## [1.1.0] - 2026-06-14
+
+Enterprise completeness: reference readers, per-layer Lambda fleet, deploy CLI, Backstage, schemas, UI, benchmarks, multi-cloud stubs.
+
+### Added
+
+- **Reference readers**: S3 bronze landing + upstream Parquet (`serverless_data_mesh.readers`)
+- **Per-layer Lambda fleet** Terraform module (`lambda-fleet`) + `layer_lambda.manifest.json` from compile
+- **`serverless-data-mesh deploy`** — apply + terraform + optional Step Functions start
+- **`serverless-data-mesh catalog export`** — Backstage `catalog-info.yaml` entities
+- **`serverless-data-mesh ui`** — local mesh control panel (HTTP)
+- **JSON Schema** for `sdm/v1` contracts + VS Code YAML autocomplete
+- **Portable cloud** adapters (AWS production, GCP/Azure stubs)
+- **Docs**: `docs/first-mesh-on-aws.md` (5-minute guide)
+- **CI**: medallion Terraform validate, local benchmark, smoke-aws + benchmark workflows
+- **Benchmarks**: `run_local_benchmark.py`, `run_aws_benchmark.py`
+
 ## [1.0.0] - 2026-06-14
 
 Production release: metadata-driven medallion mesh, zero-friction CLI, and Terraform deploy path.

serverless_data_mesh-1.3.0/NOTICE

@@ -0,0 +1,14 @@
+Vaquar Pattern (PVDM)
+Copyright © 2024–2026 Vaquar Khan. All rights reserved.
+
+PVDM (Physical · Verify · Durable · Metadata) and the Vaquar Pattern are
+proprietary architectural methods of Vaquar Khan. The method name, operational
+acronym, and publication invariant (commit_metadata ⟹ VRP = PASS) may not be
+rebranded or claimed as an independent invention without attribution to the
+inventor.
+
+This repository's reference implementation (serverless-data-mesh) is licensed
+under the Apache License 2.0. Use of the open-source code does not transfer
+ownership of the proprietary method.
+
+See docs/vaquar-pattern.md for the canonical method specification.

{serverless_data_mesh-1.0.0 → serverless_data_mesh-1.3.0}/PKG-INFO

@@ -1,6 +1,6 @@
-Metadata-Version: 2.4
+Metadata-Version: 2.5
 Name: serverless-data-mesh
-Version: 1.0.0
+Version: 1.3.0
 Summary: Federated data mesh framework for proof-gated, exactly-once Iceberg data product publication on AWS Lambda.
 Project-URL: Homepage, https://github.com/vaquarkhan/aws-serverless-datamesh-framework
 Project-URL: Documentation, https://github.com/vaquarkhan/aws-serverless-datamesh-framework#readme
@@ -10,6 +10,7 @@ Project-URL: PyPI, https://pypi.org/project/serverless-data-mesh/
 Author: Serverless Data Mesh Contributors
 License-Expression: Apache-2.0
 License-File: LICENSE
+License-File: NOTICE
 Keywords: aws,bronze-silver-gold,data-as-a-product,data-mesh,domain-oriented,durable-execution,etl,federated-data-mesh,federated-governance,iceberg,iceguard,lakehouse,lambda,medallion,metadata-driven,pyiceberg,rule-engine,serverless,sparkrules,vaquar-pattern,veridata-recon
 Classifier: Development Status :: 5 - Production/Stable
 Classifier: Intended Audience :: Developers
@@ -62,6 +63,8 @@ An open Python framework for **domain-oriented**, **federated data mesh** teams
 
 Introduces the **[Vaquar Pattern](https://github.com/vaquarkhan/aws-serverless-datamesh-framework/blob/main/docs/vaquar-pattern.md)** (PVDM): Physical → Verify → Durable → Metadata. Invariant: `commit_metadata ⟹ VRP = PASS`.
 
+**Paper:** [arXiv:2608.14643](https://arxiv.org/abs/2608.14643) · **Reference gate:** [Proof-gated-publication-PVDM](https://github.com/vaquarkhan/Proof-gated-publication-PVDM)
+
 ## Install
 
 ```bash
@@ -83,7 +86,7 @@ pip install "serverless-data-mesh[dev]"     # pytest, ruff, pre-commit
 |---------|--------|
 | Silent data loss on backfill | VRP `FAIL` blocks Iceberg snapshot |
 | "Job succeeded" is not proof | Cryptographic multiset proof per chunk |
-| Lambda 15-minute limit | Durable Execution + Step Functions (90+ min) |
+| Lambda 15-minute limit | Durable + IceGuard (any total runtime); optional LMI segments up to 90 min async |
 | Retry duplicates data | IceGuard rollback + `workload_id` checkpoints |
 | Central ETL bottleneck | Per-domain Lambda writer + transaction boundary |
 | Federated blast radius | Producer · Steward · Publisher accounts |
@@ -136,6 +139,8 @@ outcome = coordinator.run_workload(workload)
 ## Documentation
 
 - [GitHub README](https://github.com/vaquarkhan/aws-serverless-datamesh-framework#readme)
+- [PVDM paper (arXiv:2608.14643)](https://arxiv.org/abs/2608.14643)
+- [PVDM reference gate](https://github.com/vaquarkhan/Proof-gated-publication-PVDM)
 - [Vaquar Pattern](https://github.com/vaquarkhan/aws-serverless-datamesh-framework/blob/main/docs/vaquar-pattern.md)
 - [Getting started](https://github.com/vaquarkhan/aws-serverless-datamesh-framework/blob/main/docs/getting-started.md)
 - [PyPI guide](https://github.com/vaquarkhan/aws-serverless-datamesh-framework/blob/main/docs/pypi.md)

{serverless_data_mesh-1.0.0 → serverless_data_mesh-1.3.0}/PYPI.md

@@ -10,6 +10,8 @@ An open Python framework for **domain-oriented**, **federated data mesh** teams
 
 Introduces the **[Vaquar Pattern](https://github.com/vaquarkhan/aws-serverless-datamesh-framework/blob/main/docs/vaquar-pattern.md)** (PVDM): Physical → Verify → Durable → Metadata. Invariant: `commit_metadata ⟹ VRP = PASS`.
 
+**Paper:** [arXiv:2608.14643](https://arxiv.org/abs/2608.14643) · **Reference gate:** [Proof-gated-publication-PVDM](https://github.com/vaquarkhan/Proof-gated-publication-PVDM)
+
 ## Install
 
 ```bash
@@ -31,7 +33,7 @@ pip install "serverless-data-mesh[dev]"     # pytest, ruff, pre-commit
 |---------|--------|
 | Silent data loss on backfill | VRP `FAIL` blocks Iceberg snapshot |
 | "Job succeeded" is not proof | Cryptographic multiset proof per chunk |
-| Lambda 15-minute limit | Durable Execution + Step Functions (90+ min) |
+| Lambda 15-minute limit | Durable + IceGuard (any total runtime); optional LMI segments up to 90 min async |
 | Retry duplicates data | IceGuard rollback + `workload_id` checkpoints |
 | Central ETL bottleneck | Per-domain Lambda writer + transaction boundary |
 | Federated blast radius | Producer · Steward · Publisher accounts |
@@ -84,6 +86,8 @@ outcome = coordinator.run_workload(workload)
 ## Documentation
 
 - [GitHub README](https://github.com/vaquarkhan/aws-serverless-datamesh-framework#readme)
+- [PVDM paper (arXiv:2608.14643)](https://arxiv.org/abs/2608.14643)
+- [PVDM reference gate](https://github.com/vaquarkhan/Proof-gated-publication-PVDM)
 - [Vaquar Pattern](https://github.com/vaquarkhan/aws-serverless-datamesh-framework/blob/main/docs/vaquar-pattern.md)
 - [Getting started](https://github.com/vaquarkhan/aws-serverless-datamesh-framework/blob/main/docs/getting-started.md)
 - [PyPI guide](https://github.com/vaquarkhan/aws-serverless-datamesh-framework/blob/main/docs/pypi.md)