fastflowtransform 0.6.2__tar.gz

fastflowtransform-0.6.2/.gitignore

@@ -0,0 +1,52 @@
+# Envs & Secrets
+.env.local
+.env.*.local
+secrets/
+
+# Local DBs / Artifacts
+*.duckdb
+/local/**
+.local/
+
+# Virtual Environments
+.venv/
+venv/
+
+# Python
+__pycache__/
+*.pyc
+*.pyo
+*.pyd
+*.egg-info/
+.build/
+.eggs/
+.uv-cache/
+.DS_Store
+
+# Tooling Caches
+.pytest_cache/
+.mypy_cache/
+.ruff_cache/
+.coverage*
+htmlcov/
+
+# Build Artifacts
+build/
+dist/
+**/site/dag/
+**/site/dag/**
+spark-warehouse
+metastore_db
+derby.log
+.fastflowtransform
+_exports/**
+
+# Editors / IDEs
+.vscode/
+.idea/
+
+# Docs Output
+examples/**/docs/
+tickets/**
+site/dag/**
+cache/**

fastflowtransform-0.6.2/PKG-INFO

@@ -0,0 +1,122 @@
+Metadata-Version: 2.4
+Name: fastflowtransform
+Version: 0.6.2
+Summary: Python framework for SQL & Python data transformation, ETL pipelines, and dbt-style data modeling
+Project-URL: Homepage, https://github.com/MirrorsAndMisdirections/FastFlowTransform
+Project-URL: Documentation, https://fastflowtransform.com
+Project-URL: Repository, https://github.com/MirrorsAndMisdirections/FastFlowTransform.git
+Project-URL: Source, https://github.com/MirrorsAndMisdirections/fastflowtransform
+Project-URL: Issues, https://github.com/MirrorsAndMisdirections/fastflowtransform/issues
+Author: Marko Lekic
+License: Apache-2.0
+Keywords: bigquery,data modeling,data transformation,dbt alternative,duckdb,etl,postgres,snowflake,spark,sql
+Classifier: Intended Audience :: Developers
+Classifier: License :: OSI Approved :: Apache Software License
+Classifier: Operating System :: OS Independent
+Classifier: Programming Language :: Python :: 3
+Classifier: Topic :: Database
+Classifier: Topic :: Scientific/Engineering :: Information Analysis
+Classifier: Topic :: Software Development :: Build Tools
+Classifier: Topic :: Software Development :: Libraries
+Requires-Python: >=3.12
+Requires-Dist: duckdb>=1.0
+Requires-Dist: httpx>=0.28.1
+Requires-Dist: jinja2>=3.1
+Requires-Dist: pandas>=2.0
+Requires-Dist: pydantic-settings>=2.4
+Requires-Dist: pydantic>=2.8
+Requires-Dist: python-dotenv>=1.0
+Requires-Dist: pyyaml>=6.0
+Requires-Dist: sqlalchemy>=2.0
+Requires-Dist: typer>=0.12
+Provides-Extra: bigquery
+Requires-Dist: google-cloud-bigquery>=3.25; extra == 'bigquery'
+Provides-Extra: bigquery-bf
+Requires-Dist: bigframes>=2.24.0; extra == 'bigquery-bf'
+Requires-Dist: google-cloud-bigquery>=3.25; extra == 'bigquery-bf'
+Provides-Extra: dev
+Requires-Dist: mypy==1.18.*; extra == 'dev'
+Requires-Dist: pandas-stubs>=2.1; extra == 'dev'
+Requires-Dist: pre-commit==3.*; extra == 'dev'
+Requires-Dist: pytest-cov==7.0.*; extra == 'dev'
+Requires-Dist: pytest-rerunfailures==14.0.*; extra == 'dev'
+Requires-Dist: pytest==8.4.*; extra == 'dev'
+Requires-Dist: ruff==0.14.*; extra == 'dev'
+Requires-Dist: types-pyyaml>=6.0.12; extra == 'dev'
+Provides-Extra: docs
+Requires-Dist: mkdocs-autorefs>=1.0; extra == 'docs'
+Requires-Dist: mkdocs-gen-files>=0.5; extra == 'docs'
+Requires-Dist: mkdocs-literate-nav>=0.6; extra == 'docs'
+Requires-Dist: mkdocs-material>=9.5; extra == 'docs'
+Requires-Dist: mkdocs-section-index>=0.3; extra == 'docs'
+Requires-Dist: mkdocs>=1.6; extra == 'docs'
+Requires-Dist: mkdocstrings[python]>=0.25; extra == 'docs'
+Requires-Dist: pymdown-extensions>=10.0; extra == 'docs'
+Provides-Extra: full
+Requires-Dist: bigframes>=2.24.0; extra == 'full'
+Requires-Dist: delta-spark>=4.0.0; extra == 'full'
+Requires-Dist: google-cloud-bigquery>=3.25; extra == 'full'
+Requires-Dist: psycopg2-binary>=2.9; extra == 'full'
+Requires-Dist: psycopg[binary]>=3.1; extra == 'full'
+Requires-Dist: pyspark>=4.0.1; extra == 'full'
+Requires-Dist: snowflake-connector-python>=4.0.0; extra == 'full'
+Requires-Dist: snowflake-snowpark-python>=1.40.0; extra == 'full'
+Provides-Extra: postgres
+Requires-Dist: psycopg2-binary>=2.9; extra == 'postgres'
+Requires-Dist: psycopg[binary]>=3.1; extra == 'postgres'
+Provides-Extra: snowflake
+Requires-Dist: snowflake-connector-python>=4.0.0; extra == 'snowflake'
+Requires-Dist: snowflake-snowpark-python>=1.40.0; extra == 'snowflake'
+Provides-Extra: spark
+Requires-Dist: delta-spark>=4.0.0; extra == 'spark'
+Requires-Dist: pyspark>=4.0.1; extra == 'spark'
+Description-Content-Type: text/markdown
+
+# FastFlowTransform
+
+[![CI](https://github.com/MirrorsAndMisdirections/FastFlowTransform/actions/workflows/ci.yml/badge.svg)](https://github.com/MirrorsAndMisdirections/FastFlowTransform/actions/workflows/ci.yml)
+[![PyPI version](https://img.shields.io/pypi/v/fastflowtransform.svg)](https://pypi.org/project/fastflowtransform/)
+
+FastFlowTransform (FFT) is a SQL + Python data modeling engine with a deterministic DAG, level-wise parallelism, optional caching, incremental builds, auto-docs, and built-in data-quality tests. Projects are plain directories containing models, seeds, and YAML config; the `fft` CLI handles compilation, execution, docs, and validation across multiple execution engines.
+
+## Highlights
+- SQL or Python models (`*.ff.sql` / `*.ff.py`) wired with `ref()` / `source()` / `deps=[...]`.
+- Executors for DuckDB, Postgres, BigQuery (pandas + BigFrames), Databricks/Spark, and Snowflake Snowpark.
+- Level-wise parallel scheduler with cache fingerprints, rebuild flags, and state/result selectors.
+- Incremental and materialized models with engine-specific merge/append hooks.
+- Tests everywhere: schema/YAML checks, reconciliation rules, and fast model unit tests (`fft utest`).
+- Docs on demand: `fft dag --html` and `fft docgen` generate a browsable site plus JSON artifacts; optional `sync-db-comments` to push descriptions to Postgres/Snowflake.
+- HTTP helpers for Python models (`fastflowtransform.api.http`) and Jinja macros/config for templating.
+
+## Requirements
+- Python 3.12+
+- Engine extras installed only as needed (e.g. BigQuery, Snowflake, Spark/Delta, Postgres drivers). The core DuckDB path works out of the box.
+
+## Install & Quickstart
+- Pick the engine extras you need (combine as `pkg[a,b]`):
+  - DuckDB/core: `pip install fastflowtransform`
+  - Postgres: `pip install fastflowtransform[postgres]`
+  - BigQuery (pandas): `pip install fastflowtransform[bigquery]`
+  - BigQuery (BigFrames): `pip install fastflowtransform[bigquery_bf]`
+  - Databricks/Spark + Delta: `pip install fastflowtransform[spark]`
+  - Snowflake Snowpark: `pip install fastflowtransform[snowflake]`
+  - Everything: `pip install fastflowtransform[full]`
+- Installation and first run: see `docs/Quickstart.md` (venv + editable install, DuckDB demo, and init walkthrough).
+- CLI usage and flags: see `docs/CLI_Guide.md`.
+- Makefile shortcut: `make demo` runs the simple DuckDB example end-to-end and opens the DAG (`examples/simple_duckdb`).
+
+## Docs & examples
+- Docs hub: `docs/index.md` or https://fastflowtransform.com.
+- Operational guide & architecture: `docs/Technical_Overview.md`.
+- Modeling reference & macros: `docs/Config_and_Macros.md`.
+- Parallelism, cache, and state selection: `docs/Cache_and_Parallelism.md`, `docs/State_Selection.md`.
+- Incremental models: `docs/Incremental.md`.
+- Data-quality + YAML tests: `docs/Data_Quality_Tests.md`, `docs/YAML_Tests.md`, `docs/Unit_Tests.md`.
+- CLI details and troubleshooting: `docs/CLI_Guide.md`, `docs/Troubleshooting.md`.
+- Runnable demos live under `examples/` (basic, materializations, incremental, DQ, macros, cache, env matrix, API, events).
+
+## Contributing
+Issues and PRs are welcome. See `Contributing.md` for development setup, testing (`make demo`, `uv run pytest`, `fft utest`), and code-style guidelines.
+
+## License
+Apache 2.0 — see `License.md`.

fastflowtransform-0.6.2/README.md

@@ -0,0 +1,48 @@
+# FastFlowTransform
+
+[![CI](https://github.com/MirrorsAndMisdirections/FastFlowTransform/actions/workflows/ci.yml/badge.svg)](https://github.com/MirrorsAndMisdirections/FastFlowTransform/actions/workflows/ci.yml)
+[![PyPI version](https://img.shields.io/pypi/v/fastflowtransform.svg)](https://pypi.org/project/fastflowtransform/)
+
+FastFlowTransform (FFT) is a SQL + Python data modeling engine with a deterministic DAG, level-wise parallelism, optional caching, incremental builds, auto-docs, and built-in data-quality tests. Projects are plain directories containing models, seeds, and YAML config; the `fft` CLI handles compilation, execution, docs, and validation across multiple execution engines.
+
+## Highlights
+- SQL or Python models (`*.ff.sql` / `*.ff.py`) wired with `ref()` / `source()` / `deps=[...]`.
+- Executors for DuckDB, Postgres, BigQuery (pandas + BigFrames), Databricks/Spark, and Snowflake Snowpark.
+- Level-wise parallel scheduler with cache fingerprints, rebuild flags, and state/result selectors.
+- Incremental and materialized models with engine-specific merge/append hooks.
+- Tests everywhere: schema/YAML checks, reconciliation rules, and fast model unit tests (`fft utest`).
+- Docs on demand: `fft dag --html` and `fft docgen` generate a browsable site plus JSON artifacts; optional `sync-db-comments` to push descriptions to Postgres/Snowflake.
+- HTTP helpers for Python models (`fastflowtransform.api.http`) and Jinja macros/config for templating.
+
+## Requirements
+- Python 3.12+
+- Engine extras installed only as needed (e.g. BigQuery, Snowflake, Spark/Delta, Postgres drivers). The core DuckDB path works out of the box.
+
+## Install & Quickstart
+- Pick the engine extras you need (combine as `pkg[a,b]`):
+  - DuckDB/core: `pip install fastflowtransform`
+  - Postgres: `pip install fastflowtransform[postgres]`
+  - BigQuery (pandas): `pip install fastflowtransform[bigquery]`
+  - BigQuery (BigFrames): `pip install fastflowtransform[bigquery_bf]`
+  - Databricks/Spark + Delta: `pip install fastflowtransform[spark]`
+  - Snowflake Snowpark: `pip install fastflowtransform[snowflake]`
+  - Everything: `pip install fastflowtransform[full]`
+- Installation and first run: see `docs/Quickstart.md` (venv + editable install, DuckDB demo, and init walkthrough).
+- CLI usage and flags: see `docs/CLI_Guide.md`.
+- Makefile shortcut: `make demo` runs the simple DuckDB example end-to-end and opens the DAG (`examples/simple_duckdb`).
+
+## Docs & examples
+- Docs hub: `docs/index.md` or https://fastflowtransform.com.
+- Operational guide & architecture: `docs/Technical_Overview.md`.
+- Modeling reference & macros: `docs/Config_and_Macros.md`.
+- Parallelism, cache, and state selection: `docs/Cache_and_Parallelism.md`, `docs/State_Selection.md`.
+- Incremental models: `docs/Incremental.md`.
+- Data-quality + YAML tests: `docs/Data_Quality_Tests.md`, `docs/YAML_Tests.md`, `docs/Unit_Tests.md`.
+- CLI details and troubleshooting: `docs/CLI_Guide.md`, `docs/Troubleshooting.md`.
+- Runnable demos live under `examples/` (basic, materializations, incremental, DQ, macros, cache, env matrix, API, events).
+
+## Contributing
+Issues and PRs are welcome. See `Contributing.md` for development setup, testing (`make demo`, `uv run pytest`, `fft utest`), and code-style guidelines.
+
+## License
+Apache 2.0 — see `License.md`.

fastflowtransform-0.6.2/examples/basic_demo/README.md

@@ -0,0 +1,8 @@
+# Basic demo
+
+Minimal FFT pipeline that runs unchanged on DuckDB, Postgres, Databricks Spark, BigQuery, and Snowflake (Snowpark).
+
+## How to use
+- See the full walkthrough (env setup, Makefile targets, engine notes, DQ tests) in `docs/examples/Basic_Demo.md`.
+- From this directory: set the desired `.env.dev_*` (for BigQuery choose `.env.dev_bigquery_pandas` or `.env.dev_bigquery_bigframes`), then run `make demo ENGINE=<duckdb|postgres|databricks_spark|bigquery|snowflake_snowpark>` (set `BQ_FRAME` to switch BigQuery client) to seed → run → dag → test.
+- To inspect results, open `site/dag/index.html` after a run or query the mart tables via your engine client.

fastflowtransform-0.6.2/examples/basic_demo/models/README.md

@@ -0,0 +1,8 @@
+# Models directory
+
+This demo ships with:
+- `staging/users_clean.ff.sql` – normalizes the seeded users table.
+- `marts/mart_users_by_domain.ff.sql` – aggregates signups per email domain.
+- `engines/*/mart_latest_signup.ff.py` – engine-scoped Python models (pandas for DuckDB/Postgres, PySpark for Databricks) that select the most recent signup per domain using the staging view as input.
+
+Add further SQL (`*.ff.sql`) or Python (`*.ff.py`) models alongside them to grow the pipeline.

fastflowtransform-0.6.2/examples/basic_demo/seeds/README.md

@@ -0,0 +1,3 @@
+# Seeds directory
+
+`seed_users.csv` ships with the demo and feeds the staging model. Extend or replace it with your own CSV or Parquet files when experimenting.

fastflowtransform-0.6.2/examples/basic_demo/tests/unit/README.md

@@ -0,0 +1,4 @@
+# Unit tests
+
+Define YAML unit specs as described in docs/Config_and_Macros.md#73-model-unit-tests-fft-utest.
+Invoke them with `fft utest <project> --env <profile>`.

fastflowtransform-0.6.2/examples/cache_demo/README.md

@@ -0,0 +1,56 @@
+# Cache Demo
+
+This demo shows:
+- Build cache skip/hit via fingerprints
+- Downstream invalidation (seed → staging → mart)
+- Environment-driven invalidation (only `FF_*`)
+- Parallelism within levels (`--jobs`)
+- HTTP response cache + offline mode
+
+## Quickstart
+
+```bash
+# pick your engine (duckdb, postgres, databricks_spark, bigquery, or snowflake_snowpark); defaults to duckdb
+cp .env.dev_duckdb .env
+# or: cp .env.dev_postgres .env  (then edit DSN/schema)
+# or: cp .env.dev_databricks .env
+# or: cp .env.dev_bigquery_pandas .env   # or .env.dev_bigquery_bigframes
+# or: cp .env.dev_snowflake .env
+
+cd examples/cache_demo
+make cache_first      ENGINE=duckdb   # builds and writes cache
+make cache_second     ENGINE=duckdb   # should SKIP everything
+make change_sql       ENGINE=duckdb   # touch SQL → mart rebuilds
+make change_seed      ENGINE=duckdb   # seed with base + patches/seed_users_patch.csv (no tracked edits)
+make change_env       ENGINE=duckdb   # FF_* env change → full rebuild
+make change_py        ENGINE=duckdb   # edit constant in py_constants.ff.py → it rebuilds
+
+make http_first       ENGINE=duckdb   # warms HTTP cache
+make http_offline     ENGINE=duckdb   # reuses HTTP cache without network
+make http_cache_clear                  # clears HTTP response cache
+#
+# Seeds stay immutable: change_seed builds a temporary combined copy in .local/seeds using
+# patches/seed_users_patch.csv so the repo doesn’t become dirty.
+Inspect:
+
+site/dag/index.html
+
+.fastflowtransform/target/run_results.json (HTTP stats, results)
+
+markdown
+Code kopieren
+
+---
+
+To run everything on Postgres, set `ENGINE=postgres` and copy/edit `.env.dev_postgres`, e.g. `make demo ENGINE=postgres`.
+To run on Databricks/Spark locally, set `ENGINE=databricks_spark` and copy/edit `.env.dev_databricks`, e.g. `make demo ENGINE=databricks_spark`.
+To run on BigQuery, set `ENGINE=bigquery` and copy/edit `.env.dev_bigquery_pandas` (or `.env.dev_bigquery_bigframes`), e.g. `make demo ENGINE=bigquery BQ_FRAME=bigframes` (default) or `BQ_FRAME=pandas`.
+To run on Snowflake Snowpark, install `fastflowtransform[snowflake]`, set `ENGINE=snowflake_snowpark`, copy/edit `.env.dev_snowflake`, and run e.g. `make demo ENGINE=snowflake_snowpark`.
+
+## What this demo proves (in a minute)
+
+- **Cache hit/skip:** `make cache_second` should skip everything (if nothing changed).
+- **Upstream invalidation:** `make change_seed` rebuilds staging **and** the mart.
+- **Env invalidation:** `make change_env` (because `FF_*` is part of the fingerprint).
+- **Python source sensitivity:** `py_constants` rebuilds only when its code changes.
+- **HTTP cache:** `http_first` fetches; `http_offline` runs fully offline using cached responses.

fastflowtransform-0.6.2/examples/cache_demo/models/README.md

@@ -0,0 +1,4 @@
+# Models directory
+
+Place SQL (`*.ff.sql`) and Python (`*.ff.py`) models here.
+See docs/Config_and_Macros.md for modeling guidance and config options.

fastflowtransform-0.6.2/examples/cache_demo/seeds/README.md

@@ -0,0 +1,4 @@
+# Seeds directory
+
+Add CSV or Parquet files for reproducible seeds.
+Usage examples are covered in docs/Quickstart.md and docs/Config_and_Macros.md#13-seeds-sources-and-dependencies.

fastflowtransform-0.6.2/examples/cache_demo/tests/unit/README.md

@@ -0,0 +1,4 @@
+# Unit tests
+
+Define YAML unit specs as described in docs/Config_and_Macros.md#73-model-unit-tests-fft-utest.
+Invoke them with `fft utest <project> --env <profile>`.

fastflowtransform-0.6.2/examples/dq_demo/README.md

@@ -0,0 +1,27 @@
+# Data Quality Demo
+
+Run the complete DQ demo (seeds → models → DAG → tests) on DuckDB, Postgres, Databricks Spark, BigQuery (pandas or BigFrames), or Snowflake Snowpark.
+
+## Quickstart
+From this directory:
+
+1) Pick an engine and copy the matching `.env.dev_*` to `.env` (edit project/dataset if needed):
+   - DuckDB: `.env.dev_duckdb`
+   - Postgres: `.env.dev_postgres`
+   - Databricks Spark: `.env.dev_databricks`
+   - BigQuery (pandas): `.env.dev_bigquery_pandas`
+   - BigQuery (BigFrames): `.env.dev_bigquery_bigframes`
+   - Snowflake Snowpark: `.env.dev_snowflake`
+
+2) Run the demo (set `BQ_FRAME` when using BigQuery):
+   ```sh
+   make demo ENGINE=duckdb
+   make demo ENGINE=postgres
+   make demo ENGINE=databricks_spark
+   make demo ENGINE=bigquery BQ_FRAME=pandas      # or bigframes
+   make demo ENGINE=snowflake_snowpark            # install fastflowtransform[snowflake]
+   ```
+
+Artifacts:
+- Target metadata: `.fastflowtransform/target/{manifest.json,run_results.json,catalog.xml}`
+- DAG HTML: `site/dag/index.html`

fastflowtransform-0.6.2/examples/dq_demo/models/README.md

@@ -0,0 +1,4 @@
+# Models directory
+
+Place SQL (`*.ff.sql`) and Python (`*.ff.py`) models here.
+See docs/Config_and_Macros.md for modeling guidance and config options.

fastflowtransform-0.6.2/examples/dq_demo/seeds/README.md

@@ -0,0 +1,4 @@
+# Seeds directory
+
+Add CSV or Parquet files for reproducible seeds.
+Usage examples are covered in docs/Quickstart.md and docs/Config_and_Macros.md#13-seeds-sources-and-dependencies.

fastflowtransform-0.6.2/examples/dq_demo/tests/unit/README.md

@@ -0,0 +1,4 @@
+# Unit tests
+
+Define YAML unit specs as described in docs/Config_and_Macros.md#73-model-unit-tests-fft-utest.
+Invoke them with `fft utest <project> --env <profile>`.

fastflowtransform-0.6.2/examples/incremental_demo/README.md

@@ -0,0 +1,10 @@
+# Incremental demo
+
+Small FFT example that showcases incremental models and Delta/Iceberg-style merges
+across DuckDB, Postgres, Databricks Spark, BigQuery (pandas or BigFrames), and Snowflake Snowpark.
+
+## How to use
+- Fill an `.env.dev_*` for your engine (DuckDB/Postgres/Databricks/BigQuery/Snowflake). For BigQuery use `.env.dev_bigquery_pandas` or `.env.dev_bigquery_bigframes`; for Snowflake use `.env.dev_snowflake`.
+- From this directory run `make demo ENGINE=<duckdb|postgres|databricks_spark|bigquery|snowflake_snowpark>` (set `BQ_FRAME` for BigQuery, `DBR_TABLE_FORMAT` for Spark).
+- Artifacts: DAG HTML in `site/dag/index.html`, FFT metadata in `.fastflowtransform/target/`.
+- See `docs/examples/Incremental_Demo.md` for a full walkthrough of the models and incremental configs.

fastflowtransform-0.6.2/examples/incremental_demo/models/README.md

@@ -0,0 +1,4 @@
+# Models directory
+
+Place SQL (`*.ff.sql`) and Python (`*.ff.py`) models here.
+See docs/Config_and_Macros.md for modeling guidance and config options.

fastflowtransform-0.6.2/examples/incremental_demo/seeds/README.md

@@ -0,0 +1,4 @@
+# Seeds directory
+
+Add CSV or Parquet files for reproducible seeds.
+Usage examples are covered in docs/Quickstart.md and docs/Config_and_Macros.md#13-seeds-sources-and-dependencies.

fastflowtransform-0.6.2/examples/incremental_demo/tests/unit/README.md

@@ -0,0 +1,4 @@
+# Unit tests
+
+Define YAML unit specs as described in docs/Config_and_Macros.md#73-model-unit-tests-fft-utest.
+Invoke them with `fft utest <project> --env <profile>`.

fastflowtransform-0.6.2/examples/macros_demo/README.md

@@ -0,0 +1,12 @@
+# Macros demo
+
+FastFlowTransform example that highlights SQL & Python macros. See `docs/examples/Macros_Demo.md`
+for a full walkthrough.
+
+## Engines
+
+- DuckDB/Postgres/Databricks Spark are pre-wired. Run `make demo ENGINE=duckdb|postgres|databricks_spark`.
+- BigQuery (pandas or BigFrames) mirrors the basic demo setup. Set `ENGINE=bigquery` and optionally
+  `BQ_FRAME=pandas|bigframes` (default `bigframes`), then run `make demo ENGINE=bigquery BQ_FRAME=<frame>`.
+- Snowflake Snowpark is available via `ENGINE=snowflake_snowpark`. Copy `.env.dev_snowflake` and install
+  `fastflowtransform[snowflake]` before running `make demo ENGINE=snowflake_snowpark`.

fastflowtransform-0.6.2/examples/macros_demo/models/README.md

@@ -0,0 +1,4 @@
+# Models directory
+
+Place SQL (`*.ff.sql`) and Python (`*.ff.py`) models here.
+See docs/Config_and_Macros.md for modeling guidance and config options.

fastflowtransform-0.6.2/examples/macros_demo/seeds/README.md

@@ -0,0 +1,4 @@
+# Seeds directory
+
+Add CSV or Parquet files for reproducible seeds.
+Usage examples are covered in docs/Quickstart.md and docs/Config_and_Macros.md#13-seeds-sources-and-dependencies.

fastflowtransform-0.6.2/examples/macros_demo/tests/unit/README.md

@@ -0,0 +1,4 @@
+# Unit tests
+
+Define YAML unit specs as described in docs/Config_and_Macros.md#73-model-unit-tests-fft-utest.
+Invoke them with `fft utest <project> --env <profile>`.

fastflowtransform-0.6.2/examples/materializations_demo/README.md

@@ -0,0 +1,12 @@
+# Materializations demo
+
+FastFlowTransform example highlighting materialized views/tables, incremental models, and Python emitters.
+See `docs/examples/Materializations_Demo.md` for a full walkthrough.
+
+## Engines
+
+- DuckDB/Postgres/Databricks Spark are wired via the Makefile: `make demo ENGINE=duckdb|postgres|databricks_spark`.
+- BigQuery supports both pandas and BigFrames clients. Copy `.env.dev_bigquery_pandas` (or `_bigframes`),
+  set `GOOGLE_APPLICATION_CREDENTIALS`, and run `make demo ENGINE=bigquery BQ_FRAME=pandas|bigframes`.
+- Snowflake Snowpark mirrors the basic demo setup. Copy `.env.dev_snowflake`, install `fastflowtransform[snowflake]`,
+  then run `make demo ENGINE=snowflake_snowpark`.

fastflowtransform-0.6.2/examples/materializations_demo/models/README.md

@@ -0,0 +1,4 @@
+# Models directory
+
+Place SQL (`*.ff.sql`) and Python (`*.ff.py`) models here.
+See docs/Config_and_Macros.md for modeling guidance and config options.

fastflowtransform-0.6.2/examples/materializations_demo/seeds/README.md

@@ -0,0 +1,4 @@
+# Seeds directory
+
+Add CSV or Parquet files for reproducible seeds.
+Usage examples are covered in docs/Quickstart.md and docs/Config_and_Macros.md#13-seeds-sources-and-dependencies.

fastflowtransform-0.6.2/examples/materializations_demo/tests/unit/README.md

@@ -0,0 +1,4 @@
+# Unit tests
+
+Define YAML unit specs as described in docs/Config_and_Macros.md#73-model-unit-tests-fft-utest.
+Invoke them with `fft utest <project> --env <profile>`.