floe-python 0.10.0__tar.gz → 0.10.1__tar.gz

{floe_python-0.10.0 → floe_python-0.10.1}/CHANGELOG.md

@@ -2,6 +2,14 @@
 
 All notable changes to Floe are documented in this file.
 
+## Unreleased
+
+- dagster-floe logs a finished run's Floe output as one Dagster log message, a line per Floe event, instead of one message per line (#1210). Each message is an event-log write: a 25-entity domain step wrote about 100 fewer events.
+
+## v0.10.1
+
+- An included domain file may set `entities`, a glob relative to the domain file, to load its entity files from another folder (#1213): `entities: "contracts/*.yml"` lets `silver/<domain>/domain.yml` keep its entities in `silver/<domain>/contracts/`. Without the key the domain loads its sibling `*.yml` files as before. A glob that matches no file is an error, and the domain file is never loaded as one of its own entities. `schemas/domains.schema.yaml` accepts the key.
+
 ## v0.10.0
 
 Floe 0.10 accepts configs with `version:` up to `"0.10"` and generates manifests with `spec_version: "0.10"`; use
@@ -223,12 +231,20 @@ dagster-floe 0.5 or airflow-floe 0.3 with it.
   instead of spilling. It now caps memory at 4GB and spills to a temporary directory (at most
   50GB, removed afterwards). Size pods at 6 GiB or more (see `docs/write_modes.md`).
 
-## Unreleased
+## dagster-floe v0.6.0
 
-### airflow-floe
+Use it with Floe 0.10.
 
-- **A `kubernetes_job` runner `args` override no longer drops the entity selection (#1031)**, as in
-  dagster-floe: `args` now prefix Floe's rendered arguments instead of replacing them.
+- **Accepts Floe 0.10 manifests.** `spec_version` `0.8`, `0.9` and `0.10` load; the `floe` extra now installs
+  `floe-python>=0.10,<0.11`. The manifest schema it validates against gains the optional `report_formatter` and per-entity
+  `description` and `tag_list`, and drops `width`, `trim` and `incremental_mode: row` (Floe 0.10 no longer accepts them),
+  so a 0.8 or 0.9 manifest that still carries them is now refused.
+- **Asset metadata carries the run's timings, rejected output and failure evidence (#1157).** The accepted asset adds the report's
+  `timings_ms` as `floe/timings/<phase>_ms`; both assets add `entity_report_uri`, and the rejected asset adds
+  `floe/rejected_format` and `floe/rejected_uri`. A failed step also reports `floe/failure_report_uri`, `floe/error_type`,
+  `floe/error_code` and `floe/entity_states` from `run.failure.json`, or `floe/failure_evidence: unavailable: <reason>`.
+  Older reports without these keys add nothing.
+- The package is now classified `Development Status :: 4 - Beta` on PyPI (it was Production/Stable) and is linted and type-checked in CI (#1186).
 
 ## dagster-floe v0.5.0
 
@@ -499,10 +515,20 @@ supported. Floe 0.7 and earlier manifests are rejected.
   path-style addressing, matching Floe core (#448). Without these variables behaviour is
   unchanged. Requires the existing `remote` extra.
 
+## airflow-floe v0.4.0
+
+Use it with Floe 0.10; it still loads 0.8 and 0.9 manifests.
+
+- **Accepts Floe 0.10 manifests.** `spec_version` `0.8`, `0.9` and `0.10` load.
+- **Honours `execution.orchestration`, `job_scope`, `domain_resources` and the resource limits like dagster-floe (#1009, #1200).** The example DAG gets one task per entity (one per domain with `job_scope: domain`, sized by `domain_resources`) and `max_active_tasks` from the orchestration block, through the new `plan_floe_tasks` and `build_floe_tasks` helpers; a DAG built on the old example must be updated to use them. **Breaking:** a `kubernetes_job` pod's limits now come only from `cpu_limit` and `memory_limit_mb`; they no longer copy `cpu` and `memory_mb`, so a manifest that relied on that has no limits until you set them.
+- airflow-floe is a supported connector (Beta) and is linted and type-checked in CI (#1191, #1192).
+
 ## airflow-floe v0.3.0
 
 - **Accepts Floe 0.9 manifests.** `spec_version` `0.8` and `0.9` load. Pod options a Floe 0.9 profile passes
   through on a `kubernetes_job` runner are ignored, as before.
+- **A `kubernetes_job` runner `args` override no longer drops the entity selection (#1031)**, as in
+  dagster-floe: `args` now prefix Floe's rendered arguments instead of replacing them.
 
 ## airflow-floe v0.2.0
 

{floe_python-0.10.0 → floe_python-0.10.1}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.5
 Name: floe-python
-Version: 0.10.0
+Version: 0.10.1
 Summary: Floe: a data-contract runtime for file ingestion
 License-File: LICENSE
 Requires-Python: >=3.11

floe_python-0.10.1/conformance/config/parse_include_entities_glob_no_match/config.yml

@@ -0,0 +1,4 @@
+version: '0.3'
+include:
+  domains:
+  - silver/*/domain.yml

floe_python-0.10.1/conformance/config/parse_include_entities_glob_no_match/expected/validate.json

@@ -0,0 +1,4 @@
+{
+  "ok": false,
+  "error": "<ROOT>/silver/sales/domain.yml: domains.entities pattern 'contracts/*.yml' matched no file"
+}

floe_python-0.10.1/conformance/config/parse_include_entities_glob_no_match/silver/sales/domain.yml

@@ -0,0 +1,2 @@
+name: sales
+entities: contracts/*.yml

floe_python-0.10.1/conformance/config/parse_include_entities_glob_ok/config.yml

@@ -0,0 +1,4 @@
+version: '0.3'
+include:
+  domains:
+  - silver/*/domain.yml

floe_python-0.10.1/conformance/config/parse_include_entities_glob_ok/expected/manifest.json

@@ -0,0 +1,217 @@
+{
+  "generated_at_ts_ms": 0,
+  "floe_version": "<volatile>",
+  "spec_version": "<volatile>",
+  "manifest_id": "<volatile>",
+  "manifest_revision": "<volatile>",
+  "runtime_env": "cli",
+  "config_uri": "local://<ROOT>/work/config.yml",
+  "config_checksum": "sha256:909604f798da7b598eb1bcc0fab4bdac811d7c1776f31c920b8f24e22df51473",
+  "config_files": [
+    {
+      "path": "config.yml",
+      "sha256": "933fd8429f4902c8f6497ca79d37d4c7fbebaada443ebd7f158fc421c7c09b54"
+    },
+    {
+      "path": "silver/sales/contracts/customers.yml",
+      "sha256": "eb5f0bc6f106cff2a0b13d632a185ec41b6cd53990f7116c18790ca27e35ff4c"
+    },
+    {
+      "path": "silver/sales/contracts/orders.yml",
+      "sha256": "cada4e78845945f839db84f3a388686c6784e2cc943377d6bff0faccce937622"
+    },
+    {
+      "path": "silver/sales/domain.yml",
+      "sha256": "a35be99100e20ac6cee64af64ddbabd3b4776a4d674cf6ea4789894cf4594512"
+    }
+  ],
+  "report_base_uri": "local://<ROOT>/work/report",
+  "domains": [
+    {
+      "name": "sales"
+    }
+  ],
+  "execution": {
+    "entrypoint": "floe",
+    "base_args": [
+      "run",
+      "--manifest",
+      "{manifest_uri}",
+      "--log-format",
+      "json",
+      "--quiet"
+    ],
+    "per_entity_args": [
+      "--entities",
+      "{entity_name}"
+    ],
+    "log_format": "json",
+    "result_contract": {
+      "run_finished_event": true,
+      "summary_uri_field": "summary_uri",
+      "exit_codes": {
+        "0": "success_or_rejected",
+        "1": "technical_failure",
+        "2": "aborted"
+      }
+    },
+    "defaults": {
+      "env": {},
+      "workdir": null
+    }
+  },
+  "runners": {
+    "default": "local",
+    "definitions": {
+      "local": {
+        "type": "local_process",
+        "command": null,
+        "args": null,
+        "timeout_seconds": null,
+        "ttl_seconds_after_finished": null,
+        "poll_interval_seconds": null,
+        "secrets": null,
+        "image": null,
+        "namespace": null,
+        "service_account": null,
+        "resources": null,
+        "env": null,
+        "workspace_url": null,
+        "existing_cluster_id": null,
+        "config_uri": null,
+        "python_file_uri": null,
+        "job_name": null,
+        "auth": null,
+        "env_parameters": null
+      }
+    }
+  },
+  "entities": [
+    {
+      "name": "sales.customers",
+      "domain": "sales",
+      "group_name": "sales",
+      "asset_key": [
+        "sales",
+        "customers"
+      ],
+      "source_format": "csv",
+      "accepted_sink_uri": "local://<ROOT>/work/out/accepted/customers",
+      "rejected_sink_uri": null,
+      "tags": null,
+      "source": {
+        "format": "csv",
+        "storage": "local",
+        "uri": "local://<ROOT>/work/in/customers.csv",
+        "path": "in/customers.csv",
+        "resolved": true,
+        "cast_mode": "strict",
+        "options": {
+          "data_row": null,
+          "encoding": "UTF8",
+          "glob": null,
+          "header": true,
+          "header_row": 1,
+          "json_mode": null,
+          "namespace": null,
+          "null_values": [
+            ""
+          ],
+          "recursive": false,
+          "row_tag": null,
+          "separator": ";",
+          "sheet": null,
+          "value_tag": null
+        }
+      },
+      "sinks": {
+        "accepted": {
+          "format": "parquet",
+          "storage": "local",
+          "uri": "local://<ROOT>/work/out/accepted/customers",
+          "path": "out/accepted/customers",
+          "resolved": true
+        },
+        "rejected": null,
+        "archive": null
+      },
+      "runner": null,
+      "policy_severity": "warn",
+      "write_mode": "overwrite",
+      "incremental_mode": "none",
+      "schema": {
+        "columns": [
+          {
+            "name": "id",
+            "column_type": "string"
+          }
+        ],
+        "primary_key": [],
+        "unique_keys": []
+      }
+    },
+    {
+      "name": "sales.orders",
+      "domain": "sales",
+      "group_name": "sales",
+      "asset_key": [
+        "sales",
+        "orders"
+      ],
+      "source_format": "csv",
+      "accepted_sink_uri": "local://<ROOT>/work/out/accepted/orders",
+      "rejected_sink_uri": null,
+      "tags": null,
+      "source": {
+        "format": "csv",
+        "storage": "local",
+        "uri": "local://<ROOT>/work/in/orders.csv",
+        "path": "in/orders.csv",
+        "resolved": true,
+        "cast_mode": "strict",
+        "options": {
+          "data_row": null,
+          "encoding": "UTF8",
+          "glob": null,
+          "header": true,
+          "header_row": 1,
+          "json_mode": null,
+          "namespace": null,
+          "null_values": [
+            ""
+          ],
+          "recursive": false,
+          "row_tag": null,
+          "separator": ";",
+          "sheet": null,
+          "value_tag": null
+        }
+      },
+      "sinks": {
+        "accepted": {
+          "format": "parquet",
+          "storage": "local",
+          "uri": "local://<ROOT>/work/out/accepted/orders",
+          "path": "out/accepted/orders",
+          "resolved": true
+        },
+        "rejected": null,
+        "archive": null
+      },
+      "runner": null,
+      "policy_severity": "warn",
+      "write_mode": "overwrite",
+      "incremental_mode": "none",
+      "schema": {
+        "columns": [
+          {
+            "name": "id",
+            "column_type": "string"
+          }
+        ],
+        "primary_key": [],
+        "unique_keys": []
+      }
+    }
+  ]
+}

floe_python-0.10.1/conformance/config/parse_include_entities_glob_ok/silver/sales/contracts/customers.yml

@@ -0,0 +1,15 @@
+name: customers
+domain: sales
+source:
+  format: csv
+  path: in/customers.csv
+sink:
+  accepted:
+    format: parquet
+    path: out/accepted/customers
+policy:
+  severity: warn
+schema:
+  columns:
+    - name: id
+      type: string

floe_python-0.10.1/conformance/config/parse_include_entities_glob_ok/silver/sales/contracts/orders.yml

@@ -0,0 +1,14 @@
+name: orders
+source:
+  format: csv
+  path: in/orders.csv
+sink:
+  accepted:
+    format: parquet
+    path: out/accepted/orders
+policy:
+  severity: warn
+schema:
+  columns:
+    - name: id
+      type: string

floe_python-0.10.1/conformance/config/parse_include_entities_glob_ok/silver/sales/domain.yml

@@ -0,0 +1,2 @@
+name: sales
+entities: contracts/*.yml

floe_python-0.10.1/conformance/config/val2_uk_ok/expected/validate.json

@@ -0,0 +1,3 @@
+{
+  "ok": true
+}

{floe_python-0.10.0 → floe_python-0.10.1}/docs/config.md

@@ -156,7 +156,12 @@ entities:
     domain. An entity file may omit `domain`; if set, it must match the domain
     file's `name`. Included domains and entities are appended after the inline
     `domains` and `entities`, so `entities` may be omitted.
-  - A pattern that matches no file is an error. Includes resolve against local
+  - A domain file may set `entities`, a glob relative to the domain file (e.g.
+    `entities: "contracts/*.yml"`). Its matches replace the sibling files as the
+    domain's entity files; the domain file itself is never loaded as an entity.
+    Only an included domain file may set it.
+  - A pattern that matches no file is an error, in `include.domains` and in a
+    domain file's `entities`. Includes resolve against local
     files only, so a remote (`s3://`, ...) config cannot use them.
 - `entities` (required)
   - Array of entity definitions (datasets). A single CLI run may process

{floe_python-0.10.0 → floe_python-0.10.1}/docs/projects.md

@@ -194,6 +194,21 @@ schema:
       type: string
 ```
 
+To keep a domain's entity files in their own folder, set `entities` in the
+domain file to a glob relative to that file. Its matches replace the sibling
+files, and a glob that matches no file is an error:
+
+```text
+silver/sales/
+├── domain.yml          # name: sales
+│                       # entities: "contracts/*.yml"
+└── contracts/
+    ├── orders.yml
+    └── customers.yml
+```
+
+The root config then includes `"silver/*/domain.yml"` under `include.domains`.
+
 Paths in included files are still relative to the root `config.yml`. Included
 domains and entity files are loaded along with the root config, so one command
 validates or runs the whole project:
@@ -205,7 +220,8 @@ floe run -c config.yml
 ```
 
 To add an entity to an included domain, `floe add-entity` can infer its schema
-from a sample file and write the entity beside that domain's other entities.
+from a sample file and write the entity beside that domain's other entities
+(it refuses a domain that sets `entities`).
 Use a sample file that exists, and set the resource to the filename stem used
 by the named source:
 

{floe_python-0.10.0 → floe_python-0.10.1}/orchestrators/airflow-floe/README.md

@@ -15,6 +15,7 @@ airflow-floe is a supported Floe connector (Beta), linted and type-checked in CI
 
 | airflow-floe | Floe |
 | --- | --- |
+| 0.4.x | 0.8, 0.9 or 0.10 (`pip install floe-python`, or the `ghcr.io/openlakeforge/floe` image) |
 | 0.3.x | 0.8 or 0.9 (`pip install floe-python`, or the `ghcr.io/openlakeforge/floe` image) |
 | 0.2.x | 0.8 (`pip install floe-python`, or the `ghcr.io/openlakeforge/floe` image) |
 | 0.1.x | 0.7 and earlier |
@@ -24,7 +25,7 @@ airflow-floe is a supported Floe connector (Beta), linted and type-checked in CI
 
 - `INTEGRATION_SPEC.md`: contract between Airflow and Floe CLI
 - `schemas/`: JSON Schemas for XCom payloads and manifest contract
-- `src/airflow_floe/manifest.py`: manifest loader (`spec_version` `"0.8"` or `"0.9"`)
+- `src/airflow_floe/manifest.py`: manifest loader (`spec_version` `"0.8"`, `"0.9"` or `"0.10"`)
 - `src/airflow_floe/runtime.py`: shared runtime helpers (manifest context, run event parsing, summary loading)
 - `src/airflow_floe/hooks.py`: reusable manifest hook (`FloeManifestHook`)
 - `src/airflow_floe/operators.py`: reusable run hook/operator (`FloeRunHook`, `FloeRunOperator`)
@@ -37,7 +38,7 @@ The connector is driven entirely by environment variables. No code changes are n
 
 | Env var | What it does |
 | --- | --- |
-| `FLOE_MANIFEST` | Primary: path to a Floe 0.8 or 0.9 manifest JSON — enables asset registration at parse time |
+| `FLOE_MANIFEST` | Primary: path to a Floe 0.8, 0.9 or 0.10 manifest JSON — enables asset registration at parse time |
 | `FLOE_MANIFEST_DIR` | Multi-manifest mode: directory of `*.manifest.json` files; one DAG per file |
 | `FLOE_CONFIG` | Fallback run config used when manifest loading fails — DAG still executes `floe run`, but no assets are registered |
 | `FLOE_CMD` | Override the `floe` binary path (default: `floe` on `$PATH`) |

{floe_python-0.10.0 → floe_python-0.10.1}/orchestrators/airflow-floe/pyproject.toml

@@ -1,6 +1,6 @@
 [project]
 name = "airflow-floe"
-version = "0.3.0"
+version = "0.4.0"
 description = "Airflow connector for Floe CLI (manifest-first orchestration)"
 requires-python = ">=3.10"
 readme = "README.md"

{floe_python-0.10.0 → floe_python-0.10.1}/orchestrators/airflow-floe/src/airflow_floe/manifest.py

@@ -8,7 +8,7 @@ from pathlib import Path
 from typing import Any
 
 # D22: a manifest's spec_version is the Floe major.minor that generated it.
-SUPPORTED_SPEC_VERSIONS = ("0.8", "0.9")
+SUPPORTED_SPEC_VERSIONS = ("0.8", "0.9", "0.10")
 
 
 @dataclass(frozen=True)

{floe_python-0.10.0 → floe_python-0.10.1}/orchestrators/airflow-floe/tests/test_manifest_loader.py

@@ -116,6 +116,20 @@ class ManifestLoaderTests(unittest.TestCase):
 
             self.assertEqual(load_manifest(target).spec_version, "0.9")
 
+    def test_load_manifest_accepts_floe_0_10_and_refuses_0_11(self) -> None:
+        # "0.10" is the first two-digit minor: it must not be compared as a number or string.
+        with tempfile.TemporaryDirectory() as tmp:
+            target = Path(tmp) / "manifest.json"
+            payload = self._manifest_payload()
+            payload["spec_version"] = "0.10"
+            target.write_text(json.dumps(payload), encoding="utf-8")
+            self.assertEqual(load_manifest(target).spec_version, "0.10")
+
+            payload["spec_version"] = "0.11"
+            target.write_text(json.dumps(payload), encoding="utf-8")
+            with self.assertRaisesRegex(ValueError, r"spec_version 0\.11 is not supported"):
+                load_manifest(target)
+
     def test_load_manifest_rejects_unsupported_spec_version(self) -> None:
         payload = self._manifest_payload()
         payload["spec_version"] = "0.7"
@@ -125,7 +139,8 @@ class ManifestLoaderTests(unittest.TestCase):
             target.write_text(json.dumps(payload), encoding="utf-8")
 
             with self.assertRaisesRegex(
-                ValueError, r"manifest spec_version 0\.7 is not supported \(supported: 0\.8, 0\.9\)"
+                ValueError,
+                r"manifest spec_version 0\.7 is not supported \(supported: 0\.8, 0\.9, 0\.10\)",
             ):
                 load_manifest(target)
 

{floe_python-0.10.0 → floe_python-0.10.1}/orchestrators/dagster-floe/README.md

@@ -30,18 +30,19 @@ Current model:
 ## Install
 
 Prereqs:
-- Floe 0.8.3 or newer, 0.9 for a 0.9 manifest (`pip install floe-python`, **or** Docker with the `ghcr.io/openlakeforge/floe` image).
+- Floe 0.8.3 or newer, 0.9 for a 0.9 manifest, 0.10 for a 0.10 manifest (`pip install floe-python`, **or** Docker with the `ghcr.io/openlakeforge/floe` image).
 - Python 3.10+.
 
 ```bash
 pip install dagster-floe
-pip install "dagster-floe[floe]"   # also installs floe-python>=0.9,<0.10 for the in-process runner
+pip install "dagster-floe[floe]"   # also installs floe-python>=0.10,<0.11 for the in-process runner
 ```
 
 ## Supported Floe versions
 
 | dagster-floe | Floe | Manifest `spec_version` |
 | --- | --- | --- |
+| 0.6.0 | 0.8.3 or newer (the `floe` extra installs 0.10) | `0.8`, `0.9`, `0.10` |
 | 0.5.0 | 0.8.3 or newer (the `floe` extra installs 0.9) | `0.8`, `0.9` |
 | 0.4.3 | 0.8.3 or newer (the `floe/full_refresh` run tag on a `merge_scd1` entity needs 0.8.6) | `0.8` |
 | 0.4.2 | 0.8.3 or newer | `0.8` |
@@ -211,7 +212,7 @@ When a run fails, the step failure's metadata adds what `run.failure.json` says:
 
 ## Notes
 
-- This connector does **not** parse YAML directly; it consumes Floe manifests (`spec_version` `0.8` or `0.9`), read from a file or built by `floe.build_manifest` in config mode.
+- This connector does **not** parse YAML directly; it consumes Floe manifests (`spec_version` `0.8`, `0.9` or `0.10`), read from a file or built by `floe.build_manifest` in config mode.
 - Connector logic lives under `src/floe_dagster/`; local wiring for demo lives in `example/definitions.py`.
 - For local development without an installed `floe` command, you can point `LocalRunner` to a custom command, e.g.:
   - `LocalRunner("python -m floe")`

{floe_python-0.10.0 → floe_python-0.10.1}/orchestrators/dagster-floe/pyproject.toml

@@ -1,6 +1,6 @@
 [project]
 name = "dagster-floe"
-version = "0.5.0"
+version = "0.6.0"
 description = "Dagster connector for Floe CLI (config-driven ingestion)"
 requires-python = ">=3.10"
 readme = "README.md"
@@ -33,7 +33,7 @@ kubernetes = [
   "kubernetes>=28",
 ]
 floe = [
-  "floe-python[all]>=0.9,<0.10",
+  "floe-python[all]>=0.10,<0.11",
 ]
 remote = [
   "fsspec",

{floe_python-0.10.0 → floe_python-0.10.1}/orchestrators/dagster-floe/src/floe_dagster/assets.py

@@ -713,9 +713,11 @@ def _log_floe_stderr(context: Any, stderr: str) -> None:
 
 
 def _log_floe_output(context: Any, stdout: str, events: list[dict[str, Any]]) -> None:
+    """One Dagster log event for the whole run: each `context.log` call is an event-log write (#1210)."""
     rendered_by_raw = {
         json.dumps(event, sort_keys=True, separators=(",", ":")): render_log_event(event) for event in events
     }
+    lines: list[str] = []
     for line in stdout.splitlines():
         stripped = line.strip()
         if not stripped:
@@ -731,7 +733,9 @@ def _log_floe_output(context: Any, stdout: str, events: list[dict[str, Any]]) ->
                     json.dumps(event, sort_keys=True, separators=(",", ":")),
                     render_log_event(event),
                 )
-        context.log.info(rendered or f"floe stdout | {stripped}")
+        lines.append(rendered or f"floe stdout | {stripped}")
+    if lines:
+        context.log.info("\n".join(lines))
 
 
 def _load_summary_json(summary_uri: str, config_uri: str) -> dict[str, Any]:

{floe_python-0.10.0 → floe_python-0.10.1}/orchestrators/dagster-floe/src/floe_dagster/manifest.py

@@ -13,7 +13,7 @@ from urllib.parse import unquote, urlparse, urlunparse
 from jsonschema import Draft202012Validator
 
 # D22: a manifest's spec_version is the Floe major.minor that generated it.
-SUPPORTED_SPEC_VERSIONS = ("0.8", "0.9")
+SUPPORTED_SPEC_VERSIONS = ("0.8", "0.9", "0.10")
 
 
 @dataclass(frozen=True)

{floe_python-0.10.0 → floe_python-0.10.1}/orchestrators/dagster-floe/tests/test_domain_scope.py

@@ -6,7 +6,7 @@ from pathlib import Path
 from typing import Any
 from unittest.mock import MagicMock, patch
 
-from dagster import AssetKey, AssetSelection, materialize
+from dagster import AssetKey, AssetSelection, DagsterInstance, materialize
 
 from floe_dagster.assets import build_floe_asset_defs
 from floe_dagster.definitions import build_definitions_from_manifest_paths
@@ -54,6 +54,7 @@ def _run(
     exit_code: int = 0,
     selection=None,
     events: list[dict] | None = None,
+    instance: DagsterInstance | None = None,
     **manifest_kw: Any,
 ):
     """Materialize with the Kubernetes client mocked; returns the result and the Job API mock."""
@@ -81,7 +82,7 @@ def _run(
         patch("floe_dagster.kubernetes_runner._make_core_client", return_value=core_api),
     ):
         assets, sources, _ = build_floe_asset_defs(manifest_path=str(manifest), runner=LocalRunner())
-        result = materialize([*assets, *sources], selection=selection, raise_on_error=False)
+        result = materialize([*assets, *sources], selection=selection, raise_on_error=False, instance=instance)
     return result, jobs_api
 
 
@@ -293,3 +294,23 @@ def test_source_key_fn_gives_each_domain_output_its_own_upstream(tmp_path: Path)
     for name in NAMES:
         assert domain_asset.asset_deps[AssetKey(["sales", name])] == {AssetKey(["crm", name])}
     assert sources == []
+
+
+def test_domain_scope_replays_the_floe_output_as_one_log_event(tmp_path: Path) -> None:
+    """#1210: every Dagster log record is an event-log write, so a finished run's lines go as one."""
+    base = {"schema": "floe.log.v1", "level": "info", "run_id": "r1", "ts_ms": 1}
+    events = [{**base, "event": "entity_started", "name": name} for name in NAMES]
+    instance = DagsterInstance.ephemeral()
+
+    result, _ = _run(tmp_path, dict.fromkeys(NAMES, "success"), events=events, instance=instance)
+
+    assert result.success
+    floe_logs = [
+        r.user_message
+        for r in instance.all_logs(result.run_id)
+        if r.dagster_event is None and "floe " in r.user_message
+    ]
+    assert len(floe_logs) == 1
+    lines = floe_logs[0].splitlines()
+    assert lines[: len(NAMES)] == [f"floe entity started run_id=r1 entity={name}" for name in NAMES]
+    assert lines[-1].startswith("floe run finished")

{floe_python-0.10.0 → floe_python-0.10.1}/orchestrators/dagster-floe/tests/test_manifest.py

@@ -14,7 +14,7 @@ from floe_dagster.manifest import (
 )
 
 
-@pytest.mark.parametrize("spec_version", ["0.2", "0.10", "1.0"])
+@pytest.mark.parametrize("spec_version", ["0.2", "0.11", "1.0"])
 def test_manifest_rejects_unsupported_spec_version(tmp_path: Path, spec_version: str):
     fixture = Path(__file__).parent / "fixtures" / "manifest.json"
     payload = json.loads(fixture.read_text(encoding="utf-8"))
@@ -26,8 +26,8 @@ def test_manifest_rejects_unsupported_spec_version(tmp_path: Path, spec_version:
         load_manifest(manifest_path)
 
 
-@pytest.mark.parametrize("spec_version", ["0.8", "0.9"])
-def test_manifest_accepts_floe_0_8_and_0_9(tmp_path: Path, spec_version: str):
+@pytest.mark.parametrize("spec_version", ["0.8", "0.9", "0.10"])
+def test_manifest_accepts_floe_0_8_0_9_and_0_10(tmp_path: Path, spec_version: str):
     fixture = Path(__file__).parent / "fixtures" / "manifest.json"
     payload = json.loads(fixture.read_text(encoding="utf-8"))
     payload["spec_version"] = spec_version

{floe_python-0.10.0 → floe_python-0.10.1}/pyproject.toml

@@ -4,7 +4,7 @@ build-backend = "hatchling.build"
 
 [project]
 name = "floe-python"
-version = "0.10.0"
+version = "0.10.1"
 description = "Floe: a data-contract runtime for file ingestion"
 requires-python = ">=3.11"
 dependencies = [

{floe_python-0.10.0 → floe_python-0.10.1}/schemas/domains.schema.yaml

@@ -16,6 +16,8 @@ properties:
     - 'null'
   defaults:
     $ref: '#/$defs/entity_defaults'
+  entities:
+    type: string
 title: Floe domains document
 $defs:
   entity_defaults: