expops 0.1.16.dev0__tar.gz → 0.1.17.dev0__tar.gz

{expops-0.1.16.dev0 → expops-0.1.17.dev0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: expops
-Version: 0.1.16.dev0
+Version: 0.1.17.dev0
 Summary: MLOps Platform with step-based pipeline execution
 License:                     GNU GENERAL PUBLIC LICENSE
                                Version 3, 29 June 2007

{expops-0.1.16.dev0 → expops-0.1.17.dev0}/docs/features/data-parallelism.md

@@ -5,7 +5,7 @@ Use it when a process returns row-splittable data (pandas DataFrame, numpy array
 
 ## Config
 
-### Split from upstream (no `code_function`)
+### Split from upstream (no `code`)
 
 ```yaml
 processes:
@@ -17,16 +17,16 @@ processes:
 ```
 
 - `data_name` tells the system which upstream output key to split.
-- The split process has no `code_function`; it will merge its upstream outputs and split the `data_name` key.
-- `script` is optional for split nodes with no `code_function`.
+- The split process has no `code`; it will merge its upstream outputs and split the `data_name` key.
+- The script path for such helper split nodes is optional.
 
-### User-defined splitter (`code_function`)
+### User-defined splitter (`code`)
 
 ```yaml
 processes:
   - name: "nn_data_parallel"
     description: "Custom splitter"
-    code_function: "define_nn_data_parallel"
+    code: "define_nn_data_parallel"
     data_parallelism:
       size: [50, 20, 20]
 ```
@@ -42,7 +42,7 @@ def define_nn_data_parallel():
 
 - Return a **list of rows**; the framework will split it based on `size`.
 - If `data_name` is omitted and the function returns a list, the data key defaults to `data`.
-- `script_path` is required when using `code_function`.
+- `script_path` is required when using an explicit `code` function.
 
 ### Size formats
 
@@ -57,10 +57,10 @@ Add a dedicated aggregation process to collapse the **latest** data-parallel lay
 processes:
   - name: "aggregate_results"
     data_aggregation: true
-    code_function: "define_aggregate_results"
+    code: "define_aggregate_results"
 ```
 
-Aggregation processes **must** define a `code_function`.
+Aggregation processes **must** define a `code` function reference.
 
 ### Input shape at aggregation
 
@@ -76,8 +76,7 @@ def define_aggregate_results(df):
 ## Notes
 
 - Data parallelism duplicates downstream nodes in the graph and is visible in the UI.
-- Chart probe paths can use selector syntax to automatically expand to data-parallel
-  partitions; see the chart documentation for details.
+- Chart probe paths can use XPath selector syntax over the pipeline tree (including `@partition='p1'` predicates) to automatically expand to data-parallel partitions; see the chart documentation for details.
 - Multiple data-parallel layers are supported. Each aggregation collapses only the
   most recent data-parallel layer; outer layers are still represented by separate
   process nodes.

{expops-0.1.16.dev0 → expops-0.1.17.dev0}/docs/features/pipelines.md

@@ -46,12 +46,12 @@ Each process must be explicitly defined with its configuration:
 processes:
   - name: "feature_engineering"
     description: "Load and prepare data"
-    code_function: "define_feature_engineering_process"
+    code: "define_feature_engineering_process"
     environment: "my-project-env"
   
   - name: "train_model"
     description: "Train the model"
-    code_function: "define_training_process"
+    code: "define_training_process"
     environment: "my-project-env"
     parameters:
       learning_rate: 0.001
@@ -67,8 +67,10 @@ processes:
 
 - `name`: Unique process identifier (must match names in `process_adjlist`)
 - `description`: Human-readable description
-- `script` (optional): Key from the top-level `scripts` section to use for this process. Defaults to the first key in `scripts` if omitted. See [Configuration](../project-structure/configuration.md) for the `scripts` section and defaults.
-- `code_function`: Name of the Python function that defines the process (see below). Defaults to the process name if omitted, so you can omit it when the function name matches the process name.
+- `code` (optional): Unified code reference for the process:
+  - `code: "script_key.function_name"` uses the script registered under `script_key` in the top-level `scripts` map and calls `function_name`.
+  - `code: "function_name"` uses the first script key in `scripts` and calls `function_name`.
+  - If omitted, ordinary processes default to a function with the same name as the process on the default script, while pure split/aggregation helper nodes can omit `code` entirely.
 - `environment`: Environment name to use (defaults to the first environment if omitted)
 - `parameters`: Optional parameters injected by name into the process function
 - `type`: Optional type (e.g., `"chart"` for chart generation processes)
@@ -77,7 +79,7 @@ processes:
 
 ## Process Functions
 
-Processes are implemented in Python using the `@process()` decorator. The function name must match the `code_function` in the config:
+Processes are implemented in Python using the `@process()` decorator. The function name referenced in `code` (or the process name when `code` is omitted) must match the registered process:
 
 ```python
 from expops.core import process, step, 

{expops-0.1.16.dev0 → expops-0.1.17.dev0}/docs/features/reporting.md

@@ -69,8 +69,8 @@ reporting:
   charts:
     - name: "my_chart"
       probe_paths:
-        train: "//*[@name=\"train_model\"]"
-        eval: "//*[@name=\"evaluate_model\"]"
+        train: "//*[@name='train_model']"
+        eval: "//*[@name='evaluate_model']"
 ```
 
 The chart function receives:
@@ -100,38 +100,15 @@ Common patterns:
 
 | Goal | XPath pattern |
 |------|----------------|
-| Process by name | `//*[@name="process_name"]` |
-| Process + step | `//*[@name="process_name"]/step[@name="step_name"]` or `//*[@name="process_name"]/*[@name="step_name"]` |
-| Specific partition/seed | `//*[@partition="p1"]/*[@seed="41"]/*[@name="process_name"]` |
-| Any partition/seed | `//*[@partition]/*[@seed]/*[@name="process_name"]` |
-
-In `project_config.yaml`, probe paths are double-quoted YAML strings, so escape each `"` as `\"` (see examples below).
-
-**Examples from projects:**
-
-- **sklearn-basic** (simple pipeline, no steps):
-
-```yaml
-probe_paths:
-  train: "//*[@name=\"train_model\"]"
-  eval: "//*[@name=\"evaluate_model\"]"
-```
-
-- **premier-league** (process + step; partition and seed):
-
-```yaml
-probe_paths:
-  feat: "//*[@name=\"feature_engineering_generic\"]/step[@name=\"feature_analysis\"]"
-  nn_a_p1_seed41: "//*[@partition=\"p1\"]/*[@seed=\"41\"]/*[@name=\"nn_training_a\"]/*[@name=\"train_and_evaluate_nn_classifier\"]"
-  linear: "//*[@partition]/*[@seed]/*[@name=\"linear_inference\"]/*[@name=\"test_inference_classification\"]"
-  nn_best: "//*[@partition]/*[@seed]/*[@name=\"nn_best_inference\"]/step[@name=\"test_inference_classification\"]"
-  ensemble: "//*[@partition]/*[@seed]/*[@name=\"ensemble_inference\"]"
-```
+| Process by name | `//*[@name='process_name']` |
+| Process + step | `//*[@name='process_name']/*[@name='step_name']` or `//*[@name='step_name']` if the step name is unique among process names |
+| Specific partition/seed | `//*[@partition='p1']/*[@seed='41']/*[@name='process_name']` |
+| Any partition/seed | `//*[@partition]/*[@seed]/*[@name='process_name']` |
 
 #### How keys map to chart metrics
 
 - **One XPath match**: The config key is preserved (e.g. `train` → `metrics['train']`).
-- **Multiple XPath matches**: Each resolved probe path becomes a key (e.g. `nn_training_a__p1_seed41/train_and_evaluate_nn_classifier`). Chart code can iterate over keys or use prefix/grouping logic to aggregate across partitions or seeds.
+- **Multiple XPath matches**: Each resolved probe path becomes a key. The key is the canonical XPath-style identifier for that process/step (e.g. `"//*[@partition='p1']/*[@seed='41']/*[@name='nn_training_a']/step[@name='train_and_evaluate_nn_classifier']"`). Chart code can iterate over keys or use prefix/grouping logic to aggregate across partitions or seeds.
 - **Literal path**: Single key as in config (e.g. `train: "train_model"` → `metrics['train']`).
 
 ### Output
@@ -147,7 +124,7 @@ Dynamic charts provide real-time, interactive visualizations.
 
 **Configuration**: Dynamic charts are defined as **pipeline processes** in `project_config.yaml` (under `experiment.parameters.pipeline.processes`). Each dynamic chart process must have:
 
-- `script` - a key that resolves to your JS chart script (e.g. `reporting_js`), defined under `scripts:` at the top of the config
+- `code` - a unified code reference that points to your JS chart script and function (e.g. `code: "reporting_js.nn_losses"`), where `reporting_js` is defined under `scripts:` at the top of the config
 - `chart_type: "dynamic"`
 - `probe_paths` - same XPath semantics as static charts (see [Probe paths](#probe-paths) below)
 
@@ -158,7 +135,7 @@ Dynamic charts provide real-time, interactive visualizations.
 ```yaml
 # Under experiment.parameters.pipeline.processes:
         - name: "nn_losses"
-          script: "reporting_js"
+          code: "reporting_js.nn_losses"
           environment: "premier-league-env-reporting"
           chart_type: "dynamic"
           probe_paths: ...

{expops-0.1.16.dev0 → expops-0.1.17.dev0}/docs/features/seed-parallelism.md

@@ -1,10 +1,10 @@
-# Seed Parallelism
+### Seed Parallelism
 
 Seed parallelism duplicates the downstream process graph and runs each duplicate under a different random seed. It uses deterministic task-level seeding so that each duplicated branch is reproducible.
 
 ## Config
 
-### Predefined seed split (no `code_function`)
+### Predefined seed split (no `code`)
 
 ```yaml
 processes:
@@ -14,18 +14,17 @@ processes:
       seeds: [41, 42, 43]
 ```
 
-- The split process has no `code_function`; it will merge upstream outputs and pass them through.
+- The split process has no `code`; it will merge upstream outputs and pass them through.
 - The engine duplicates all downstream nodes until a `seed_aggregation` node is reached.
-- Duplicated nodes use a `_seed<value>` suffix (for example, `train_model_seed41`).
-- `script_path` is optional for split nodes with no `code_function`.
+- Duplicated nodes are tracked via structured `seed_value` metadata on each process instance.
 
-### User-defined seed split (`code_function`)
+### User-defined seed split (`code`)
 
 ```yaml
 processes:
   - name: "seed_parallel"
     description: "Custom seed hook"
-    code_function: "define_seed_parallel_process"
+    code: "define_seed_parallel_process"
     seed_parallelism:
       seeds: [41, 42, 43]
 ```
@@ -39,7 +38,6 @@ def define_seed_parallel_process(seeds, **inputs):
 ```
 
 - The `seeds` list is passed to the user-defined function as a kwarg.
-- `script_path` is required when using `code_function`.
 
 ## Aggregation
 
@@ -49,7 +47,7 @@ Add a dedicated aggregation process to collapse the **latest** seed-parallel lay
 processes:
   - name: "aggregate_seeds"
     seed_aggregation: true
-    code_function: "define_aggregate_seeds"
+    code: "define_aggregate_seeds"
 ```
 
 ### Input shape at aggregation
@@ -74,8 +72,11 @@ def define_aggregate_data_and_seed(metrics):
 
 ## Notes
 
-- Seed parallelism duplicates downstream nodes and is visible in the UI.
-- Task-level RNG seeding uses the most recent (innermost) seed layer when multiple
-  seed-parallel layers are nested.
-- Each aggregation collapses only the most recent seed-parallel layer; outer layers
-  remain as separate process nodes.
+- **UI representation**: Seed-parallel duplicates now use canonical XPath-style
+  process IDs in the process graph (for example
+  `//*[@partition='p1']/*[@seed='41']/process[@name='train']`), and human-readable
+  labels such as `train P1 S41` are derived from this metadata.
+- **Task-level RNG seeding**: Uses the most recent (innermost) seed layer when
+  multiple seed-parallel layers are nested.
+- **Aggregation behavior**: Each aggregation collapses only the most recent
+  seed-parallel layer; outer layers remain as separate process nodes.

{expops-0.1.16.dev0 → expops-0.1.17.dev0}/docs/project-structure/configuration.md

@@ -41,8 +41,13 @@ reporting:         # Chart entrypoints, probe paths, reporting environment
 
 You can omit some process fields and rely on defaults to keep config minimal:
 
-- **Script**: If a process does not set `script`, the **first key** in the top-level `scripts` section is used. List your main script first so most processes need no `script` field.
-- **code_function**: If omitted, it defaults to the process **name**. When your Python function name matches the process name (e.g. process `train_model` and function `train_model`), you can omit `code_function`.
+- **Scripts section**: The top-level `scripts` map still defines script keys to file paths. The **first key** is treated as the default script for processes that do not explicitly specify a script key in `code`.
+- **Code field**: Each process may define a single `code` field instead of separate `script` and `code_function` fields:
+  - `code: "script_key.function_name"` → use the script registered under `script_key` and call `function_name` from that module.
+  - `code: "function_name"` → use the first script key in `scripts` and call `function_name`.
+- **Omitted code**:
+  - For ordinary processes, if `code` is omitted the system assumes a function with the same name as the process, loaded from the default script.
+  - For data/seed split helper nodes (processes that only define `data_parallelism` or `seed_parallelism` and no `code`), the system treats them as function-less split nodes.
 
 Example minimal process that uses both defaults:
 
@@ -88,7 +93,7 @@ For detailed information on each configuration section:
 - **Process & Step Code**: [Model Code](model-code.md)
 - **Caching**: [Caching & Reproducibility](../features/caching.md)
 - **Backends**: [Backends](../advanced/backends.md)
-- **Reporting/Charts**: [Reporting Features](../features/reporting.md) and [Chart Generation](charts.md)
+- **Reporting/Charts**: [Reporting Features](../features/reporting.md)
 - **Cluster Execution**: [Cluster Configuration](../advanced/cluster-config.md) and [Distributed Computing](../features/distributed.md)
 
 ## Example Configurations

{expops-0.1.16.dev0 → expops-0.1.17.dev0}/docs/project-structure/overview.md

@@ -49,8 +49,6 @@ The `charts/` directory contains visualization code:
 - **plot_metrics.py**: Static PNG chart generation
 - **plot_metrics.js**: Dynamic interactive charts
 
-See [Chart Generation](charts.md) for details.
-
 ### Dependencies
 
 - **requirements.txt**: Main dependencies for training/inference

{expops-0.1.16.dev0/src/mlops/templates → expops-0.1.17.dev0}/premier-league/charts/plot_metrics.js

@@ -17,16 +17,22 @@ chart('nn_losses', (probePaths, ctx, listener) => {
     datasets: []
   };
 
-  const formatProbeLabel = (probePath) => {
-    const raw = String(probePath || '');
-    const proc = raw.split('/')[0] || raw;
-    const partMatch = proc.match(/__p(\d+)/) || proc.match(/_p(\d+)/);
-    const seedMatch = proc.match(/_seed(\d+)/);
-    const base = proc.replace(/__p\d+/, '').replace(/_p\d+/, '').replace(/_seed\d+/, '');
-    const parts = [base];
-    if (partMatch) parts.push(`P${partMatch[1]}`);
-    if (seedMatch) parts.push(`S${seedMatch[1]}`);
-    return parts.join(' ');
+  const formatProbeLabel = (canonicalPath) => {
+    const raw = String(canonicalPath || '');
+    const partMatch = raw.match(/@partition='p(\d+)'/);
+    const seedMatch = raw.match(/@seed='(\d+)'/);
+    const procMatch = raw.match(/process\[@name='([^']+)'\]/);
+    const parts = [];
+    if (procMatch && procMatch[1]) {
+      parts.push(procMatch[1]);
+    }
+    if (partMatch && partMatch[1]) {
+      parts.push(`P${partMatch[1]}`);
+    }
+    if (seedMatch && seedMatch[1]) {
+      parts.push(`S${seedMatch[1]}`);
+    }
+    return parts.join(' ') || raw;
   };
 
   const desiredOrder = [
@@ -42,8 +48,9 @@ chart('nn_losses', (probePaths, ctx, listener) => {
     .filter(Boolean);
 
   selectedKeys.forEach((k) => {
+    const canonical = probePaths[k];
     chartData.datasets.push({
-      label: formatProbeLabel(k).replace(/_/g, ' ').toUpperCase(),
+      label: formatProbeLabel(canonical).replace(/_/g, ' ').toUpperCase(),
       data: [],
       borderColor: colors[colorIndex % colors.length],
       backgroundColor: colors[colorIndex % colors.length] + '33',

{expops-0.1.16.dev0/src/mlops/templates → expops-0.1.17.dev0}/premier-league/charts/plot_metrics.py

@@ -1,4 +1,5 @@
 from typing import Dict, Any, Optional
+import logging
 
 import matplotlib
 matplotlib.use('Agg')
@@ -7,6 +8,8 @@ import numpy as np
 
 from mlops.reporting import chart, ChartContext
 
+logger = logging.getLogger(__name__)
+
 
 @chart()
 def pca_scree(metrics: Dict[str, Any], ctx: ChartContext) -> None:
@@ -163,6 +166,10 @@ def test_metrics_comparison(metrics: Dict[str, Any], ctx: ChartContext) -> None:
         f1s.append(f1 if f1 is not None else 0.0)
 
     if not labels:
+        logger.warning(
+            "test_metrics_comparison: no comparable metrics found for chart generation. metric_keys=%s",
+            sorted((metrics or {}).keys()),
+        )
         return
 
     x = np.arange(len(labels))

{expops-0.1.16.dev0/src/mlops/templates → expops-0.1.17.dev0}/premier-league/configs/project_config.yaml

@@ -95,21 +95,21 @@ experiment:
         - name: "linear_training"
 
         - name: "nn_training_a"
-          code_function: "define_nn_training_process"
+          code: "define_nn_training_process"
           parameters:
             hidden_layers: [128, 64]
             learning_rate: 0.002
             epochs: 50
 
         - name: "nn_training_b"
-          code_function: "define_nn_training_process"
+          code: "define_nn_training_process"
           parameters:
             hidden_layers: [256, 128, 64]
             learning_rate: 0.0008
             epochs: 50
 
         - name: "xgb_training_a"
-          code_function: "define_xgb_training_process"
+          code: "define_xgb_training_process"
           parameters:
             n_estimators: 350
             max_depth: 4
@@ -118,7 +118,7 @@ experiment:
             colsample_bytree: 0.9
 
         - name: "xgb_training_b"
-          code_function: "define_xgb_training_process"
+          code: "define_xgb_training_process"
           parameters:
             n_estimators: 500
             max_depth: 8
@@ -127,22 +127,22 @@ experiment:
             colsample_bytree: 0.8
 
         - name: "nn_inference_a"
-          code_function: "define_nn_inference_process"
+          code: "define_nn_inference_process"
           parameters:
             train_key: nn_training_a
 
         - name: "nn_inference_b"
-          code_function: "define_nn_inference_process"
+          code: "define_nn_inference_process"
           parameters:
             train_key: nn_training_b
 
         - name: "xgb_inference_a"
-          code_function: "define_xgb_inference_process"
+          code: "define_xgb_inference_process"
           parameters:
             train_key: xgb_training_a
 
         - name: "xgb_inference_b"
-          code_function: "define_xgb_inference_process"
+          code: "define_xgb_inference_process"
           parameters:
             train_key: xgb_training_b
 
@@ -160,31 +160,31 @@ experiment:
 
         - name: "pca_scree"
           description: "Render PCA scree plot"
-          script: "reporting"
+          code: "reporting.pca_scree"
           environment: "premier-league-env-reporting"
           probe_paths:
-            feat: "//*[@name=\"feature_engineering_generic\"]/step[@name=\"feature_analysis\"]"
+            feat: "//*[@name='feature_analysis']"
 
         - name: "goals_distribution"
-          script: "reporting"
+          code: "reporting.goals_distribution"
           environment: "premier-league-env-reporting"
           probe_paths:
-            feat: "//*[@name=\"feature_engineering_generic\"]/step[@name=\"derive_labels_and_indices\"]"
+            feat: "//*[@name='derive_labels_and_indices']"
 
         - name: "test_metrics_comparison"
-          script: "reporting"
+          code: "reporting.test_metrics_comparison"
           environment: "premier-league-env-reporting"
           probe_paths:
-            linear: "//*[@partition]/*[@seed]/*[@name=\"linear_inference\"]/*[@name=\"test_inference_classification\"]"
-            nn_best: "//*[@partition]/*[@seed]/*[@name=\"nn_best_inference\"]/step[@name=\"test_inference_classification\"]"
-            xgb_best: "//*[@partition]/*[@seed]/*[@name=\"xgb_best_inference\"]/step[@name=\"test_inference_classification\"]"
-            ensemble: "//*[@partition]/*[@seed]/*[@name=\"ensemble_inference\"]"
+            linear: "//*[@name='linear_inference']/*[@name='test_inference_classification']"
+            nn_best: "//*[@name='nn_best_inference']/*[@name='test_inference_classification']"
+            xgb_best: "//*[@name='xgb_best_inference']/*[@name='test_inference_classification']"
+            ensemble: "//*[@name='ensemble_inference']"
 
         - name: "nn_losses"
-          script: "reporting_js"
+          code: "reporting_js.nn_losses"
           environment: "premier-league-env-reporting"
           chart_type: "dynamic"
           probe_paths:
-            nn_a_p1_seed41: "//*[@partition=\"p1\"]/*[@seed=\"41\"]/*[@name=\"nn_training_a\"]/*[@name=\"train_and_evaluate_nn_classifier\"]"
-            nn_a_p2_seed41: "//*[@partition=\"p2\"]/*[@seed=\"41\"]/*[@name=\"nn_training_a\"]/*[@name=\"train_and_evaluate_nn_classifier\"]"
-            nn_a_p1_seed42: "//*[@partition=\"p1\"]/*[@seed=\"42\"]/*[@name=\"nn_training_a\"]/*[@name=\"train_and_evaluate_nn_classifier\"]"
+            nn_a_p1_seed41: "//*[@partition='p1']/*[@seed='41']/*[@name='nn_training_a']/*[@name='train_and_evaluate_nn_classifier']"
+            nn_a_p2_seed41: "//*[@partition='p2']/*[@seed='41']/*[@name='nn_training_a']/*[@name='train_and_evaluate_nn_classifier']"
+            nn_a_p1_seed42: "//*[@partition='p1']/*[@seed='42']/*[@name='nn_training_a']/*[@name='train_and_evaluate_nn_classifier']"

expops-0.1.17.dev0/premier-league/firestore.json

@@ -0,0 +1 @@
+{"type":"service_account","project_id":"mlops-platform-470017","private_key_id":"0a5f97bd39814e45553c7ddca399e504c4821f04","private_key":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQDBDxZkEB6KTMyS\n4/KKOHlbzwTLFTAXYWyKY15X6hhetwrRzAMWoGX1/fopvkf3u60gevrJq4R+UOTe\nZ1XGhySrpAyEtr2KPD9Zz0H+EgdLlBM+SZHfKkrM3Iln08LV501EF+miouaZ+Pn4\naNBYcQH5ry9BAADfysHj9fS92OVvGQ1cfj/RMUVOA9wHTBoFUzzwDVyGgUv6oA6K\nJLWzx4Z9Uh5W1PpkBVxaFrvzGMIQ/YOlgN6Ii67mR3RvYdXsEgNoRudiiG0djNDP\n/NnRm3D8Eo93Kxv5K9dJeKGX3lobSGfGPvqe6FqeUOlTDb8PS3LbTsQj3vW/EZ8Y\nsOcGnSmxAgMBAAECggEADUDO5bGhlxbsmEzjso9r7VyJ1LMwqPo8LEfkCx7760yf\nhoV91MjQFxIHYWQ5po0QtoEaxEts/grpm0b2wXk3kDzjyxyMaHf4VV8ABcQREiQp\nKgZ86BgMKIIfQKxt3KdTS5BkrpCGSh2oc2AmpVukqhJXqRup87MEmnShB4NjRLwR\n80jaYHOsTul4fDxcofzgUWTd+wou6fTWNrPPGDP3bvGUD2ktuXwmJ1Ye8wXfuiaW\nVgTa5dNsY/DoRqfXe9QagJ9cdmm0SjQppAxY8+FcHheSuwzp7XWAUegzc8rCqQp5\nlKW47CL6UdTN7jx2AEadannZiYgN4A51yu0bX0vd0QKBgQDtPTj3OSG61LxJSycb\n6SnoO+2jBskDsbnWFSaPj88GFiitLPegH9kr54uoea5mOtpNSt7mW3iTy/V3zABc\nf+KK/5l6ZpV+CVaVndd6LRBt3aFBbEx3MZGcPeIoZDEqYTkROQlJKBRYrDpHJAAe\nQhbHl0XP+4EmbMTqNPL4kD9f/QKBgQDQU3XlkWaABwispE+7r58K8Z+7Uzapzlj7\nM0UsdLXj/FtmwEx5PWiVFCDEiy3F17aAsJmcEhXEl3yYARdES5q1/fAcBrGguxQK\n0Uzc+958oodV+SL70V147k+NvmPtrOhwYMCdRavAk5/zUrVNrvS6rk/aMFscwheR\ns9YnkY08xQKBgFHUFSsI1L6JlCw/tMymvuKwkQXzWDBjA/N4tiU8eC7kQ8F/yiW7\n9n9zTTOeTO5MDHIuifWwxUVNS2y3u8QsBCrngLu8WIHxnKDcoa8tjgYnNPDI9xMB\n0PSwT6qY7HBuum1bW/2UynfPaAaTv0qwhwTvA5B6cpCbYcxa2RetQX7NAoGBALm3\n/d23vvIZ0zDdlrtSeG2wNF8ycwP0kjz3Ww6jyVfDLNSwUDyxcx+b/w5YqWi7wtZ9\nGaQaN0+4YPm91zkqUXU3OiwyB36r6NUv+97xp0njNtV9MiPeZP8fLMrHVZyYTeuJ\nRY2vg8s9kBXCwSDM/R3Dsipoe4FqwspA0YUa7BelAoGAOOLY6E7sdE76Tuzd7jxh\nWrO1vY0H6PO3SWns14J3/ZcpXPda2RvpResoDLQ2BDSdWO8oRcWkv8IctODkKLkb\nCCf+n82KnZmaAd9mBW9mdX+1djkBiEjYBW6XPAP3QUZLsf+jxTlIu/20X+iUo/LC\nlVoi6u3ZyJbX90OIkIWkOiA=\n-----END PRIVATE KEY-----\n","client_email":"platform@mlops-platform-470017.iam.gserviceaccount.com","client_id":"102504406075317026901","auth_uri":"https://accounts.google.com/o/oauth2/auth","token_uri":"https://oauth2.googleapis.com/token","auth_provider_x509_cert_url":"https://www.googleapis.com/oauth2/v1/certs","client_x509_cert_url":"https://www.googleapis.com/robot/v1/metadata/x509/platform%40mlops-platform-470017.iam.gserviceaccount.com","universe_domain":"googleapis.com"}

{expops-0.1.16.dev0 → expops-0.1.17.dev0}/src/expops.egg-info/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: expops
-Version: 0.1.16.dev0
+Version: 0.1.17.dev0
 Summary: MLOps Platform with step-based pipeline execution
 License:                     GNU GENERAL PUBLIC LICENSE
                                Version 3, 29 June 2007

{expops-0.1.16.dev0 → expops-0.1.17.dev0}/src/expops.egg-info/SOURCES.txt

@@ -16,13 +16,21 @@ docs/features/reporting.md
 docs/features/seed-parallelism.md
 docs/getting-started/creating-a-project.md
 docs/getting-started/quick-start.md
-docs/project-structure/charts.md
 docs/project-structure/configuration.md
 docs/project-structure/model-code.md
 docs/project-structure/overview.md
 docs/templates/premier-league.md
 docs/templates/sklearn-basic.md
 docs/web-ui/local-ui.md
+premier-league/firestore.json
+premier-league/requirements.txt
+premier-league/charts/plot_metrics.js
+premier-league/charts/plot_metrics.py
+premier-league/charts/requirements.txt
+premier-league/configs/compute_config.yaml
+premier-league/configs/project_config.yaml
+premier-league/data/England CSV.csv
+premier-league/models/premier_league_model.py
 src/__init__.py
 src/expops/__init__.py
 src/expops/__main__.py
@@ -103,14 +111,6 @@ src/mlops/storage/adapters/redis_store.py
 src/mlops/storage/adapters/sqlite_store.py
 src/mlops/storage/interfaces/__init__.py
 src/mlops/storage/interfaces/kv_store.py
-src/mlops/templates/premier-league/requirements.txt
-src/mlops/templates/premier-league/charts/plot_metrics.js
-src/mlops/templates/premier-league/charts/plot_metrics.py
-src/mlops/templates/premier-league/charts/requirements.txt
-src/mlops/templates/premier-league/configs/compute_config.yaml
-src/mlops/templates/premier-league/configs/project_config.yaml
-src/mlops/templates/premier-league/data/England CSV.csv
-src/mlops/templates/premier-league/models/premier_league_model.py
 src/mlops/templates/sklearn-basic/README.md
 src/mlops/templates/sklearn-basic/requirements.txt
 src/mlops/templates/sklearn-basic/charts/plot_metrics.py
@@ -134,13 +134,19 @@ tests/unit/test_core/test_data_hashing.py
 tests/unit/test_core/test_executor_worker.py
 tests/unit/test_core/test_graph_expansion.py
 tests/unit/test_core/test_networkx_parser.py
+tests/unit/test_core/test_networkx_parser_code_field.py
 tests/unit/test_core/test_payload_spill.py
+tests/unit/test_core/test_pipeline_tree_steps.py
 tests/unit/test_core/test_prepare_runner_kwargs.py
+tests/unit/test_core/test_probe_path_selectors_xpath.py
 tests/unit/test_core/test_process_hashing.py
 tests/unit/test_core/test_step_state_manager.py
 tests/unit/test_core/test_step_system.py
 tests/unit/test_managers/__init__.py
 tests/unit/test_managers/test_reproducibility_manager.py
+tests/unit/test_platform/test_dynamic_js_charts.py
+tests/unit/test_platform/test_project_metadata_resilience.py
+tests/unit/test_reporting/test_entrypoint.py
 tests/unit/test_storage/__init__.py
 tests/unit/test_storage/test_factory.py
 tests/unit/test_storage/test_gcp_kv_store.py

{expops-0.1.16.dev0 → expops-0.1.17.dev0}/src/mlops/_version.py

@@ -28,7 +28,7 @@ version_tuple: VERSION_TUPLE
 commit_id: COMMIT_ID
 __commit_id__: COMMIT_ID
 
-__version__ = version = '0.1.16.dev0'
-__version_tuple__ = version_tuple = (0, 1, 16, 'dev0')
+__version__ = version = '0.1.17.dev0'
+__version_tuple__ = version_tuple = (0, 1, 17, 'dev0')
 
-__commit_id__ = commit_id = 'ga8d9fd60b'
+__commit_id__ = commit_id = 'g8934518e8'

{expops-0.1.16.dev0 → expops-0.1.17.dev0}/src/mlops/adapters/custom/custom_adapter.py

@@ -181,20 +181,34 @@ class CustomModelAdapter(ModelAdapter):
             probe_paths = proc.get("probe_paths")
             chart_type = proc.get("chart_type")
             is_chart = (proc_type == "chart") or (probe_paths is not None) or (chart_type is not None)
+
+            # Derive script key from unified `code` field where possible.
+            raw_code = proc.get("code")
+            code_str = str(raw_code).strip() if isinstance(raw_code, str) else ""
+            has_explicit_code = bool(code_str)
+            has_data_parallelism = proc.get("data_parallelism") is not None
+            has_seed_parallelism = proc.get("seed_parallelism") is not None
+            is_default_split = (not has_explicit_code) and (has_data_parallelism or has_seed_parallelism)
+
+            script_key: str | None = None
+            if has_explicit_code:
+                if "." in code_str:
+                    script_key, _ = code_str.rsplit(".", 1)
+                    script_key = script_key or None
+                else:
+                    # No explicit script key: use default script
+                    script_key = None
+
             if is_chart:
-                script_key = proc.get("script")
                 script_path = resolve_script_path(script_key, scripts_section, default_script) if scripts_section else None
                 if script_path and str(script_path).lower().endswith(".py"):
                     chart_script_paths.append(str(script_path))
                 continue
-            script_key = proc.get("script")
+
             script_path = resolve_script_path(script_key, scripts_section, default_script) if scripts_section else None
-            has_code_function = bool(proc.get("code_function"))
-            has_data_parallelism = proc.get("data_parallelism") is not None
-            has_seed_parallelism = proc.get("seed_parallelism") is not None
-            is_default_split = (not has_code_function) and (has_data_parallelism or has_seed_parallelism)
             if not script_path:
                 if is_default_split:
+                    # Default data/seed split nodes without explicit code may omit scripts.
                     continue
                 missing_script_paths.append(str(proc.get("name", "unknown")))
                 continue
@@ -204,7 +218,7 @@ class CustomModelAdapter(ModelAdapter):
             missing = ", ".join(sorted(set(missing_script_paths)))
             raise ValueError(
                 "script must be specified for non-chart processes "
-                "(except default data/seed split nodes without code_function): "
+                "(except default data/seed split nodes without explicit code): "
                 f"{missing}"
             )
         if not script_paths:
@@ -563,15 +577,16 @@ class CustomModelAdapter(ModelAdapter):
                 proc_type = str(proc.get("type", "process"))
                 if proc_type == "chart":
                     continue
-                # script is optional - default script will be used if omitted
-                has_code_function = bool(proc.get("code_function"))
+                raw_code = proc.get("code")
+                code_str = str(raw_code).strip() if isinstance(raw_code, str) else ""
+                has_explicit_code = bool(code_str)
                 has_data_parallelism = proc.get("data_parallelism") is not None
                 has_seed_parallelism = proc.get("seed_parallelism") is not None
-                is_default_split = (not has_code_function) and (has_data_parallelism or has_seed_parallelism)
+                is_default_split = (not has_explicit_code) and (has_data_parallelism or has_seed_parallelism)
                 if is_default_split:
                     continue
-                # For non-split processes, script key is optional (defaults to first script)
-                # Validation passes if script key exists or will use default
+                # For non-split processes, we require either explicit code or default
+                # behavior (code omitted but no split flags). In both cases validation passes.
             return True
         except Exception:
             return False