nenuflow 0.2__tar.gz

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (29) hide show
  1. nenuflow-0.2/.gitignore +14 -0
  2. nenuflow-0.2/CHANGELOG.md +17 -0
  3. nenuflow-0.2/LICENSE +674 -0
  4. nenuflow-0.2/PKG-INFO +299 -0
  5. nenuflow-0.2/README.md +277 -0
  6. nenuflow-0.2/nenuflow/__init__.py +1 -0
  7. nenuflow-0.2/nenuflow/cli.py +82 -0
  8. nenuflow-0.2/nenuflow/main.nf +136 -0
  9. nenuflow-0.2/nenuflow/models/Ateam_LBA.skymodel +364 -0
  10. nenuflow-0.2/nenuflow/parsets/average.parset +8 -0
  11. nenuflow-0.2/nenuflow/parsets/dd_cal.parset +12 -0
  12. nenuflow-0.2/nenuflow/parsets/dd_sub.parset +11 -0
  13. nenuflow-0.2/nenuflow/parsets/di_apply.parset +11 -0
  14. nenuflow-0.2/nenuflow/parsets/di_ateams_subtraction.parset +11 -0
  15. nenuflow-0.2/nenuflow/parsets/di_cal_ateam.parset +12 -0
  16. nenuflow-0.2/nenuflow/parsets/wsclean_allsky.yaml +20 -0
  17. nenuflow-0.2/nenuflow/parsets/wsclean_selfcal.yaml +24 -0
  18. nenuflow-0.2/nenuflow/processes/calibration.nf +285 -0
  19. nenuflow-0.2/nenuflow/processes/diagnostics.nf +307 -0
  20. nenuflow-0.2/nenuflow/processes/imaging.nf +133 -0
  21. nenuflow-0.2/nenuflow/processes/skymodel.nf +336 -0
  22. nenuflow-0.2/nenuflow/templates/nextflow.config.template +216 -0
  23. nenuflow-0.2/nenuflow/templates/plot_aoqstats.py +54 -0
  24. nenuflow-0.2/nenuflow/workflows/calibrate_dd.nf +93 -0
  25. nenuflow-0.2/nenuflow/workflows/calibrate_di.nf +152 -0
  26. nenuflow-0.2/nenuflow/workflows/fast_track.nf +88 -0
  27. nenuflow-0.2/nenuflow/workflows/postprocess.nf +38 -0
  28. nenuflow-0.2/nenuflow/workflows/selfcal.nf +174 -0
  29. nenuflow-0.2/pyproject.toml +78 -0
nenuflow-0.2/.gitignore ADDED
@@ -0,0 +1,14 @@
1
+ .nextflow/
2
+ .nextflow.log*
3
+ work/
4
+ results/
5
+ /nextflow.config
6
+ .vscode/
7
+ __pycache__/
8
+ .ruff_cache/
9
+ .coverage
10
+ coverage.xml
11
+
12
+ test/stub/data/
13
+ test/stub/*.txt
14
+ test/stub/*.log
nenuflow-0.2/CHANGELOG.md ADDED
@@ -0,0 +1,17 @@
1
+ # Change Log
2
+
3
+ ## Unreleased
4
+
5
+ ## 0.2 - 2026-08-03
6
+
7
+ - [Changed] Add ruff lint configuration and fix all reported issues
8
+ - [Changed] Add GitLab CI with automated linting, tests, and coverage reporting
9
+ - [Fixed] Make the CLI initialization test independent of files in the developer checkout
10
+
11
+ ## 0.1.0 - 2026-07-06
12
+
13
+ - [New] `nenuflow` pip-installable CLI (`init`/`run`), replacing manual `nextflow.config` copying and hardcoded absolute `main.nf` paths — `nenuflow init` scaffolds a deployment directory, `nenuflow run MSLIST [NEXTFLOW_ARGS...]` resolves the bundled pipeline and runs it in its own `-work-dir work/<name>`, with `-resume`
14
+ - [Change] Self-cal WSClean diagnostic calls trimmed from 8 to 4 per run (full-sky before A-team subtraction, sky-model imaging, full-sky after A-team subtraction, deep clean after DD calibration) — the dropped calls were redundant checks that weren't meaningfully cheaper than the ones kept
15
+ - [Fix] Two concurrency races where a wide-field diagnostic image could run in parallel with a process mutating the same MS in place (`SubtractSources`/DD calibration) — both now gated behind the diagnostic via a `combine()` barrier
16
+ - [Change] Resource accounting simplified to pure cpu-based throttling: `cpus = 10` declared on WSClean and all DP3-based (`dp3` label) processes, so the local executor's own `floor(available cpus / cpus)` accounting caps concurrency; `max_forks`/`maxForks` removed everywhere
17
+ - [Change] `parsets/wsclean_allsky.yaml` retuned for speed while preserving full horizon coverage (`maxuv-l: 210` instead of shrinking the field, `scale: 8amin`/`size: 900`, `baseline-averaging: 0.5`)