starbash 0.2.7__tar.gz → 0.3.1__tar.gz

{starbash-0.2.7 → starbash-0.3.1}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: starbash
-Version: 0.2.7
+Version: 0.3.1
 Summary: A tool for automating/standardizing/sharing astrophotography workflows.
 License-File: LICENSE
 Author: Kevin Hester
@@ -11,10 +11,14 @@ Classifier: Programming Language :: Python :: 3.12
 Classifier: Programming Language :: Python :: 3.13
 Classifier: Programming Language :: Python :: 3.14
 Requires-Dist: astropy (>=7.1.1,<8.0.0)
+Requires-Dist: click (>=8.0,<8.5)
 Requires-Dist: doit (>=0.36.0,<0.37.0)
 Requires-Dist: graxpert[cpuonly] (>=3.2.0a2,<4.0.0)
+Requires-Dist: jinja2 (>=3.1,<4.0)
+Requires-Dist: keyring (>=25.6,<26.0)
 Requires-Dist: numpy (==2.2.6)
 Requires-Dist: platformdirs (>=4.5.0,<5.0.0)
+Requires-Dist: pygal (>=3.0,<4.0)
 Requires-Dist: pyqt6 (>=6.10.1,<7.0.0)
 Requires-Dist: restrictedpython (>=8.1,<9.0)
 Requires-Dist: rich (>=14.2.0,<15.0.0)
@@ -37,15 +41,16 @@ Description-Content-Type: text/markdown
 A tool for automating/standardizing/sharing astrophotography workflows.
 
 ## What is starbash?
+<img src="https://raw.githubusercontent.com/geeksville/starbash/refs/heads/main/doc/icon/generated/web/icon-192.png" alt="Starbash: Astrophotography workflows simplified" width="30%" align="right" style="margin-bottom: 20px;">
 
-<img src="https://raw.githubusercontent.com/geeksville/starbash/refs/heads/main/doc/img/icon.jpg" alt="Starbash: Astrophotography workflows simplified" width="30%" align="right" style="margin-bottom: 20px;">
-
-* Automatic - with sensible defaults that you can change as needed.  Just a few keystrokes to preprocess an entire repo of raw images.
-* Easy - provides a 'seestar-like' autoprocessing all your sessions (by default).  You can optionally do manual postprocessing with all this 'grunt work' preprocessing automated.
+* Automatic - with sensible defaults that you can change as needed.  Just a few keystrokes to auto-process an **entire** repo of raw images.  It uses sensible customizable defaults - you can optionally tweak parameters and reprocess as needed.
+* Easy - provides a 'seestar-like' autoprocessing all your sessions (by default).  You can optionally do manual postprocessing with all this 'grunt work' default processing automated.
 * Fast<sup>1</sup> - even with large image repositories.  Automatic master bias and flat generation.  Automatic preprocessing/ stacking/background-elimination with reasonable defaults.
-* Multi-session - by default.  So your workflows can stack from multiple nights (and still use the correct flats etc...).
+* Multi-session - by default.  So your workflows can stack from multiple nights (and still use/auto-generate the correct flats, darks/biases etc...).
 * Shareable - you can share/use recipes for image preprocessing flows.  The eventual goal is a transition away from opaque burried scripts.  Recipes can come from multiple repos and you or other orgs can host recipes.
+* Automatic (optional) posting/creation of your generated images and workflows to a free ['github pages'](https://docs.github.com/en/pages) website.  [Sample](https://geeksville.github.io/starbash-public/targets/sh2-91/).
 * Attribution (by default) - a full set of contributions to final image can be tracked: instrument, raw images, processed-by, recipes-by/version etc...
+* Full session/FITS aware history - select targets by name, date-range, instrument etc... 
 
 (This project is currently 'alpha' and missing recipes for some workflows, but adding new recipes is easy and we're happy to help.  Please file a GitHub issue if your images are not auto-processed and we'll work out a fix.)
 
@@ -55,7 +60,7 @@ A tool for automating/standardizing/sharing astrophotography workflows.
 ## What is starbash NOT
 
 ### Not a new image processing tool (like Siril)
-It is important to understand that Starbash is primarily a tool for **repeatable**, **sharable**, **semi-automated** workflows.  It is tool agnostic and really just focuses on the relationship between tools, images and sessions.  It builds upon the great work of existing tools (currently mainly Siril and Graxpert) so we can grow an ecosystem of recipes.
+It is important to understand that Starbash is primarily a tool for **repeatable**, **sharable**, **semi-automated** workflows.  It is tool agnostic and really just focuses on the relationship between tools, images and sessions.  It builds upon the great work of existing tools (currently mainly [Siril](https://siril.org/), [GraXpert](https://graxpert.com/), [Blurxterminator](https://www.rc-astro.com/software/bxt/) and [Starnet2](https://starnetastro.com/cli-tools/)) so we can grow an ecosystem of recipes.
 
 ### Not a set of scripts
 
@@ -93,10 +98,19 @@ If you are interested in alpha-testing we ❤️ you.  This README should have e
 * Repos can be on the local disk or shared via HTTPS/GitHub/etc.  This is particularly useful for recipe repos.
 * [Graxpert](https://graxpert.com/) based [recipe stages](https://github.com/geeksville/starbash-recipes/tree/main/graxpert) added (support for Pixinsight-based recipes will probably be coming at some point...).
 
+### From the alpha 3 (0.3.0) release (2026/08/31)
+
+- Added end-to-end GitHub Pages publishing, including a friendlier GitHub setup flow and automatic token refresh.
+- Introduced the new processing layout with shareable per-target configuration and improved recipe/dependency handling.
+- Added Starnet, BlurXTerminator, and NoiseXTerminator support, with live Siril progress and automatic star recomposition.
+- Improved FITS/session reporting with focal-length and FWHM information, plus more reliable OSC stacking.
+- Added safer cleanup of temporary processing files and clearer warnings when external tools are missing.
+- Publishing is now about twice as fast thanks to concurrent uploads.
+
 ## Features coming soon
 
 * Recipe 'writers guide' documentation.  Currently iterating based on usage reports 😄
-* Support for mono-camera workflows (the alpha only includes osc recipes).
+* Support for mono-camera workflows (this alpha only includes osc recipes).
 * The target report can be used to auto-generate a human-friendly 'postable/shareable' report about that image.
 * Target reports are shareable so that you can request comments from others and others can rerender with different settings.
 * Namespaces for recipes are disambiguated to be globally unique
@@ -194,6 +208,23 @@ If you don't want the automated processing you can still ask Starbash to prepare
 
 ![siril session](https://raw.githubusercontent.com/geeksville/starbash/refs/heads/main/doc/vhs/process-siril.gif)
 
+### Fully extensible/repeatable/sharable workflows
+
+Early user guide [here](doc/toml/guide.md).
+
+### Publish a shareable website
+
+Generate a local GitHub Pages-compatible site or publish processed targets to
+your personal public `starbash-public` repository.  The first time you run this command
+it will walk you through creating a (free) account and signing into github:
+
+```text
+sb publish github               # Publish to github
+```
+
+See the [GitHub publishing guide](doc/publish/github.md) for prerequisites,
+preview instructions, authentication, and troubleshooting.
+
 ## Supported commands
 
 ### Repository Management
@@ -242,6 +273,8 @@ Starbash is a tool agnostic workflow manager.  But it wouldn't be possible witho
 
 * [Siril](https://siril.org/)
 * [Graxpert](https://graxpert.com/) - for background and noise elimination
+* [blur exterminator / noise exterminator](https://www.rc-astro.com/stand-alone-rc-astro-tools/)
+* [starnet](https://starnetastro.com/cli-tools/) - for star removal
 * [Python](https://www.python.org/) (you can add Python code to recipes if necessary)
 
 ## Credits
@@ -258,6 +291,17 @@ We accept pull-requests and enjoy discussing possible new development directions
 
 [Click here](https://raw.githubusercontent.com/geeksville/starbash/refs/heads/main/doc/development.md) for the current work in progress developer docs.  They will get better before our beta release...
 
+## AI slop and development
+
+I'm okay with using AI tools to help make code.  In fact, I used them a fair amount so far on this project (one of my first experiments with not writing all my code 'by hand').  So far it has been pretty fun.
+
+However, in some of my other open-source projects, I've seen the current hell PR management is becoming.  So I'd **love** any code contributions y'all want to make (and I promise to be kind) but:
+
+* Please only send in PRs **you** are willing to sign off as 'nicely written' (using your experience as an engineer).  If your little AI buddy made something a bit ugly, please iterate with it first to make it not ugly.
+* Send in PRs that are fairly 'atomic' (touch just the code they need to touch for one nicely defined feature or bug-fix)
+* Only send in tested code you've run on real hardware (not just the simulator)
+* If you are new at making software: no problem! We can talk in the pull-request and make it better.
+
 ## License
 
 Copyright 2025 Kevin Hester, kevinh@geeksville.com.

{starbash-0.2.7 → starbash-0.3.1}/README.md

@@ -7,15 +7,16 @@
 A tool for automating/standardizing/sharing astrophotography workflows.
 
 ## What is starbash?
+<img src="https://raw.githubusercontent.com/geeksville/starbash/refs/heads/main/doc/icon/generated/web/icon-192.png" alt="Starbash: Astrophotography workflows simplified" width="30%" align="right" style="margin-bottom: 20px;">
 
-<img src="https://raw.githubusercontent.com/geeksville/starbash/refs/heads/main/doc/img/icon.jpg" alt="Starbash: Astrophotography workflows simplified" width="30%" align="right" style="margin-bottom: 20px;">
-
-* Automatic - with sensible defaults that you can change as needed.  Just a few keystrokes to preprocess an entire repo of raw images.
-* Easy - provides a 'seestar-like' autoprocessing all your sessions (by default).  You can optionally do manual postprocessing with all this 'grunt work' preprocessing automated.
+* Automatic - with sensible defaults that you can change as needed.  Just a few keystrokes to auto-process an **entire** repo of raw images.  It uses sensible customizable defaults - you can optionally tweak parameters and reprocess as needed.
+* Easy - provides a 'seestar-like' autoprocessing all your sessions (by default).  You can optionally do manual postprocessing with all this 'grunt work' default processing automated.
 * Fast<sup>1</sup> - even with large image repositories.  Automatic master bias and flat generation.  Automatic preprocessing/ stacking/background-elimination with reasonable defaults.
-* Multi-session - by default.  So your workflows can stack from multiple nights (and still use the correct flats etc...).
+* Multi-session - by default.  So your workflows can stack from multiple nights (and still use/auto-generate the correct flats, darks/biases etc...).
 * Shareable - you can share/use recipes for image preprocessing flows.  The eventual goal is a transition away from opaque burried scripts.  Recipes can come from multiple repos and you or other orgs can host recipes.
+* Automatic (optional) posting/creation of your generated images and workflows to a free ['github pages'](https://docs.github.com/en/pages) website.  [Sample](https://geeksville.github.io/starbash-public/targets/sh2-91/).
 * Attribution (by default) - a full set of contributions to final image can be tracked: instrument, raw images, processed-by, recipes-by/version etc...
+* Full session/FITS aware history - select targets by name, date-range, instrument etc... 
 
 (This project is currently 'alpha' and missing recipes for some workflows, but adding new recipes is easy and we're happy to help.  Please file a GitHub issue if your images are not auto-processed and we'll work out a fix.)
 
@@ -25,7 +26,7 @@ A tool for automating/standardizing/sharing astrophotography workflows.
 ## What is starbash NOT
 
 ### Not a new image processing tool (like Siril)
-It is important to understand that Starbash is primarily a tool for **repeatable**, **sharable**, **semi-automated** workflows.  It is tool agnostic and really just focuses on the relationship between tools, images and sessions.  It builds upon the great work of existing tools (currently mainly Siril and Graxpert) so we can grow an ecosystem of recipes.
+It is important to understand that Starbash is primarily a tool for **repeatable**, **sharable**, **semi-automated** workflows.  It is tool agnostic and really just focuses on the relationship between tools, images and sessions.  It builds upon the great work of existing tools (currently mainly [Siril](https://siril.org/), [GraXpert](https://graxpert.com/), [Blurxterminator](https://www.rc-astro.com/software/bxt/) and [Starnet2](https://starnetastro.com/cli-tools/)) so we can grow an ecosystem of recipes.
 
 ### Not a set of scripts
 
@@ -63,10 +64,19 @@ If you are interested in alpha-testing we ❤️ you.  This README should have e
 * Repos can be on the local disk or shared via HTTPS/GitHub/etc.  This is particularly useful for recipe repos.
 * [Graxpert](https://graxpert.com/) based [recipe stages](https://github.com/geeksville/starbash-recipes/tree/main/graxpert) added (support for Pixinsight-based recipes will probably be coming at some point...).
 
+### From the alpha 3 (0.3.0) release (2026/08/31)
+
+- Added end-to-end GitHub Pages publishing, including a friendlier GitHub setup flow and automatic token refresh.
+- Introduced the new processing layout with shareable per-target configuration and improved recipe/dependency handling.
+- Added Starnet, BlurXTerminator, and NoiseXTerminator support, with live Siril progress and automatic star recomposition.
+- Improved FITS/session reporting with focal-length and FWHM information, plus more reliable OSC stacking.
+- Added safer cleanup of temporary processing files and clearer warnings when external tools are missing.
+- Publishing is now about twice as fast thanks to concurrent uploads.
+
 ## Features coming soon
 
 * Recipe 'writers guide' documentation.  Currently iterating based on usage reports 😄
-* Support for mono-camera workflows (the alpha only includes osc recipes).
+* Support for mono-camera workflows (this alpha only includes osc recipes).
 * The target report can be used to auto-generate a human-friendly 'postable/shareable' report about that image.
 * Target reports are shareable so that you can request comments from others and others can rerender with different settings.
 * Namespaces for recipes are disambiguated to be globally unique
@@ -164,6 +174,23 @@ If you don't want the automated processing you can still ask Starbash to prepare
 
 ![siril session](https://raw.githubusercontent.com/geeksville/starbash/refs/heads/main/doc/vhs/process-siril.gif)
 
+### Fully extensible/repeatable/sharable workflows
+
+Early user guide [here](doc/toml/guide.md).
+
+### Publish a shareable website
+
+Generate a local GitHub Pages-compatible site or publish processed targets to
+your personal public `starbash-public` repository.  The first time you run this command
+it will walk you through creating a (free) account and signing into github:
+
+```text
+sb publish github               # Publish to github
+```
+
+See the [GitHub publishing guide](doc/publish/github.md) for prerequisites,
+preview instructions, authentication, and troubleshooting.
+
 ## Supported commands
 
 ### Repository Management
@@ -212,6 +239,8 @@ Starbash is a tool agnostic workflow manager.  But it wouldn't be possible witho
 
 * [Siril](https://siril.org/)
 * [Graxpert](https://graxpert.com/) - for background and noise elimination
+* [blur exterminator / noise exterminator](https://www.rc-astro.com/stand-alone-rc-astro-tools/)
+* [starnet](https://starnetastro.com/cli-tools/) - for star removal
 * [Python](https://www.python.org/) (you can add Python code to recipes if necessary)
 
 ## Credits
@@ -228,6 +257,17 @@ We accept pull-requests and enjoy discussing possible new development directions
 
 [Click here](https://raw.githubusercontent.com/geeksville/starbash/refs/heads/main/doc/development.md) for the current work in progress developer docs.  They will get better before our beta release...
 
+## AI slop and development
+
+I'm okay with using AI tools to help make code.  In fact, I used them a fair amount so far on this project (one of my first experiments with not writing all my code 'by hand').  So far it has been pretty fun.
+
+However, in some of my other open-source projects, I've seen the current hell PR management is becoming.  So I'd **love** any code contributions y'all want to make (and I promise to be kind) but:
+
+* Please only send in PRs **you** are willing to sign off as 'nicely written' (using your experience as an engineer).  If your little AI buddy made something a bit ugly, please iterate with it first to make it not ugly.
+* Send in PRs that are fairly 'atomic' (touch just the code they need to touch for one nicely defined feature or bug-fix)
+* Only send in tested code you've run on real hardware (not just the simulator)
+* If you are new at making software: no problem! We can talk in the pull-request and make it better.
+
 ## License
 
 Copyright 2025 Kevin Hester, kevinh@geeksville.com.

{starbash-0.2.7 → starbash-0.3.1}/pyproject.toml

@@ -1,6 +1,6 @@
 [tool.poetry]
 name = "starbash"
-version = "0.2.7"
+version = "0.3.1"
 description = "A tool for automating/standardizing/sharing astrophotography workflows."
 authors = ["Kevin Hester <kevinh@geeksville.com>"]
 readme = "README.md"
@@ -21,10 +21,17 @@ restrictedpython = ">=8.1,<9.0"
 astropy = ">=7.1.1,<8.0.0"
 platformdirs = ">=4.5.0,<5.0.0"
 typer = "^0.20.0"
+# Typer 0.20.1 still imports Click's deprecated stream helpers. Click 8.5
+# warns about those imports, so keep the compatible pre-8.5 release line until
+# Typer removes that dependency on deprecated APIs.
+click = ">=8.0,<8.5"
 sentry-sdk = "^2.42.1"
 update-checker = "^0.18.0"
 doit = "^0.36.0"
 textual = "^6.8.0"
+jinja2 = ">=3.1,<4.0"
+pygal = ">=3.0,<4.0"
+keyring = ">=25.6,<26.0"
 
 # Note: to use graxpert from the local tree rather than pypi use:
 # graxpert = {path = "GraXpert", extras = ["cpuonly"], develop = true}
@@ -45,6 +52,9 @@ ruff = "^0.14.4"
 basedpyright = "^1.33.0"
 textual-dev = "^1.8.0"
 
+# Adds the `graph` command to doit (GraphViz output) for `sb process doit graph`.
+doit-graph = "^0.3.0"
+
 # We don't currently use this text based sql client
 # harlequin = "^2.4.1"
 

{starbash-0.2.7 → starbash-0.3.1}/src/starbash/aliases.py

@@ -29,7 +29,7 @@ def normalize_target_name(name: str | None) -> str | None:
     """Converts a target name to an any filesystem-safe format by removing spaces and other noise"""
     if name is None:
         return None
-    return name.replace(" ", "").replace("(", "").replace(")", "").lower()
+    return name.replace("-", " ").replace(" ", "").replace("(", "").replace(")", "").lower()
 
 
 def pre_normalize(name: str) -> str:

{starbash-0.2.7 → starbash-0.3.1}/src/starbash/analytics.py

@@ -75,7 +75,6 @@ def analytics_shutdown() -> None:
 
 def is_development_environment() -> bool:
     """Detect if running in a development environment."""
-
     # Check for explicit environment variable
     if os.getenv("SENTRY_ENVIRONMENT") == "development":
         return True
@@ -139,7 +138,11 @@ class NopAnalytics:
 
 
 def analytics_start_span(**kwargs: Any) -> Any:
-    """Start an analytics/tracing span if analytics is enabled, otherwise return a no-op context manager."""
+    """Start an analytics/tracing span if analytics is enabled, otherwise return a no-op context manager.
+
+    arguments (example):
+        name="operation-name", op="category"
+    """
     if analytics_allowed:
         import sentry_sdk
 

{starbash-0.2.7 → starbash-0.3.1}/src/starbash/app.py

@@ -10,7 +10,6 @@ from typing import Any
 
 import rich.console
 import typer
-from astropy.io import fits
 from rich.logging import RichHandler
 from rich.progress import track
 from toml_repo import Repo, RepoManager, get_config_suffix
@@ -39,6 +38,7 @@ from starbash.database import (
 )
 from starbash.dwarf3 import extend_dwarf3_headers
 from starbash.exception import NonSoftwareError, UserHandledError, raise_missing_repo
+from starbash.fits import read_fits_header
 from starbash.linux import linux_init
 from starbash.os import symlink_or_copy
 from starbash.paths import get_user_config_dir, get_user_config_path
@@ -719,31 +719,24 @@ class Starbash:
 
         if not found or force:
             # Read and log the primary header (HDU 0)
-            with fits.open(str(f), memmap=False) as hdul:
-                # convert headers to dict
-                hdu0: Any = hdul[0]
-                header = hdu0.header
-                if type(header).__name__ == "Unknown":
-                    raise ValueError("FITS header has Unknown type: %s", f)
-
-                items = header.items()
-                headers = {}
-                for key, value in items:
-                    if (not whitelist) or (key in whitelist):
-                        headers[key] = value
-
-                # Add any extra metadata if it was missing in the existing headers
-                for key, value in extra_metadata.items():
-                    headers.setdefault(key, value)
-
-                # Store relative path in database (use POSIX-style forward slashes for consistency)
-                headers["path"] = relative_path_str
-                if self._extend_image_header(headers, f):
-                    image_doc_id = self.db.upsert_image(headers, repo.url)
-                    headers[Database.ID_KEY] = image_doc_id
-
-                    if not found:  # allow a session to also be created
-                        return headers
+            headers = read_fits_header(f)
+            if not whitelist:
+                headers = dict(headers)
+            else:
+                headers = {key: value for key, value in headers.items() if key in whitelist}
+
+            # Add any extra metadata if it was missing in the existing headers
+            for key, value in extra_metadata.items():
+                headers.setdefault(key, value)
+
+            # Store relative path in database (use POSIX-style forward slashes for consistency)
+            headers["path"] = relative_path_str
+            if self._extend_image_header(headers, f):
+                image_doc_id = self.db.upsert_image(headers, repo.url)
+                headers[Database.ID_KEY] = image_doc_id
+
+                if not found:  # allow a session to also be created
+                    return headers
 
         return None
 
@@ -781,6 +774,10 @@ class Starbash:
                 all_files,
                 description=f"Indexing {repo.url}...",
             ):
+                if ".sbignore" in str(f):
+                    logging.warning('Skipping "%s": path contains ".sbignore".', f)
+                    continue
+
                 try:
                     # progress.console.print(f"Indexing {f}...")
                     if repo_kind == "master":

{starbash-0.2.7 → starbash-0.3.1}/src/starbash/commands/process.py

@@ -90,7 +90,7 @@ def siril(
             else:
                 session_to_dir(candidates[0].candidate, subdir)
 
-        # FIXME put an starbash.toml repo file in output_dir (with info about what we picked/why)
+        # FIXME put a processed-target metadata file in output_dir (with info about what we picked/why)
         # to allow users to override/reprocess with the same settings.
         # Also FIXME, check for the existence of such a file
 
@@ -264,6 +264,8 @@ def doit(
             from starbash import console
 
             console.print("[red]This command is currently for developers only...[/red]")
+            # Build the full task tree so doit subcommands (graph/list/info) have data to show.
+            proc.load_tasks_for_inspection()
             proc.doit.run(ctx.args)