topo_map_processor 0.1.10__tar.gz → 0.1.12__tar.gz

{topo_map_processor-0.1.10 → topo_map_processor-0.1.12}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: topo_map_processor
-Version: 0.1.10
+Version: 0.1.12
 Summary: Library for processing topographic maps
 Project-URL: homepage, https://github.com/ramSeraph/topo_map_processor
 Project-URL: repository, https://github.com/ramSeraph/topo_map_processor.git
@@ -32,7 +32,7 @@ License: This is free and unencumbered software released into the public domain.
 License-File: LICENSE
 Requires-Python: >=3.12
 Requires-Dist: mercantile>=1.2.1
-Requires-Dist: pmtiles==3.4.1
+Requires-Dist: pmtiles-mosaic>=0.1.0
 Requires-Dist: requests>=2.32.4
 Requires-Dist: shapely>=2.1.1
 Provides-Extra: easyocr
@@ -184,7 +184,13 @@ The `get_intersection_point` method is the most critical part to customize for a
     3.  Identifying the point closest to the expected corner position, while also matching an expected angle and distance from an anchor point.
 
 ![corner for 4way intersection point](/samples/corner3.png)
--   **`get_4way_intersection_point`**: This is a more robust version for crosshair-style corners. It specifically looks for intersections where four lines meet, making it less prone to errors from stray lines in the map collar.
+-   **`get_4way_intersection_point`**: This is a more robust version for crosshair-style corners. It works by:
+    1.  Isolating lines based on their color.
+    2.  Optionally removing any text that might interfere with line detection.
+    3.  Ignoring the edges of the corner image patch to avoid spurious intersections with the border.
+    4.  Detecting all horizontal and vertical lines and finding their intersection points.
+    5.  Validating each intersection by checking for the presence of lines extending in all four directions (up, down, left, right) from the intersection point. This ensures it's a true 4-way "crosshair" intersection.
+    6.  It is designed to be very specific and will fail if it doesn't find exactly one 4-way intersection.
 
 ![corner for biggest contour corner](/samples/corner2.png)
 -   **`get_biggest_contour_corner`**: This strategy is designed for corners that are marked by a solid shape or a filled area (e.g., a colored square or circle). It works by:
@@ -208,15 +214,6 @@ Similar to corner detection, the `locate_grid_lines` method can be implemented u
 
 -   **`get_grid_line_corrections`**: This method serves as a refinement step to improve accuracy. While the transformer provides a very close estimate, this function can correct for minor printing or scanning inaccuracies. For each projected grid intersection, it searches a small area in the actual image for the *true* intersection of printed lines, adjusting the point to match the visual data. This ensures that the lines targeted for removal are precisely the ones printed on the map.
 
-### Tile Sources
-
-The `topo_map_processor.tools.tile_sources` module provides classes for reading tiles from different sources.
-
--   `DiskTilesSource`: Reads tiles from a directory on the local disk.
--   `MBTilesSource`: Reads tiles from an MBTiles file.
--   `PMTilesSource`: Reads tiles from a PMTiles file.
--   `StackedTileSource`: Combines multiple tile sources (Disk, MBTiles, PMTiles) into a single logical source, allowing for seamless access across different storage types.
-
 ### Command-Line Tools
 
 This project provides several command-line tools to work with topographic maps. These tools are dynamically loaded, and you can get the most up-to-date usage information by running the tool with the `--help` flag.
@@ -233,39 +230,6 @@ collect-bounds --bounds-dir <directory> --output-file <file> [--preexisting-file
 -   `--output-file`: Output GeoJSON file path. (Required)
 -   `--preexisting-file`: Pre existing GeoJSON file path. (Optional)
 
-#### `download-mosaic`
-
-Downloads a PMTiles mosaic and converts it to a single MBTiles or PMTiles file. A mosaic is a JSON file that lists multiple PMTiles files.
-
-```bash
-download-mosaic --mosaic-url <url> [--output-file <file>] [--archive-type <type>] [--request-timeout-secs <seconds>] [--num-http-retries <retries>]
-```
-
--   `--mosaic-url`, `-u`: URL of the mosaic JSON file. (Required)
--   `--output-file`, `-o`: Output MBTiles/PMTiles file name. The format is inferred from the extension (`.mbtiles` or `.pmtiles`). If not specified, it is derived from the mosaic URL. (Optional)
--   `--archive-type`: Type of archive to create (`mbtiles` or `pmtiles`). Required if `--output-file` is not provided or its extension is not recognized.
--   `--request-timeout-secs`, `-t`: Timeout for HTTP requests in seconds (default: 60).
--   `--num-http-retries`, `-r`: Number of retries for HTTP requests (default: 3).
-
-#### `partition`
-
-Partitions a large set of tiles into smaller PMTiles files. This is useful for managing large datasets, for example, to stay within file size limits for services like GitHub Releases. It creates a mosaic file if the output is partitioned into multiple files.
-
-```bash
-partition --from-source <source> [--from-source <source> ...] --to-pmtiles <file> [--size-limit <limit>]
-```
-
--   `--from-source`: Path to a source file or directory. Can be repeated. Supported sources:
-    -   `.mbtiles` file: e.g., `path/to/file.mbtiles`
-    -   `.pmtiles` file (supports glob patterns): e.g., `path/to/*.pmtiles`
-    -   Directory containing tiles: e.g., `path/to/tiles_dir`
--   `--to-pmtiles`: Output PMTiles file. The prefix for partitioned files will be derived from this argument.
--   `--size-limit`: Maximum size of each partition. Can be a number in bytes (e.g., `100000000`), or with units (e.g., `100M`, `2G`), or a preset:
-    -   `github_release`: 2GB limit
-    -   `github_file`: 100MB limit
-    -   `cloudflare_object`: 512MB limit
-    The overhead (delta) is scaled proportionally based on the `github_release` preset (2GB with 5MB overhead). Defaults to `github_release`.
-
 #### `retile`
 
 Retiles a specific list of sheets (GeoTIFFs) and updates the corresponding tiles in an existing tile set. It can determine which other sheets are affected and need to be pulled in to correctly retile the area.

{topo_map_processor-0.1.10 → topo_map_processor-0.1.12}/README.md

@@ -135,7 +135,13 @@ The `get_intersection_point` method is the most critical part to customize for a
     3.  Identifying the point closest to the expected corner position, while also matching an expected angle and distance from an anchor point.
 
 ![corner for 4way intersection point](/samples/corner3.png)
--   **`get_4way_intersection_point`**: This is a more robust version for crosshair-style corners. It specifically looks for intersections where four lines meet, making it less prone to errors from stray lines in the map collar.
+-   **`get_4way_intersection_point`**: This is a more robust version for crosshair-style corners. It works by:
+    1.  Isolating lines based on their color.
+    2.  Optionally removing any text that might interfere with line detection.
+    3.  Ignoring the edges of the corner image patch to avoid spurious intersections with the border.
+    4.  Detecting all horizontal and vertical lines and finding their intersection points.
+    5.  Validating each intersection by checking for the presence of lines extending in all four directions (up, down, left, right) from the intersection point. This ensures it's a true 4-way "crosshair" intersection.
+    6.  It is designed to be very specific and will fail if it doesn't find exactly one 4-way intersection.
 
 ![corner for biggest contour corner](/samples/corner2.png)
 -   **`get_biggest_contour_corner`**: This strategy is designed for corners that are marked by a solid shape or a filled area (e.g., a colored square or circle). It works by:
@@ -159,15 +165,6 @@ Similar to corner detection, the `locate_grid_lines` method can be implemented u
 
 -   **`get_grid_line_corrections`**: This method serves as a refinement step to improve accuracy. While the transformer provides a very close estimate, this function can correct for minor printing or scanning inaccuracies. For each projected grid intersection, it searches a small area in the actual image for the *true* intersection of printed lines, adjusting the point to match the visual data. This ensures that the lines targeted for removal are precisely the ones printed on the map.
 
-### Tile Sources
-
-The `topo_map_processor.tools.tile_sources` module provides classes for reading tiles from different sources.
-
--   `DiskTilesSource`: Reads tiles from a directory on the local disk.
--   `MBTilesSource`: Reads tiles from an MBTiles file.
--   `PMTilesSource`: Reads tiles from a PMTiles file.
--   `StackedTileSource`: Combines multiple tile sources (Disk, MBTiles, PMTiles) into a single logical source, allowing for seamless access across different storage types.
-
 ### Command-Line Tools
 
 This project provides several command-line tools to work with topographic maps. These tools are dynamically loaded, and you can get the most up-to-date usage information by running the tool with the `--help` flag.
@@ -184,39 +181,6 @@ collect-bounds --bounds-dir <directory> --output-file <file> [--preexisting-file
 -   `--output-file`: Output GeoJSON file path. (Required)
 -   `--preexisting-file`: Pre existing GeoJSON file path. (Optional)
 
-#### `download-mosaic`
-
-Downloads a PMTiles mosaic and converts it to a single MBTiles or PMTiles file. A mosaic is a JSON file that lists multiple PMTiles files.
-
-```bash
-download-mosaic --mosaic-url <url> [--output-file <file>] [--archive-type <type>] [--request-timeout-secs <seconds>] [--num-http-retries <retries>]
-```
-
--   `--mosaic-url`, `-u`: URL of the mosaic JSON file. (Required)
--   `--output-file`, `-o`: Output MBTiles/PMTiles file name. The format is inferred from the extension (`.mbtiles` or `.pmtiles`). If not specified, it is derived from the mosaic URL. (Optional)
--   `--archive-type`: Type of archive to create (`mbtiles` or `pmtiles`). Required if `--output-file` is not provided or its extension is not recognized.
--   `--request-timeout-secs`, `-t`: Timeout for HTTP requests in seconds (default: 60).
--   `--num-http-retries`, `-r`: Number of retries for HTTP requests (default: 3).
-
-#### `partition`
-
-Partitions a large set of tiles into smaller PMTiles files. This is useful for managing large datasets, for example, to stay within file size limits for services like GitHub Releases. It creates a mosaic file if the output is partitioned into multiple files.
-
-```bash
-partition --from-source <source> [--from-source <source> ...] --to-pmtiles <file> [--size-limit <limit>]
-```
-
--   `--from-source`: Path to a source file or directory. Can be repeated. Supported sources:
-    -   `.mbtiles` file: e.g., `path/to/file.mbtiles`
-    -   `.pmtiles` file (supports glob patterns): e.g., `path/to/*.pmtiles`
-    -   Directory containing tiles: e.g., `path/to/tiles_dir`
--   `--to-pmtiles`: Output PMTiles file. The prefix for partitioned files will be derived from this argument.
--   `--size-limit`: Maximum size of each partition. Can be a number in bytes (e.g., `100000000`), or with units (e.g., `100M`, `2G`), or a preset:
-    -   `github_release`: 2GB limit
-    -   `github_file`: 100MB limit
-    -   `cloudflare_object`: 512MB limit
-    The overhead (delta) is scaled proportionally based on the `github_release` preset (2GB with 5MB overhead). Defaults to `github_release`.
-
 #### `retile`
 
 Retiles a specific list of sheets (GeoTIFFs) and updates the corresponding tiles in an existing tile set. It can determine which other sheets are affected and need to be pulled in to correctly retile the area.

{topo_map_processor-0.1.10 → topo_map_processor-0.1.12}/pyproject.toml

@@ -9,7 +9,7 @@ authors = [
 ]
 dependencies = [
     "mercantile>=1.2.1",
-    "pmtiles==3.4.1",
+    "pmtiles-mosaic>=0.1.0",
     "requests>=2.32.4",
     "shapely>=2.1.1",
 ]
@@ -38,16 +38,10 @@ repository = "https://github.com/ramSeraph/topo_map_processor.git"
 
 [project.scripts]
 collect-bounds = "topo_map_processor.tools.collect_bounds:cli"
-download-mosaic = "topo_map_processor.tools.download_mosaic:cli"
-partition = "topo_map_processor.tools.partition:cli"
-partition-basic = "topo_map_processor.tools.partition_basic:cli"
 retile = "topo_map_processor.tools.retile:cli"
 tile = "topo_map_processor.tools.tile:cli"
-generate-lists = "topo_map_processor.tools.execute_bash:generate_lists"
-upload-to-release = "topo_map_processor.tools.execute_bash:upload_to_release"
 retile-e2e = "topo_map_processor.tools.retile_e2e:cli"
 
-
 [build-system]
 requires = [
     "hatchling",
@@ -64,12 +58,10 @@ version-file = "topo_map_processor/_version.py"
 [tool.hatch.build.targets.sdist]
 include = [
     "topo_map_processor",
-    "topo_map_processor/bash_scripts/**",
 ]
 
 [tool.hatch.build.targets.wheel]
 include = [
     "topo_map_processor",
-    "topo_map_processor/bash_scripts/**",
 ]
 

{topo_map_processor-0.1.10 → topo_map_processor-0.1.12}/topo_map_processor/_version.py

@@ -1,7 +1,14 @@
 # file generated by setuptools-scm
 # don't change, don't track in version control
 
-__all__ = ["__version__", "__version_tuple__", "version", "version_tuple"]
+__all__ = [
+    "__version__",
+    "__version_tuple__",
+    "version",
+    "version_tuple",
+    "__commit_id__",
+    "commit_id",
+]
 
 TYPE_CHECKING = False
 if TYPE_CHECKING:
@@ -9,13 +16,19 @@ if TYPE_CHECKING:
     from typing import Union
 
     VERSION_TUPLE = Tuple[Union[int, str], ...]
+    COMMIT_ID = Union[str, None]
 else:
     VERSION_TUPLE = object
+    COMMIT_ID = object
 
 version: str
 __version__: str
 __version_tuple__: VERSION_TUPLE
 version_tuple: VERSION_TUPLE
+commit_id: COMMIT_ID
+__commit_id__: COMMIT_ID
 
-__version__ = version = '0.1.10'
-__version_tuple__ = version_tuple = (0, 1, 10)
+__version__ = version = '0.1.12'
+__version_tuple__ = version_tuple = (0, 1, 12)
+
+__commit_id__ = commit_id = None

{topo_map_processor-0.1.10 → topo_map_processor-0.1.12}/topo_map_processor/processor.py

@@ -1074,12 +1074,16 @@ class TopoMapProcessor:
 
         return ip
 
-    def get_4way_intersection_point(self, img, line_color, 
+    def get_4way_intersection_point(self, img, line_color, remove_text,
                                     find_line_scale, find_line_iter, 
-                                    cwidth, ext_thresh):
+                                    cwidth, ext_thresh, direction,
+                                    remove_corner_edges_ratio):
         img_mask = self.get_color_mask(img, line_color)
 
-        self.remove_text(img_mask)
+        if remove_text:
+            self.remove_text(img_mask)
+
+        self.remove_corner_edges(img_mask, direction, remove_corner_edges_ratio)
 
         h, w = img_mask.shape[:2]
         self.show_image(img_mask)
@@ -1106,7 +1110,8 @@ class TopoMapProcessor:
             if len(four_corner_ips) > 1:
                 continue
 
-            self.show_points(four_corner_ips, img_mask, [0, 255, 0])
+        self.show_points(four_corner_ips, img_mask, [0, 255, 0])
+
         if len(four_corner_ips) > 1:
             raise Exception(f'multiple intersection points found - {len(four_corner_ips)}')
 

{topo_map_processor-0.1.10 → topo_map_processor-0.1.12}/topo_map_processor/tools/retile.py

@@ -1,16 +1,7 @@
-# /// script
-# requires-python = ">=3.12"
-# dependencies = [
-#     "mercantile",
-#     "pmtiles",
-#     "shapely",
-# ]
-# ///
 
 import os
 import re
 import sys
-import glob
 import json
 import argparse
 
@@ -33,7 +24,9 @@ from osgeo_utils.gdal2tiles import (
     DividedCache,
 )
 
-from .tile_sources import create_source_from_paths, MissingTileError
+from pmtiles_mosaic.tile_sources import create_source_from_paths, MissingTileError
+
+from .utils import relax_open_file_limit
 
 def run_external(cmd):
     print(f'running cmd - {cmd}')
@@ -309,8 +302,8 @@ class Tiler:
             prev_affected_tiles = curr_affected_tiles
     
         metadata = self.orig_tile_source.get_metadata()
-        metadata['minzoom'] = self.orig_tile_source.min_zoom
-        metadata['maxzoom'] = self.orig_tile_source.max_zoom
+        metadata['minzoom'] = min_zoom
+        metadata['maxzoom'] = max_zoom
         self.disk_handler.save_metadata(metadata)
         print('All Done!!!')
 
@@ -454,6 +447,8 @@ def retile_main(args):
     if tile_extension == 'jpg':
         tile_extension = 'jpeg'
 
+    relax_open_file_limit()
+
     os.environ['GDAL_CACHEMAX'] = '2048'
     os.environ['GDAL_MAX_DATASET_POOL_SIZE'] = '5000'
     os.environ['GDAL_DISABLE_READDIR_ON_OPEN'] = 'TRUE'

{topo_map_processor-0.1.10 → topo_map_processor-0.1.12}/topo_map_processor/tools/retile_e2e.py

@@ -8,7 +8,8 @@ import sys
 from pathlib import Path
 from multiprocessing import set_start_method
 
-from .partition import partition_main
+from pmtiles_mosaic.partition import partition_main
+
 from .retile import retile_main
 
 

{topo_map_processor-0.1.10 → topo_map_processor-0.1.12}/topo_map_processor/tools/tile.py

@@ -9,9 +9,12 @@ import subprocess
 
 from pathlib import Path
 from multiprocessing import set_start_method, cpu_count
+from pprint import pprint
 
 from osgeo_utils.gdal2tiles import submain as gdal2tiles_main
 
+from .utils import relax_open_file_limit
+
 SUPPORTED_FORMATS = ['webp', 'jpeg', 'png']
 
 def run_external(cmd):
@@ -56,6 +59,14 @@ def get_tiler_cmd_params(tile_extension, tile_quality):
 
     raise ValueError(f'Unsupported tile extension: {tile_extension}, {SUPPORTED_FORMATS=}')
 
+def get_format(tile_extension):
+    if tile_extension == 'webp':
+        return 'webp'
+    if tile_extension == 'jpeg':
+        return 'jpeg'
+    if tile_extension == 'png':
+        return 'png'
+    raise ValueError(f'Unsupported tile extension: {tile_extension}, {SUPPORTED_FORMATS=}')
 
 
 def cli():
@@ -86,6 +97,7 @@ def cli():
     else:
         attribution_text = args.attribution
 
+    relax_open_file_limit()
 
     tiles_dir = Path(args.tiles_dir)
     tiles_dir.mkdir(parents=True, exist_ok=True)
@@ -131,10 +143,12 @@ def cli():
 
     metadata_file = tiles_dir / 'tiles.json'
 
+    fmt = get_format(args.tile_extension)
+
     # it is not really a proper tilejson spec.. it is the basic things needed to populate a pmtiles metadata
     metadata = {
         'type': 'baselayer',
-        'format': format,
+        'format': fmt,
         'attribution': attribution_text,
         'description': args.description,
         'name': args.name,
@@ -142,6 +156,9 @@ def cli():
         'maxzoom': args.max_zoom,
         'minzoom': args.min_zoom,
     }
+
+    print(f'writing metadata to {metadata_file}')
+    pprint(metadata)
     metadata_file.write_text(json.dumps(metadata, indent=2))
 
     print('All Done!!')

topo_map_processor-0.1.12/topo_map_processor/tools/utils.py

@@ -0,0 +1,31 @@
+
+import resource
+
+
+def relax_open_file_limit():
+
+    # Get the current soft and hard limits for open files
+    current_soft, current_hard = resource.getrlimit(resource.RLIMIT_NOFILE)
+    print(f"Current open file limits: Soft={current_soft}, Hard={current_hard}")
+    
+    # Set new soft and hard limits for open files
+    new_soft = resource.RLIM_INFINITY  # Set to unlimited
+    new_hard = resource.RLIM_INFINITY  # Set to unlimited
+
+    try:
+        resource.setrlimit(resource.RLIMIT_NOFILE, (new_soft, new_hard))
+        print(f"New open file limits set: Soft={new_soft}, Hard={new_hard}")
+    except Exception as e:
+        print(f"Error setting resource limit to unlimited: {e}")
+        print('Increasing soft limit to match the hard limit instead')
+        new_soft = current_hard
+        new_hard = current_hard
+        try:
+            resource.setrlimit(resource.RLIMIT_NOFILE, (new_soft, new_hard))
+            print(f"New open file limits set: Soft={new_soft}, Hard={new_hard}")
+        except Exception as e:
+            print(f"Error setting soft resource limit to match hard limit: {e}")
+    
+    # Verify the new limits
+    updated_soft, updated_hard = resource.getrlimit(resource.RLIMIT_NOFILE)
+    print(f"Verified open file limits: Soft={updated_soft}, Hard={updated_hard}")

topo_map_processor-0.1.10/topo_map_processor/bash_scripts/generate_lists.sh

@@ -1,33 +0,0 @@
-#!/bin/bash
-
-prog_name=${COMMNAND_NAME:-$(basename "$0")}
-release_base=$1
-ext=$2
-
-if [ -z "$release_base" ] || [ -z "$ext" ]; then
-  echo "Usage: $prog_name <release_base> <extension>"
-  exit 1
-fi
-
-#owner=$(gh repo view --json owner -q .owner.login)
-#name=$(gh repo view --json name -q .name)
-#repo="$owner/$name"
-
-echo "getting file list"
-echo "name,size,url" > listing_files.csv
-
-# Get all releases, then filter for the base release and any -extra releases.
-releases_to_process=$(gh release list --repo "$repo" --json tagName -q '.[].tagName' | grep -E "^${release_base}(-extra[0-9]+)?$")
-releases_to_process=$(echo "$releases_to_process" | sort -u)
-
-echo "Will process releases: $releases_to_process"
-
-for release in $releases_to_process; do
-  echo "Processing release: $release"
-  gh release view "$release" --json assets -q ".assets[] | select(.name | endswith(\"$ext\")) | \"\\(.name),\\(.size),\\(.url)\"" >> listing_files.csv
-done
-
-gh release upload "$release_base" listing_files.csv --clobber
-
-rm listing_files.csv
-

topo_map_processor-0.1.10/topo_map_processor/bash_scripts/upload_to_release.sh

@@ -1,148 +0,0 @@
-#!/bin/bash
-
-# A script to upload files from a folder to a GitHub release,
-# skipping files that already exist in the release.
-# If the fourth argument is 'yes', it will overwrite existing assets.
-
-set -e
-set -o pipefail
-
-# --- Configuration ---
-# TAG: The git tag of the release to upload to.
-# FOLDER: The local folder containing the files to upload.
-# OVERWRITE: Optional. Set to 'yes' to allow overwriting existing assets.
-prog_name=${COMMNAND_NAME:-$(basename "$0")}
-
-if [ "$#" -lt 3 ] || [ "$#" -gt 4 ]; then
-    echo "Usage: $prog_name <tag> <folder> <extension_without_the_leading_dot> [yes_to_overwrite]"
-    exit 1
-fi
-
-TAG="$1"
-FOLDER="$2"
-EXT="$3"
-OVERWRITE_FLAG=${4:-no}
-
-# --- Pre-flight Checks ---
-
-# Check if gh is installed
-if ! command -v gh &> /dev/null; then
-    echo "Error: gh command-line tool is not installed. Please install it to continue."
-    exit 1
-fi
-
-if [ -z "$TAG" ]; then
-    echo "Error: Release tag is not specified."
-    exit 1
-fi
-
-if [ ! -d "$FOLDER" ]; then
-    echo "Error: Folder '$FOLDER' not found."
-    exit 1
-fi
-
-if [ -z "$EXT" ]; then
-    echo "Error: Extension '$EXT' is not specified."
-    exit 1
-fi
-
-ALLOW_OVERWRITE=0
-if [ "$OVERWRITE_FLAG" == "yes" ]; then
-    ALLOW_OVERWRITE=1
-    echo "Overwrite flag is set. Existing assets will be overwritten."
-fi
-
-# --- Main Logic ---
-
-echo "Fetching existing assets for releases matching pattern '${TAG}(-extra[0-9]+)?'..."
-
-# Get all releases, then filter for the base release and any -extra releases, and sort them
-RELEASES_TO_PROCESS=$(gh release list --json tagName -q '.[].tagName' | grep -E "^${TAG}(-extra[0-9]+)?$" | sort -V)
-
-if [ -z "$RELEASES_TO_PROCESS" ]; then
-    echo "Error: No releases found matching pattern '${TAG}(-extra[0-9]+)?'." >&2
-    exit 1
-fi
-
-echo "Found releases: $RELEASES_TO_PROCESS"
-
-# Store assets with their release tags. Format: "asset_name release_tag"
-EXISTING_ASSETS_WITH_RELEASES=""
-for release in $RELEASES_TO_PROCESS; do
-  echo "Fetching assets from release: $release"
-  assets=$(gh release view "$release" --json assets -q '.assets[].name' 2>/dev/null || echo "")
-  if [ -n "$assets" ]; then
-    while IFS= read -r asset_name; do
-      if [ -n "$asset_name" ]; then
-        EXISTING_ASSETS_WITH_RELEASES="${EXISTING_ASSETS_WITH_RELEASES}${asset_name} ${release}"$'
-'
-      fi
-    done <<< "$assets"
-  fi
-done
-
-# Determine available releases and their current asset counts
-AVAILABLE_RELEASES=()
-AVAILABLE_ASSET_COUNTS=()
-for release in $RELEASES_TO_PROCESS; do
-    count=$(gh release view "$release" --json assets -q '.assets | length' 2>/dev/null || echo "0")
-    
-    MAX_ASSETS=998
-    if [ "$release" == "$TAG" ]; then
-        MAX_ASSETS=988
-    fi
-
-    if [ "$count" -lt "$MAX_ASSETS" ]; then
-        AVAILABLE_RELEASES+=("$release")
-        AVAILABLE_ASSET_COUNTS+=("$count")
-    fi
-done
-
-echo "Starting upload process from folder '$FOLDER'..."
-
-# Find all files in the folder that are not yet in any release and loop through them.
-find "${FOLDER}" -type f | grep "^.*\.${EXT}$" | while read -r FILE_PATH; do
-    FILENAME=$(basename "$FILE_PATH")
-    echo "Processing file: $FILENAME"
-
-    set +o pipefail
-    RELEASE_FOR_ASSET=$(echo -n "$EXISTING_ASSETS_WITH_RELEASES" | grep "^${FILENAME} " | head -n 1 | awk '{print $2}')
-    set -o pipefail
-
-    if [ -n "$RELEASE_FOR_ASSET" ]; then
-        # Asset exists
-        if [ "$ALLOW_OVERWRITE" -eq 1 ]; then
-            echo "  -> Overwriting '$FILENAME' in release '$RELEASE_FOR_ASSET'..."
-            gh release upload "$RELEASE_FOR_ASSET" "$FILE_PATH" --clobber
-        else
-            echo "  -> Skipping '$FILENAME', it already exists in release '$RELEASE_FOR_ASSET'."
-        fi
-        continue
-    fi
-
-    # Find a release to upload to for a new asset
-    if [ ${#AVAILABLE_RELEASES[@]} -eq 0 ]; then
-        echo "Error: All existing releases are full. No space to upload '$FILENAME'." >&2
-        exit 1
-    fi
-
-    UPLOAD_TARGET=${AVAILABLE_RELEASES[0]}
-
-    echo "  -> Uploading '$FILENAME' to '$UPLOAD_TARGET'..."
-    gh release upload "$UPLOAD_TARGET" "$FILE_PATH"
-
-    # Update asset count and remove release from available list if full
-    AVAILABLE_ASSET_COUNTS[0]=$((${AVAILABLE_ASSET_COUNTS[0]} + 1))
-    
-    MAX_ASSETS=998
-    if [ "$UPLOAD_TARGET" == "$TAG" ]; then
-        MAX_ASSETS=988
-    fi
-
-    if [ "${AVAILABLE_ASSET_COUNTS[0]}" -ge "$MAX_ASSETS" ]; then
-        AVAILABLE_RELEASES=("${AVAILABLE_RELEASES[@]:1}")
-        AVAILABLE_ASSET_COUNTS=("${AVAILABLE_ASSET_COUNTS[@]:1}")
-    fi
-done
-
-echo "Upload process complete."