dar-backup 0.6.18__py3-none-any.whl → 0.6.20__py3-none-any.whl

dar_backup/Changelog.md

@@ -1,6 +1,37 @@
 <!-- markdownlint-disable MD024 -->
 # dar-backup Changelog
 
+## v2-beta-0.6.20 - 2025-05-03
+
+Github link: [v2-beta-0.6.20](https://github.com/per2jensen/dar-backup/tree/v2-beta-0.6.20/v2)
+
+### Added
+
+- show_version() moved to util and tests for dar-backup, manager and cleanup
+- startup informational messages now works the same across the scripts
+- Improved ConfigSettings class to handle optional configuration keys
+
+  -- test cases added
+
+- Optional config parameter: MANAGER_DB_DIR, ideally to point to another disk for safe keeping backup catalogs
+
+  -- test cases added
+
+## v2-beta-0.6.19 - 2025-04-21
+
+Github link: [v2-beta-0.6.19](https://github.com/per2jensen/dar-backup/tree/v2-beta-0.6.19/v2)
+
+### Added
+
+- removed a BackupError in the verify() to reduce noise in logs and let the rest of "compares" run.
+- Added bash and zsh auto completion for a nicer CLI experience.
+  
+  -- See [README for details](https://github.com/per2jensen/dar-backup?tab=readme-ov-file#shell-autocompletion)  
+
+- Improvement to command_runner.run(), more robust decoding
+
+- Manager --add-specific-archive now gives a prompt with a warning if user attempts to add a catalog that breaks chronology. The user is allowed to go forward and ignore the warning or can choose to abort. The program times out after a little while and discards the operation.
+
 ## v2-beta-0.6.18 - 2025-04-05
 
 Github link: [v2-beta-0.6.18](https://github.com/per2jensen/dar-backup/tree/v2-beta-0.6.18/v2)

dar_backup/README.md

@@ -2,12 +2,18 @@
 # Full, differential or incremental backups using 'dar'
 
 [![codecov](https://codecov.io/gh/per2jensen/dar-backup/branch/main/graph/badge.svg)](https://codecov.io/gh/per2jensen/dar-backup)
+[![PyPI monthly downloads](https://img.shields.io/pypi/dm/dar-backup)](https://pypi.org/project/dar-backup/)
+[![Total Downloads](https://img.shields.io/badge/dynamic/json?color=blue&label=Total%20Downloads&query=total&url=https%3A%2F%2Fraw.githubusercontent.com%2Fper2jensen%2Fdar-backup%2Fmain%2Fdownloads.json)](https://pypi.org/project/dar-backup/)
 
 The wonderful 'dar' [Disk Archiver](https://github.com/Edrusb/DAR) is used for
 the heavy lifting, together with the par2 suite in these scripts.
 
 This is the `Python` based **version 2** of `dar-backup`.
 
+## TL;DR
+
+`dar-backup` is a Python-powered CLI for creating and validating full, differential, and incremental backups using dar and par2. Designed for long-term restore integrity, even on user-space filesystems like FUSE.
+
 ## Table of Contents
 
 - [Full, differential or incremental backups using 'dar'](#full-differential-or-incremental-backups-using-dar)
@@ -33,6 +39,7 @@ This is the `Python` based **version 2** of `dar-backup`.
   - [Generate systemd files](#generate-systemd-files)
   - [Service: dar-back --incremental-backup](#service-dar-backup---incremental-backup)
   - [Timer: dar-back --incremental-backup](#timer-dar-backup---incremental-backup)
+  - [Systemd timer note](#systemd-timer-note)
 - [List contents of an archive](#list-contents-of-an-archive)
 - [dar file selection examples](#dar-file-selection-examples)
   - [Select a directory](#select-a-directory)
@@ -58,7 +65,9 @@ This is the `Python` based **version 2** of `dar-backup`.
   - [Skipping cache directories](#skipping-cache-directories)
   - [Progress bar + current directory](#progress-bar-and-current-directory)
 - [Todo](#todo)
+- [Known Limitations / Edge Cases](#known-limitations--edge-cases)
 - [Reference](#reference)
+  - [CLI Tools Overview](#cli-tools-overview)
   - [Test coverage report](#test-coverage)
   - [dar-backup](#dar-backup-options)
   - [manager](#manager-options)
@@ -651,6 +660,10 @@ Persistent=true
 WantedBy=timers.target
 ````
 
+## systemd timer note
+
+📅 OnCalendar syntax is flexible — you can tweak backup schedules easily. Run systemd-analyze calendar to preview timers.
+
 ## list contents of an archive
 
 ```` bash
@@ -941,8 +954,27 @@ The indicators are not shown if dar-backup is run from systemd or if it is used
 - Look into a way to move the .par2 files away from the `dar` slices, to maximize chance of good redundancy.
 - Add option to dar-backup to use the `dar` option `--fsa-scope none`
 
+## Known Limitations / Edge Cases
+
+Does not currently encrypt data (by design — relies on encrypted storage)
+
+One backup definition per file
+
+.par2 files created for each slice (may be moved in future)
+
 ## Reference
 
+### CLI Tools Overview
+
+| Command               | Description                               |
+|-----------------------|-------------------------------------------|
+| `dar-backup`          | Perform full, differential, or incremental backups with verification and restore testing |
+| `manager`             | Maintain and query catalog databases for archives |
+| `cleanup`             | Remove outdated DIFF/INCR archives (and optionally FULLs) |
+| `clean-log`           | Clean up excessive log output from dar command logs |
+| `installer`           | Set up required directories and default config files |
+| `dar-backup-systemd`  | Generate (and optionally install) systemd timers and services for automated backups |
+
 ### test coverage
 
 Running
@@ -951,23 +983,26 @@ Running
 pytest --cov=dar_backup tests/
 ````
 
-results for version 0.6.17 in this report:
+results for a dev version 0.6.19 in this report:
 
 ```` code
 ---------- coverage: platform linux, python 3.12.3-final-0 -----------
-Name                                                              Stmts   Miss  Cover
--------------------------------------------------------------------------------------
-venv/lib/python3.12/site-packages/dar_backup/__about__.py             1      0   100%
-venv/lib/python3.12/site-packages/dar_backup/__init__.py              0      0   100%
-venv/lib/python3.12/site-packages/dar_backup/clean_log.py            68     14    79%
-venv/lib/python3.12/site-packages/dar_backup/cleanup.py             196     53    73%
-venv/lib/python3.12/site-packages/dar_backup/config_settings.py      66      8    88%
-venv/lib/python3.12/site-packages/dar_backup/dar_backup.py          464     99    79%
-venv/lib/python3.12/site-packages/dar_backup/installer.py            46     46     0%
-venv/lib/python3.12/site-packages/dar_backup/manager.py             316     72    77%
-venv/lib/python3.12/site-packages/dar_backup/util.py                162     34    79%
--------------------------------------------------------------------------------------
-TOTAL                                                              1319    326    75%
+Name                                   Stmts   Miss  Cover
+----------------------------------------------------------
+src/dar_backup/__about__.py                1      0   100%
+src/dar_backup/__init__.py                 0      0   100%
+src/dar_backup/clean_log.py               68     13    81%
+src/dar_backup/cleanup.py                193     17    91%
+src/dar_backup/command_runner.py          73      1    99%
+src/dar_backup/config_settings.py         66      8    88%
+src/dar_backup/dar_backup.py             535     56    90%
+src/dar_backup/dar_backup_systemd.py      56      7    88%
+src/dar_backup/installer.py               59      6    90%
+src/dar_backup/manager.py                351     56    84%
+src/dar_backup/rich_progress.py           70      7    90%
+src/dar_backup/util.py                   130     15    88%
+----------------------------------------------------------
+TOTAL                                   1602    186    88%
 ````
 
 ### dar-backup options

dar_backup/__about__.py

@@ -1 +1 @@
-__version__ = "0.6.18"
+__version__ = "0.6.20"

dar_backup/clean_log.py

@@ -11,6 +11,8 @@ See section 15 and section 16 in the supplied "LICENSE" file
 
 This script can be used to remove (much of) the logged output from `dar`.
 When `dar` verbose options are enabled, quite a lot of information is emitted.
+
+If a rerex is matched, the entire line is removed (change in v2-beta-0.6.19).
 """
 
 
@@ -19,7 +21,7 @@ import re
 import os
 import sys 
 
-from . import __about__ as about
+from dar_backup import __about__ as about
 from dar_backup.config_settings import ConfigSettings
 
 LICENSE = '''Licensed under GNU GENERAL PUBLIC LICENSE v3, see the supplied file "LICENSE" for details.
@@ -32,7 +34,7 @@ def clean_log_file(log_file_path, dry_run=False):
 
     if not os.path.isfile(log_file_path):
         print(f"File '{log_file_path}' not found!")
-        sys.exit(1)
+        sys.exit(127)
 
     if not os.access(log_file_path, os.R_OK):
         print(f"No read permission for '{log_file_path}'")
@@ -49,13 +51,18 @@ def clean_log_file(log_file_path, dry_run=False):
     temp_file_path = log_file_path + ".tmp"
     
     patterns = [
+        r"INFO\s*-\s*Inspecting\s*directory",
+        r"INFO\s*-\s*Finished\s*Inspecting",
         r"INFO\s*-\s*<File",
+        r"INFO\s*-\s*</File",
         r"INFO\s*-\s*<Attributes",
+        r"INFO\s*-\s*</Attributes",
         r"INFO\s*-\s*</Directory",
         r"INFO\s*-\s*<Directory",
-        r"INFO\s*-\s*</File",
-        r"INFO\s*-\s*Inspecting\s*directory",
-        r"INFO\s*-\s*Finished\s*Inspecting"
+        r"INFO\s*-\s*<Catalog",
+        r"INFO\s*-\s*</Catalog",
+        r"INFO\s*-\s*<Symlink",
+        r"INFO\s*-\s*</Symlink",
     ]
 
     try:
@@ -70,9 +77,9 @@ def clean_log_file(log_file_path, dry_run=False):
                         if dry_run:
                             print(f"Would remove: {original_line.strip()}")  # Print full line for dry-run
                         matched = True  # Mark that a pattern matched
-                        line = re.sub(pattern, "", line).strip()  # Remove only matched part
+                        break  # No need to check other patterns if one matches
 
-                if not dry_run and line:  # In normal mode, only write non-empty lines
+                if not dry_run and not matched:  # In normal mode, only write non-empty lines
                     outfile.write(line.rstrip() + "\n")
 
                 if dry_run and matched:

dar_backup/cleanup.py

@@ -13,17 +13,22 @@ This script removes old DIFF and INCR archives + accompanying .par2 files accord
 [AGE] settings in the configuration file.
 """
 
+import argcomplete
 import argparse
 import logging
 import os
 import re
 import subprocess
 import sys
+sys.path.insert(0, os.path.abspath(os.path.join(os.path.dirname(__file__), "..", "..")))
+
+
 
 from datetime import datetime, timedelta
 from inputimeout import inputimeout, TimeoutOccurred
 from time import time
-from typing import Dict, List, NamedTuple
+from typing import Dict, List, NamedTuple, Tuple
+
 
 from . import __about__ as about
 from dar_backup.config_settings import ConfigSettings
@@ -31,6 +36,9 @@ from dar_backup.util import list_backups
 from dar_backup.util import setup_logging
 from dar_backup.util import get_logger
 from dar_backup.util import requirements
+from dar_backup.util import show_version
+from dar_backup.util import print_aligned_settings
+from dar_backup.util import backup_definition_completer, list_archive_completer
 
 from dar_backup.command_runner import CommandRunner   
 from dar_backup.command_runner import CommandResult
@@ -150,21 +158,12 @@ def delete_catalog(catalog_name: str, args: NamedTuple) -> bool:
         return False
 
 
-def show_version():
-    script_name = os.path.basename(sys.argv[0])
-    print(f"{script_name} {about.__version__}")
-    print('''Licensed under GNU GENERAL PUBLIC LICENSE v3, see the supplied file "LICENSE" for details.
-THERE IS NO WARRANTY FOR THE PROGRAM, TO THE EXTENT PERMITTED BY APPLICABLE LAW, not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
-See section 15 and section 16 in the supplied "LICENSE" file.''')
-
-
 def confirm_full_archive_deletion(archive_name: str, test_mode=False) -> bool:
     try:
         if test_mode:
-            confirmation = os.environ.get("CLEANUP_TEST_DELETE_FULL")
-            if confirmation is None:
-                raise RuntimeError("envvar 'CLEANUP_TEST_DELETE_FULL' not set")
-            print(f"Simulated confirmation for FULL archive: {confirmation}")
+            answer = os.getenv("CLEANUP_TEST_DELETE_FULL", "").lower()
+            print(f"Simulated confirmation for FULL archive '{archive_name}': {answer}")
+            return answer == "yes"
         else:
             confirmation = inputimeout(
                 prompt=f"Are you sure you want to delete the FULL archive '{archive_name}'? (yes/no): ",
@@ -186,16 +185,19 @@ def main():
     global logger, runner
 
     parser = argparse.ArgumentParser(description="Cleanup old archives according to AGE configuration.")
-    parser.add_argument('-d', '--backup-definition', help="Specific backup definition to cleanup.")
+    parser.add_argument('-d', '--backup-definition', help="Specific backup definition to cleanup.").completer = backup_definition_completer
     parser.add_argument('-c', '--config-file', '-c', type=str, help="Path to 'dar-backup.conf'", default='~/.config/dar-backup/dar-backup.conf')
     parser.add_argument('-v', '--version', action='store_true', help="Show version information.")
     parser.add_argument('--alternate-archive-dir', type=str, help="Cleanup in this directory instead of the default one.")
-    parser.add_argument('--cleanup-specific-archives', type=str, help="Comma separated list of archives to cleanup") 
+    parser.add_argument('--cleanup-specific-archives', type=str, help="Comma separated list of archives to cleanup").completer = list_archive_completer 
     parser.add_argument('-l', '--list', action='store_true', help="List available archives.")
     parser.add_argument('--verbose', action='store_true', help="Print various status messages to screen")
     parser.add_argument('--log-level', type=str, help="`debug` or `trace`, default is `info`", default="info")
     parser.add_argument('--log-stdout', action='store_true', help='also print log messages to stdout')
     parser.add_argument('--test-mode', action='store_true', help='Read envvars in order to run some pytest cases')
+
+    argcomplete.autocomplete(parser)
+
     args = parser.parse_args()
 
     args.config_file = os.path.expanduser(os.path.expandvars(args.config_file))
@@ -215,21 +217,24 @@ def main():
     command_logger = get_logger(command_output_logger = True)
     runner = CommandRunner(logger=logger, command_logger=command_logger)
 
-    logger.info(f"=====================================")
-    logger.info(f"cleanup.py started, version: {about.__version__}")
+    start_msgs: List[Tuple[str, str]] = []
+
+    start_msgs.append(("cleanup.py:", about.__version__))
 
     logger.info(f"START TIME: {start_time}")
     logger.debug(f"`args`:\n{args}")
     logger.debug(f"`config_settings`:\n{config_settings}")
 
     file_dir =  os.path.normpath(os.path.dirname(__file__))
-    args.verbose and (print(f"Script directory:           {file_dir}"))
-    args.verbose and (print(f"Config file:                {args.config_file}"))
-    args.verbose and (print(f"Backup dir:                 {config_settings.backup_dir}"))
-    args.verbose and (print(f"Logfile location:           {config_settings.logfile_location}"))
-    args.verbose and (print(f"--alternate-archive-dir:    {args.alternate_archive_dir}"))
-    args.verbose and (print(f"--cleanup-specific-archives:{args.cleanup_specific_archives}")) 
-
+    args.verbose and start_msgs.append(("Script directory:", file_dir))
+    start_msgs.append(("Config file:", args.config_file))
+    args.verbose and start_msgs.append(("Backup dir:", config_settings.backup_dir))
+    start_msgs.append(("Logfile:", config_settings.logfile_location))
+    args.verbose and start_msgs.append(("--alternate-archive-dir:", args.alternate_archive_dir))
+    args.verbose and start_msgs.append(("--cleanup-specific-archives:", args.cleanup_specific_archives)) 
+
+    dangerous_keywords = ["--cleanup", "_FULL_"] # TODO: add more dangerous keywords
+    print_aligned_settings(start_msgs, highlight_keywords=dangerous_keywords)
 
     # run PREREQ scripts
     requirements('PREREQ', config_settings)

dar_backup/command_runner.py

@@ -3,8 +3,11 @@ import logging
 import threading
 import os
 import sys
+import tempfile
 sys.path.insert(0, os.path.abspath(os.path.join(os.path.dirname(__file__), "../src")))
 from typing import List, Optional
+from dar_backup.util import get_logger
+
 
 class CommandResult:
     def __init__(self, returncode: int, stdout: str, stderr: str):
@@ -15,6 +18,7 @@ class CommandResult:
     def __repr__(self):
         return f"<CommandResult returncode={self.returncode}>"
 
+
 class CommandRunner:
     def __init__(
         self,
@@ -22,10 +26,41 @@ class CommandRunner:
         command_logger: Optional[logging.Logger] = None,
         default_timeout: int = 30
     ):
-        self.logger = logger or logging.getLogger(__name__)
-        self.command_logger = command_logger or self.logger
+        self.logger = logger or get_logger()
+        self.command_logger = command_logger or get_logger(command_output_logger=True)
         self.default_timeout = default_timeout
 
+        if not self.logger or not self.command_logger:
+            self.logger_fallback()
+
+    def logger_fallback(self):
+        """
+        Setup temporary log files
+        """
+        main_log = tempfile.NamedTemporaryFile(delete=False)
+        command_log = tempfile.NamedTemporaryFile(delete=False)
+
+        logger = logging.getLogger("command_runner_fallback_main_logger")
+        command_logger = logging.getLogger("command_runner_fallback_command_logger")
+        logger.setLevel(logging.DEBUG)
+        command_logger.setLevel(logging.DEBUG)
+
+        main_handler = logging.FileHandler(main_log.name)
+        command_handler = logging.FileHandler(command_log.name)
+
+        logger.addHandler(main_handler)
+        command_logger.addHandler(command_handler)
+
+        self.logger = logger
+        self.command_logger = command_logger
+        self.default_timeout = 30
+        self.logger.info("CommandRunner initialized with fallback loggers")
+        self.command_logger.info("CommandRunner initialized with fallback loggers")
+
+        print(f"[WARN] Using fallback loggers:\n  Main log: {main_log.name}\n  Command log: {command_log.name}", file=sys.stderr)
+
+
+
     def run(
         self,
         cmd: List[str],
@@ -36,24 +71,39 @@ class CommandRunner:
         text: bool = True
     ) -> CommandResult:
         timeout = timeout or self.default_timeout
-        self.logger.debug(f"Executing command: {' '.join(cmd)} (timeout={timeout}s)")
+
+        #log the command to be executed
+        command = f"Executing command: {' '.join(cmd)} (timeout={timeout}s)"
+        self.command_logger.info(command) # log to command logger
+        self.logger.debug(command)        # log to main logger if "--log-level debug"
 
         process = subprocess.Popen(
             cmd,
             stdout=subprocess.PIPE if capture_output else None,
             stderr=subprocess.PIPE if capture_output else None,
-            text=text,
-            bufsize=1
+            text=False,
+            bufsize=-1
         )
 
         stdout_lines = []
         stderr_lines = []
 
+
         def stream_output(stream, lines, level):
-            for line in iter(stream.readline, ''):
-                lines.append(line)
-                self.command_logger.log(level, line.strip())
-            stream.close()
+            try:
+                while True:
+                    chunk = stream.read(1024)
+                    if not chunk:
+                        break
+                    decoded = chunk.decode('utf-8', errors='replace')
+                    lines.append(decoded)
+                    self.command_logger.log(level, decoded.strip())
+            except Exception as e:
+                self.logger.warning(f"stream_output decode error: {e}")
+            finally:
+                stream.close()
+
+
 
         threads = []
         if capture_output and process.stdout:

dar_backup/config_settings.py

@@ -1,33 +1,35 @@
-
 import configparser
-import logging
-import sys
-
 from dataclasses import dataclass, field, fields
 from os.path import expandvars, expanduser
 from pathlib import Path
 
+from dar_backup.exceptions import ConfigSettingsError
+
 @dataclass
 class ConfigSettings:
     """
-    A dataclass for holding configuration settings, initialized from a configuration file.
-
-    Attributes:
-        logfile_location (str): The location of the log file.
-        max_size_verification_mb (int): The maximum size for verification in megabytes.
-        min_size_verification_mb (int): The minimum size for verification in megabytes.
-        no_files_verification (int): The number of files for verification.
-        command_timeout_secs (int): The timeout in seconds for commands.
-        backup_dir (str): The directory for backups.
-        test_restore_dir (str): The directory for test restores.
-        backup_d_dir (str): The directory for backup.d.
-        diff_age (int): The age for differential backups before deletion.
-        incr_age (int): The age for incremental backups before deletion.
-        error_correction_percent (int): The error correction percentage for PAR2.
-        par2_enabled (bool): Whether PAR2 is enabled.
+    Parses and holds configuration values from a dar-backup.conf file.
+
+    Required fields are defined as dataclass attributes and must be present in the config file.
+    Optional fields can be declared in the OPTIONAL_CONFIG_FIELDS list. If a key is present in the
+    config file, the field is set to its parsed value; otherwise, it defaults to None.
+
+    The __repr__ method will only include optional fields if their value is not None,
+    keeping debug output clean and focused on explicitly configured values.
+
+    OPTIONAL_CONFIG_FIELDS = [
+        {
+            "section": "DIRECTORIES",
+            "key": "MANAGER_DB_DIR",
+            "attr": "manager_db_dir",
+            "type": str,
+            "default": None,
+        }
+    ]
     """
 
     config_file: str
+
     logfile_location: str = field(init=False)
     max_size_verification_mb: int = field(init=False)
     min_size_verification_mb: int = field(init=False)
@@ -41,17 +43,28 @@ class ConfigSettings:
     error_correction_percent: int = field(init=False)
     par2_enabled: bool = field(init=False)
 
+
+    OPTIONAL_CONFIG_FIELDS = [
+        {
+            "section": "DIRECTORIES",
+            "key": "MANAGER_DB_DIR",
+            "attr": "manager_db_dir",
+            "type": str,
+            "default": None,
+        },
+        # Add more optional fields here
+    ]
+
     def __post_init__(self):
-        """
-        Initializes the ConfigSettings instance by reading the specified configuration file
-        and expands environment variables for all string fields.
-        """
-        if self.config_file is None:
-            raise ValueError("`config_file` must be specified.")
-        
-        self.config = configparser.ConfigParser()
+        if not self.config_file:
+            raise ConfigSettingsError("`config_file` must be specified.")
+
         try:
-            self.config.read(self.config_file)
+            self.config = configparser.ConfigParser()
+            loaded_files = self.config.read(self.config_file)
+            if not loaded_files:
+                raise RuntimeError(f"Configuration file not found or unreadable: '{self.config_file}'")
+
             self.logfile_location = self.config['MISC']['LOGFILE_LOCATION']
             self.max_size_verification_mb = int(self.config['MISC']['MAX_SIZE_VERIFICATION_MB'])
             self.min_size_verification_mb = int(self.config['MISC']['MIN_SIZE_VERIFICATION_MB'])
@@ -63,37 +76,54 @@ class ConfigSettings:
             self.diff_age = int(self.config['AGE']['DIFF_AGE'])
             self.incr_age = int(self.config['AGE']['INCR_AGE'])
             self.error_correction_percent = int(self.config['PAR2']['ERROR_CORRECTION_PERCENT'])
+
             val = self.config['PAR2']['ENABLED'].strip().lower()
             if val in ('true', '1', 'yes'):
                 self.par2_enabled = True
             elif val in ('false', '0', 'no'):
                 self.par2_enabled = False
             else:
-                raise ValueError(f"Invalid boolean value for 'ENABLED' in [PAR2]: '{val}'")
-            
-            # Ensure the directories exist
-            Path(self.backup_dir).mkdir(parents=True, exist_ok=True)
-            Path(self.test_restore_dir).mkdir(parents=True, exist_ok=True)
-            Path(self.backup_d_dir).mkdir(parents=True, exist_ok=True)
-
-            # Expand environment variables for all string fields
+                raise ConfigSettingsError(f"Invalid boolean value for 'ENABLED' in [PAR2]: '{val}'")
+
+            # Load optional fields
+            for opt in self.OPTIONAL_CONFIG_FIELDS:
+                if self.config.has_option(opt['section'], opt['key']):
+                    raw_value = self.config.get(opt['section'], opt['key'])
+                    try:
+                        value = opt['type'](raw_value.strip())
+                        setattr(self, opt['attr'], value)
+                    except Exception as e:
+                        raise ConfigSettingsError(
+                            f"Failed to parse optional config '{opt['section']}::{opt['key']}': {e}"
+                        )
+                else:
+                    setattr(self, opt['attr'], opt.get('default', None))
+
+
+            # Expand paths in all string fields that exist
             for field in fields(self):
-                if isinstance(getattr(self, field.name), str):
-                    setattr(self, field.name, expanduser(expandvars(getattr(self, field.name))))
-
-        except FileNotFoundError as e:
-            logging.error(f"Configuration file not found: {self.config_file}")
-            logging.error(f"Error details: {e}")
-            sys.exit("Error: Configuration file not found.")
-        except PermissionError as e:
-            logging.error(f"Permission error while reading config file {self.config_file}")
-            logging.error(f"Error details: {e}")
-            sys.exit("Error: Permission error while reading config file.")
+                if hasattr(self, field.name):
+                    value = getattr(self, field.name)
+                    if isinstance(value, str):
+                        setattr(self, field.name, expanduser(expandvars(value)))
+
+        except RuntimeError as e:
+            raise ConfigSettingsError(f"RuntimeError: {e}")
         except KeyError as e:
-            logging.error(f"Missing mandatory configuration key: {e}")
-            logging.error(f"Error details: {e}")
-            sys.exit(f"Error: Missing mandatory configuration key: {e}.")
+            raise ConfigSettingsError(f"Missing mandatory configuration key: {e}")
+        except ValueError as e:
+            raise ConfigSettingsError(f"Invalid value in config: {e}")
         except Exception as e:
-            logging.exception(f"Unexpected error reading config file {self.config_file}: {e}")
-            logging.error(f"Error details: {e}")
-            sys.exit(f"Unexpected error reading config file: {e}.")
+            raise ConfigSettingsError(f"Unexpected error during config initialization: {e}")
+
+
+
+    def __repr__(self):
+        safe_fields = [
+            f"{field.name}={getattr(self, field.name)!r}"
+            for field in fields(self)
+            if hasattr(self, field.name) and getattr(self, field.name) is not None
+        ]
+        return f"<ConfigSettings({', '.join(safe_fields)})>"
+
+

dar_backup/dar-backup.conf

@@ -16,8 +16,12 @@ COMMAND_TIMEOUT_SECS = 86400
 BACKUP_DIR = ~/dar-backup/backups
 BACKUP.D_DIR = ~/.config/dar-backup/backup.d/
 TEST_RESTORE_DIR = ~/dar-backup/restore/
+# Optional parameter
+# If you want to store the catalog database away from the BACKUP_DIR,  use the MANAGER_DB_DIR variable.
+#MANAGER_DB_DIR = /some/where/else/
 
 [AGE]
+# DIFF and INCR backups are kept for a configured number of days, then deleted by the `cleanuo` 
 # age settings are in days
 DIFF_AGE = 100
 INCR_AGE = 40