pywaybackup 3.3.0__tar.gz → 3.4.0__tar.gz

{pywaybackup-3.3.0/pywaybackup.egg-info → pywaybackup-3.4.0}/PKG-INFO

@@ -1,6 +1,6 @@
-Metadata-Version: 2.4
+Metadata-Version: 2.1
 Name: pywaybackup
-Version: 3.3.0
+Version: 3.4.0
 Summary: Query and download archive.org as simple as possible.
 Author-email: bitdruid <bitdruid@outlook.com>
 License: MIT License
@@ -35,7 +35,6 @@ Requires-Dist: requests==2.32.3
 Requires-Dist: tqdm==4.67.1
 Requires-Dist: python-magic==0.4.27; sys_platform == "linux"
 Requires-Dist: python-magic-bin==0.4.14; sys_platform == "win32"
-Dynamic: license-file
 
 # python wayback machine downloader
 
@@ -77,12 +76,50 @@ This tool allows you to download content from the Wayback Machine (archive.org).
 <br>
 <br>
 
-## Arguments
+## import
+
+You can import pywaybackup into your own scripts and run it. Args are the same as cli.
+
+Additional args:
+- `silent` (default True): If True, suppresses all output to the console.
+- `debug` (default False): If True, disables writing errors to the error log file.
+
+```python
+from pywaybackup import PyWayBackup
+
+backup = PyWayBackup(
+  url="https://example.com",
+  all=True,
+  start="20200101",
+  end="20201231",
+  silent=False,
+  debug=True,
+  log=True,
+  keep=True
+)
+
+backup.run()
+backup_paths = backup.paths(rel=True)
+print(backup_paths)
+```
+output:
+```bash
+{
+  'snapshots': 'output/example.com',
+  'cdxfile': 'output/waybackup_example.cdx',
+  'dbfile': 'output/waybackup_example.com.db',
+  'csvfile': 'output/waybackup_https.example.com.csv',
+  'log': 'output/waybackup_example.com.log',
+  'debug': 'output/waybackup_error.log'
+}
+```
+
+## cli
 
 - `-h`, `--help`: Show the help message and exit.
 - `-v`, `--version`: Show information about the tool and exit.
 
-### Required
+#### Required
 
 - **`-u`**, **`--url`**:<br>
   The URL of the web page to download. This argument is required.
@@ -107,8 +144,8 @@ This tool allows you to download content from the Wayback Machine (archive.org).
   Limits the amount of snapshots to query from the CDX server. If an existing CDX file is injected, the limit will have no effect. So you would need to set `--keep`.
 
 - **Range Selection:**<br>
-  Specify the range in years or a specific timestamp either start, end, or both. If you specify the `range` argument, the `start` and `end` arguments will be ignored. Format for timestamps: YYYYMMDDhhmmss. You can only give a year or increase specificity by going through the timestamp starting on the left.<br>
-  (year 2019, year 2019, year+month+day 20190101, year+month+day+hour 2019010112)
+  Specify the range in years or a specific timestamp either start, end, or both. If you specify the `range`, the `start` and `end` will be ignored. Format for timestamps: YYYYMMDDhhmmss. You can only give a year or increase specificity by going through the timestamp starting on the left.<br>
+  (year 2019, year+month+day 20190101, year+month+day+hour 2019010112)
 
   - **`-r`**, **`--range`**:<br>
     Specify the range in years for which to search and download snapshots.
@@ -144,9 +181,6 @@ This tool allows you to download content from the Wayback Machine (archive.org).
 - **`--verbose`**:<br>
   Increase output verbosity.
 
-<!-- - **`--verbosity`** `<level>`:<br>
-Sets verbosity level. Options are `info`and `trace`. Default is `info`. -->
-
 - **`--log`** <!-- `<path>` -->:<br>
   Saves a log file into the output-dir. Named as `waybackup_<sanitized_url>.log`.
 
@@ -165,9 +199,6 @@ Sets verbosity level. Options are `info`and `trace`. Default is `info`. -->
 - **`--delay`** `<seconds>`:<br>
   Specifies delay between download requests in seconds. Default is no delay (0).
 
-<!-- - **`--convert-links`**:<br>
-If set, all links in the downloaded files will be converted to local links. This is useful for offline browsing. The links are converted to the local path structure. Show output with `--verbosity trace`. -->
-
 #### Job Handling:
 
 - **`--reset`**:  
@@ -265,9 +296,7 @@ your/path/waybackup_snapshots/
 
 ### CSV
 
-Each snapshot is stored with the following keys/values. These are either stored in a sqlite database while the download is running or saved into a CSV file after the download is finished.
-
-For download queries:
+The CSV contains a snapshot per row:
 
 ```
 [
@@ -313,5 +342,3 @@ Exceptions will be written into `waybackup_error.log` (each run overwrites the f
 
 I'm always happy for some feature requests to improve the usability of this tool.
 Feel free to give suggestions and report issues. Project is still far from being perfect.
-
-> Please PR from dev into dev.

{pywaybackup-3.3.0 → pywaybackup-3.4.0}/README.md

@@ -38,12 +38,50 @@ This tool allows you to download content from the Wayback Machine (archive.org).
 <br>
 <br>
 
-## Arguments
+## import
+
+You can import pywaybackup into your own scripts and run it. Args are the same as cli.
+
+Additional args:
+- `silent` (default True): If True, suppresses all output to the console.
+- `debug` (default False): If True, disables writing errors to the error log file.
+
+```python
+from pywaybackup import PyWayBackup
+
+backup = PyWayBackup(
+  url="https://example.com",
+  all=True,
+  start="20200101",
+  end="20201231",
+  silent=False,
+  debug=True,
+  log=True,
+  keep=True
+)
+
+backup.run()
+backup_paths = backup.paths(rel=True)
+print(backup_paths)
+```
+output:
+```bash
+{
+  'snapshots': 'output/example.com',
+  'cdxfile': 'output/waybackup_example.cdx',
+  'dbfile': 'output/waybackup_example.com.db',
+  'csvfile': 'output/waybackup_https.example.com.csv',
+  'log': 'output/waybackup_example.com.log',
+  'debug': 'output/waybackup_error.log'
+}
+```
+
+## cli
 
 - `-h`, `--help`: Show the help message and exit.
 - `-v`, `--version`: Show information about the tool and exit.
 
-### Required
+#### Required
 
 - **`-u`**, **`--url`**:<br>
   The URL of the web page to download. This argument is required.
@@ -68,8 +106,8 @@ This tool allows you to download content from the Wayback Machine (archive.org).
   Limits the amount of snapshots to query from the CDX server. If an existing CDX file is injected, the limit will have no effect. So you would need to set `--keep`.
 
 - **Range Selection:**<br>
-  Specify the range in years or a specific timestamp either start, end, or both. If you specify the `range` argument, the `start` and `end` arguments will be ignored. Format for timestamps: YYYYMMDDhhmmss. You can only give a year or increase specificity by going through the timestamp starting on the left.<br>
-  (year 2019, year 2019, year+month+day 20190101, year+month+day+hour 2019010112)
+  Specify the range in years or a specific timestamp either start, end, or both. If you specify the `range`, the `start` and `end` will be ignored. Format for timestamps: YYYYMMDDhhmmss. You can only give a year or increase specificity by going through the timestamp starting on the left.<br>
+  (year 2019, year+month+day 20190101, year+month+day+hour 2019010112)
 
   - **`-r`**, **`--range`**:<br>
     Specify the range in years for which to search and download snapshots.
@@ -105,9 +143,6 @@ This tool allows you to download content from the Wayback Machine (archive.org).
 - **`--verbose`**:<br>
   Increase output verbosity.
 
-<!-- - **`--verbosity`** `<level>`:<br>
-Sets verbosity level. Options are `info`and `trace`. Default is `info`. -->
-
 - **`--log`** <!-- `<path>` -->:<br>
   Saves a log file into the output-dir. Named as `waybackup_<sanitized_url>.log`.
 
@@ -126,9 +161,6 @@ Sets verbosity level. Options are `info`and `trace`. Default is `info`. -->
 - **`--delay`** `<seconds>`:<br>
   Specifies delay between download requests in seconds. Default is no delay (0).
 
-<!-- - **`--convert-links`**:<br>
-If set, all links in the downloaded files will be converted to local links. This is useful for offline browsing. The links are converted to the local path structure. Show output with `--verbosity trace`. -->
-
 #### Job Handling:
 
 - **`--reset`**:  
@@ -226,9 +258,7 @@ your/path/waybackup_snapshots/
 
 ### CSV
 
-Each snapshot is stored with the following keys/values. These are either stored in a sqlite database while the download is running or saved into a CSV file after the download is finished.
-
-For download queries:
+The CSV contains a snapshot per row:
 
 ```
 [
@@ -273,6 +303,4 @@ Exceptions will be written into `waybackup_error.log` (each run overwrites the f
 ## Contributing
 
 I'm always happy for some feature requests to improve the usability of this tool.
-Feel free to give suggestions and report issues. Project is still far from being perfect.
-
-> Please PR from dev into dev.
+Feel free to give suggestions and report issues. Project is still far from being perfect.

{pywaybackup-3.3.0 → pywaybackup-3.4.0}/pyproject.toml

@@ -7,7 +7,7 @@ packages = ["pywaybackup"]
 
 [project]
 name = "pywaybackup"
-version = "3.3.0"
+version = "3.4.0"
 description = "Query and download archive.org as simple as possible."
 authors = [
     { name = "bitdruid", email = "bitdruid@outlook.com" }
@@ -25,7 +25,7 @@ dependencies = [
 ]
 
 [project.scripts]
-waybackup = "pywaybackup.main:main"
+waybackup = "pywaybackup.main:cli"
 
 [project.urls]
 homepage = "https://github.com/bitdruid/python-wayback-machine-downloader"

pywaybackup-3.4.0/pywaybackup/Arguments.py

@@ -0,0 +1,57 @@
+import sys
+import argparse
+
+from argparse import RawTextHelpFormatter
+
+from importlib.metadata import version
+
+
+class Arguments:
+    def __init__(self):
+        parser = argparse.ArgumentParser(
+            description=f"<<< python-wayback-machine-downloader v{version('pywaybackup')} >>>\nby @bitdruid -> https://github.com/bitdruid",
+            formatter_class=RawTextHelpFormatter,
+        )
+
+        required = parser.add_argument_group("required (one exclusive)")
+        required.add_argument("-u", "--url", type=str, metavar="", help="url (with subdir/subdomain) to download")
+        exclusive_required = required.add_mutually_exclusive_group(required=True)
+        exclusive_required.add_argument("-a", "--all", action="store_true", help="download snapshots of all timestamps")
+        exclusive_required.add_argument("-l", "--last", action="store_true", help="download the last version of each file snapshot")
+        exclusive_required.add_argument("-f", "--first", action="store_true", help="download the first version of each file snapshot")
+        exclusive_required.add_argument("-s", "--save", action="store_true", help="save a page to the wayback machine")
+
+        optional = parser.add_argument_group("optional query parameters")
+        optional.add_argument("-e", "--explicit", action="store_true", help="search only for the explicit given url")
+        optional.add_argument("-r", "--range", type=int, metavar="", help="range in years to search")
+        optional.add_argument("--start", type=int, metavar="", help="start timestamp format: YYYYMMDDhhmmss")
+        optional.add_argument("--end", type=int, metavar="", help="end timestamp format: YYYYMMDDhhmmss")
+        optional.add_argument("--limit", type=int, nargs="?", const=True, metavar="int", help="limit the number of snapshots to download")
+        optional.add_argument("--filetype", type=str, metavar="", help="filetypes to download comma separated (js,css,...)")
+        optional.add_argument("--statuscode", type=str, metavar="", help="statuscodes to download comma separated (200,404,...)")
+
+        behavior = parser.add_argument_group("manipulate behavior")
+        behavior.add_argument("-o", "--output", type=str, metavar="", help="output for all files - defaults to current directory")
+        behavior.add_argument("-m", "--metadata", type=str, metavar="", help="change directory for db/cdx/csv/log files")
+        behavior.add_argument("-v", "--verbose", action="store_true", help="overwritten by progress - gives detailed output")
+        behavior.add_argument("--log", action="store_true", help="save a log file into the output folder")
+        behavior.add_argument("--progress", action="store_true", help="show a progress bar")
+        behavior.add_argument("--no-redirect", action="store_true", help="do not follow redirects by archive.org")
+        behavior.add_argument("--retry", type=int, default=0, metavar="", help="retry failed downloads (opt tries as int, else infinite)")
+        behavior.add_argument("--workers", type=int, default=1, metavar="", help="number of workers (simultaneous downloads)")
+        behavior.add_argument("--delay", type=int, default=0, metavar="", help="delay between each download in seconds")
+
+        special = parser.add_argument_group("special")
+        special.add_argument("--reset", action="store_true", help="reset the job and ignore existing cdx/db/csv files")
+        special.add_argument("--keep", action="store_true", help="keep all files after the job finished")
+
+        args = parser.parse_args(args=None if sys.argv[1:] else ["--help"])  # if no arguments are given, print help
+
+        args.silent = False
+        args.debug = True
+
+        self.args = args
+
+    def get_args(self) -> dict:
+        """Returns the parsed arguments as a dictionary."""
+        return vars(self.args)

{pywaybackup-3.3.0 → pywaybackup-3.4.0}/pywaybackup/Exception.py

@@ -14,8 +14,9 @@ class Exception:
     command = None
 
     @classmethod
-    def init(cls, output=None, command=None):
+    def init(cls, debug=None, output=None, command=None):
         sys.excepthook = cls.exception_handler  # set custom exception handler (uncaught exceptions)
+        cls.debug = debug
         cls.output = output
         cls.command = command
 
@@ -44,32 +45,30 @@ class Exception:
             exception_message += "!-- Traceback is None\n"
         exception_message += f"!-- Description: {e}\n-------------------------"
         print(exception_message)
-        debug_file = os.path.join(cls.output, "waybackup_error.log")
-        print(f"Exception log: {debug_file}")
-        # print("-------------------------")
-        # print(f"Full traceback:\n{original_tb}")
-        if cls.new_debug:  # new run, overwrite file
-            cls.new_debug = False
-            f = open(debug_file, "w", encoding="utf-8")
+        if cls.debug:
+            print(f"Exception log: {cls.debug}")
+            if cls.new_debug:  # new run, overwrite file
+                cls.new_debug = False
+                f = open(cls.debug, "w", encoding="utf-8")
+                f.write("-------------------------\n")
+                f.write(f"Version: {version('pywaybackup')}\n")
+                f.write("-------------------------\n")
+                f.write(f"Command: {cls.command}\n")
+                f.write("-------------------------\n\n")
+            else:  # current run, append to file
+                f = open(cls.debug, "a", encoding="utf-8")
+            f.write(datetime.now().strftime("%Y-%m-%d %H:%M:%S") + "\n")
+            f.write(exception_message + "\n")
+            f.write("!-- Local Variables:\n")
+            for var_name, value in local_vars.items():
+                if var_name in ["status_message", "headers"]:
+                    continue
+                value = cls.relativate_path(str(value))
+                value = value[:666] + " ... " if len(value) > 666 else value
+                f.write(f"    -- {var_name} = {value}\n")
             f.write("-------------------------\n")
-            f.write(f"Version: {version('pywaybackup')}\n")
-            f.write("-------------------------\n")
-            f.write(f"Command: {cls.command}\n")
-            f.write("-------------------------\n\n")
-        else:  # current run, append to file
-            f = open(debug_file, "a", encoding="utf-8")
-        f.write(datetime.now().strftime("%Y-%m-%d %H:%M:%S") + "\n")
-        f.write(exception_message + "\n")
-        f.write("!-- Local Variables:\n")
-        for var_name, value in local_vars.items():
-            if var_name in ["status_message", "headers"]:
-                continue
-            value = cls.relativate_path(str(value))
-            value = value[:666] + " ... " if len(value) > 666 else value
-            f.write(f"    -- {var_name} = {value}\n")
-        f.write("-------------------------\n")
-        f.write(original_tb + "\n")
-        f.close()
+            f.write(original_tb + "\n")
+            f.close()
 
     @classmethod
     def relativate_path(cls, input_str: str) -> str:

pywaybackup-3.4.0/pywaybackup/PyWaybackup.py

@@ -0,0 +1,235 @@
+import sys
+import os
+import signal
+from pywaybackup.helper import url_split, sanitize_filename
+
+import pywaybackup.archive_download as archive_download
+import pywaybackup.archive_save as archive_save
+from pywaybackup.db import Database as db
+from pywaybackup.Verbosity import Verbosity as vb
+from pywaybackup.Exception import Exception as ex
+from pywaybackup.SnapshotCollection import SnapshotCollection as sc
+
+class PyWayBackup:
+    """
+    PyWayBackup: A Python interface for downloading or saving archived web pages from the Wayback Machine (archive.org).
+
+    Supported Modes (only one must be selected):
+    - all   : Download all snapshots for a URL within a time range.
+    - last  : Download the latest version of each file in the range.
+    - first : Download the earliest version of each file in the range.
+    - save  : Save a snapshot to the Wayback Machine (beta).
+
+    Args:
+        url (str): Target URL to download snapshots for. (Required)
+        all (bool): If True, downloads all snapshots within the range.
+        last (bool): If True, downloads the last version of each file.
+        first (bool): If True, downloads the first version of each file.
+        save (bool): If True, saves a new snapshot to archive.org (beta).
+        explicit (bool): Only use the explicitly provided URL without wildcards.
+        range (str): A year-based or timestamp-based range (e.g., '2020' or '20200101').
+        start (str): Start timestamp (YYYYMMDDhhmmss).
+        end (str): End timestamp (YYYYMMDDhhmmss).
+        limit (int): Limit the number of snapshots queried from the CDX API.
+        filetype (str): Comma-separated list of filetypes to include (e.g., 'jpg,css,js').
+        statuscode (str): Comma-separated list of HTTP status codes to include (e.g., '200,301').
+        output (str): Output path for downloaded files. Defaults to `./waybackup_snapshots`.
+        metadata (str): Path to store metadata files (`cdx`, `db`, `csv`, etc.).
+        verbose (bool): Enable verbose logging.
+        log (bool): Enable writing logs to a file.
+        progress (bool): Show a progress bar.
+        no_redirect (bool): Disable handling redirects.
+        retry (int): Retry attempts for failed downloads.
+        workers (int): Number of download workers (default: 1).
+        delay (int): Delay between download requests in seconds.
+        reset (bool): Reset job metadata (deletes `.cdx`/`.db`/`.csv` files).
+        keep (bool): Retain all job metadata after completion.
+        silent (bool): Suppress all output (for programmatic use).
+        debug (bool): Enable debug mode.
+        **kwargs: Catch-all for future expansion or external integration.
+
+    Methods:
+        run(): Executes the full download or save operation based on initialized parameters.
+
+    Example:
+        >>> from pywaybackup import PyWayBackup
+        >>> backup = PyWayBackup(url="https://example.com", all=True, start="20200101", end="20201231")
+        >>> backup.run()
+        >>> backup_paths = backup.paths(rel=True)
+        >>> print(backup_paths)
+    """
+        
+    def __init__(self, url: str = None, all: bool = False, last: bool = False, first: bool = False,
+                save: bool = False, explicit: bool = False, range: str = None, start: str = None,
+                end: str = None, limit: int = None, filetype: str = None, statuscode: str = None,
+                output: str = None, metadata: str = None, verbose: bool = False, log: bool = False,
+                progress: bool = False, no_redirect: bool = False, retry: int = 0, workers: int = 1,
+                delay: int = 0, reset: bool = False, keep: bool = False, 
+                silent: bool = True, debug: bool = False, **kwargs: dict):
+                
+        # restrictions
+        # url must be given
+        # all, last, first, save are mutually exclusive
+        if not url:
+            raise ValueError("URL must be provided")
+        if sum([all, last, first, save]) != 1:
+            raise ValueError("Exactly one of --all, --last, --first, or --save is allowed")
+
+        self.url = url
+        self.all = all
+        self.last = last
+        self.first = first
+        self.save = save
+        self.explicit = explicit
+        self.range = range
+        self.start = start
+        self.end = end
+        self.limit = limit
+        self.filetype = filetype
+        self.statuscode = statuscode
+        self.output = output
+        self.metadata = metadata
+        self.verbose = verbose
+        self.log = log
+        self.progress = progress
+        self.no_redirect = no_redirect
+        self.retry = retry
+        self.workers = workers
+        self.delay = delay
+        self.reset = reset
+        self.keep = keep
+
+        self.silent = silent
+        self.debug = debug
+
+        self.query_identifier = (
+            str(self.url) +
+            # required_args
+            str(self.all) + str(self.last) + str(self.first) + str(self.save) +
+            # optional_args
+            str(self.explicit) + str(self.range) + str(self.start) + str(self.end) +
+            str(self.limit) + str(self.filetype) + str(self.statuscode)
+        )
+        
+        # if sys.argv is empty, we assume this is being run as a module
+        if not sys.argv[1:]:
+            self.command = "pywaybackup_module"
+        else:
+            # otherwise, we take the command line arguments
+            self.command = ' '.join(sys.argv[1:])
+
+        self._init()
+
+    def _init(self):
+
+        self.domain, self.subdir, self.filename = url_split(self.url)
+
+        if self.output is None:
+            self.output = os.path.join(os.getcwd(), "waybackup_snapshots")
+        if self.metadata is None:
+            self.metadata = self.output
+        os.makedirs(self.output, exist_ok=True) if not self.save else None
+        os.makedirs(self.metadata, exist_ok=True) if not self.save else None
+
+        if self.all:
+            self.mode = "all"
+        if self.last:
+            self.mode = "last"
+        if self.first:
+            self.mode = "first"
+        if self.save:
+            self.mode = "save"
+
+        if self.filetype:
+            self.filetype = [f.lower().strip() for f in self.filetype.split(",")]
+        if self.statuscode:
+            self.statuscode = [s.lower().strip() for s in self.statuscode.split(",")]
+
+        base_path = self.metadata
+        base_name = f"waybackup_{sanitize_filename(self.url)}"
+        self.cdxfile = os.path.join(base_path, f"{base_name}.cdx")
+        self.dbfile = os.path.join(base_path, f"{base_name}.db")
+        self.csvfile = os.path.join(base_path, f"{base_name}.csv")
+        self.log = os.path.join(base_path, f"{base_name}.log") if self.log else None
+        self.debug = os.path.join(base_path, "waybackup_error.log") if self.debug else None
+
+        if self.reset:
+            os.remove(self.cdxfile) if os.path.isfile(self.cdxfile) else None
+            os.remove(self.dbfile) if os.path.isfile(self.dbfile) else None
+            os.remove(self.csvfile) if os.path.isfile(self.csvfile) else None
+
+    def paths(self, rel: bool = False) -> dict:
+        """
+        Return a dictionary of existing file paths associated to the backup process:
+            {'shapshots':, 'cdxfile':, 'dbfile':, 'csvfile':, 'log':, 'debug':}
+
+        Parameters:
+            rel (bool): If True, return relative paths; otherwise, return absolute paths.
+
+        Returns:
+            dict: Mapping of file types to their corresponding paths, including only files that exist.
+        """
+        files = {
+            "snapshots": os.path.join(self.output, self.domain),
+            "cdxfile": self.cdxfile,
+            "dbfile": self.dbfile,
+            "csvfile": self.csvfile,
+            "log": self.log,
+            "debug": self.debug
+        }
+        return {
+            key: (os.path.relpath(path) if rel else path)
+            for key, path in files.items()
+            if path and os.path.exists(path)
+        }
+
+    def run(self):
+        """Run the PyWayBackup process with the given configuration."""
+        ex.init(self.debug, self.output, self.command)
+        vb.init(self.silent, self.verbose, self.progress, self.log)
+
+        if self.save:
+            archive_save.save_page(self.url)
+            os._exit(1)
+
+        db.init(self.dbfile, self.query_identifier)
+        sc.init(self.mode)
+
+        if not self.save:
+            archive_download.startup()
+
+            try:
+                archive_download.query_list(
+                    self.csvfile,
+                    self.cdxfile,
+                    self.range,
+                    self.limit,
+                    self.start,
+                    self.end,
+                    self.explicit,
+                    self.filetype,
+                    self.statuscode,
+                    self.domain,
+                    self.subdir,
+                    self.filename,
+                )
+                archive_download.download_list(self.output, self.retry, self.no_redirect, self.delay, self.workers)
+            except KeyboardInterrupt:
+                print("\nInterrupted by user\n")
+                self.keep = True
+                signal.signal(signal.SIGINT, signal.SIG_IGN)
+
+            except Exception as e:
+                self.keep = True
+                ex.exception(message="", e=e)
+
+            finally:
+                sc.csv_create(self.csvfile)
+                sc.fini()
+                vb.fini()
+
+                if not self.keep:
+                    os.remove(self.dbfile) if os.path.exists(self.dbfile) else None
+                    os.remove(self.cdxfile) if os.path.exists(self.cdxfile) else None
+
+                os._exit(1)