pywaybackup 4.0.0__tar.gz → 4.1.0__tar.gz

{pywaybackup-4.0.0/pywaybackup.egg-info → pywaybackup-4.1.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: pywaybackup
-Version: 4.0.0
+Version: 4.1.0
 Summary: Query and download archive.org as simple as possible.
 Author-email: bitdruid <bitdruid@outlook.com>
 License: MIT License
@@ -29,8 +29,7 @@ Project-URL: homepage, https://github.com/bitdruid/python-wayback-machine-downlo
 Requires-Python: >=3.8
 Description-Content-Type: text/markdown
 License-File: LICENSE
-Requires-Dist: pysqlite3-binary==0.5.4; sys_platform == "linux"
-Requires-Dist: pysqlite-binary; sys_platform == "win32"
+Requires-Dist: SQLAlchemy==2.0.43
 Requires-Dist: requests==2.32.3
 Requires-Dist: tqdm==4.67.1
 Requires-Dist: python-magic==0.4.27; sys_platform == "linux"
@@ -167,25 +166,24 @@ output:
 #### Mode Selection (Choose One)
 
 - **`-a`**, **`--all`**:<br>
-  Download snapshots of all timestamps. You will get a folder per timestamp with the files available at that time.
+  All timestamps. Gives one folder per timestamp.
 - **`-l`**, **`--last`**:<br>
-  Download the last version of each file snapshot. You will get one directory with a rebuild of the page. It contains the last version of each file of your specified `--range`.
+  Last Version. Gives one folder containing the last version of each file of specified `--range`.
 - **`-f`**, **`--first`**:<br>
-  Download the first version of each file snapshot. You will get one directory with a rebuild of the page. It contains the first version of each file of your specified `--range`.
-- **`-s`**, **`--save`**:<br>
-  Save a page to the Wayback Machine. (beta)
+  First Version. Gives one folder containing the first version of each file of specified `--range`.
 
 #### Optional query parameters
 
+Parameters for archive.org CDX query. No effect on snapshot download itself.
+
 - **`-e`**, **`--explicit`**:<br>
-  Only download the explicit given URL. No wildcard subdomains or paths. Use e.g. to get root-only snapshots. This is recommended for explicit files like `login.html` or `?query=this`.
+  Only the explicit URL. No wildcard subdomains or paths. For example get: root-only (`https://example.com`) or specific file (`login.html`, `?query=this`).
 
 - **`--limit`** `<count>`:<br>
-  Limits the amount of snapshots to query from the CDX server. If an existing CDX file is injected, the limit will have no effect. So you would need to set `--keep`.
+  Limits the snapshots fetched from archive.org CDX. (Will have no effect on existing CDX files)
 
 - **Range Selection:**<br>
-  Specify the range in years or a specific timestamp either start, end, or both. If you specify the `range`, the `start` and `end` will be ignored. Format for timestamps: YYYYMMDDhhmmss. You can only give a year or increase specificity by going through the timestamp starting on the left.<br>
-  (year 2019, year+month+day 20190101, year+month+day+hour 2019010112)
+  Set the query range in years (`range`) or a timestamp (`start` and/or `end`). If `range` then ignores `start` and `end`. Format for timestamps: YYYYMMDDhhmmss. Timestamp can as specific as needed (year 2019, year+month+day 20190101, ...).
 
   - **`-r`**, **`--range`**:<br>
     Specify the range in years for which to search and download snapshots.
@@ -195,57 +193,56 @@ output:
     Timestamp to end searching.
 
 - **Filtering:**<br>
-  A filter will result in a filtered cdx-file. So if you want to download all files later, you need to query again without the filter.
 
   - **`--filetype`** `<filetype>`:<br>
-    Specify filetypes to download. Default is all filetypes. Separate multiple filetypes with a comma. Example: `--filetype jpg,css,js`. Filetypes are filtered as they are in the snapshot. So if there is no explicit `html` file in the path (common practice) then you cant filter them.
+    Specify filetypes to download. Example: `--filetype jpg,css,js`. You can only filter filetypes which are stored by archive.org (.html mostly not)
 
   - **`--statuscode`** `<statuscode>`:<br>
-    Specify HTTP status codes to download. Default is all statuscodes. Separate multiple status codes with a comma. Example: `--statuscode 200,301`. Pywaybackup will try to download any snapshot regardless of it's statuscode. For 404 of course this means logged errors and corresponding entries in the csv. However, you may want to get a csv that includes these negative attempts for your needs.<br>
+    Specify HTTP status codes to download. Example: `--statuscode 200,301`. PyWayBackup will always skip `404` and `301`.<br>
     Common status codes you may want to handle/filter:
       - `200` (OK)
-      - `301` (Moved Permanently - will redirect snapshot)
+      - `301` (Moved Permanently)
       - `404` (Not Found - snapshot seems to be empty)
       - `500` (Internal Server Error - snapshot is at least for now not available)
 
-### Optional
+#### Optional Behavior Manipulation
 
-#### Behavior Manipulation
+Parameters will change the download behavior for snapshots.
 
 - **`-o`**, **`--output`**:<br>
   Defaults to `waybackup_snapshots` in the current directory. The folder where downloaded files will be saved.
 
 - **`-m`**, **`--metadata`**<br>
-  Change the folder where metadata will be saved (`cdx`/`db`/`csv`/`log`). Especially if you are downloading into a network share, you SHOULD set this to a local path because sqlite locking mechanism may cause issues with network shares.
+  Folder where metadata will be saved (`cdx`/`db`/`csv`/`log`). If you are downloading into a network share, you SHOULD set this to a local path because sqlite locking mechanism may cause issues with network shares.
 
 - **`--verbose`**:<br>
   Increase output verbosity.
 
 - **`--log`** <!-- `<path>` -->:<br>
-  Saves a log file into the output-dir. Named as `waybackup_<sanitized_url>.log`.
+  Saves a log file into the output-dir. `waybackup_<sanitized_url>.log`.
 
 - **`--progress`**:<br>
   Shows a progress bar instead of the default output.
 
 - **`--workers`** `<count>`:<br>
-  Sets the number of simultaneous download workers. Default is 1, safe range is about 10. Be cautious as too many workers may lead to refused connections from the Wayback Machine.
+  Number of simultaneous download workers. Default is 1, safe range is about 10. Too many workers may lead to refused connections by archive.org.
 
 - **`--no-redirect`**:<br>
-  Disables following redirects of snapshots. Useful for preventing timestamp-folder mismatches caused by Archive.org redirects.
+  Disables following redirects of snapshots. Can prevent timestamp-folder mismatches caused by redirects.
 
 - **`--retry`** `<attempts>`:<br>
-  Specifies number of retry attempts for failed downloads.
+  Retry attempts for failed downloads.
 
 - **`--delay`** `<seconds>`:<br>
-  Specifies delay between download requests in seconds. Default is no delay (0).
+  Delay between download requests in seconds. Default is no delay (0).
 
 #### Job Handling:
 
 - **`--reset`**:  
-  If set, the job will be reset, and any existing `cdx`, `db`, `csv` files will be **deleted**. This allows you to start the job from scratch without considering previously downloaded data.
+  If set, the job will be reset, and `cdx`, `db`, `csv` files will be **deleted**. This allows you to start the job from scratch.
 
 - **`--keep`**:  
-  If set, all files will be kept after the job is finished. This includes the `cdx` and `db` file. Without this argument, they will be deleted if the job finished successfully.
+  If set, `cdx` and `db` files will be kept after the job is finished. Otherwise they will be deleted.
 
 <br>
 <br>
@@ -256,23 +253,11 @@ output:
 
 `pywaybackup` resumes interrupted jobs. The tool automatically continues from where it left off.
 
-- Detects existing `.cdx` and `.db` files in an `output dir` to resume downloading from the last successful point.
-- Compares `URL`, `mode`, and `optional query parameters` to ensure automatic resumption.
-- Skips previously downloaded files to save time.
+Only resumes queries if:
+- existing `.cdx` and `.db` files in an `output dir`
+- command is identical by `URL`, `mode`, and `optional query parameters`
   > **Note:** Changing URL, mode selection, query parameters or output prevents automatic resumption.
 
-#### Resetting a Job (`--reset`)
-
-- Deletes `.cdx` and `.db` files and restarts the process from scratch.
-- Does **not** remove already downloaded files.
-- `waybackup -u https://example.com -a --reset`
-
-#### Keeping Job Data (`--keep`)
-
-- Normally, `.cdx` and `.db` files are deleted after a successful job.
-- `--keep` preserves them for future re-analysis or extending the query.
-- `waybackup -u https://example.com -a --keep`
-
 <br>
 <br>
 
@@ -378,6 +363,11 @@ Exceptions will be written into `waybackup_error.log` (each run overwrites the f
 <br>
 <br>
 
+## Future ideas (long run)
+
+- More module functionality
+- Docker UI
+
 ## Contributing
 
 I'm always happy for some feature requests to improve the usability of this tool.

{pywaybackup-4.0.0 → pywaybackup-4.1.0}/README.md

@@ -129,25 +129,24 @@ output:
 #### Mode Selection (Choose One)
 
 - **`-a`**, **`--all`**:<br>
-  Download snapshots of all timestamps. You will get a folder per timestamp with the files available at that time.
+  All timestamps. Gives one folder per timestamp.
 - **`-l`**, **`--last`**:<br>
-  Download the last version of each file snapshot. You will get one directory with a rebuild of the page. It contains the last version of each file of your specified `--range`.
+  Last Version. Gives one folder containing the last version of each file of specified `--range`.
 - **`-f`**, **`--first`**:<br>
-  Download the first version of each file snapshot. You will get one directory with a rebuild of the page. It contains the first version of each file of your specified `--range`.
-- **`-s`**, **`--save`**:<br>
-  Save a page to the Wayback Machine. (beta)
+  First Version. Gives one folder containing the first version of each file of specified `--range`.
 
 #### Optional query parameters
 
+Parameters for archive.org CDX query. No effect on snapshot download itself.
+
 - **`-e`**, **`--explicit`**:<br>
-  Only download the explicit given URL. No wildcard subdomains or paths. Use e.g. to get root-only snapshots. This is recommended for explicit files like `login.html` or `?query=this`.
+  Only the explicit URL. No wildcard subdomains or paths. For example get: root-only (`https://example.com`) or specific file (`login.html`, `?query=this`).
 
 - **`--limit`** `<count>`:<br>
-  Limits the amount of snapshots to query from the CDX server. If an existing CDX file is injected, the limit will have no effect. So you would need to set `--keep`.
+  Limits the snapshots fetched from archive.org CDX. (Will have no effect on existing CDX files)
 
 - **Range Selection:**<br>
-  Specify the range in years or a specific timestamp either start, end, or both. If you specify the `range`, the `start` and `end` will be ignored. Format for timestamps: YYYYMMDDhhmmss. You can only give a year or increase specificity by going through the timestamp starting on the left.<br>
-  (year 2019, year+month+day 20190101, year+month+day+hour 2019010112)
+  Set the query range in years (`range`) or a timestamp (`start` and/or `end`). If `range` then ignores `start` and `end`. Format for timestamps: YYYYMMDDhhmmss. Timestamp can as specific as needed (year 2019, year+month+day 20190101, ...).
 
   - **`-r`**, **`--range`**:<br>
     Specify the range in years for which to search and download snapshots.
@@ -157,57 +156,56 @@ output:
     Timestamp to end searching.
 
 - **Filtering:**<br>
-  A filter will result in a filtered cdx-file. So if you want to download all files later, you need to query again without the filter.
 
   - **`--filetype`** `<filetype>`:<br>
-    Specify filetypes to download. Default is all filetypes. Separate multiple filetypes with a comma. Example: `--filetype jpg,css,js`. Filetypes are filtered as they are in the snapshot. So if there is no explicit `html` file in the path (common practice) then you cant filter them.
+    Specify filetypes to download. Example: `--filetype jpg,css,js`. You can only filter filetypes which are stored by archive.org (.html mostly not)
 
   - **`--statuscode`** `<statuscode>`:<br>
-    Specify HTTP status codes to download. Default is all statuscodes. Separate multiple status codes with a comma. Example: `--statuscode 200,301`. Pywaybackup will try to download any snapshot regardless of it's statuscode. For 404 of course this means logged errors and corresponding entries in the csv. However, you may want to get a csv that includes these negative attempts for your needs.<br>
+    Specify HTTP status codes to download. Example: `--statuscode 200,301`. PyWayBackup will always skip `404` and `301`.<br>
     Common status codes you may want to handle/filter:
       - `200` (OK)
-      - `301` (Moved Permanently - will redirect snapshot)
+      - `301` (Moved Permanently)
       - `404` (Not Found - snapshot seems to be empty)
       - `500` (Internal Server Error - snapshot is at least for now not available)
 
-### Optional
+#### Optional Behavior Manipulation
 
-#### Behavior Manipulation
+Parameters will change the download behavior for snapshots.
 
 - **`-o`**, **`--output`**:<br>
   Defaults to `waybackup_snapshots` in the current directory. The folder where downloaded files will be saved.
 
 - **`-m`**, **`--metadata`**<br>
-  Change the folder where metadata will be saved (`cdx`/`db`/`csv`/`log`). Especially if you are downloading into a network share, you SHOULD set this to a local path because sqlite locking mechanism may cause issues with network shares.
+  Folder where metadata will be saved (`cdx`/`db`/`csv`/`log`). If you are downloading into a network share, you SHOULD set this to a local path because sqlite locking mechanism may cause issues with network shares.
 
 - **`--verbose`**:<br>
   Increase output verbosity.
 
 - **`--log`** <!-- `<path>` -->:<br>
-  Saves a log file into the output-dir. Named as `waybackup_<sanitized_url>.log`.
+  Saves a log file into the output-dir. `waybackup_<sanitized_url>.log`.
 
 - **`--progress`**:<br>
   Shows a progress bar instead of the default output.
 
 - **`--workers`** `<count>`:<br>
-  Sets the number of simultaneous download workers. Default is 1, safe range is about 10. Be cautious as too many workers may lead to refused connections from the Wayback Machine.
+  Number of simultaneous download workers. Default is 1, safe range is about 10. Too many workers may lead to refused connections by archive.org.
 
 - **`--no-redirect`**:<br>
-  Disables following redirects of snapshots. Useful for preventing timestamp-folder mismatches caused by Archive.org redirects.
+  Disables following redirects of snapshots. Can prevent timestamp-folder mismatches caused by redirects.
 
 - **`--retry`** `<attempts>`:<br>
-  Specifies number of retry attempts for failed downloads.
+  Retry attempts for failed downloads.
 
 - **`--delay`** `<seconds>`:<br>
-  Specifies delay between download requests in seconds. Default is no delay (0).
+  Delay between download requests in seconds. Default is no delay (0).
 
 #### Job Handling:
 
 - **`--reset`**:  
-  If set, the job will be reset, and any existing `cdx`, `db`, `csv` files will be **deleted**. This allows you to start the job from scratch without considering previously downloaded data.
+  If set, the job will be reset, and `cdx`, `db`, `csv` files will be **deleted**. This allows you to start the job from scratch.
 
 - **`--keep`**:  
-  If set, all files will be kept after the job is finished. This includes the `cdx` and `db` file. Without this argument, they will be deleted if the job finished successfully.
+  If set, `cdx` and `db` files will be kept after the job is finished. Otherwise they will be deleted.
 
 <br>
 <br>
@@ -218,23 +216,11 @@ output:
 
 `pywaybackup` resumes interrupted jobs. The tool automatically continues from where it left off.
 
-- Detects existing `.cdx` and `.db` files in an `output dir` to resume downloading from the last successful point.
-- Compares `URL`, `mode`, and `optional query parameters` to ensure automatic resumption.
-- Skips previously downloaded files to save time.
+Only resumes queries if:
+- existing `.cdx` and `.db` files in an `output dir`
+- command is identical by `URL`, `mode`, and `optional query parameters`
   > **Note:** Changing URL, mode selection, query parameters or output prevents automatic resumption.
 
-#### Resetting a Job (`--reset`)
-
-- Deletes `.cdx` and `.db` files and restarts the process from scratch.
-- Does **not** remove already downloaded files.
-- `waybackup -u https://example.com -a --reset`
-
-#### Keeping Job Data (`--keep`)
-
-- Normally, `.cdx` and `.db` files are deleted after a successful job.
-- `--keep` preserves them for future re-analysis or extending the query.
-- `waybackup -u https://example.com -a --keep`
-
 <br>
 <br>
 
@@ -340,6 +326,11 @@ Exceptions will be written into `waybackup_error.log` (each run overwrites the f
 <br>
 <br>
 
+## Future ideas (long run)
+
+- More module functionality
+- Docker UI
+
 ## Contributing
 
 I'm always happy for some feature requests to improve the usability of this tool.

{pywaybackup-4.0.0 → pywaybackup-4.1.0}/pyproject.toml

@@ -7,7 +7,7 @@ packages = ["pywaybackup"]
 
 [project]
 name = "pywaybackup"
-version = "4.0.0"
+version = "4.1.0"
 description = "Query and download archive.org as simple as possible."
 authors = [
     { name = "bitdruid", email = "bitdruid@outlook.com" }
@@ -16,8 +16,7 @@ license = { file = "LICENSE" }
 readme = "README.md"
 requires-python = ">=3.8"
 dependencies = [
-    "pysqlite3-binary==0.5.4; sys_platform == 'linux'",
-    "pysqlite-binary; sys_platform == 'win32'",
+    "SQLAlchemy==2.0.43",
     "requests==2.32.3",
     "tqdm==4.67.1",
     "python-magic==0.4.27; sys_platform == 'linux'",

{pywaybackup-4.0.0 → pywaybackup-4.1.0}/pywaybackup/PyWayBackup.py

@@ -1,18 +1,18 @@
-import sys
+import multiprocessing
 import os
-import time
 import signal
-import multiprocessing
-from pywaybackup.helper import url_split, sanitize_filename
+import sys
+import time
 from importlib.metadata import version
 
 import pywaybackup.archive_save as archive_save
+from pywaybackup.archive_download import DownloadArchive
 from pywaybackup.db import Database as db
-from pywaybackup.Verbosity import Verbosity as vb
 from pywaybackup.Exception import Exception as ex
+from pywaybackup.files import CDXfile, CDXquery, CSVfile, File
+from pywaybackup.helper import sanitize_filename, url_split
 from pywaybackup.SnapshotCollection import SnapshotCollection
-from pywaybackup.archive_download import DownloadArchive
-from pywaybackup.files import CDXquery, CDXfile, CSVfile, File
+from pywaybackup.Verbosity import Verbosity as vb
 
 
 class _Status:
@@ -401,15 +401,15 @@ class PyWayBackup:
         """
         files = {
             "snapshots": os.path.join(self._output, self._domain),
-            "cdxfile": self._cdxfile,
+            "cdxfile": self._cdxfile.filepath,
             "dbfile": self._dbfile,
-            "csvfile": self._csvfile,
+            "csvfile": self._csvfile.filepath,
             "log": self._log,
             "debug": self._debug,
         }
         return {key: (os.path.relpath(path) if rel else path) for key, path in files.items() if path and os.path.exists(path)}
 
-    def status(self):
+    def status(self) -> dict:
         """
         Return the current status of the backup process by a dictionary:
             {'task':, 'current':, 'total':, 'progress':}
@@ -475,10 +475,10 @@ class PyWayBackup:
         return False
 
     def _startup(self):
-        if db.QUERY_EXIST:
+        if db.query_exist:
             self._status.task = "resuming"
             vb.write(
-                content=f"\nDOWNLOAD job exist - processed: {db.QUERY_PROGRESS}\nResuming download... (to reset the job use '--reset')"
+                content=f"\nDOWNLOAD job exist - processed: {db.query_progress}\nResuming download... (to reset the job use '--reset')"
             )
 
             if not self._silent:

pywaybackup-4.1.0/pywaybackup/Snapshot.py

@@ -0,0 +1,206 @@
+import os
+import threading
+
+from pywaybackup.db import Database, select, update, waybackup_snapshots
+from pywaybackup.helper import url_split
+
+
+class Snapshot:
+    """
+    Represents a single snapshot entry and manages its state and persistence.
+
+    When a relevant property of the snapshot is modified, the change is automatically
+    pushed to the database:
+        - redirect_url
+        - redirect_timestamp
+        - response_status
+        - file
+
+    Thread-safe for SQLite operations using a lock.
+    """
+
+    __sqlite_lock = threading.Lock()
+
+    def __init__(self, db: Database, output: str, mode: str):
+        """
+        Initialize a Snapshot instance and fetch its database row if available.
+
+        Args:
+            db (Database): Database connection/session manager.
+            output (str): Output directory for downloaded files.
+            mode (str): Download mode ('first', 'last', or default).
+        """
+        self._db = db
+        self.output = output
+        self.mode = mode
+
+        self._redirect_url = None
+        self._redirect_timestamp = None
+        self._response_status = None
+        self._file = None
+
+        self._row = self.fetch()
+        if self._row:
+            self.scid = self._row.scid
+            self.counter = self._row.counter
+            self.timestamp = self._row.timestamp
+            self.url_archive = self._row.url_archive
+            self.url_origin = self._row.url_origin
+            self.redirect_url = self._row.redirect_url
+            self.redirect_timestamp = self._row.redirect_timestamp
+            self.response_status = self._row.response
+            self.file = self._row.file
+        else:
+            self.counter = False
+
+    def fetch(self):
+        """
+        Fetch a snapshot row from the database with response=NULL (not processed).
+        Uses row locking to prevent concurrent workers from processing the same row.
+
+        Returns:
+            waybackup_snapshots or None: The next unprocessed snapshot row, or None if none available.
+        """
+        # mark as locked for other workers // only visual because get_snapshot fetches by NULL
+        # prevent another worker from fetching between LOCK-update (for sqlite by threading.Lock, else lock row)
+
+        def __on_sqlite():
+            if self._db.session.bind.dialect.name == "sqlite":
+                return True
+            return False
+
+        def __get_row():
+            with self._db.session.begin():
+                row = self._db.session.execute(
+                    select(waybackup_snapshots)
+                    .where(waybackup_snapshots.response.is_(None))
+                    .order_by(waybackup_snapshots.scid)
+                    .limit(1)
+                    .with_for_update(skip_locked=True)
+                ).scalar_one_or_none()
+
+                if row is None:
+                    return None
+
+                row.response = "LOCK"
+
+            return row
+
+        if __on_sqlite():
+            with self.__sqlite_lock:
+                return __get_row()
+        else:
+            return __get_row()
+
+    def modify(self, column, value):
+        """
+        Update a column value for this snapshot in the database.
+
+        Args:
+            column (str): Name of the column to update.
+            value: New value to set for the column.
+        """
+        column = getattr(waybackup_snapshots, column)
+        self._db.session.execute(update(waybackup_snapshots).where(waybackup_snapshots.scid == self.scid).values({column: value}))
+        self._db.session.commit()
+
+    def create_output(self):
+        """
+        Generate the file path for the snapshot download.
+
+        If mode is 'first' or 'last', the path does not include the timestamp.
+        Otherwise, the timestamp is included in the path.
+
+        Returns:
+            str: Absolute path to the output file for the snapshot.
+        """
+        domain, subdir, filename = url_split(self.url_archive.split("id_/")[1], index=True)
+
+        if self.mode == "last" or self.mode == "first":
+            download_dir = os.path.join(self.output, domain, subdir)
+        else:
+            download_dir = os.path.join(self.output, domain, self.timestamp, subdir)
+
+        download_file = os.path.abspath(os.path.join(download_dir, filename))
+
+        return download_file
+
+    @property
+    def redirect_url(self):
+        """
+        str: The redirect URL for this snapshot, if any.
+        """
+        return self._redirect_url
+
+    @redirect_url.setter
+    def redirect_url(self, value):
+        """
+        Set the redirect URL and update the database.
+
+        Args:
+            value (str): The new redirect URL.
+        """
+        if self.redirect_timestamp is None and value is None:
+            return
+        self._redirect_url = value
+        self.modify(column="redirect_url", value=value)
+
+    @property
+    def redirect_timestamp(self):
+        """
+        str: The timestamp of the redirect, if any.
+        """
+        return self._redirect_timestamp
+
+    @redirect_timestamp.setter
+    def redirect_timestamp(self, value):
+        """
+        Set the redirect timestamp and update the database.
+
+        Args:
+            value (str): The new redirect timestamp.
+        """
+        if self.redirect_url is None and value is None:
+            return
+        self._redirect_timestamp = value
+        self.modify(column="redirect_timestamp", value=value)
+
+    @property
+    def response_status(self):
+        """
+        str: The HTTP response/status for this snapshot.
+        """
+        return self._response_status
+
+    @response_status.setter
+    def response_status(self, value):
+        """
+        Set the response status and update the database.
+
+        Args:
+            value (str): The new response status.
+        """
+        if self.response_status is None and value is None:
+            return
+        self._response_status = value
+        self.modify(column="response", value=value)
+
+    @property
+    def file(self):
+        """
+        str: The file path for the downloaded snapshot.
+        """
+        return self._file
+
+    @file.setter
+    def file(self, value):
+        """
+        Set the file path and update the database.
+
+        Args:
+            value (str): The new file path.
+        """
+        if self.file is None and value is None:
+            return
+        self._file = value
+        self.modify(column="file", value=value)