minerva-worker 1.2.4__tar.gz

minerva_worker-1.2.4/.github/ISSUE_TEMPLATE/bug_report.md

@@ -0,0 +1,27 @@
+---
+name: Bug report
+about: Create a report to help us improve
+title: ''
+labels: ''
+assignees: ''
+
+---
+
+**Describe the bug**
+A clear and concise description of what the bug is.
+
+**To Reproduce**
+Steps to reproduce the behavior:
+
+1. Clone repository '...'
+2. Run '....'
+3. See error
+
+**Expected behavior**
+A clear and concise description of what you expected to happen.
+
+**Screenshots**
+If applicable, add screenshots to help explain your problem.
+
+**Additional context**
+Add any other context about the problem here.

minerva_worker-1.2.4/.github/ISSUE_TEMPLATE/feature_request.md

@@ -0,0 +1,20 @@
+---
+name: Feature request
+about: Suggest an idea for this project
+title: ''
+labels: enhancement
+assignees: ''
+
+---
+
+**Is your feature request related to a problem? Please describe.**
+A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
+
+**Describe the solution you'd like**
+A clear and concise description of what you want to happen.
+
+**Describe alternatives you've considered**
+A clear and concise description of any alternative solutions or features you've considered.
+
+**Additional context**
+Add any other context or screenshots about the feature request here.

minerva_worker-1.2.4/.github/workflows/cd.yml

@@ -0,0 +1,48 @@
+name: cd
+
+on:
+  push:
+    tags:
+      - "v*"
+
+jobs:
+  tagged-release:
+    name: Tagged Release
+    runs-on: windows-2022  # windows-2025 dropped InnoSetup/ISCC
+    environment:
+      name: pypi
+    permissions:
+      id-token: write
+      contents: write
+    steps:
+    - uses: actions/checkout@v6
+    - name: Set up Python
+      uses: actions/setup-python@v6
+    - name: Install uv
+      uses: astral-sh/setup-uv@v7
+    - name: Install the project
+      run: uv sync --locked --all-extras --group pack
+    - name: Build EXE with PyInstaller
+      run: uv run python pyinstaller.py
+    - name: Create Windows Installer with Inno Setup
+      run: |
+        $env:APP_VERSION = uvx hatch version
+        iscc setup.iss
+        mv dist/Minerva-*.exe .
+    - name: Build Portable EXE with PyInstaller
+      shell: pwsh
+      run: |
+        uv run python pyinstaller.py --one-file
+        mv dist/Minerva.exe Minerva-${{ github.ref_name }}-portable.exe
+    - name: Build project
+      run: uv build
+    - name: Deploy release
+      uses: marvinpinto/action-automatic-releases@latest
+      with:
+        prerelease: false
+        repo_token: "${{ secrets.GITHUB_TOKEN }}"
+        files: |
+          Minerva-*.exe
+          Minerva-*-portable.exe
+    - name: Publish to PyPI
+      run: uv publish

minerva_worker-1.2.4/.github/workflows/ci.yml

@@ -0,0 +1,40 @@
+name: ci
+
+on:
+  push:
+    branches: [ master ]
+  pull_request:
+    branches: [ master ]
+
+jobs:
+  lint:
+    runs-on: windows-latest
+    steps:
+      - uses: actions/checkout@v6
+      - name: Set up Python
+        uses: actions/setup-python@v6
+      - name: Install uv
+        uses: astral-sh/setup-uv@v7
+      - name: Install the project
+        run: uv sync --locked --all-extras --group lint --group form
+      - name: Install pre-commit patched for uv
+        run: uv tool install pre-commit --with pre-commit-uv --force-reinstall
+      - name: Run pre-commit to do linting, formatting, type-checking, and more
+        run: uv run pre-commit run --all-files --show-diff-on-failure
+  build:
+    runs-on: windows-latest
+    strategy:
+      matrix:
+        python-version: ["3.10", "3.11", "3.12", "3.13", "3.14"]
+    steps:
+    - uses: actions/checkout@v6
+    - name: Set up Python ${{ matrix.python-version }}
+      uses: actions/setup-python@v6
+      with:
+        python-version: ${{ matrix.python-version }}
+    - name: Install uv
+      uses: astral-sh/setup-uv@v7
+    - name: Install the project
+      run: uv sync --locked
+    - name: Build project
+      run: uv build

minerva_worker-1.2.4/.gitignore

@@ -0,0 +1,132 @@
+# Byte-compiled / optimized / DLL files
+__pycache__/
+*.py[cod]
+*$py.class
+
+# C extensions
+*.so
+
+# Distribution / packaging
+.Python
+build/
+develop-eggs/
+dist/
+downloads/
+eggs/
+.eggs/
+lib/
+lib64/
+parts/
+sdist/
+var/
+wheels/
+pip-wheel-metadata/
+share/python-wheels/
+*.egg-info/
+.installed.cfg
+*.egg
+MANIFEST
+
+# PyInstaller
+#  Usually these files are written by a python script from a template
+#  before PyInstaller builds the exe, so as to inject date/other infos into it.
+*.manifest
+*.spec
+
+# Installer logs
+pip-log.txt
+pip-delete-this-directory.txt
+
+# Unit test / coverage reports
+htmlcov/
+.tox/
+.nox/
+.coverage
+.coverage.*
+.cache
+nosetests.xml
+coverage.xml
+*.cover
+*.py,cover
+.hypothesis/
+.pytest_cache/
+
+# Translations
+*.mo
+*.pot
+
+# Django stuff:
+*.log
+local_settings.py
+db.sqlite3
+db.sqlite3-journal
+
+# Flask stuff:
+instance/
+.webassets-cache
+
+# Scrapy stuff:
+.scrapy
+
+# Sphinx documentation
+docs/_build/
+
+# PyBuilder
+target/
+
+# Jupyter Notebook
+.ipynb_checkpoints
+
+# IPython
+profile_default/
+ipython_config.py
+
+# pyenv
+.python-version
+
+# pipenv
+#   According to pypa/pipenv#598, it is recommended to include Pipfile.lock in version control.
+#   However, in case of collaboration, if having platform-specific dependencies or dependencies
+#   having no cross-platform support, pipenv may install dependencies that don't work, or not
+#   install all needed dependencies.
+#Pipfile.lock
+
+# PEP 582; used by e.g. github.com/David-OConnor/pyflow
+__pypackages__/
+
+# Celery stuff
+celerybeat-schedule
+celerybeat.pid
+
+# SageMath parsed files
+*.sage.py
+
+# Environments
+.env
+.venv
+env/
+venv/
+ENV/
+env.bak/
+venv.bak/
+
+# Spyder project settings
+.spyderproject
+.spyproject
+
+# Rope project settings
+.ropeproject
+
+# Jetbrains project settings
+.idea
+
+# mkdocs documentation
+/site
+
+# mypy
+.mypy_cache/
+.dmypy.json
+dmypy.json
+
+# Pyre type checker
+.pyre/

minerva_worker-1.2.4/.pre-commit-config.yaml

@@ -0,0 +1,25 @@
+# See https://pre-commit.com for more information
+# See https://pre-commit.com/hooks.html for more hooks
+
+repos:
+  - repo: https://github.com/astral-sh/ruff-pre-commit
+    rev: v0.14.13
+    hooks:
+      - id: ruff-check
+        types: [ python ]
+      - id: ruff-format
+        types: [ python ]
+  - repo: https://github.com/pre-commit/mirrors-mypy
+    rev: v1.19.1
+    hooks:
+      - id: mypy
+        types: [ python ]
+        args: []  # override defaults to empty
+        additional_dependencies:
+          - types-requests
+  - repo: https://github.com/pre-commit/pre-commit-hooks
+    rev: v6.0.0
+    hooks:
+      - id: end-of-file-fixer
+      - id: trailing-whitespace
+        args: [--markdown-linebreak-ext=md]

minerva_worker-1.2.4/LICENSE

@@ -0,0 +1,121 @@
+Creative Commons Legal Code
+
+CC0 1.0 Universal
+
+    CREATIVE COMMONS CORPORATION IS NOT A LAW FIRM AND DOES NOT PROVIDE
+    LEGAL SERVICES. DISTRIBUTION OF THIS DOCUMENT DOES NOT CREATE AN
+    ATTORNEY-CLIENT RELATIONSHIP. CREATIVE COMMONS PROVIDES THIS
+    INFORMATION ON AN "AS-IS" BASIS. CREATIVE COMMONS MAKES NO WARRANTIES
+    REGARDING THE USE OF THIS DOCUMENT OR THE INFORMATION OR WORKS
+    PROVIDED HEREUNDER, AND DISCLAIMS LIABILITY FOR DAMAGES RESULTING FROM
+    THE USE OF THIS DOCUMENT OR THE INFORMATION OR WORKS PROVIDED
+    HEREUNDER.
+
+Statement of Purpose
+
+The laws of most jurisdictions throughout the world automatically confer
+exclusive Copyright and Related Rights (defined below) upon the creator
+and subsequent owner(s) (each and all, an "owner") of an original work of
+authorship and/or a database (each, a "Work").
+
+Certain owners wish to permanently relinquish those rights to a Work for
+the purpose of contributing to a commons of creative, cultural and
+scientific works ("Commons") that the public can reliably and without fear
+of later claims of infringement build upon, modify, incorporate in other
+works, reuse and redistribute as freely as possible in any form whatsoever
+and for any purposes, including without limitation commercial purposes.
+These owners may contribute to the Commons to promote the ideal of a free
+culture and the further production of creative, cultural and scientific
+works, or to gain reputation or greater distribution for their Work in
+part through the use and efforts of others.
+
+For these and/or other purposes and motivations, and without any
+expectation of additional consideration or compensation, the person
+associating CC0 with a Work (the "Affirmer"), to the extent that he or she
+is an owner of Copyright and Related Rights in the Work, voluntarily
+elects to apply CC0 to the Work and publicly distribute the Work under its
+terms, with knowledge of his or her Copyright and Related Rights in the
+Work and the meaning and intended legal effect of CC0 on those rights.
+
+1. Copyright and Related Rights. A Work made available under CC0 may be
+protected by copyright and related or neighboring rights ("Copyright and
+Related Rights"). Copyright and Related Rights include, but are not
+limited to, the following:
+
+  i. the right to reproduce, adapt, distribute, perform, display,
+     communicate, and translate a Work;
+ ii. moral rights retained by the original author(s) and/or performer(s);
+iii. publicity and privacy rights pertaining to a person's image or
+     likeness depicted in a Work;
+ iv. rights protecting against unfair competition in regards to a Work,
+     subject to the limitations in paragraph 4(a), below;
+  v. rights protecting the extraction, dissemination, use and reuse of data
+     in a Work;
+ vi. database rights (such as those arising under Directive 96/9/EC of the
+     European Parliament and of the Council of 11 March 1996 on the legal
+     protection of databases, and under any national implementation
+     thereof, including any amended or successor version of such
+     directive); and
+vii. other similar, equivalent or corresponding rights throughout the
+     world based on applicable law or treaty, and any national
+     implementations thereof.
+
+2. Waiver. To the greatest extent permitted by, but not in contravention
+of, applicable law, Affirmer hereby overtly, fully, permanently,
+irrevocably and unconditionally waives, abandons, and surrenders all of
+Affirmer's Copyright and Related Rights and associated claims and causes
+of action, whether now known or unknown (including existing as well as
+future claims and causes of action), in the Work (i) in all territories
+worldwide, (ii) for the maximum duration provided by applicable law or
+treaty (including future time extensions), (iii) in any current or future
+medium and for any number of copies, and (iv) for any purpose whatsoever,
+including without limitation commercial, advertising or promotional
+purposes (the "Waiver"). Affirmer makes the Waiver for the benefit of each
+member of the public at large and to the detriment of Affirmer's heirs and
+successors, fully intending that such Waiver shall not be subject to
+revocation, rescission, cancellation, termination, or any other legal or
+equitable action to disrupt the quiet enjoyment of the Work by the public
+as contemplated by Affirmer's express Statement of Purpose.
+
+3. Public License Fallback. Should any part of the Waiver for any reason
+be judged legally invalid or ineffective under applicable law, then the
+Waiver shall be preserved to the maximum extent permitted taking into
+account Affirmer's express Statement of Purpose. In addition, to the
+extent the Waiver is so judged Affirmer hereby grants to each affected
+person a royalty-free, non transferable, non sublicensable, non exclusive,
+irrevocable and unconditional license to exercise Affirmer's Copyright and
+Related Rights in the Work (i) in all territories worldwide, (ii) for the
+maximum duration provided by applicable law or treaty (including future
+time extensions), (iii) in any current or future medium and for any number
+of copies, and (iv) for any purpose whatsoever, including without
+limitation commercial, advertising or promotional purposes (the
+"License"). The License shall be deemed effective as of the date CC0 was
+applied by Affirmer to the Work. Should any part of the License for any
+reason be judged legally invalid or ineffective under applicable law, such
+partial invalidity or ineffectiveness shall not invalidate the remainder
+of the License, and in such case Affirmer hereby affirms that he or she
+will not (i) exercise any of his or her remaining Copyright and Related
+Rights in the Work or (ii) assert any associated claims and causes of
+action with respect to the Work, in either case contrary to Affirmer's
+express Statement of Purpose.
+
+4. Limitations and Disclaimers.
+
+ a. No trademark or patent rights held by Affirmer are waived, abandoned,
+    surrendered, licensed or otherwise affected by this document.
+ b. Affirmer offers the Work as-is and makes no representations or
+    warranties of any kind concerning the Work, express, implied,
+    statutory or otherwise, including without limitation warranties of
+    title, merchantability, fitness for a particular purpose, non
+    infringement, or the absence of latent or other defects, accuracy, or
+    the present or absence of errors, whether or not discoverable, all to
+    the greatest extent permissible under applicable law.
+ c. Affirmer disclaims responsibility for clearing rights of other persons
+    that may apply to the Work or any use thereof, including without
+    limitation any person's Copyright and Related Rights in the Work.
+    Further, Affirmer disclaims responsibility for obtaining any necessary
+    consents, permissions or other rights required for any use of the
+    Work.
+ d. Affirmer understands and acknowledges that Creative Commons is not a
+    party to this document and has no duty or obligation with respect to
+    this CC0 or use of the Work.

minerva_worker-1.2.4/PKG-INFO

@@ -0,0 +1,149 @@
+Metadata-Version: 2.4
+Name: minerva-worker
+Version: 1.2.4
+Summary: Minerva DPN Worker, for more information see https://minerva-worker.org
+Project-URL: Website, https://minerva-worker.org
+Project-URL: Repository, https://github.com/rlaphoenix/minerva
+Project-URL: Issues, https://github.com/rlaphoenix/minerva/issues
+Project-URL: Discussions, https://github.com/rlaphoenix/minerva/discussions
+Project-URL: Changelog, https://github.com/rlaphoenix/minerva/blob/master/CHANGELOG.md
+Author-email: 17136956+rlaphoenix@users.noreply.github.com
+License-Expression: CC0-1.0
+License-File: LICENSE
+Keywords: archival,data,minerva,myrient,tui
+Classifier: Development Status :: 1 - Planning
+Classifier: Intended Audience :: End Users/Desktop
+Classifier: Natural Language :: English
+Classifier: Operating System :: Microsoft :: Windows
+Classifier: Operating System :: Microsoft :: Windows :: Windows 10
+Classifier: Operating System :: Microsoft :: Windows :: Windows 11
+Classifier: Topic :: Games/Entertainment
+Classifier: Topic :: Utilities
+Requires-Python: >=3.12
+Requires-Dist: click~=8.3.1
+Requires-Dist: httpx~=0.28.1
+Requires-Dist: humanize~=4.15.0
+Requires-Dist: pathvalidate~=3.3.1
+Requires-Dist: pyjwt~=2.11.0
+Requires-Dist: rich~=14.3.3
+Description-Content-Type: text/markdown
+
+<p align="center">
+  <a href="https://github.com/rlaphoenix/minerva">Minerva Worker</a>
+  <br/>
+  <sup><em>Preserving Myrient's legacy, one file at a time.</em></sup>
+</p>
+
+<p align="center">
+  <a href="https://github.com/rlaphoenix/minerva/blob/master/LICENSE">
+    <img src="https://img.shields.io/:license-CC%201.0-blue.svg" alt="License">
+  </a>
+  <a href="https://pypi.org/project/minerva">
+    <img src="https://img.shields.io/badge/python-3.10%2B-informational" alt="Python version">
+  </a>
+  <a href="https://github.com/astral-sh/uv">
+    <img src="https://img.shields.io/endpoint?url=https://raw.githubusercontent.com/Onyx-Nostalgia/uv/refs/heads/fix/logo-badge/assets/badge/v0.json" alt="Manager: uv">
+  </a>
+  <a href="https://github.com/astral-sh/ruff">
+    <img src="https://img.shields.io/endpoint?url=https://raw.githubusercontent.com/astral-sh/ruff/main/assets/badge/v2.json" alt="Linter: Ruff">
+  </a>
+  <a href="https://github.com/rlaphoenix/minerva/actions/workflows/ci.yml">
+    <img src="https://github.com/rlaphoenix/minerva/actions/workflows/ci.yml/badge.svg" alt="Build status">
+  </a>
+</p>
+
+* * *
+
+Myrient is shutting down. Minerva is a volunteer-driven effort to archive its entire collection before it goes offline.
+Run a script, share your bandwidth, help preserve the archive.
+
+## Installation
+
+Download and install the Python script from PIP/PyPI:
+
+```shell
+$ pip install minerva-worker
+```
+
+> [!NOTE]
+If pip gives you a warning about a path not being in your PATH environment variable then promptly add that path then
+close all open command prompt Windows, or running `minerva` won't work as it will not be recognized as a program.
+
+You now have the `minerva` package installed - Voilà 🎉!  
+Get started by running `minerva` in your Terminal or Windows Run.  
+For configuration options, see help and options by running `minerva --help`.
+
+*Alternatively, a Windows EXE is available on the [Releases] page, simply run it to begin!*
+
+  [Releases]: <https://github.com/rlaphoenix/minerva/releases>
+
+## Usage
+
+It's very easy to use. Simply run the minerva.exe file, or run `minerva` in your Terminal/Command Prompt.
+
+You can configure the worker settings by running `minerva run --help` to see what configuration options
+you can change. If you have a great computer and network, it's recommended to bump up the -c and -b
+options.
+
+> [!TIP]
+It's recommended to keep -c smaller or the same as -b.
+
+### How it works
+
+The worker script asks the minerva server for jobs to download. The server gives active workers random
+missing needed file URLs to download. When the worker is given a job, it temporarily downloads the file
+and uploads it to the minerva file servers. Once the file is downloaded, it is deleted from your machine.
+
+> [!TIP]
+If you also want a copy of the files, use the `--keep-files` setting.
+
+Jobs are given exclusively to each worker, no two workers download the same file at the same time. However,
+to verify that uploads aren't corrupted, each job gets given (eventually) to a second worker. Both uploads
+are then confirmed and if both workers give back the same file to the minerva file server, then the job is
+marked as complete and verified.
+
+> [!NOTE]
+You may see 409 Conflict errors on upload, this happens when either you or another worker had mismatching
+files uploaded. Just ignore these error's and let the worker continue. If you suspect every file has this
+issue, please verify your network connection is stable and verify your downloads arent corrupted.
+
+### Discord Authentication
+
+When using the minerva worker, you are prompted upon startup to login and authorize with Discord. This is
+to authenticate unique users on the minerva server, to know who jobs are given to, and to use your username
+and avatar in the worker dashboard leaderboards.
+
+This does not give Minerva, this script, or anyone else access to your account, or any permissions.
+
+## Development
+
+1. Install [uv]
+2. `uv sync --all-extras --all-groups`
+3. `.venv\Scripts\activate` (or `source .venv/bin/activate` on macOS and Linux)
+4. `uv tool install pre-commit --with pre-commit-uv --force-reinstall`
+5. `pre-commit install`
+
+Now feel free to work on the project however you like, all code will be checked before committing.
+
+  [uv]: <https://docs.astral.sh/uv>
+
+## Credit
+
+- [bl791] for the original one-file script.
+- [Puyodead1] for their improved rich interface and speedups.
+- [rlaphoenix] for further improvements, bug fixes, support.
+- [wikipiti] for the aria2 control file parsing code.
+
+  [bl79]: <https://github.com/bl79>
+  [Puyodead1]: <https://github.com/Puyodead1>
+  [rlaphoenix]: <https://github.com/rlaphoenix>
+  [wikipiti]: <https://github.com/wikipiti>
+
+## Licensing
+
+This software is licensed under the terms of [CC0 1.0 Universal](LICENSE).
+You can find a copy of the license in the LICENSE file in the root folder
+
+* * *
+
+© rlaphoenix 2026