rda-python-dsquasar 2.0.12__tar.gz → 3.0.1__tar.gz

rda_python_dsquasar-3.0.1/PKG-INFO

@@ -0,0 +1,87 @@
+Metadata-Version: 2.4
+Name: rda_python_dsquasar
+Version: 3.0.1
+Summary: RDA Python package to backup and recover RDA data archives to and from GLOBUS Quasar backup server
+Author-email: Zaihua Ji <zji@ucar.edu>
+Project-URL: Homepage, https://github.com/NCAR/rda-python-dsquasar
+Classifier: Programming Language :: Python :: 3
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Operating System :: OS Independent
+Classifier: Development Status :: 5 - Production/Stable
+Requires-Python: >=3.7
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: rda_python_common
+Requires-Dist: rda_python_dsarch
+Dynamic: license-file
+
+# rda_python_dsquasar
+
+RDA Python package to back up and recover RDA data archives to and from the
+GLOBUS Quasar backup server.
+
+## Programs
+
+The package installs the following command-line utilities, all running as the
+current user:
+
+- `dsquasar` — back up and restore RDA dataset archives via Quasar
+- `tacctar` — create tar bundles for Quasar archival
+- `taccrec` — recover content from Quasar tar bundles
+
+Run any program with `--help` (or `-h`) for full usage details.
+
+## Environment setup
+
+Create a Python environment first; package installs in the next section run
+inside whichever environment you activate here.
+
+### Option A — Python venv (DECS machines)
+
+```bash
+python3 -m venv $ENVHOME          # e.g. /glade/u/home/gdexdata/gdexmsenv
+source $ENVHOME/bin/activate
+```
+
+### Option B — Conda (DAV/Casper)
+
+```bash
+conda create --prefix $ENVHOME python=3.12   # e.g. /glade/work/gdexdata/conda-envs/pg-gdex
+conda activate $ENVHOME
+```
+
+## Installing rda-python-dsquasar
+
+Pick whichever install mode fits your workflow.  All variants pull in the
+transitive dependencies (`rda_python_common`, `rda_python_dsarch`)
+automatically.
+
+For local development, clone this repo alongside your project and install it
+in editable mode so that changes are picked up without re-installing:
+
+```bash
+git clone https://github.com/NCAR/rda-python-dsquasar.git
+cd rda-python-dsquasar
+pip install -e .
+```
+
+To test a specific branch (e.g. an in-progress feature or fix branch), pass
+`-b/--branch` to `git clone`:
+
+```bash
+git clone -b <branch-name> https://github.com/NCAR/rda-python-dsquasar.git
+cd rda-python-dsquasar
+pip install -e .
+```
+
+For a regular (non-editable) install from a checkout:
+
+```bash
+pip install /path/to/rda-python-dsquasar
+```
+
+For a production install on a system that uses the published distribution:
+
+```bash
+pip install rda_python_dsquasar
+```

rda_python_dsquasar-3.0.1/README.md

@@ -0,0 +1,70 @@
+# rda_python_dsquasar
+
+RDA Python package to back up and recover RDA data archives to and from the
+GLOBUS Quasar backup server.
+
+## Programs
+
+The package installs the following command-line utilities, all running as the
+current user:
+
+- `dsquasar` — back up and restore RDA dataset archives via Quasar
+- `tacctar` — create tar bundles for Quasar archival
+- `taccrec` — recover content from Quasar tar bundles
+
+Run any program with `--help` (or `-h`) for full usage details.
+
+## Environment setup
+
+Create a Python environment first; package installs in the next section run
+inside whichever environment you activate here.
+
+### Option A — Python venv (DECS machines)
+
+```bash
+python3 -m venv $ENVHOME          # e.g. /glade/u/home/gdexdata/gdexmsenv
+source $ENVHOME/bin/activate
+```
+
+### Option B — Conda (DAV/Casper)
+
+```bash
+conda create --prefix $ENVHOME python=3.12   # e.g. /glade/work/gdexdata/conda-envs/pg-gdex
+conda activate $ENVHOME
+```
+
+## Installing rda-python-dsquasar
+
+Pick whichever install mode fits your workflow.  All variants pull in the
+transitive dependencies (`rda_python_common`, `rda_python_dsarch`)
+automatically.
+
+For local development, clone this repo alongside your project and install it
+in editable mode so that changes are picked up without re-installing:
+
+```bash
+git clone https://github.com/NCAR/rda-python-dsquasar.git
+cd rda-python-dsquasar
+pip install -e .
+```
+
+To test a specific branch (e.g. an in-progress feature or fix branch), pass
+`-b/--branch` to `git clone`:
+
+```bash
+git clone -b <branch-name> https://github.com/NCAR/rda-python-dsquasar.git
+cd rda-python-dsquasar
+pip install -e .
+```
+
+For a regular (non-editable) install from a checkout:
+
+```bash
+pip install /path/to/rda-python-dsquasar
+```
+
+For a production install on a system that uses the published distribution:
+
+```bash
+pip install rda_python_dsquasar
+```

{rda_python_dsquasar-2.0.12 → rda_python_dsquasar-3.0.1}/pyproject.toml

@@ -4,7 +4,7 @@ build-backend = "setuptools.build_meta"
 
 [project]
 name = "rda_python_dsquasar"
-version = "2.0.12"
+version = "3.0.1"
 authors = [
   { name="Zaihua Ji", email="zji@ucar.edu" },
 ]

{rda_python_dsquasar-2.0.12 → rda_python_dsquasar-3.0.1}/src/rda_python_dsquasar/ds_quasar.py

@@ -91,7 +91,7 @@ TFCOUNT = 100          # if file count is greater, use MINSIZE for tar file
 SUBLMTS = 2000        # file count limit for a sub-group
 
 PGBACK = {
-   'workdir' : "{}/{}/quasar_backup".format(PgLOG.PGLOG['GDEXWORK'], PgLOG.PGLOG['GDEXUSER']),
+   'workdir' : "{}/{}/quasar_backup".format(PgLOG.PGLOG['GDEXWORK'], PgLOG.PGLOG['COMMONUSER']),
    'mproc' : 1,
    'action' : CTACTS,
    'chgdays' : 0,
@@ -1092,7 +1092,7 @@ def evaluate_file_stat(dsid, cate, pgrec):
    chome = PgLOG.PGLOG['DECSHOME'] if cate == 's' else PgLOG.PGLOG['DSDHOME']
 
    if pgrec['locflag'] == 'O':
-      bucket = 'gdex-decsdata' if cate == 's' else PgLOG.PGLOC['OBJCTBKT']
+      bucket = 'gdex-decsdata' if cate == 's' else PgLOG.PGLOG['OBJCTBKT']
       ofile = PgLOG.join_paths(dsid, fname)
       info = PgFile.check_object_file(ofile, bucket, 1, ERRACT)
       if not info: return False

{rda_python_dsquasar-2.0.12 → rda_python_dsquasar-3.0.1}/src/rda_python_dsquasar/dsquasar.py

@@ -85,7 +85,7 @@ class DsQuasar(PgCMD, PgSplit):
       self.TFCOUNT = 100          # if file count is greater, use self.MINSIZE for tar file
       self.SUBLMTS = 2000         # file count limit for a sub-group
       self.PGBACK = {
-         'workdir' : "{}/{}/quasar_backup".format(self.PGLOG['GDEXWORK'], self.PGLOG['GDEXUSER']),
+         'workdir' : "{}/{}/quasar_backup".format(self.PGLOG['GDEXWORK'], self.PGLOG['COMMONUSER']),
          'mproc' : 1,
          'action' : self.CTACTS,
          'chgdays' : 0,
@@ -920,7 +920,7 @@ class DsQuasar(PgCMD, PgSplit):
       fname = pgrec[tname]
       chome = self.PGLOG['DECSHOME'] if cate == 's' else self.PGLOG['DSDHOME']
       if pgrec['locflag'] == 'O':
-         bucket = 'gdex-decsdata' if cate == 's' else self.PGLOC['OBJCTBKT']
+         bucket = 'gdex-decsdata' if cate == 's' else self.PGLOG['OBJCTBKT']
          ofile = self.join_paths(dsid, fname)
          info = self.check_object_file(ofile, bucket, 1, self.ERRACT)
          if not info: return False

{rda_python_dsquasar-2.0.12 → rda_python_dsquasar-3.0.1}/src/rda_python_dsquasar/dstacc.py

@@ -81,7 +81,7 @@ class DsTACC(PgCMD, PgSplit):
       self.ONESIZE = 20*self.PGLOG['ONEGBS']  # 20GB, minimal file size to tar a single file 
       self.TFCOUNT = 1000000      # if file count is greater, use self.MINSIZE for tar file
       self.PGBACK = {
-         'workdir' : "{}/{}/tacc_backup".format(self.PGLOG['GDEXWORK'], self.PGLOG['GDEXUSER']),
+         'workdir' : "{}/{}/tacc_backup".format(self.PGLOG['GDEXWORK'], self.PGLOG['COMMONUSER']),
          'mproc' : 1,
          'action' : self.CTACTS,
          'chgdays' : 0,
@@ -857,7 +857,7 @@ class DsTACC(PgCMD, PgSplit):
       fname = pgrec[tname]
       chome = self.PGLOG['DECSHOME'] if cate == 's' else self.PGLOG['DSDHOME']
       if pgrec['locflag'] == 'O':
-         bucket = 'gdex-decsdata' if cate == 's' else self.PGLOC['OBJCTBKT']
+         bucket = 'gdex-decsdata' if cate == 's' else self.PGLOG['OBJCTBKT']
          ofile = self.join_paths(dsid, fname)
          info = self.check_object_file(ofile, bucket, 1, self.ERRACT)
          if not info: return False

{rda_python_dsquasar-2.0.12 → rda_python_dsquasar-3.0.1}/src/rda_python_dsquasar/taccrec.py

@@ -19,7 +19,7 @@ def get_tar_summary_and_details(member_list_path):
         with open(member_list_path, 'r') as f:
             for idx, line in enumerate(f):
                 line = line.strip()
-                if not line or line.startswith('-rw') is False:
+                if not line:
                     continue
                 parts = line.split()
                 if len(parts) < 6:

rda_python_dsquasar-3.0.1/src/rda_python_dsquasar.egg-info/PKG-INFO

@@ -0,0 +1,87 @@
+Metadata-Version: 2.4
+Name: rda_python_dsquasar
+Version: 3.0.1
+Summary: RDA Python package to backup and recover RDA data archives to and from GLOBUS Quasar backup server
+Author-email: Zaihua Ji <zji@ucar.edu>
+Project-URL: Homepage, https://github.com/NCAR/rda-python-dsquasar
+Classifier: Programming Language :: Python :: 3
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Operating System :: OS Independent
+Classifier: Development Status :: 5 - Production/Stable
+Requires-Python: >=3.7
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: rda_python_common
+Requires-Dist: rda_python_dsarch
+Dynamic: license-file
+
+# rda_python_dsquasar
+
+RDA Python package to back up and recover RDA data archives to and from the
+GLOBUS Quasar backup server.
+
+## Programs
+
+The package installs the following command-line utilities, all running as the
+current user:
+
+- `dsquasar` — back up and restore RDA dataset archives via Quasar
+- `tacctar` — create tar bundles for Quasar archival
+- `taccrec` — recover content from Quasar tar bundles
+
+Run any program with `--help` (or `-h`) for full usage details.
+
+## Environment setup
+
+Create a Python environment first; package installs in the next section run
+inside whichever environment you activate here.
+
+### Option A — Python venv (DECS machines)
+
+```bash
+python3 -m venv $ENVHOME          # e.g. /glade/u/home/gdexdata/gdexmsenv
+source $ENVHOME/bin/activate
+```
+
+### Option B — Conda (DAV/Casper)
+
+```bash
+conda create --prefix $ENVHOME python=3.12   # e.g. /glade/work/gdexdata/conda-envs/pg-gdex
+conda activate $ENVHOME
+```
+
+## Installing rda-python-dsquasar
+
+Pick whichever install mode fits your workflow.  All variants pull in the
+transitive dependencies (`rda_python_common`, `rda_python_dsarch`)
+automatically.
+
+For local development, clone this repo alongside your project and install it
+in editable mode so that changes are picked up without re-installing:
+
+```bash
+git clone https://github.com/NCAR/rda-python-dsquasar.git
+cd rda-python-dsquasar
+pip install -e .
+```
+
+To test a specific branch (e.g. an in-progress feature or fix branch), pass
+`-b/--branch` to `git clone`:
+
+```bash
+git clone -b <branch-name> https://github.com/NCAR/rda-python-dsquasar.git
+cd rda-python-dsquasar
+pip install -e .
+```
+
+For a regular (non-editable) install from a checkout:
+
+```bash
+pip install /path/to/rda-python-dsquasar
+```
+
+For a production install on a system that uses the published distribution:
+
+```bash
+pip install rda_python_dsquasar
+```

rda_python_dsquasar-2.0.12/PKG-INFO

@@ -1,18 +0,0 @@
-Metadata-Version: 2.4
-Name: rda_python_dsquasar
-Version: 2.0.12
-Summary: RDA Python package to backup and recover RDA data archives to and from GLOBUS Quasar backup server
-Author-email: Zaihua Ji <zji@ucar.edu>
-Project-URL: Homepage, https://github.com/NCAR/rda-python-dsquasar
-Classifier: Programming Language :: Python :: 3
-Classifier: License :: OSI Approved :: MIT License
-Classifier: Operating System :: OS Independent
-Classifier: Development Status :: 5 - Production/Stable
-Requires-Python: >=3.7
-Description-Content-Type: text/markdown
-License-File: LICENSE
-Requires-Dist: rda_python_common
-Requires-Dist: rda_python_dsarch
-Dynamic: license-file
-
-RDA python package to backup RDA dataset data onto Globus Quasar Server.

rda_python_dsquasar-2.0.12/README.md

@@ -1 +0,0 @@
-RDA python package to backup RDA dataset data onto Globus Quasar Server.

rda_python_dsquasar-2.0.12/src/rda_python_dsquasar.egg-info/PKG-INFO

@@ -1,18 +0,0 @@
-Metadata-Version: 2.4
-Name: rda_python_dsquasar
-Version: 2.0.12
-Summary: RDA Python package to backup and recover RDA data archives to and from GLOBUS Quasar backup server
-Author-email: Zaihua Ji <zji@ucar.edu>
-Project-URL: Homepage, https://github.com/NCAR/rda-python-dsquasar
-Classifier: Programming Language :: Python :: 3
-Classifier: License :: OSI Approved :: MIT License
-Classifier: Operating System :: OS Independent
-Classifier: Development Status :: 5 - Production/Stable
-Requires-Python: >=3.7
-Description-Content-Type: text/markdown
-License-File: LICENSE
-Requires-Dist: rda_python_common
-Requires-Dist: rda_python_dsarch
-Dynamic: license-file
-
-RDA python package to backup RDA dataset data onto Globus Quasar Server.