gitdata-lib 0.0.17__tar.gz → 0.0.18__tar.gz

{gitdata_lib-0.0.17 → gitdata_lib-0.0.18}/CHANGELOG.md

@@ -6,6 +6,13 @@ and this project follows [Semantic Versioning](https://semver.org/spec/v2.0.0.ht
 
 ## [Unreleased]
 
+## [v0.0.18] - 2026-09-28
+- support and test Python 3.9 through 3.12
+- replace removed `collections` aliases with `collections.abc`
+- update PostgreSQL and CLI dependencies for Python 3.12
+- register explicit SQLite date and timestamp adapters and converters
+- run pytest-based CI and local test workflows across supported Python versions and database integrations
+
 ## [v0.0.17] - 2026-09-28
 - add direct `gitdata ls` and streaming `gitdata scan` for CSV, SQLite, and MariaDB refs without digestion or storage
 - allow `gitdata ls` on a MariaDB server ref to list databases visible to the user

gitdata_lib-0.0.18/PKG-INFO

@@ -0,0 +1,228 @@
+Metadata-Version: 2.4
+Name: gitdata-lib
+Version: 0.0.18
+Summary: Data extraction and analysis library
+Home-page: https://github.com/gitdata/gitdata-lib
+Author: DSI Labs
+Author-email: support@gitdata.com
+Classifier: Development Status :: 1 - Planning
+Classifier: Environment :: Console
+Classifier: Intended Audience :: Developers
+Classifier: Intended Audience :: Science/Research
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Operating System :: OS Independent
+Classifier: Programming Language :: Python
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.9
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3 :: Only
+Classifier: Topic :: Database :: Front-Ends
+Requires-Python: >=3.9,<3.13
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: python-decouple>=3.4
+Requires-Dist: Unipath>=1.1
+Requires-Dist: PyMySQL==0.10.1
+Requires-Dist: psycopg2-binary==2.9.10
+Requires-Dist: python-dotenv
+Requires-Dist: requests
+Requires-Dist: docopt-ng<1,>=0.9
+Requires-Dist: faker
+Requires-Dist: cryptography
+Provides-Extra: oracle
+Requires-Dist: oracledb<4,>=1.3; extra == "oracle"
+Dynamic: author
+Dynamic: author-email
+Dynamic: classifier
+Dynamic: description
+Dynamic: description-content-type
+Dynamic: home-page
+Dynamic: license-file
+Dynamic: provides-extra
+Dynamic: requires-dist
+Dynamic: requires-python
+Dynamic: summary
+
+# GitData
+
+GitData gives you one set of commands for exploring files and databases.
+List what is inside a source with `gitdata ls`, then preview its data with
+`gitdata scan`.
+
+## Install
+
+GitData supports Python 3.9 through 3.12.
+
+```bash
+python3 -m pip install gitdata-lib
+```
+
+Oracle support is optional:
+
+```bash
+python3 -m pip install 'gitdata-lib[oracle]'
+```
+
+## Explore a data source
+
+The same two commands work across CSV files, SQLite databases, and
+MariaDB/MySQL databases:
+
+```bash
+gitdata ls <source>
+gitdata scan <source>
+```
+
+Use `-l` for a detailed listing, `-a` to include system objects, and `--limit`
+to choose how many rows to preview.
+
+## CSV
+
+List the columns in a CSV file:
+
+```bash
+gitdata ls examples/locations-headered.csv
+```
+
+Preview its rows:
+
+```bash
+gitdata scan --limit 10 examples/locations-headered.csv
+```
+
+## SQLite
+
+Start with the database file, then move into a table or column:
+
+```bash
+# List tables
+gitdata ls examples/inspection.sqlite
+
+# Show table details
+gitdata ls -l examples/inspection.sqlite/customers
+
+# Preview rows
+gitdata scan --limit 5 examples/inspection.sqlite/customers
+
+# Examine one column
+gitdata scan --limit 5 examples/inspection.sqlite/customers.email
+```
+
+SQLite references follow this shape:
+
+```text
+path/to/database.sqlite
+path/to/database.sqlite/table
+path/to/database.sqlite/table.column
+```
+
+## MariaDB and MySQL
+
+Keep passwords in environment variables instead of putting them in database
+references:
+
+```bash
+export GITDATA_DB_PASSWORD='your-password'
+
+SERVER='mysql://user@db.example.com?password_env=GITDATA_DB_PASSWORD'
+DATABASE='mysql://user@db.example.com/sales?password_env=GITDATA_DB_PASSWORD'
+TABLE='mysql://user@db.example.com/sales.orders?password_env=GITDATA_DB_PASSWORD'
+```
+
+Explore the server, database, and table with the same commands:
+
+```bash
+# List databases
+gitdata ls "$SERVER"
+
+# List tables
+gitdata ls "$DATABASE"
+
+# Show columns and indexes
+gitdata ls -l "$TABLE"
+
+# Preview rows
+gitdata scan --limit 10 "$TABLE"
+```
+
+MariaDB/MySQL references follow this shape:
+
+```text
+mysql://user@host
+mysql://user@host/database
+mysql://user@host/database.table
+```
+
+If the username is omitted, GitData uses the current operating-system username.
+Use `gitdata ls -a` when you also want to see system databases or tables.
+
+### Try the included MariaDB example
+
+The repository includes `examples/mariadb.sql`. Load it into a disposable
+MariaDB container:
+
+```bash
+docker run --name gitdata-example-mariadb \
+  -e MARIADB_ROOT_PASSWORD=example \
+  -p 3307:3306 \
+  -d mariadb:10.7
+
+until docker exec gitdata-example-mariadb \
+  mariadb-admin ping -h 127.0.0.1 -uroot -pexample --silent
+do
+  sleep 1
+done
+
+docker exec -i gitdata-example-mariadb \
+  mariadb -uroot -pexample < examples/mariadb.sql
+
+export GITDATA_EXAMPLE_PASSWORD=example
+gitdata ls 'mysql://root@127.0.0.1:3307/gitdata_example?password_env=GITDATA_EXAMPLE_PASSWORD'
+gitdata scan --limit 5 'mysql://root@127.0.0.1:3307/gitdata_example.customers?password_env=GITDATA_EXAMPLE_PASSWORD'
+```
+
+Remove the example when finished:
+
+```bash
+docker rm -f gitdata-example-mariadb
+```
+
+## Command reference
+
+```text
+gitdata ls <source>          list databases, tables, or columns
+gitdata ls -l <source>       show a detailed listing
+gitdata ls -a <source>       include system objects
+gitdata scan <source>        preview and profile data
+gitdata scan --limit N ...   preview at most N rows
+```
+
+Run a command with `--help` for all options:
+
+```bash
+gitdata ls --help
+gitdata scan --help
+```
+
+## Oracle from Python
+
+Use the optional Oracle driver through the Python API:
+
+```python
+import os
+
+from gitdata.database import connect
+
+db = connect(
+    'oracle',
+    host='127.0.0.1',
+    port=1521,
+    service_name='FREEPDB1',
+    user='app',
+    password=os.environ['ORACLE_PASSWORD'],
+)
+
+rows = list(db('SELECT 1 FROM dual'))
+```

gitdata_lib-0.0.18/README.md

@@ -0,0 +1,181 @@
+# GitData
+
+GitData gives you one set of commands for exploring files and databases.
+List what is inside a source with `gitdata ls`, then preview its data with
+`gitdata scan`.
+
+## Install
+
+GitData supports Python 3.9 through 3.12.
+
+```bash
+python3 -m pip install gitdata-lib
+```
+
+Oracle support is optional:
+
+```bash
+python3 -m pip install 'gitdata-lib[oracle]'
+```
+
+## Explore a data source
+
+The same two commands work across CSV files, SQLite databases, and
+MariaDB/MySQL databases:
+
+```bash
+gitdata ls <source>
+gitdata scan <source>
+```
+
+Use `-l` for a detailed listing, `-a` to include system objects, and `--limit`
+to choose how many rows to preview.
+
+## CSV
+
+List the columns in a CSV file:
+
+```bash
+gitdata ls examples/locations-headered.csv
+```
+
+Preview its rows:
+
+```bash
+gitdata scan --limit 10 examples/locations-headered.csv
+```
+
+## SQLite
+
+Start with the database file, then move into a table or column:
+
+```bash
+# List tables
+gitdata ls examples/inspection.sqlite
+
+# Show table details
+gitdata ls -l examples/inspection.sqlite/customers
+
+# Preview rows
+gitdata scan --limit 5 examples/inspection.sqlite/customers
+
+# Examine one column
+gitdata scan --limit 5 examples/inspection.sqlite/customers.email
+```
+
+SQLite references follow this shape:
+
+```text
+path/to/database.sqlite
+path/to/database.sqlite/table
+path/to/database.sqlite/table.column
+```
+
+## MariaDB and MySQL
+
+Keep passwords in environment variables instead of putting them in database
+references:
+
+```bash
+export GITDATA_DB_PASSWORD='your-password'
+
+SERVER='mysql://user@db.example.com?password_env=GITDATA_DB_PASSWORD'
+DATABASE='mysql://user@db.example.com/sales?password_env=GITDATA_DB_PASSWORD'
+TABLE='mysql://user@db.example.com/sales.orders?password_env=GITDATA_DB_PASSWORD'
+```
+
+Explore the server, database, and table with the same commands:
+
+```bash
+# List databases
+gitdata ls "$SERVER"
+
+# List tables
+gitdata ls "$DATABASE"
+
+# Show columns and indexes
+gitdata ls -l "$TABLE"
+
+# Preview rows
+gitdata scan --limit 10 "$TABLE"
+```
+
+MariaDB/MySQL references follow this shape:
+
+```text
+mysql://user@host
+mysql://user@host/database
+mysql://user@host/database.table
+```
+
+If the username is omitted, GitData uses the current operating-system username.
+Use `gitdata ls -a` when you also want to see system databases or tables.
+
+### Try the included MariaDB example
+
+The repository includes `examples/mariadb.sql`. Load it into a disposable
+MariaDB container:
+
+```bash
+docker run --name gitdata-example-mariadb \
+  -e MARIADB_ROOT_PASSWORD=example \
+  -p 3307:3306 \
+  -d mariadb:10.7
+
+until docker exec gitdata-example-mariadb \
+  mariadb-admin ping -h 127.0.0.1 -uroot -pexample --silent
+do
+  sleep 1
+done
+
+docker exec -i gitdata-example-mariadb \
+  mariadb -uroot -pexample < examples/mariadb.sql
+
+export GITDATA_EXAMPLE_PASSWORD=example
+gitdata ls 'mysql://root@127.0.0.1:3307/gitdata_example?password_env=GITDATA_EXAMPLE_PASSWORD'
+gitdata scan --limit 5 'mysql://root@127.0.0.1:3307/gitdata_example.customers?password_env=GITDATA_EXAMPLE_PASSWORD'
+```
+
+Remove the example when finished:
+
+```bash
+docker rm -f gitdata-example-mariadb
+```
+
+## Command reference
+
+```text
+gitdata ls <source>          list databases, tables, or columns
+gitdata ls -l <source>       show a detailed listing
+gitdata ls -a <source>       include system objects
+gitdata scan <source>        preview and profile data
+gitdata scan --limit N ...   preview at most N rows
+```
+
+Run a command with `--help` for all options:
+
+```bash
+gitdata ls --help
+gitdata scan --help
+```
+
+## Oracle from Python
+
+Use the optional Oracle driver through the Python API:
+
+```python
+import os
+
+from gitdata.database import connect
+
+db = connect(
+    'oracle',
+    host='127.0.0.1',
+    port=1521,
+    service_name='FREEPDB1',
+    user='app',
+    password=os.environ['ORACLE_PASSWORD'],
+)
+
+rows = list(db('SELECT 1 FROM dual'))
+```

{gitdata_lib-0.0.17 → gitdata_lib-0.0.18}/gitdata/__init__.py

@@ -1,4 +1,4 @@
-"""
+r"""
    ____ _ _   ____        _
   / ___(_) |_|  _ \  __ _| |_ __ _
  | |  _| | __| | | |/ _` | __/ _` |

gitdata_lib-0.0.18/gitdata/__version__.py

@@ -0,0 +1 @@
+__version__ = '0.0.18'

{gitdata_lib-0.0.17 → gitdata_lib-0.0.18}/gitdata/database/common.py

@@ -6,7 +6,7 @@
     A database module that does less.
 """
 
-import collections
+import collections.abc
 import inspect
 import logging
 import os
@@ -134,7 +134,7 @@ class Database:
             """test for a sequence type that is not a string"""
             if isinstance(obj, (str, bytes)):
                 return False
-            return isinstance(obj, collections.Sequence)
+            return isinstance(obj, collections.abc.Sequence)
 
         if self.paramstyle == 'qmark':
             if not many and len(args) == 1 and hasattr(args[0], 'items') and args[0]:

{gitdata_lib-0.0.17 → gitdata_lib-0.0.18}/gitdata/database/sqlite3.py

@@ -2,6 +2,7 @@
     gitdata sqlite3 database
 """
 
+from datetime import date, datetime
 from decimal import Decimal
 import sqlite3
 import logging
@@ -57,13 +58,32 @@ class Sqlite3Database(Database):
             return str(value)
 
         def convert_decimal(bytetext):
-            """convert bytesring representatinos of decimal values to actual
-            Decimal values"""
+            """convert byte-string decimal values to Decimal values"""
             return Decimal(bytetext.decode())
 
+        def adapt_date(value):
+            """Store dates using the ISO 8601 representation."""
+            return value.isoformat()
+
+        def adapt_datetime(value):
+            """Store datetimes using the historical SQLite representation."""
+            return value.isoformat(' ')
+
+        def convert_date(bytetext):
+            """Restore ISO 8601 dates."""
+            return date.fromisoformat(bytetext.decode())
+
+        def convert_timestamp(bytetext):
+            """Restore ISO 8601 timestamps."""
+            return datetime.fromisoformat(bytetext.decode())
+
         kwargs.setdefault('isolation_level', None)  # autocommit
         sqlite3.register_adapter(Decimal, adapt_decimal)
         sqlite3.register_converter('decimal', convert_decimal)
+        sqlite3.register_adapter(date, adapt_date)
+        sqlite3.register_adapter(datetime, adapt_datetime)
+        sqlite3.register_converter('date', convert_date)
+        sqlite3.register_converter('timestamp', convert_timestamp)
 
         Database.__init__(self, sqlite3.connect, *args, **keyword_args)
 

{gitdata_lib-0.0.17 → gitdata_lib-0.0.18}/gitdata/utils.py

@@ -2,7 +2,7 @@
     gitdata utils
 """
 
-import collections
+import collections.abc
 import datetime
 import decimal
 import inspect
@@ -46,6 +46,9 @@ def test_uid_maker(start=0):
     return _new_id
 
 
+test_uid_maker.__test__ = False
+
+
 def id_for(*args):
     """Calculates a valid hyphenated id given an arbitrary string.
 
@@ -735,7 +738,7 @@ class RecordList(list):
         return title + str(ItemList(rows, labels=labels)) + footer
 
 
-class OrderedSet(collections.MutableSet):
+class OrderedSet(collections.abc.MutableSet):
     """OrderedSet
 
     A set that preserves the order of the elements