tracktolib 0.67.0__tar.gz → 0.69.0__tar.gz

{tracktolib-0.67.0 → tracktolib-0.69.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: tracktolib
-Version: 0.67.0
+Version: 0.69.0
 Summary: Utility library for python
 Keywords: utility
 Author-email: julien.brayere@tracktor.fr
@@ -12,6 +12,8 @@ Classifier: Programming Language :: Python :: 3.13
 Classifier: Programming Language :: Python :: 3.14
 Requires-Dist: fastapi>=0.103.2 ; extra == 'api'
 Requires-Dist: pydantic>=2 ; extra == 'api'
+Requires-Dist: niquests>=3.17.0 ; extra == 'cf'
+Requires-Dist: niquests>=3.17.0 ; extra == 'gh'
 Requires-Dist: httpx>=0.25.0 ; extra == 'http'
 Requires-Dist: python-json-logger>=3.2.1 ; extra == 'logs'
 Requires-Dist: niquests>=3.17.0 ; extra == 'notion'
@@ -26,6 +28,8 @@ Requires-Dist: niquests>=3.17.0 ; extra == 's3-niquests'
 Requires-Dist: deepdiff>=8.1.0 ; extra == 'tests'
 Requires-Python: >=3.12, <4.0
 Provides-Extra: api
+Provides-Extra: cf
+Provides-Extra: gh
 Provides-Extra: http
 Provides-Extra: logs
 Provides-Extra: notion
@@ -126,12 +130,42 @@ uv add tracktolib[s3-minio]
 
 ### s3-niquests
 
-Async S3 helpers using [niquests](https://github.com/jawah/niquests) and [botocore](https://github.com/boto/botocore).
+Async S3 helpers using [niquests](https://github.com/jawah/niquests) and [botocore](https://github.com/boto/botocore) presigned URLs.
 
 ```bash
 uv add tracktolib[s3-niquests]
 ```
 
+```python
+from tracktolib.s3.niquests import S3Session
+
+async with S3Session(
+    endpoint_url='http://localhost:9000',
+    access_key='...',
+    secret_key='...',
+    region='us-east-1',
+) as s3:
+    # Object operations
+    await s3.put_object('bucket', 'path/file.txt', b'content')
+    content = await s3.get_object('bucket', 'path/file.txt')
+    await s3.delete_object('bucket', 'path/file.txt')
+
+    # Streaming upload (multipart for large files)
+    async def data_stream():
+        yield b'chunk1'
+        yield b'chunk2'
+    await s3.file_upload('bucket', 'large-file.bin', data_stream())
+
+    # Bucket policy management
+    policy = {'Version': '2012-10-17', 'Statement': [...]}
+    await s3.put_bucket_policy('bucket', policy)
+    await s3.get_bucket_policy('bucket')
+    await s3.delete_bucket_policy('bucket')
+
+    # Empty a bucket (delete all objects)
+    deleted_count = await s3.empty_bucket('bucket')
+```
+
 ### http (deprecated)
 
 HTTP client helpers using [httpx](https://www.python-httpx.org/).
@@ -156,6 +190,85 @@ Notion API helpers using [niquests](https://github.com/jawah/niquests).
 uv add tracktolib[notion]
 ```
 
+```python
+import niquests
+from tracktolib.notion.fetch import fetch_database, get_notion_headers
+from tracktolib.notion.cache import NotionCache
+
+async with niquests.AsyncSession() as session:
+    session.headers.update(get_notion_headers())
+
+    # Without cache
+    db = await fetch_database(session, "database-id")
+
+    # With persistent cache (stored in ~/.cache/tracktolib/notion/cache.json)
+    cache = NotionCache()
+    db = await fetch_database(session, "database-id", cache=cache)
+
+    # Check cached databases
+    cache.get_databases()           # All cached databases
+    cache.get_database("db-id")     # Specific database (id, title, properties, cached_at)
+```
+
+### gh
+
+GitHub API helpers using [niquests](https://github.com/jawah/niquests).
+
+```bash
+uv add tracktolib[gh]
+```
+
+```python
+from tracktolib.gh import GitHubClient
+
+async with GitHubClient() as gh:  # Uses GITHUB_TOKEN env var
+    # Issue comments
+    comments = await gh.get_issue_comments("owner/repo", 123)
+    await gh.create_issue_comment("owner/repo", 123, "Hello!")
+    await gh.delete_comments_with_marker("owner/repo", 123, "<!-- bot -->")
+
+    # Labels
+    labels = await gh.get_issue_labels("owner/repo", 123)
+    await gh.add_labels("owner/repo", 123, ["bug", "priority"])
+    await gh.remove_label("owner/repo", 123, "wontfix")
+
+    # Deployments
+    deploys = await gh.get_deployments("owner/repo", environment="production")
+    await gh.mark_deployment_inactive("owner/repo", "preview-123")
+```
+
+### cf
+
+Cloudflare DNS API helpers using [niquests](https://github.com/jawah/niquests).
+
+```bash
+uv add tracktolib[cf]
+```
+
+```python
+from tracktolib.cf import CloudflareDNSClient
+
+async with CloudflareDNSClient() as cf:  # Uses CLOUDFLARE_API_TOKEN and CLOUDFLARE_ZONE_ID env vars
+    # Get a DNS record
+    record = await cf.get_dns_record("app.example.com", "CNAME")
+
+    # Create a DNS record
+    record = await cf.create_dns_record(
+        "app.example.com",
+        "target.example.com",
+        record_type="CNAME",
+        ttl=60,
+        proxied=True,
+    )
+
+    # Delete by ID or name
+    await cf.delete_dns_record(record["id"])
+    await cf.delete_dns_record_by_name("app.example.com", "CNAME")
+
+    # Check existence
+    exists = await cf.dns_record_exists("app.example.com")
+```
+
 ### tests
 
 Testing utilities using [deepdiff](https://github.com/seperman/deepdiff).

tracktolib-0.69.0/README.md

@@ -0,0 +1,235 @@
+# Tracktolib
+
+[![Python versions](https://img.shields.io/pypi/pyversions/tracktolib)](https://pypi.python.org/pypi/tracktolib)
+[![Latest PyPI version](https://img.shields.io/pypi/v/tracktolib?logo=pypi)](https://pypi.python.org/pypi/tracktolib)
+[![CI](https://github.com/Tracktor/tracktolib/actions/workflows/ci.yml/badge.svg)](https://github.com/Tracktor/tracktolib/actions/workflows/ci.yml)
+
+Tracktor Swiss-knife Utility library.
+
+## Installation
+
+```bash
+uv add tracktolib
+```
+
+With specific extras:
+
+```bash
+uv add tracktolib[pg,api]
+```
+
+## Modules
+
+### logs
+
+Utility functions to initialize logging formatting and streams.
+
+```python
+import logging
+from tracktolib.logs import init_logging
+
+logger = logging.getLogger()
+formatter, stream_handler = init_logging(logger, 'json', version='0.0.1')
+```
+
+### pg
+
+Async PostgreSQL helpers using [asyncpg](https://github.com/MagicStack/asyncpg).
+
+```bash
+uv add tracktolib[pg]
+```
+
+### pg-sync
+
+Sync PostgreSQL helpers using [psycopg](https://www.psycopg.org/psycopg3/) (v3).
+
+```bash
+uv add tracktolib[pg-sync]
+```
+
+```python
+from psycopg import connect
+from tracktolib.pg_sync import insert_many, fetch_one, fetch_count, fetch_all
+
+conn = connect('postgresql://user:pass@localhost/db')
+
+data = [
+    {'foo': 'bar', 'value': 1},
+    {'foo': 'baz', 'value': 2}
+]
+insert_many(conn, 'public.test', data)
+
+query = 'SELECT foo from public.test order by value asc'
+value = fetch_one(conn, query, required=True)  # {'foo': 'bar'}, raises if not found
+
+assert fetch_count(conn, 'public.test') == 2
+
+query = 'SELECT * from public.test order by value asc'
+assert fetch_all(conn, query) == data
+```
+
+### s3
+
+Async S3 helpers using [aiobotocore](https://github.com/aio-libs/aiobotocore).
+
+```bash
+uv add tracktolib[s3]
+```
+
+### s3-minio
+
+S3 helpers using [minio](https://min.io/docs/minio/linux/developers/python/API.html).
+
+```bash
+uv add tracktolib[s3-minio]
+```
+
+### s3-niquests
+
+Async S3 helpers using [niquests](https://github.com/jawah/niquests) and [botocore](https://github.com/boto/botocore) presigned URLs.
+
+```bash
+uv add tracktolib[s3-niquests]
+```
+
+```python
+from tracktolib.s3.niquests import S3Session
+
+async with S3Session(
+    endpoint_url='http://localhost:9000',
+    access_key='...',
+    secret_key='...',
+    region='us-east-1',
+) as s3:
+    # Object operations
+    await s3.put_object('bucket', 'path/file.txt', b'content')
+    content = await s3.get_object('bucket', 'path/file.txt')
+    await s3.delete_object('bucket', 'path/file.txt')
+
+    # Streaming upload (multipart for large files)
+    async def data_stream():
+        yield b'chunk1'
+        yield b'chunk2'
+    await s3.file_upload('bucket', 'large-file.bin', data_stream())
+
+    # Bucket policy management
+    policy = {'Version': '2012-10-17', 'Statement': [...]}
+    await s3.put_bucket_policy('bucket', policy)
+    await s3.get_bucket_policy('bucket')
+    await s3.delete_bucket_policy('bucket')
+
+    # Empty a bucket (delete all objects)
+    deleted_count = await s3.empty_bucket('bucket')
+```
+
+### http (deprecated)
+
+HTTP client helpers using [httpx](https://www.python-httpx.org/).
+
+```bash
+uv add tracktolib[http]
+```
+
+### api
+
+FastAPI utilities using [fastapi](https://fastapi.tiangolo.com/) and [pydantic](https://docs.pydantic.dev/).
+
+```bash
+uv add tracktolib[api]
+```
+
+### notion
+
+Notion API helpers using [niquests](https://github.com/jawah/niquests).
+
+```bash
+uv add tracktolib[notion]
+```
+
+```python
+import niquests
+from tracktolib.notion.fetch import fetch_database, get_notion_headers
+from tracktolib.notion.cache import NotionCache
+
+async with niquests.AsyncSession() as session:
+    session.headers.update(get_notion_headers())
+
+    # Without cache
+    db = await fetch_database(session, "database-id")
+
+    # With persistent cache (stored in ~/.cache/tracktolib/notion/cache.json)
+    cache = NotionCache()
+    db = await fetch_database(session, "database-id", cache=cache)
+
+    # Check cached databases
+    cache.get_databases()           # All cached databases
+    cache.get_database("db-id")     # Specific database (id, title, properties, cached_at)
+```
+
+### gh
+
+GitHub API helpers using [niquests](https://github.com/jawah/niquests).
+
+```bash
+uv add tracktolib[gh]
+```
+
+```python
+from tracktolib.gh import GitHubClient
+
+async with GitHubClient() as gh:  # Uses GITHUB_TOKEN env var
+    # Issue comments
+    comments = await gh.get_issue_comments("owner/repo", 123)
+    await gh.create_issue_comment("owner/repo", 123, "Hello!")
+    await gh.delete_comments_with_marker("owner/repo", 123, "<!-- bot -->")
+
+    # Labels
+    labels = await gh.get_issue_labels("owner/repo", 123)
+    await gh.add_labels("owner/repo", 123, ["bug", "priority"])
+    await gh.remove_label("owner/repo", 123, "wontfix")
+
+    # Deployments
+    deploys = await gh.get_deployments("owner/repo", environment="production")
+    await gh.mark_deployment_inactive("owner/repo", "preview-123")
+```
+
+### cf
+
+Cloudflare DNS API helpers using [niquests](https://github.com/jawah/niquests).
+
+```bash
+uv add tracktolib[cf]
+```
+
+```python
+from tracktolib.cf import CloudflareDNSClient
+
+async with CloudflareDNSClient() as cf:  # Uses CLOUDFLARE_API_TOKEN and CLOUDFLARE_ZONE_ID env vars
+    # Get a DNS record
+    record = await cf.get_dns_record("app.example.com", "CNAME")
+
+    # Create a DNS record
+    record = await cf.create_dns_record(
+        "app.example.com",
+        "target.example.com",
+        record_type="CNAME",
+        ttl=60,
+        proxied=True,
+    )
+
+    # Delete by ID or name
+    await cf.delete_dns_record(record["id"])
+    await cf.delete_dns_record_by_name("app.example.com", "CNAME")
+
+    # Check existence
+    exists = await cf.dns_record_exists("app.example.com")
+```
+
+### tests
+
+Testing utilities using [deepdiff](https://github.com/seperman/deepdiff).
+
+```bash
+uv add tracktolib[tests]
+```

{tracktolib-0.67.0 → tracktolib-0.69.0}/pyproject.toml

@@ -1,6 +1,6 @@
 [project]
 name = "tracktolib"
-version = "0.67.0"
+version = "0.69.0"
 authors = [
     { email = "julien.brayere@tracktor.fr" }
 ]
@@ -46,11 +46,13 @@ pg = [
     "asyncpg>=0.27.0",
     "rich>=13.6.0",
 ]
-notion = [
-    "niquests>=3.17.0"
-]
+notion = ["niquests>=3.17.0"]
+gh = ["niquests>=3.17.0"]
+cf = ["niquests>=3.17.0"]
 
 [dependency-groups]
+niquests = ["niquests>=3.17.0"]
+
 dev = [
     "pytest-cov>=7.0.0,<8",
     "pytest>=9.0.1,<10",
@@ -66,9 +68,11 @@ dev = [
     "pycryptodome>=3.23.0",
     "aiobotocore==2.15.2",
     # niquests for s3-niquests tests (botocore comes from aiobotocore)
-    "niquests>=3.17.0",
+    { include-group = "niquests" },
     "python-json-logger>=3.2.0",
     "prek>=0.2.30",
+    "datamodel-code-generator>=0.53.0",
+    "pytest-asyncio>=1.3.0",
 ]
 
 bump = [
@@ -98,6 +102,8 @@ filterwarnings = [
     "ignore::DeprecationWarning",
     "ignore::PendingDeprecationWarning"
 ]
+asyncio_mode = "auto"
+asyncio_default_fixture_loop_scope = "function"
 
 [tool.pyright]
 include = ["tracktolib", "tests"]
@@ -108,7 +114,7 @@ pythonPlatform = "Linux"
 
 [tool.commitizen]
 name = "cz_conventional_commits"
-version = "0.67.0"
+version = "0.69.0"
 tag_format = "$version"
 version_files = [
     "pyproject.toml:version"
@@ -122,6 +128,9 @@ changelog_file = "CHANGELOG.md"
 line-length = 120
 target-version = "py314"
 
+[tool.ruff.lint]
+# I: isort - consolidates duplicate imports
+extend-select = ["I"]
 
 [tool.ruff.lint.per-file-ignores]
 "__init__.py" = [

{tracktolib-0.67.0 → tracktolib-0.69.0}/tracktolib/api.py

@@ -1,32 +1,31 @@
 import json
 import warnings
-from collections.abc import Mapping
-from dataclasses import field, dataclass
+from dataclasses import dataclass, field
 from inspect import getdoc
 from typing import (
-    Callable,
     Any,
-    Literal,
-    Sequence,
     AsyncIterator,
+    Callable,
+    ClassVar,
     Coroutine,
-    get_type_hints,
-    get_args,
-    TypedDict,
+    Literal,
+    Mapping,
+    Sequence,
     TypeAlias,
-    Type,
-    ClassVar,
+    TypedDict,
+    get_args,
     get_origin,
+    get_type_hints,
 )
 
-from .utils import json_serial, get_first_line
+from .utils import get_first_line, json_serial
 
 try:
-    from fastapi import params, APIRouter
+    import starlette.status
+    from fastapi import APIRouter, params
     from fastapi.responses import JSONResponse
-    from pydantic.alias_generators import to_camel
     from pydantic import BaseModel, ConfigDict
-    import starlette.status
+    from pydantic.alias_generators import to_camel
 except ImportError:
     raise ImportError('Please install fastapi, pydantic or tracktolib with "api" to use this module')
 
@@ -61,7 +60,7 @@ class MethodMeta(TypedDict):
     status_code: StatusCode
     dependencies: Dependencies
     path: str | None
-    response_model: Type[BaseModel | None | Sequence[BaseModel]] | None
+    response_model: type[BaseModel | None | Sequence[BaseModel]] | None
     openapi_extra: dict[str, Any] | None
     name: str | None
     summary: str | None
@@ -82,7 +81,7 @@ class Endpoint:
         status_code: StatusCode = None,
         dependencies: Dependencies = None,
         path: str | None = None,
-        model: Type[B] | None = None,
+        model: type[B] | None = None,
         openapi_extra: dict[str, Any] | None = None,
         name: str | None = None,
         summary: str | None = None,
@@ -109,7 +108,7 @@ class Endpoint:
         status_code: StatusCode = None,
         dependencies: Dependencies = None,
         path: str | None = None,
-        model: Type[B] | None = None,
+        model: type[B] | None = None,
         openapi_extra: dict[str, Any] | None = None,
         name: str | None = None,
         summary: str | None = None,
@@ -135,7 +134,7 @@ class Endpoint:
         status_code: StatusCode = None,
         dependencies: Dependencies = None,
         path: str | None = None,
-        model: Type[B] | None = None,
+        model: type[B] | None = None,
         openapi_extra: dict[str, Any] | None = None,
         name: str | None = None,
         summary: str | None = None,
@@ -161,7 +160,7 @@ class Endpoint:
         status_code: StatusCode = None,
         dependencies: Dependencies = None,
         path: str | None = None,
-        model: Type[B] | None = None,
+        model: type[B] | None = None,
         openapi_extra: dict[str, Any] | None = None,
         name: str | None = None,
         summary: str | None = None,
@@ -187,7 +186,7 @@ class Endpoint:
         status_code: StatusCode = None,
         dependencies: Dependencies = None,
         path: str | None = None,
-        model: Type[B] | None = None,
+        model: type[B] | None = None,
         openapi_extra: dict[str, Any] | None = None,
         name: str | None = None,
         summary: str | None = None,
@@ -216,7 +215,7 @@ def _get_method_wrapper[B: _BaseModelBound](
     status_code: StatusCode = None,
     dependencies: Dependencies = None,
     path: str | None = None,
-    model: Type[B] | None = None,
+    model: type[B] | None = None,
     openapi_extra: dict[str, Any] | None = None,
     name: str | None = None,
     summary: str | None = None,
@@ -335,7 +334,7 @@ def check_status(resp, status: int = starlette.status.HTTP_200_OK):
         raise AssertionError(json.dumps(resp.json(), indent=4))
 
 
-def generate_list_name_model[B: _BaseModelBound](model: Type[B], status: int | None = None) -> dict:
+def generate_list_name_model[B: _BaseModelBound](model: type[B], status: int | None = None) -> dict:
     _status = "200" if status is None else str(status)
     if get_origin(model) and get_origin(model) is list:
         _title = f"Array[{get_args(model)[0].__name__}]"

tracktolib-0.69.0/tracktolib/cf/__init__.py

@@ -0,0 +1,8 @@
+from .client import CloudflareDNSClient, CloudflareError
+from .types import DnsRecord
+
+__all__ = [
+    "CloudflareDNSClient",
+    "CloudflareError",
+    "DnsRecord",
+]