pysaka 0.3.0__tar.gz

pysaka-0.3.0/.github/PULL_REQUEST_TEMPLATE.md

@@ -0,0 +1,72 @@
+## Description
+
+<!-- Provide a clear and concise description of what this PR does. -->
+
+
+
+## Type of Change
+
+<!-- Mark the appropriate option with an [x] -->
+
+- [ ] `feat` - New feature
+- [ ] `fix` - Bug fix
+- [ ] `docs` - Documentation only
+- [ ] `refactor` - Code refactoring (no behavior change)
+- [ ] `test` - Adding or updating tests
+- [ ] `build` - Build system or CI changes
+- [ ] `chore` - Maintenance tasks
+
+## Related Issues
+
+<!-- Link any related issues. Use "Closes #123" to auto-close. -->
+
+Closes #
+
+## Changes Made
+
+<!-- List the specific changes in bullet points -->
+
+-
+-
+-
+
+## Testing Performed
+
+<!-- Describe how you tested these changes -->
+
+- [ ] Unit tests pass (`uv run pytest`)
+- [ ] Type checking passes (`uv run mypy .`)
+- [ ] Linting passes (`uv run ruff check .`)
+- [ ] Integration tests pass (if applicable)
+
+**Test Details:**
+<!-- Describe specific testing performed -->
+
+
+
+## Checklist
+
+<!-- Ensure all items are checked before requesting review -->
+
+- [ ] My code follows the project's style guidelines
+- [ ] I have performed a self-review of my code
+- [ ] I have added docstrings to new public functions/classes
+- [ ] I have added tests that prove my fix/feature works
+- [ ] New and existing tests pass locally
+- [ ] Type hints are complete for all new public APIs
+- [ ] **I have updated `CHANGELOG.md` under the `[Unreleased]` section**
+
+## Changelog Entry
+
+<!-- Copy your CHANGELOG.md addition here for easy review -->
+
+```markdown
+### Added/Changed/Fixed
+- Your changelog entry here (#PR-number)
+```
+
+## Additional Notes
+
+<!-- Any additional context for reviewers -->
+
+

pysaka-0.3.0/.github/workflows/publish.yml

@@ -0,0 +1,62 @@
+name: Publish to PyPI
+
+on:
+  push:
+    tags:
+      - 'v*.*.*'  # Trigger on version tags like v0.1.1, v1.0.0
+  release:
+    types: [published]  # Also trigger on GitHub Release (creates tag if needed)
+
+permissions:
+  id-token: write  # Required for trusted publishing
+
+jobs:
+  build:
+    name: Build distribution
+    runs-on: ubuntu-latest
+    steps:
+      - uses: actions/checkout@v4
+
+      - name: Install uv
+        uses: astral-sh/setup-uv@v5
+
+      - name: Set up Python
+        run: uv python install 3.12
+
+      - name: Verify version matches tag
+        if: startsWith(github.ref, 'refs/tags/v')
+        run: |
+          TAG_VERSION="${GITHUB_REF#refs/tags/v}"
+          PKG_VERSION=$(grep -Po '(?<=^version = ")[^"]*' pyproject.toml)
+          if [ "$TAG_VERSION" != "$PKG_VERSION" ]; then
+            echo "Error: Tag version ($TAG_VERSION) does not match package version ($PKG_VERSION)"
+            exit 1
+          fi
+          echo "Version verified: $PKG_VERSION"
+
+      - name: Build package
+        run: uv build
+
+      - name: Upload distribution artifacts
+        uses: actions/upload-artifact@v4
+        with:
+          name: python-package-distributions
+          path: dist/
+
+  publish-pypi:
+    name: Publish to PyPI
+    needs: build
+    runs-on: ubuntu-latest
+    environment:
+      name: pypi
+      url: https://pypi.org/p/pysaka
+    steps:
+      - name: Download distribution artifacts
+        uses: actions/download-artifact@v4
+        with:
+          name: python-package-distributions
+          path: dist/
+
+      - name: Publish to PyPI
+        uses: pypa/gh-action-pypi-publish@release/v1
+        # No API token needed - uses trusted publishing via OIDC

pysaka-0.3.0/.github/workflows/test-publish.yml

@@ -0,0 +1,146 @@
+name: Test Publish to TestPyPI
+
+on:
+  # Manual trigger for dry-run testing
+  workflow_dispatch:
+    inputs:
+      version_suffix:
+        description: 'Version suffix (e.g., dev1, rc1). Leave empty for timestamp-based suffix.'
+        required: false
+        default: ''
+  # Automatically run on PRs to main for validation
+  pull_request:
+    branches: [main]
+    paths:
+      - 'pyproject.toml'
+      - 'src/**'
+      - '.github/workflows/publish.yml'
+      - '.github/workflows/test-publish.yml'
+
+permissions:
+  id-token: write  # Required for trusted publishing
+
+jobs:
+  test-build:
+    name: Build and Test Publish
+    runs-on: ubuntu-latest
+    outputs:
+      test_version: ${{ steps.test_version.outputs.test_version }}
+    steps:
+      - uses: actions/checkout@v4
+
+      - name: Install uv
+        uses: astral-sh/setup-uv@v5
+
+      - name: Set up Python
+        run: uv python install 3.12
+
+      - name: Get base version
+        id: version
+        run: |
+          BASE_VERSION=$(grep -Po '(?<=^version = ")[^"]*' pyproject.toml)
+          echo "base_version=$BASE_VERSION" >> $GITHUB_OUTPUT
+          echo "Base version: $BASE_VERSION"
+
+      - name: Generate test version
+        id: test_version
+        env:
+          INPUT_SUFFIX: ${{ github.event.inputs.version_suffix }}
+        run: |
+          BASE="${{ steps.version.outputs.base_version }}"
+
+          # Use provided suffix or generate timestamp-based one
+          if [ -n "$INPUT_SUFFIX" ]; then
+            SUFFIX="$INPUT_SUFFIX"
+          else
+            # Use timestamp for unique version
+            TIMESTAMP=$(date +%Y%m%d%H%M%S)
+            SUFFIX="dev${TIMESTAMP}"
+          fi
+
+          TEST_VERSION="${BASE}.${SUFFIX}"
+          echo "test_version=$TEST_VERSION" >> $GITHUB_OUTPUT
+          echo "Test version: $TEST_VERSION"
+
+      - name: Update version for TestPyPI
+        env:
+          TEST_VERSION: ${{ steps.test_version.outputs.test_version }}
+        run: |
+          # Create a temporary version for TestPyPI
+          sed -i "s/^version = \".*\"/version = \"$TEST_VERSION\"/" pyproject.toml
+          echo "Updated pyproject.toml version:"
+          grep '^version' pyproject.toml
+
+      - name: Build package
+        run: uv build
+
+      - name: List built artifacts
+        run: ls -la dist/
+
+      - name: Upload distribution artifacts
+        uses: actions/upload-artifact@v4
+        with:
+          name: test-python-package-distributions
+          path: dist/
+
+  publish-testpypi:
+    name: Publish to TestPyPI
+    needs: test-build
+    runs-on: ubuntu-latest
+    # Only publish on manual trigger, not on PR (to save TestPyPI quota)
+    if: github.event_name == 'workflow_dispatch'
+    environment:
+      name: testpypi
+      url: https://test.pypi.org/p/pysaka
+    steps:
+      - name: Download distribution artifacts
+        uses: actions/download-artifact@v4
+        with:
+          name: test-python-package-distributions
+          path: dist/
+
+      - name: Publish to TestPyPI
+        uses: pypa/gh-action-pypi-publish@release/v1
+        with:
+          repository-url: https://test.pypi.org/legacy/
+          # Uses trusted publishing via OIDC - no API token needed
+          # Requires TestPyPI trusted publisher to be configured
+
+  verify-install:
+    name: Verify Installation from TestPyPI
+    needs: [test-build, publish-testpypi]
+    runs-on: ubuntu-latest
+    if: github.event_name == 'workflow_dispatch'
+    strategy:
+      matrix:
+        python-version: ["3.9", "3.12"]
+    steps:
+      - name: Install uv
+        uses: astral-sh/setup-uv@v5
+
+      - name: Set up Python ${{ matrix.python-version }}
+        run: uv python install ${{ matrix.python-version }}
+
+      - name: Wait for TestPyPI index to update
+        run: sleep 30
+
+      - name: Install from TestPyPI
+        env:
+          TEST_VERSION: ${{ needs.test-build.outputs.test_version }}
+        run: |
+          # Install from TestPyPI, falling back to PyPI for dependencies
+          uv pip install --index-url https://test.pypi.org/simple/ \
+            --extra-index-url https://pypi.org/simple/ \
+            "pysaka==$TEST_VERSION"
+
+      - name: Verify import
+        run: |
+          uv run python -c "from importlib.metadata import version; print(f'pysaka version: {version(\"pysaka\")}')"
+
+      - name: Run basic smoke test
+        run: |
+          uv run python -c "
+          from pysaka import Group
+          print('Available groups:', [g.value for g in Group])
+          print('Smoke test passed!')
+          "

pysaka-0.3.0/.github/workflows/test.yml

@@ -0,0 +1,33 @@
+
+name: Test
+
+on:
+  push:
+    branches: [main, dev]
+  pull_request:
+    branches: [main, dev]
+
+jobs:
+  test:
+    runs-on: ubuntu-latest
+    strategy:
+      matrix:
+        python-version: ["3.9", "3.10", "3.11", "3.12"]
+
+    steps:
+    - uses: actions/checkout@v4
+
+    - name: Install uv
+      uses: astral-sh/setup-uv@v5
+
+    - name: Set up Python ${{ matrix.python-version }}
+      run: uv python install ${{ matrix.python-version }}
+
+    - name: Install dependencies
+      run: uv sync --all-extras --dev
+
+    - name: Run Tests
+      run: uv run pytest
+    
+    - name: Run Benchmarks (Check)
+      run: uv run pytest --benchmark-only

pysaka-0.3.0/.gitignore

@@ -0,0 +1,63 @@
+
+# Python
+__pycache__/
+*.pyc
+*.pyo
+*.pyd
+.Python
+env/
+venv/
+.venv/
+pip-log.txt
+
+# pysaka local state
+sync_state.json
+tokens.json
+*_data/
+
+# Environment Variables
+.env
+.env.*
+
+# Tooling
+.ruff_cache/
+.mypy_cache/
+
+# Distribution
+build/
+dist/
+*.egg-info/
+
+# Testing
+.pytest_cache/
+.coverage
+htmlcov/
+.hypothesis/
+.benchmarks/
+
+# Editor
+.vscode/
+.idea/
+*.swp
+*.swo
+*~
+
+# macOS
+.DS_Store
+.AppleDouble
+.LSOverride
+._*
+
+# Windows
+Thumbs.db
+ehthumbs.db
+Desktop.ini
+
+# Logs
+*.log
+logs/
+
+# Temporary files
+*.tmp
+*.temp
+.cache/

pysaka-0.3.0/CHANGELOG.md

@@ -0,0 +1,109 @@
+# Changelog
+
+All notable changes to this project will be documented in this file.
+
+The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.1.0/),
+and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
+
+## [Unreleased]
+
+## [0.3.0] - 2026-03-21
+
+### Changed
+- **Breaking:** Package renamed from `pyhako`/`pyzaka` to `pysaka`
+- Incremental sync now uses timestamp-based cursor instead of message ID
+- `get_messages()` accepts `since_ts` parameter for cursor-based fetching
+- `sync_member()` accepts `prefetched_messages` for group-level batching
+- Integrity check resets on any message count drop (stricter)
+
+### Added
+- Log rotation with separate `error.log` file
+- Thread name included in structlog output
+
+### Fixed
+- Message loss prevented during force-close with atomic temp file writes
+- Overly aggressive low-ID message warning removed
+
+## [0.2.0] - 2026-03-15
+
+### Added
+- Yodel service with multi-organization support
+- `RefreshFailedError` exception and `is_active` single source of truth
+- OAuth cookie preservation for Google, Apple, and LINE providers
+- `get_token_manager()` singleton factory for credential management
+- File handler support and configurable log levels
+- API methods for official app feature parity (media duration, is_muted)
+- Lazy token refresh to reduce unnecessary API calls
+- JWT parsing shared utilities
+- `BlogGoneError` for permanently removed blogs (404/410)
+- Blog URL normalization and Sakurazaka thumbnail support
+- `keyrings.alt` declared as optional dependency for headless environments
+
+### Changed
+- Client now uses `get_token_manager()` singleton instead of creating new instances
+- Blog `MemberInfo` moved to `base.py` for shared access
+- `get_blog_thumbnail` renamed to `get_blog_detail_metadata`
+- Removed internal semaphore from `process_media_queue`
+
+### Fixed
+- TLS certificate verification enabled on all API calls (removed `ssl=False`)
+- Session cookie value no longer logged in plaintext
+- Token prefix removed from debug logs to prevent leakage
+- Incremental sync correctly handles non-sequential message IDs
+- Nogizaka blog content truncation and path issues resolved
+- Sakurazaka blog timestamp parsing uses correct `.blog-foot .date` selector
+- Sakurazaka `og:title` site suffix stripped during parsing
+- Group official accounts excluded from member lists
+- Group rename detection prevents duplicate directories
+- Dead `max_id is not None` guard removed from sync manager
+
+### Security
+- Removed `ssl=False` from all 9 aiohttp API calls — TLS verification now active
+- Session cookie values redacted from debug logs
+- mypy overrides documented with rationale for remaining suppressions
+
+## [0.1.1] - 2026-01-11
+
+### Added
+- Blog backup support with parallel downloading for all three groups
+- Media dimension extraction (width/height) for images and videos
+- `SessionExpiredError` exception for proper session handling
+- `display_name` configuration option
+- Git Flow workflow documentation (CONTRIBUTING.md, PR template)
+
+### Changed
+- Improved browser mimicry with proper headers (Accept, Accept-Language, Origin, Platform)
+- Optimized headless refresh wait condition
+
+### Fixed
+- Token refresh now sends `refresh_token: null` to match browser behavior
+- Added `x-talk-app-platform` header for correct web token refresh
+- Removed Authorization header that caused refresh failures
+
+### Documentation
+- Added official Terms of Service links and warnings
+- Added blog scraper documentation
+
+## [0.1.0] - 2026-01-11
+
+### Added
+- Initial pysaka core library release
+- Multi-group support: Hinatazaka46, Nogizaka46, Sakurazaka46
+- OAuth browser authentication flow
+- Message synchronization with incremental updates
+- Media downloading with progress tracking
+- Member information and avatar management
+- SQLite database for sync state persistence
+- Async/await API design
+- Comprehensive type hints
+- Property-based testing with Hypothesis
+
+### Security
+- Secure credential storage via system keyring
+- Token refresh without storing plaintext credentials
+
+[Unreleased]: https://github.com/xebjhm/pysaka/compare/v0.3.0...HEAD
+[0.3.0]: https://github.com/xebjhm/pysaka/compare/v0.2.0...v0.3.0
+[0.2.0]: https://github.com/xebjhm/pysaka/compare/v0.1.1...v0.2.0
+[0.1.1]: https://github.com/xebjhm/pysaka/compare/v0.1.0...v0.1.1
+[0.1.0]: https://github.com/xebjhm/pysaka/releases/tag/v0.1.0