gapless-crypto-data 4.0.2__tar.gz → 5.0.0__tar.gz

{gapless_crypto_data-4.0.2 → gapless_crypto_data-5.0.0}/.releaserc.json

@@ -1,6 +1,7 @@
 {
   "$schema": "https://json.schemastore.org/semantic-release.json",
   "branches": ["main"],
+  "repositoryUrl": "git@github.com:terrylica/gapless-crypto-data.git",
   "tagFormat": "v${version}",
   "plugins": [
     [
@@ -47,14 +48,14 @@
     [
       "@semantic-release/exec",
       {
-        "prepareCmd": "sed -i.bak 's/^version = \".*\"/version = \"${nextRelease.version}\"/' pyproject.toml && rm -f pyproject.toml.bak",
+        "prepareCmd": "sed -i.bak 's/^version = \".*\"/version = \"${nextRelease.version}\"/' pyproject.toml && rm -f pyproject.toml.bak && sed -i.bak 's/^__version__ = \".*\"/__version__ = \"${nextRelease.version}\"/' src/gapless_crypto_data/__init__.py && rm -f src/gapless_crypto_data/__init__.py.bak",
         "publishCmd": "echo 'Version ${nextRelease.version} prepared for release'"
       }
     ],
     [
       "@semantic-release/git",
       {
-        "assets": ["CHANGELOG.md", "pyproject.toml"],
+        "assets": ["CHANGELOG.md", "pyproject.toml", "src/gapless_crypto_data/__init__.py"],
         "message": "chore(release): ${nextRelease.version} [skip ci]\n\n${nextRelease.notes}"
       }
     ],

{gapless_crypto_data-4.0.2 → gapless_crypto_data-5.0.0}/CHANGELOG.md

@@ -2,6 +2,35 @@
 
 All notable changes to gapless-crypto-data will be documented in this file.
 
+## [5.0.0](https://github.com/terrylica/gapless-crypto-data/compare/v4.0.1...v5.0.0) (2026-01-02)
+
+### ⚠ BREAKING CHANGES
+
+* **ci:** CI no longer runs tests. Run `uv run pytest` locally before push.
+
+Refs: ADR-0005
+
+### Features
+
+* **ci:** add Earthly pipeline and semantic-release configuration ([a45a321](https://github.com/terrylica/gapless-crypto-data/commit/a45a32144ac0b0f663e8425253b78a9f9f58f9d3))
+* **ci:** add Pushover notification scripts and update gitignore ([a403ffd](https://github.com/terrylica/gapless-crypto-data/commit/a403ffd3501a850690de77875fe32ec5f557f6c0))
+
+### Bug Fixes
+
+* **api:** ensure datetime64 types after CSV reload ([2a3afbc](https://github.com/terrylica/gapless-crypto-data/commit/2a3afbc8568bd268fb6c01811249cfb690b7ee4a)), closes [#90](https://github.com/terrylica/gapless-crypto-data/issues/90)
+* **ci:** add --no-install-project flag to Earthly deps targets ([a7b776e](https://github.com/terrylica/gapless-crypto-data/commit/a7b776e69ef45cf4479f3851a097d1adf87a7f7c))
+* **ci:** use correct Doppler secret names for Pushover ([54c3e4e](https://github.com/terrylica/gapless-crypto-data/commit/54c3e4e122a151359418b7b6c97d1e15e7c7865d))
+* **config:** correct repository and project names in automation ([44b1b27](https://github.com/terrylica/gapless-crypto-data/commit/44b1b27d5b9b0dfb461bde3a6b127b51092a1318))
+* **docs:** correct version references and feature status ([4c1a2da](https://github.com/terrylica/gapless-crypto-data/commit/4c1a2da4d2041fa80de3b1876d7b7e39b9ec69c7))
+* **docs:** fix broken links and standardize file paths ([30e332e](https://github.com/terrylica/gapless-crypto-data/commit/30e332eeb24e5aba478ab05ff19438f3715c1fd5))
+
+### Refactoring
+
+* **ci:** remove tests from GitHub Actions per local-first policy ([9e149c7](https://github.com/terrylica/gapless-crypto-data/commit/9e149c7b16093cd235583db91b4bd9e5ae723f0a))
+* **docs:** apply AOD/IOI principles and remove magic numbers ([2bc7b58](https://github.com/terrylica/gapless-crypto-data/commit/2bc7b58909d976295583e4980e8b030d053bbb0e))
+* **docs:** apply AOD/IOI principles to README ([cb810dd](https://github.com/terrylica/gapless-crypto-data/commit/cb810dd1961beb1f272d03e0d724a6e473be98ff))
+* **naming:** standardize SDK standards YAML to UPPERCASE convention ([5b47371](https://github.com/terrylica/gapless-crypto-data/commit/5b47371068575956eec6c6c0c9c6d51640c69182))
+
 The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
 and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 

{gapless_crypto_data-4.0.2 → gapless_crypto_data-5.0.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: gapless-crypto-data
-Version: 4.0.2
+Version: 5.0.0
 Summary: Cryptocurrency OHLCV data collection with gap-free guarantee. Retrieves microstructure-enriched kline data from Binance Public Data Repository with automatic gap detection and filling.
 Project-URL: Homepage, https://github.com/terrylica/gapless-crypto-data
 Project-URL: Documentation, https://github.com/terrylica/gapless-crypto-data#readme
@@ -92,7 +92,12 @@ See [Data Format Specification](https://github.com/terrylica/gapless-crypto-data
 
 ## Supported Timeframes
 
-All Binance spot kline intervals: `1s`, `1m`, `3m`, `5m`, `15m`, `30m`, `1h`, `2h`, `4h`, `6h`, `8h`, `12h`, `1d`
+All Binance spot kline intervals. Query dynamically:
+
+```python
+import gapless_crypto_data as gcd
+print(gcd.get_supported_timeframes())
+```
 
 ## API Reference
 

{gapless_crypto_data-4.0.2 → gapless_crypto_data-5.0.0}/README.md

@@ -55,7 +55,12 @@ See [Data Format Specification](https://github.com/terrylica/gapless-crypto-data
 
 ## Supported Timeframes
 
-All Binance spot kline intervals: `1s`, `1m`, `3m`, `5m`, `15m`, `30m`, `1h`, `2h`, `4h`, `6h`, `8h`, `12h`, `1d`
+All Binance spot kline intervals. Query dynamically:
+
+```python
+import gapless_crypto_data as gcd
+print(gcd.get_supported_timeframes())
+```
 
 ## API Reference
 

{gapless_crypto_data-4.0.2 → gapless_crypto_data-5.0.0}/docs/plan/0005-earthly-release-pipeline/plan.md

@@ -195,13 +195,13 @@ updated: "2025-11-25"
 
 **Validation Results**:
 
-| Component        | Status  | Details                                   |
-| ---------------- | ------- | ----------------------------------------- |
-| Earthly +build   | ✅ PASS | Builds Python package successfully        |
-| semantic-release | ✅ PASS | Dry run shows v5.0.0 release              |
-| Pushover         | ✅ PASS | Test notification received                |
-| GitHub Secrets   | ✅ PASS | PUSHOVER_USER_KEY, PUSHOVER_APP_TOKEN set |
-| GitHub Actions   | ✅ PASS | Workflows validated with actionlint       |
+| Component | Status | Details |
+|-----------|--------|---------|
+| Earthly +build | ✅ PASS | Builds Python package successfully |
+| semantic-release | ✅ PASS | Dry run shows v5.0.0 release |
+| Pushover | ✅ PASS | Test notification received |
+| GitHub Secrets | ✅ PASS | PUSHOVER_USER_KEY, PUSHOVER_APP_TOKEN set |
+| GitHub Actions | ✅ PASS | Workflows validated with actionlint |
 
 **Key Fixes Applied**:
 
@@ -211,7 +211,6 @@ updated: "2025-11-25"
 4. GitHub Secrets: Synced from Doppler using `gh secret set`
 
 **Release Ready**: Run `npm run release` to create v5.0.0 with:
-
 - GitHub Release with changelog
 - Pushover notification with release link
 - Package build artifacts

{gapless_crypto_data-4.0.2 → gapless_crypto_data-5.0.0}/pyproject.toml

@@ -1,6 +1,6 @@
 [project]
 name = "gapless-crypto-data"
-version = "4.0.2"
+version = "5.0.0"
 description = "Cryptocurrency OHLCV data collection with gap-free guarantee. Retrieves microstructure-enriched kline data from Binance Public Data Repository with automatic gap detection and filling."
 readme = { file = "README.md", content-type = "text/markdown" }
 authors = [

gapless_crypto_data-5.0.0/src/gapless_crypto_data/__init__.py

@@ -0,0 +1,92 @@
+"""
+Gapless Crypto Data - Binance USDT spot market OHLCV collection with gap-free guarantee.
+
+Scope:
+    - USDT spot pairs only (BTCUSDT, ETHUSDT, SOLUSDT, etc.)
+    - No futures, perpetuals, derivatives, or margin data
+
+Capabilities:
+    - Bulk historical data via Binance Public Data Repository
+    - Microstructure-enriched kline format (OHLCV + order flow metrics)
+    - Gap detection and API-based filling
+    - All Binance spot kline intervals supported
+
+Data Source:
+    https://data.binance.vision/data/spot/monthly/klines/
+
+Usage:
+    import gapless_crypto_data as gcd
+
+    # Fetch data
+    df = gcd.fetch_data("BTCUSDT", timeframe="1h", limit=1000)
+    df = gcd.download("ETHUSDT", timeframe="4h", start="2024-01-01", end="2024-06-30")
+
+    # Discovery
+    symbols = gcd.get_supported_symbols()
+    timeframes = gcd.get_supported_timeframes()
+
+    # Gap filling
+    results = gcd.fill_gaps("./data")
+
+    # Class-based API
+    from gapless_crypto_data import BinancePublicDataCollector, UniversalGapFiller
+    collector = BinancePublicDataCollector()
+    result = collector.collect_timeframe_data("1h")
+"""
+
+__version__ = "5.0.0"
+__author__ = "Eon Labs"
+__email__ = "terry@eonlabs.com"
+
+# Core classes (advanced/power-user API)
+# Enhanced DataFrame for domain-specific operations
+# Convenience functions (simple/intuitive API)
+# API-only probe hooks for AI coding agents
+from . import __probe__
+from .api import (
+    download,
+    fetch_data,
+    fill_gaps,
+    get_info,
+    get_supported_intervals,
+    get_supported_symbols,
+    get_supported_timeframes,
+    load_parquet,
+    save_parquet,
+)
+from .collectors.binance_public_data_collector import BinancePublicDataCollector
+from .exceptions import (
+    DataCollectionError,
+    GapFillingError,
+    GaplessCryptoDataError,
+    NetworkError,
+    ValidationError,
+)
+from .gap_filling.safe_file_operations import AtomicCSVOperations, SafeCSVMerger
+from .gap_filling.universal_gap_filler import UniversalGapFiller
+
+__all__ = [
+    # Simple function-based API (recommended for most users)
+    "fetch_data",
+    "download",
+    "get_supported_symbols",
+    "get_supported_timeframes",
+    "get_supported_intervals",  # Legacy compatibility
+    "fill_gaps",
+    "get_info",
+    "save_parquet",
+    "load_parquet",
+    # Advanced class-based API (for complex workflows)
+    "BinancePublicDataCollector",
+    "UniversalGapFiller",
+    "AtomicCSVOperations",
+    "SafeCSVMerger",
+    # Structured exception hierarchy (v3.2.0)
+    "GaplessCryptoDataError",
+    "DataCollectionError",
+    "ValidationError",
+    "NetworkError",
+    "GapFillingError",
+    # AI agent probe hooks
+    "__probe__",
+]

{gapless_crypto_data-4.0.2 → gapless_crypto_data-5.0.0}/src/gapless_crypto_data/api.py

@@ -30,6 +30,27 @@ import pandas as pd
 from .collectors.binance_public_data_collector import BinancePublicDataCollector
 from .gap_filling.universal_gap_filler import UniversalGapFiller
 
+# Timestamp columns requiring datetime64 conversion
+TIMESTAMP_COLUMNS = ("date", "close_time")
+
+
+def _ensure_datetime_types(df: pd.DataFrame) -> pd.DataFrame:
+    """Ensure timestamp columns are datetime64 type, not strings.
+
+    Applies pd.to_datetime() to timestamp columns. Idempotent - safe to call
+    on DataFrames that already have datetime types.
+
+    Args:
+        df: DataFrame with potential string timestamp columns
+
+    Returns:
+        DataFrame with datetime64 timestamp columns
+    """
+    for col in TIMESTAMP_COLUMNS:
+        if col in df.columns:
+            df[col] = pd.to_datetime(df[col])
+    return df
+
 
 def get_supported_symbols() -> List[str]:
     """Get list of supported USDT spot trading pairs.
@@ -263,8 +284,9 @@ def _perform_gap_filling(
                 f"✅ Auto-filled {gap_result['gaps_filled']}/{gap_result['gaps_detected']} "
                 f"gap(s) with authentic Binance API data"
             )
-            # Reload DataFrame with filled gaps
+            # Reload DataFrame with filled gaps and restore datetime types
             df = pd.read_csv(csv_file, comment="#")
+            df = _ensure_datetime_types(df)
         else:
             logger.warning(
                 f"⚠️  Detected {gap_result['gaps_detected']} gap(s) but could not fill them. "

{gapless_crypto_data-4.0.2 → gapless_crypto_data-5.0.0}/uv.lock

@@ -368,7 +368,7 @@ wheels = [
 
 [[package]]
 name = "gapless-crypto-data"
-version = "4.0.1"
+version = "4.0.2"
 source = { editable = "." }
 dependencies = [
     { name = "duckdb" },

gapless_crypto_data-4.0.2/src/gapless_crypto_data/__init__.py

@@ -1,134 +0,0 @@
-"""
-Gapless Crypto Data v4.0.1 - USDT spot market data collection with zero gaps guarantee
-
-Market Compatibility:
-- USDT SPOT PAIRS ONLY (BTCUSDT, ETHUSDT, SOLUSDT, etc.)
-- NO futures, perpetuals, or derivatives support
-- NO non-USDT pairs (BTC/ETH, etc.)
-- NO margin trading data
-
-Core Features:
-- Data collection via Binance public data repository (22x performance vs API calls)
-- Full 11-column microstructure format with order flow and liquidity metrics
-- Zero gaps guarantee through authentic API-first validation
-- UV-based Python tooling
-- Atomic file operations
-- Complete 13-timeframe support (1s, 1m, 3m, 5m, 15m, 30m, 1h, 2h, 4h, 6h, 8h, 12h, 1d)
-- Ultra-high frequency (1s) to daily (1d) data collection
-- Intelligent monthly-to-daily fallback for seamless recent data access
-- Gap detection and filling with authentic data only
-- CCXT-compatible dual parameter support (timeframe/interval)
-- Backward compatibility with 5-year deprecation period
-
-Data Source:
-    Binance Spot Market: https://data.binance.vision/data/spot/monthly/klines/
-    Market Type: SPOT only (no futures/derivatives)
-    Supported Pairs: USDT-quoted spot pairs exclusively
-
-Usage:
-    # Function-based API
-    import gapless_crypto_data as gcd
-
-    # Fetch recent data as standard pandas DataFrame
-    df = gcd.fetch_data("BTCUSDT", timeframe="1h", limit=1000)
-
-    # Standard pandas operations for analysis
-    returns = df['close'].pct_change()                     # Returns calculation
-    rolling_vol = df['close'].rolling(20).std()            # Rolling volatility
-    max_drawdown = (df['close'] / df['close'].cummax() - 1).min()  # Drawdown
-
-    # Resampling with pandas
-    df_resampled = df.set_index('date').resample('4H').agg({
-        'open': 'first', 'high': 'max', 'low': 'min',
-        'close': 'last', 'volume': 'sum'
-    })
-
-    # Backward compatibility (legacy interval parameter)
-    df = gcd.fetch_data("BTCUSDT", interval="1h", limit=1000)  # DeprecationWarning
-
-    # Download with date range
-    df = gcd.download("ETHUSDT", timeframe="4h", start="2024-01-01", end="2024-06-30")
-
-    # Get available symbols and timeframes
-    symbols = gcd.get_supported_symbols()
-    timeframes = gcd.get_supported_timeframes()
-
-    # Fill gaps in existing data
-    results = gcd.fill_gaps("./data")
-
-    # Class-based API (for complex workflows)
-    from gapless_crypto_data import BinancePublicDataCollector, UniversalGapFiller
-
-    collector = BinancePublicDataCollector()
-    result = collector.collect_timeframe_data("1h")
-    df = result["dataframe"]
-
-CLI Usage (DEPRECATED - Will be removed in v4.0.0):
-    ⚠️  The CLI is deprecated. Please use the Python API instead (see above).
-
-    Legacy CLI (deprecated):
-        uv run gapless-crypto-data --symbol SOLUSDT --timeframes 1s,1m,5m,1h,4h,1d
-        uv run gapless-crypto-data --symbol BTCUSDT --timeframes 1s,6h,8h,12h,1d
-        uv run gapless-crypto-data --fill-gaps --directory ./data
-
-Supported Symbols (USDT Spot Only):
-    BTCUSDT, ETHUSDT, SOLUSDT, ADAUSDT, DOTUSDT, LINKUSDT, MATICUSDT,
-    AVAXUSDT, ATOMUSDT, NEARUSDT, FTMUSDT, SANDUSDT, MANAUSDT, etc.
-"""
-
-__version__ = "4.0.1"
-__author__ = "Eon Labs"
-__email__ = "terry@eonlabs.com"
-
-# Core classes (advanced/power-user API)
-# Enhanced DataFrame for domain-specific operations
-# Convenience functions (simple/intuitive API)
-# API-only probe hooks for AI coding agents
-from . import __probe__
-from .api import (
-    download,
-    fetch_data,
-    fill_gaps,
-    get_info,
-    get_supported_intervals,
-    get_supported_symbols,
-    get_supported_timeframes,
-    load_parquet,
-    save_parquet,
-)
-from .collectors.binance_public_data_collector import BinancePublicDataCollector
-from .exceptions import (
-    DataCollectionError,
-    GapFillingError,
-    GaplessCryptoDataError,
-    NetworkError,
-    ValidationError,
-)
-from .gap_filling.safe_file_operations import AtomicCSVOperations, SafeCSVMerger
-from .gap_filling.universal_gap_filler import UniversalGapFiller
-
-__all__ = [
-    # Simple function-based API (recommended for most users)
-    "fetch_data",
-    "download",
-    "get_supported_symbols",
-    "get_supported_timeframes",
-    "get_supported_intervals",  # Legacy compatibility
-    "fill_gaps",
-    "get_info",
-    "save_parquet",
-    "load_parquet",
-    # Advanced class-based API (for complex workflows)
-    "BinancePublicDataCollector",
-    "UniversalGapFiller",
-    "AtomicCSVOperations",
-    "SafeCSVMerger",
-    # Structured exception hierarchy (v3.2.0)
-    "GaplessCryptoDataError",
-    "DataCollectionError",
-    "ValidationError",
-    "NetworkError",
-    "GapFillingError",
-    # AI agent probe hooks
-    "__probe__",
-]