dccd 2.3.2__tar.gz → 2.3.3__tar.gz

{dccd-2.3.2 → dccd-2.3.3}/CHANGELOG.md

@@ -6,6 +6,19 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 ## [Unreleased]
 
+## [2.3.3] - 2026-05-31
+
+### Added
+
+- `doc/source/` — complete Sphinx documentation overhaul: redesigned homepage
+  with sphinx-design cards, captioned toctrees (Getting Started / Data Collection /
+  Reference), new pages (`installation`, `quickstart`, `changelog`, `cli`,
+  `configuration`, `models`, `storage`, `tools`, per-exchange histo/continuous pages),
+  adaptive light/dark logo and favicon, sticky top navbar with PyPI/GitHub/Fynance
+  links, hero header with inline logo+title, responsive layout (#59, #61)
+- `README.md` — converted from RST to Markdown; inline logo+title header with
+  `<picture>` for light/dark mode switching; badges on two rows (#60)
+
 ## [2.3.2] - 2026-05-25
 
 ### Added

dccd-2.3.3/PKG-INFO

@@ -0,0 +1,275 @@
+Metadata-Version: 2.4
+Name: dccd
+Version: 2.3.3
+Summary: Download Crypto Currency Data from different exchanges.
+Author-email: Arthur Bernard <arthur.bernard.92@gmail.com>
+License: MIT
+Project-URL: Homepage, https://github.com/ArthurBernard/Download_Crypto_Currencies_Data
+Project-URL: Documentation, https://download-crypto-currencies-data.readthedocs.io/
+Project-URL: Changelog, https://github.com/ArthurBernard/Download_Crypto_Currencies_Data/blob/master/CHANGELOG.md
+Classifier: Development Status :: 5 - Production/Stable
+Classifier: Intended Audience :: Financial and Insurance Industry
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Operating System :: OS Independent
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Topic :: Database
+Classifier: Topic :: Office/Business :: Financial
+Requires-Python: >=3.10
+Description-Content-Type: text/markdown
+License-File: LICENSE.txt
+Requires-Dist: numpy>=1.26
+Requires-Dist: polars>=0.20
+Requires-Dist: pyarrow>=13
+Requires-Dist: requests>=2.28
+Requires-Dist: openpyxl>=3.1
+Requires-Dist: websockets>=12.0
+Requires-Dist: scipy>=1.10
+Requires-Dist: SQLAlchemy>=2.0
+Requires-Dist: tenacity>=8.0
+Requires-Dist: pydantic>=2.0
+Provides-Extra: io
+Requires-Dist: polars>=0.20; extra == "io"
+Requires-Dist: pyarrow>=13; extra == "io"
+Provides-Extra: daemon
+Requires-Dist: pyyaml>=6.0; extra == "daemon"
+Requires-Dist: apscheduler<4,>=3.10; extra == "daemon"
+Requires-Dist: typer>=0.12; extra == "daemon"
+Requires-Dist: tqdm>=4.64; extra == "daemon"
+Provides-Extra: dev
+Requires-Dist: pytest>=7.4; extra == "dev"
+Requires-Dist: pytest-asyncio>=0.23; extra == "dev"
+Requires-Dist: pytest-cov>=4.1; extra == "dev"
+Requires-Dist: ruff>=0.4; extra == "dev"
+Requires-Dist: interrogate>=1.5; extra == "dev"
+Requires-Dist: mypy>=1.0; extra == "dev"
+Requires-Dist: pyyaml>=6.0; extra == "dev"
+Requires-Dist: apscheduler<4,>=3.10; extra == "dev"
+Requires-Dist: typer>=0.12; extra == "dev"
+Requires-Dist: tqdm>=4.64; extra == "dev"
+Provides-Extra: doc
+Requires-Dist: sphinx>=7.0; extra == "doc"
+Requires-Dist: furo; extra == "doc"
+Requires-Dist: numpydoc; extra == "doc"
+Requires-Dist: sphinx-design; extra == "doc"
+Requires-Dist: sphinx-copybutton; extra == "doc"
+Requires-Dist: pyyaml>=6.0; extra == "doc"
+Requires-Dist: apscheduler<4,>=3.10; extra == "doc"
+Dynamic: license-file
+
+<picture>
+  <source media="(prefers-color-scheme: dark)" srcset="https://raw.githubusercontent.com/ArthurBernard/Download_Crypto_Currencies_Data/develop/doc/source/_static/logo-dark-transparent.svg">
+  <img alt="dccd logo" src="https://raw.githubusercontent.com/ArthurBernard/Download_Crypto_Currencies_Data/develop/doc/source/_static/logo-light-transparent.svg" height="130px" align="left">
+</picture>
+
+# Download Crypto-Currency Data
+
+[![Python versions](https://img.shields.io/pypi/pyversions/dccd)](https://pypi.org/project/dccd/)
+[![PyPI](https://img.shields.io/pypi/v/dccd.svg)](https://pypi.org/project/dccd/)
+[![PyPI status](https://img.shields.io/pypi/status/dccd.svg?colorB=blue)](https://pypi.org/project/dccd/)
+[![CI](https://github.com/ArthurBernard/Download_Crypto_Currencies_Data/actions/workflows/ci.yml/badge.svg)](https://github.com/ArthurBernard/Download_Crypto_Currencies_Data/actions/workflows/ci.yml)
+[![License](https://img.shields.io/github/license/ArthurBernard/Download_Crypto_Currencies_Data.svg)](https://github.com/ArthurBernard/Download_Crypto_Currencies_Data/blob/master/LICENSE.txt)<br>
+[![Documentation](https://readthedocs.org/projects/download-crypto-currencies-data/badge/?version=latest)](https://download-crypto-currencies-data.readthedocs.io/en/latest/)
+[![Coverage](https://codecov.io/gh/ArthurBernard/Download_Crypto_Currencies_Data/branch/master/graph/badge.svg)](https://codecov.io/gh/ArthurBernard/Download_Crypto_Currencies_Data)
+[![Docstring coverage](https://raw.githubusercontent.com/ArthurBernard/Download_Crypto_Currencies_Data/badges/interrogate_badge.svg)](https://github.com/ArthurBernard/Download_Crypto_Currencies_Data)
+[![Downloads](https://pepy.tech/badge/dccd)](https://pepy.tech/project/dccd)
+
+Python package to download crypto-currency data (OHLCV, trades, order book) from multiple
+exchanges via REST and WebSocket APIs. Data can be saved to CSV, Excel, SQLite, PostgreSQL,
+or Parquet.
+
+## Installation
+
+```bash
+pip install dccd
+```
+
+With autonomous daemon support (APScheduler + PyYAML):
+
+```bash
+pip install "dccd[daemon]"
+```
+
+From source:
+
+```bash
+git clone https://github.com/ArthurBernard/Download_Crypto_Currencies_Data
+cd Download_Crypto_Currencies_Data
+pip install -e .
+```
+
+## Supported exchanges
+
+| Exchange | REST OHLCV | REST Trades | REST Order Book | WS OHLCV | WS Trades | WS Order Book |
+|----------|:----------:|:-----------:|:---------------:|:--------:|:---------:|:-------------:|
+| Binance  | ✓ | ✓ | ✓ | | ✓ | ✓ |
+| Coinbase | ✓ | ✓ † | ✓ | | | |
+| Kraken   | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
+| Bybit    | ✓ | ✓ † | ✓ | | ✓ | ✓ |
+| OKX      | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
+| Bitfinex | | | | ✓ \* | ✓ | ✓ |
+| Bitmex   | | | | | ✓ | ✓ |
+
+\* Bitfinex WS OHLCV is aggregated from the trades stream via `get_ohlc_bitfinex`.  
+† Recent trades only (Bybit ≤ 1 000, Coinbase ≤ 100) — no deep historical pagination via the public REST API.
+
+## Presentation
+
+**Historical Downloader** `dccd.histo_dl`  
+Download OHLCV data via REST APIs and save to disk. Supports chunked requests, automatic retry on rate-limit (HTTP 429), and incremental updates from the last saved timestamp.
+
+**Continuous Downloader** `dccd.continuous_dl`  
+Stream real-time data (order book, trades) via WebSocket with automatic reconnection and configurable processing/saving callbacks.
+
+**Daemon** `dccd.daemon`  
+Autonomous, server-side collector driven by a YAML config. Runs REST jobs on a schedule (APScheduler), opens WebSocket streams for real-time collection, and periodically syncs all local data to one or more remote destinations (NAS, S3, SFTP, …) via rclone. Multiple remotes and a configurable sync interval are supported; collection is never blocked by remote availability.
+
+### Output formats
+
+Historical data can be saved as **CSV**, **Excel** (`.xlsx`), **SQLite**, **PostgreSQL** (via SQLAlchemy), or **Parquet**.
+All DataFrames are native `polars.DataFrame`. A `pandas.DataFrame` can be obtained via `get_data(format='pandas')`.
+
+## Quick start
+
+Historical data:
+
+```python
+from dccd.histo_dl import FromBinance
+
+obj = FromBinance('/path/to/data/', 'BTC', 3600, fiat='USDT')
+obj.import_data(start='2024-01-01 00:00:00', end='2024-12-31 00:00:00')
+obj.save(form='parquet')
+df = obj.get_data()               # polars DataFrame (default)
+df_pd = obj.get_data(format='pandas')  # pandas DataFrame (optional)
+```
+
+Incremental update (resume from last saved point):
+
+```python
+obj.import_data(start='last', end='now').save(form='parquet')
+```
+
+Other exchanges:
+
+```python
+from dccd.histo_dl import FromKraken, FromBybit, FromOKX
+
+FromKraken('/path/', 'ETH', 3600).import_data(start='2024-01-01', end='now').save()
+FromBybit('/path/', 'BTC', 86400).import_data(start='2024-01-01', end='now').save()
+FromOKX('/path/', 'BTC', 3600).import_data(start='2024-01-01', end='now').save()
+```
+
+Trades (historical or recent):
+
+```python
+from dccd.histo_dl import FromBinance, FromKraken
+
+obj = FromBinance('/path/', 'BTC', 3600, fiat='USDT')
+obj.import_trades(start='2024-01-01 00:00:00', end='2024-01-02 00:00:00')
+obj.save_trades(form='csv')
+df = obj.trades_df    # polars DataFrame — columns: TS, price, amount, type, tid
+
+# Kraken also supports full history; Bybit/Coinbase return recent-only snapshots
+FromKraken('/path/', 'BTC', 3600).import_trades(start='2024-01-01', end='2024-01-02').save_trades()
+```
+
+Order book snapshot:
+
+```python
+from dccd.histo_dl import FromOKX
+
+obj = FromOKX('/path/', 'BTC', 3600)
+obj.import_orderbook(depth=50)
+obj.save_orderbook(form='csv')
+df = obj.orderbook_df    # columns: side, price, amount, count
+```
+
+Daemon (autonomous collector) — `config.yml`:
+
+```yaml
+settings:
+  data_path: /data/crypto/
+  timezone: UTC
+
+storage:
+  remotes:
+    - provider: rclone
+      remote: "mynas:crypto/"
+  sync_interval: 3600
+
+histo_jobs:
+  - exchange: binance
+    pairs: [BTC/USDT, ETH/USDT]
+    span: 3600
+    format: parquet
+
+stream_jobs:
+  - exchange: binance
+    pairs: [BTC/USDT]
+    channels: [trades, book]
+    time_step: 60
+```
+
+CLI quick start:
+
+```bash
+# Validate the config
+dccd validate --config config.yml
+
+# Backfill all OHLC history defined in config (resumable)
+dccd backfill --config config.yml --start "2020-01-01 00:00:00"
+
+# Dry run — estimate windows and time without downloading
+dccd backfill --config config.yml --dry-run
+
+# Backfill only one exchange
+dccd backfill --config config.yml --exchange kraken
+
+# One incremental batch per job, then exit (for cron)
+dccd collect --config config.yml
+
+# Continuous daemon (Ctrl-C to stop)
+dccd start --config config.yml
+
+# Add / remove a histo job in-place
+dccd add --exchange kraken --pair ETH/USD --span 86400 --config config.yml
+dccd remove --exchange kraken --pair ETH/USD --span 86400 --config config.yml
+
+# Inspect all data on disk (OHLC, trades, orderbook)
+dccd inventory --config config.yml
+
+# Enable shell tab-completion (run once after install)
+dccd --install-completion
+```
+
+> `--config` is optional — dccd searches `./config.yml` then `~/.config/dccd/config.yml` when omitted.
+
+Python API:
+
+```python
+from dccd.daemon.config import load_config
+from dccd.daemon.scheduler import run_once, build_histo_scheduler
+from dccd.daemon.stream_manager import StreamManager
+
+config = load_config('config.yml')
+
+# One-shot: download all histo jobs once, then exit
+run_once(config)
+
+# Daemon mode: periodic REST + live WebSocket streams
+scheduler = build_histo_scheduler(config)
+scheduler.start()
+
+mgr = StreamManager(config)
+mgr.start()      # runs until mgr.stop() is called
+```
+
+## Links
+
+- PyPI: https://pypi.org/project/dccd/
+- Documentation: https://download-crypto-currencies-data.readthedocs.io/
+- Source: https://github.com/ArthurBernard/Download_Crypto_Currencies_Data
+- Changelog: https://github.com/ArthurBernard/Download_Crypto_Currencies_Data/blob/master/CHANGELOG.md

dccd-2.3.3/README.md

@@ -0,0 +1,213 @@
+<picture>
+  <source media="(prefers-color-scheme: dark)" srcset="https://raw.githubusercontent.com/ArthurBernard/Download_Crypto_Currencies_Data/develop/doc/source/_static/logo-dark-transparent.svg">
+  <img alt="dccd logo" src="https://raw.githubusercontent.com/ArthurBernard/Download_Crypto_Currencies_Data/develop/doc/source/_static/logo-light-transparent.svg" height="130px" align="left">
+</picture>
+
+# Download Crypto-Currency Data
+
+[![Python versions](https://img.shields.io/pypi/pyversions/dccd)](https://pypi.org/project/dccd/)
+[![PyPI](https://img.shields.io/pypi/v/dccd.svg)](https://pypi.org/project/dccd/)
+[![PyPI status](https://img.shields.io/pypi/status/dccd.svg?colorB=blue)](https://pypi.org/project/dccd/)
+[![CI](https://github.com/ArthurBernard/Download_Crypto_Currencies_Data/actions/workflows/ci.yml/badge.svg)](https://github.com/ArthurBernard/Download_Crypto_Currencies_Data/actions/workflows/ci.yml)
+[![License](https://img.shields.io/github/license/ArthurBernard/Download_Crypto_Currencies_Data.svg)](https://github.com/ArthurBernard/Download_Crypto_Currencies_Data/blob/master/LICENSE.txt)<br>
+[![Documentation](https://readthedocs.org/projects/download-crypto-currencies-data/badge/?version=latest)](https://download-crypto-currencies-data.readthedocs.io/en/latest/)
+[![Coverage](https://codecov.io/gh/ArthurBernard/Download_Crypto_Currencies_Data/branch/master/graph/badge.svg)](https://codecov.io/gh/ArthurBernard/Download_Crypto_Currencies_Data)
+[![Docstring coverage](https://raw.githubusercontent.com/ArthurBernard/Download_Crypto_Currencies_Data/badges/interrogate_badge.svg)](https://github.com/ArthurBernard/Download_Crypto_Currencies_Data)
+[![Downloads](https://pepy.tech/badge/dccd)](https://pepy.tech/project/dccd)
+
+Python package to download crypto-currency data (OHLCV, trades, order book) from multiple
+exchanges via REST and WebSocket APIs. Data can be saved to CSV, Excel, SQLite, PostgreSQL,
+or Parquet.
+
+## Installation
+
+```bash
+pip install dccd
+```
+
+With autonomous daemon support (APScheduler + PyYAML):
+
+```bash
+pip install "dccd[daemon]"
+```
+
+From source:
+
+```bash
+git clone https://github.com/ArthurBernard/Download_Crypto_Currencies_Data
+cd Download_Crypto_Currencies_Data
+pip install -e .
+```
+
+## Supported exchanges
+
+| Exchange | REST OHLCV | REST Trades | REST Order Book | WS OHLCV | WS Trades | WS Order Book |
+|----------|:----------:|:-----------:|:---------------:|:--------:|:---------:|:-------------:|
+| Binance  | ✓ | ✓ | ✓ | | ✓ | ✓ |
+| Coinbase | ✓ | ✓ † | ✓ | | | |
+| Kraken   | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
+| Bybit    | ✓ | ✓ † | ✓ | | ✓ | ✓ |
+| OKX      | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
+| Bitfinex | | | | ✓ \* | ✓ | ✓ |
+| Bitmex   | | | | | ✓ | ✓ |
+
+\* Bitfinex WS OHLCV is aggregated from the trades stream via `get_ohlc_bitfinex`.  
+† Recent trades only (Bybit ≤ 1 000, Coinbase ≤ 100) — no deep historical pagination via the public REST API.
+
+## Presentation
+
+**Historical Downloader** `dccd.histo_dl`  
+Download OHLCV data via REST APIs and save to disk. Supports chunked requests, automatic retry on rate-limit (HTTP 429), and incremental updates from the last saved timestamp.
+
+**Continuous Downloader** `dccd.continuous_dl`  
+Stream real-time data (order book, trades) via WebSocket with automatic reconnection and configurable processing/saving callbacks.
+
+**Daemon** `dccd.daemon`  
+Autonomous, server-side collector driven by a YAML config. Runs REST jobs on a schedule (APScheduler), opens WebSocket streams for real-time collection, and periodically syncs all local data to one or more remote destinations (NAS, S3, SFTP, …) via rclone. Multiple remotes and a configurable sync interval are supported; collection is never blocked by remote availability.
+
+### Output formats
+
+Historical data can be saved as **CSV**, **Excel** (`.xlsx`), **SQLite**, **PostgreSQL** (via SQLAlchemy), or **Parquet**.
+All DataFrames are native `polars.DataFrame`. A `pandas.DataFrame` can be obtained via `get_data(format='pandas')`.
+
+## Quick start
+
+Historical data:
+
+```python
+from dccd.histo_dl import FromBinance
+
+obj = FromBinance('/path/to/data/', 'BTC', 3600, fiat='USDT')
+obj.import_data(start='2024-01-01 00:00:00', end='2024-12-31 00:00:00')
+obj.save(form='parquet')
+df = obj.get_data()               # polars DataFrame (default)
+df_pd = obj.get_data(format='pandas')  # pandas DataFrame (optional)
+```
+
+Incremental update (resume from last saved point):
+
+```python
+obj.import_data(start='last', end='now').save(form='parquet')
+```
+
+Other exchanges:
+
+```python
+from dccd.histo_dl import FromKraken, FromBybit, FromOKX
+
+FromKraken('/path/', 'ETH', 3600).import_data(start='2024-01-01', end='now').save()
+FromBybit('/path/', 'BTC', 86400).import_data(start='2024-01-01', end='now').save()
+FromOKX('/path/', 'BTC', 3600).import_data(start='2024-01-01', end='now').save()
+```
+
+Trades (historical or recent):
+
+```python
+from dccd.histo_dl import FromBinance, FromKraken
+
+obj = FromBinance('/path/', 'BTC', 3600, fiat='USDT')
+obj.import_trades(start='2024-01-01 00:00:00', end='2024-01-02 00:00:00')
+obj.save_trades(form='csv')
+df = obj.trades_df    # polars DataFrame — columns: TS, price, amount, type, tid
+
+# Kraken also supports full history; Bybit/Coinbase return recent-only snapshots
+FromKraken('/path/', 'BTC', 3600).import_trades(start='2024-01-01', end='2024-01-02').save_trades()
+```
+
+Order book snapshot:
+
+```python
+from dccd.histo_dl import FromOKX
+
+obj = FromOKX('/path/', 'BTC', 3600)
+obj.import_orderbook(depth=50)
+obj.save_orderbook(form='csv')
+df = obj.orderbook_df    # columns: side, price, amount, count
+```
+
+Daemon (autonomous collector) — `config.yml`:
+
+```yaml
+settings:
+  data_path: /data/crypto/
+  timezone: UTC
+
+storage:
+  remotes:
+    - provider: rclone
+      remote: "mynas:crypto/"
+  sync_interval: 3600
+
+histo_jobs:
+  - exchange: binance
+    pairs: [BTC/USDT, ETH/USDT]
+    span: 3600
+    format: parquet
+
+stream_jobs:
+  - exchange: binance
+    pairs: [BTC/USDT]
+    channels: [trades, book]
+    time_step: 60
+```
+
+CLI quick start:
+
+```bash
+# Validate the config
+dccd validate --config config.yml
+
+# Backfill all OHLC history defined in config (resumable)
+dccd backfill --config config.yml --start "2020-01-01 00:00:00"
+
+# Dry run — estimate windows and time without downloading
+dccd backfill --config config.yml --dry-run
+
+# Backfill only one exchange
+dccd backfill --config config.yml --exchange kraken
+
+# One incremental batch per job, then exit (for cron)
+dccd collect --config config.yml
+
+# Continuous daemon (Ctrl-C to stop)
+dccd start --config config.yml
+
+# Add / remove a histo job in-place
+dccd add --exchange kraken --pair ETH/USD --span 86400 --config config.yml
+dccd remove --exchange kraken --pair ETH/USD --span 86400 --config config.yml
+
+# Inspect all data on disk (OHLC, trades, orderbook)
+dccd inventory --config config.yml
+
+# Enable shell tab-completion (run once after install)
+dccd --install-completion
+```
+
+> `--config` is optional — dccd searches `./config.yml` then `~/.config/dccd/config.yml` when omitted.
+
+Python API:
+
+```python
+from dccd.daemon.config import load_config
+from dccd.daemon.scheduler import run_once, build_histo_scheduler
+from dccd.daemon.stream_manager import StreamManager
+
+config = load_config('config.yml')
+
+# One-shot: download all histo jobs once, then exit
+run_once(config)
+
+# Daemon mode: periodic REST + live WebSocket streams
+scheduler = build_histo_scheduler(config)
+scheduler.start()
+
+mgr = StreamManager(config)
+mgr.start()      # runs until mgr.stop() is called
+```
+
+## Links
+
+- PyPI: https://pypi.org/project/dccd/
+- Documentation: https://download-crypto-currencies-data.readthedocs.io/
+- Source: https://github.com/ArthurBernard/Download_Crypto_Currencies_Data
+- Changelog: https://github.com/ArthurBernard/Download_Crypto_Currencies_Data/blob/master/CHANGELOG.md

{dccd-2.3.2 → dccd-2.3.3}/dccd/daemon/backfill.py

@@ -58,8 +58,8 @@ __all__ = ['OHLCBackfill', 'KrakenBackfill', 'make_job', 'run_backfill']
 _EXCHANGE_DEFAULTS: dict[str, dict] = {
     'binance':  {'max_candles': 990, 'sleep': 0.12},
     'bybit':    {'max_candles': 990, 'sleep': 0.15},
-    'kraken':   {'sleep': 1.00},
-    'okx':      {'max_candles': 990, 'sleep': 0.20},
+    'kraken':   {'sleep': 1.0},
+    'okx':      {'max_candles': 300, 'sleep': 0.20},
     'coinbase': {'max_candles': 300, 'sleep': 0.25},
 }
 
@@ -471,7 +471,7 @@ class KrakenBackfill(_BackfillBase):
             .sort('ts')
         )
         result = (
-            df.group_by_dynamic('ts', every=f'{span}s', closed='left', start_by='datapoint')
+            df.group_by_dynamic('ts', every=f'{span}s', closed='left', start_by='window')
             .agg(
                 pl.col('price').first().alias('open'),
                 pl.col('price').max().alias('high'),
@@ -484,10 +484,11 @@ class KrakenBackfill(_BackfillBase):
                 (pl.col('ts').dt.epoch(time_unit='s') >= start_ts)
                 & (pl.col('ts').dt.epoch(time_unit='s') < end_ts)
             )
+            .with_columns(pl.col('ts').dt.epoch(time_unit='s').alias('ts_sec'))
         )
 
         return [{
-            'date':            int(row['ts'].timestamp()),
+            'date':            row['ts_sec'],
             'open':            float(row['open']),
             'high':            float(row['high']),
             'low':             float(row['low']),

{dccd-2.3.2 → dccd-2.3.3}/dccd/daemon/cli.py

@@ -77,6 +77,24 @@ __all__ = ['app']
 
 app = typer.Typer(help='dccd — autonomous crypto data collection daemon')
 
+
+def _complete_histo_exchange(incomplete: str) -> list[str]:
+    from dccd.daemon.config import SUPPORTED_HISTO_EXCHANGES
+    return [e for e in sorted(SUPPORTED_HISTO_EXCHANGES) if e.startswith(incomplete)]
+
+
+def _complete_pairs_from_config(incomplete: str) -> list[str]:
+    from dccd.daemon.config import load_config, resolve_config_path
+    try:
+        cfg = load_config(resolve_config_path(None))
+        pairs: set[str] = set()
+        for job in cfg.histo_jobs:  # type: ignore[attr-defined]
+            pairs.update(job.pairs)
+        return [p for p in sorted(pairs) if p.startswith(incomplete)]
+    except Exception:
+        return []
+
+
 def _load(config_path: Optional[str]) -> object:
     """Load config, exit with code 1 on any error."""
     from dccd.daemon.config import load_config, resolve_config_path
@@ -132,10 +150,12 @@ def backfill(
     exchange: Optional[str] = typer.Option(
         None, '--exchange', '-e',
         help='Restrict to one exchange (e.g. binance, kraken, bybit).',
+        autocompletion=_complete_histo_exchange,
     ),
     pairs: Optional[List[str]] = typer.Option(
         None, '--pairs', '-p',
         help='Restrict to specific pairs, e.g. --pairs BTC/USDT ETH/USDT.',
+        autocompletion=_complete_pairs_from_config,
     ),
     start: str = typer.Option(
         '2020-01-01 00:00:00', '--start',
@@ -307,8 +327,10 @@ def status(
 
 @app.command()
 def add(
-    exchange: str = typer.Option(..., '--exchange', '-e', help='Exchange name.'),
-    pair: str = typer.Option(..., '--pair', '-p', help='Trading pair (e.g. BTC/USDT).'),
+    exchange: str = typer.Option(..., '--exchange', '-e', help='Exchange name.',
+                                 autocompletion=_complete_histo_exchange),
+    pair: str = typer.Option(..., '--pair', '-p', help='Trading pair (e.g. BTC/USDT).',
+                             autocompletion=_complete_pairs_from_config),
     span: int = typer.Option(..., '--span', '-s', help='Candle interval in seconds.'),
     config: Optional[str] = typer.Option(
         None, '--config', '-c',
@@ -358,8 +380,10 @@ def add(
 
 @app.command()
 def remove(
-    exchange: str = typer.Option(..., '--exchange', '-e', help='Exchange name.'),
-    pair: str = typer.Option(..., '--pair', '-p', help='Trading pair (e.g. BTC/USDT).'),
+    exchange: str = typer.Option(..., '--exchange', '-e', help='Exchange name.',
+                                 autocompletion=_complete_histo_exchange),
+    pair: str = typer.Option(..., '--pair', '-p', help='Trading pair (e.g. BTC/USDT).',
+                             autocompletion=_complete_pairs_from_config),
     span: int = typer.Option(..., '--span', '-s', help='Candle interval in seconds.'),
     config: Optional[str] = typer.Option(
         None, '--config', '-c',

{dccd-2.3.2 → dccd-2.3.3}/dccd/histo_dl/binance.py

@@ -39,18 +39,23 @@ class FromBinance(ImportDataCryptoCurrencies):
     Parameters
     ----------
     path : str
-        The path where data will be save.
+        Root directory for data files.
     crypto : str
-        The abreviation of the crypto-currency.
-    span : {int, 'weekly', 'daily', 'hourly'}
-        - If str, periodicity of observation.
-        - If int, number of the seconds between each observation, minimal span\
-            is 60 seconds.
-    fiat : str
-        A fiat currency or a crypto-currency. Binance don't allow fiat
-        currencies, but USD theter.
-    form : {'xlsx', 'csv'}
-        Your favorit format. Only 'xlsx' and 'csv' for the moment.
+        Crypto-currency symbol, e.g. ``'BTC'``.
+    span : int or str
+        Candle interval in seconds (minimum 60) or a label such as
+        ``'hourly'`` or ``'1h'``.
+    fiat : str, optional
+        Quote currency. Default is ``'USD'``, which is silently coerced to
+        ``'USDT'`` (Binance does not support fiat; only USDT is accepted as
+        a USD-equivalent). ``'EUR'`` is likewise coerced to ``'USDT'`` with
+        a warning.
+    form : str, optional
+        Legacy parameter — ignored. Storage is always Parquet via
+        :class:`~dccd.storage.DataStore`.
+    tz : str, optional
+        Timezone for date parsing: ``'local'`` (default), ``'UTC'``, or any
+        IANA timezone name (e.g. ``'Europe/Paris'``).
 
     See Also
     --------
@@ -108,7 +113,6 @@ class FromBinance(ImportDataCryptoCurrencies):
         return crypto + fiat
 
     def __init__(self, path, crypto, span, fiat='USD', form='xlsx', tz='local'):
-        """ Initialize object. """
         if fiat in ['EUR', 'USD']:
             _logger.warning(
                 "Binance don't allow fiat currencies. "