dccd 2.3.3__tar.gz → 2.4.0__tar.gz

{dccd-2.3.3 → dccd-2.4.0}/CHANGELOG.md

@@ -6,10 +6,36 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 ## [Unreleased]
 
+## [2.4.0] - 2026-06-04
+
+### Added
+
+- `dccd/daemon/api.py` — web UI and JSON API (FastAPI + Jinja2 + htmx): a thin
+  HTTP layer over the existing daemon modules exposing dashboard (live health
+  metrics), inventory (stored data coverage), jobs (histo/stream list + add/remove
+  + live backfill progress), logs (tail), config (view/validate/save the YAML),
+  and storage (rclone status + manual sync). JSON-only API (`/api/*`) with
+  dumb-shell templates, so the front-end can be swapped without touching the API.
+  Optional Bearer-token auth via `settings.ui_auth_token`
+- `dccd/daemon/cli.py` — `dccd ui`: serve the web UI standalone; the UI is also
+  started automatically (background thread) by `dccd start` when the `[ui]` extra
+  is installed
+- `dccd/daemon/config.py` — `SettingsConfig.ui_host`, `ui_port`, `ui_auth_token`:
+  web UI bind address, port, and optional auth token
+- `dccd/daemon/backfill.py` — `progress_callback` and `stop_event` on
+  `_BackfillBase.run()` / `run_backfill()`: let the UI report live progress and
+  cancel a running backfill (defaults keep CLI behaviour unchanged)
+- `dccd/daemon/stream_manager.py` — `SyncService` writes
+  `{local_path}/.dccd/last_sync.json` after each successful remote push, so the UI
+  can display the last sync time
+- `pyproject.toml` — new optional extra `[ui]` (`fastapi`, `uvicorn[standard]`,
+  `jinja2`); install with `pip install dccd[daemon,ui]`
+
 ## [2.3.3] - 2026-05-31
 
 ### Added
 
+
 - `doc/source/` — complete Sphinx documentation overhaul: redesigned homepage
   with sphinx-design cards, captioned toctrees (Getting Started / Data Collection /
   Reference), new pages (`installation`, `quickstart`, `changelog`, `cli`,

{dccd-2.3.3 → dccd-2.4.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: dccd
-Version: 2.3.3
+Version: 2.4.0
 Summary: Download Crypto Currency Data from different exchanges.
 Author-email: Arthur Bernard <arthur.bernard.92@gmail.com>
 License: MIT
@@ -39,6 +39,10 @@ Requires-Dist: pyyaml>=6.0; extra == "daemon"
 Requires-Dist: apscheduler<4,>=3.10; extra == "daemon"
 Requires-Dist: typer>=0.12; extra == "daemon"
 Requires-Dist: tqdm>=4.64; extra == "daemon"
+Provides-Extra: ui
+Requires-Dist: fastapi>=0.110; extra == "ui"
+Requires-Dist: uvicorn[standard]>=0.29; extra == "ui"
+Requires-Dist: jinja2>=3.1; extra == "ui"
 Provides-Extra: dev
 Requires-Dist: pytest>=7.4; extra == "dev"
 Requires-Dist: pytest-asyncio>=0.23; extra == "dev"
@@ -50,6 +54,10 @@ Requires-Dist: pyyaml>=6.0; extra == "dev"
 Requires-Dist: apscheduler<4,>=3.10; extra == "dev"
 Requires-Dist: typer>=0.12; extra == "dev"
 Requires-Dist: tqdm>=4.64; extra == "dev"
+Requires-Dist: fastapi>=0.110; extra == "dev"
+Requires-Dist: uvicorn[standard]>=0.29; extra == "dev"
+Requires-Dist: jinja2>=3.1; extra == "dev"
+Requires-Dist: httpx>=0.27; extra == "dev"
 Provides-Extra: doc
 Requires-Dist: sphinx>=7.0; extra == "doc"
 Requires-Dist: furo; extra == "doc"
@@ -58,14 +66,17 @@ Requires-Dist: sphinx-design; extra == "doc"
 Requires-Dist: sphinx-copybutton; extra == "doc"
 Requires-Dist: pyyaml>=6.0; extra == "doc"
 Requires-Dist: apscheduler<4,>=3.10; extra == "doc"
+Requires-Dist: fastapi>=0.110; extra == "doc"
+Requires-Dist: uvicorn[standard]>=0.29; extra == "doc"
+Requires-Dist: jinja2>=3.1; extra == "doc"
 Dynamic: license-file
 
 <picture>
   <source media="(prefers-color-scheme: dark)" srcset="https://raw.githubusercontent.com/ArthurBernard/Download_Crypto_Currencies_Data/develop/doc/source/_static/logo-dark-transparent.svg">
-  <img alt="dccd logo" src="https://raw.githubusercontent.com/ArthurBernard/Download_Crypto_Currencies_Data/develop/doc/source/_static/logo-light-transparent.svg" height="130px" align="left">
+  <img alt="dccd logo" src="https://raw.githubusercontent.com/ArthurBernard/Download_Crypto_Currencies_Data/develop/doc/source/_static/logo-light-transparent.svg" height="180px" align="left">
 </picture>
 
-# Download Crypto-Currency Data
+# **Download Crypto-Currency Data**
 
 [![Python versions](https://img.shields.io/pypi/pyversions/dccd)](https://pypi.org/project/dccd/)
 [![PyPI](https://img.shields.io/pypi/v/dccd.svg)](https://pypi.org/project/dccd/)
@@ -77,6 +88,8 @@ Dynamic: license-file
 [![Docstring coverage](https://raw.githubusercontent.com/ArthurBernard/Download_Crypto_Currencies_Data/badges/interrogate_badge.svg)](https://github.com/ArthurBernard/Download_Crypto_Currencies_Data)
 [![Downloads](https://pepy.tech/badge/dccd)](https://pepy.tech/project/dccd)
 
+___
+
 Python package to download crypto-currency data (OHLCV, trades, order book) from multiple
 exchanges via REST and WebSocket APIs. Data can be saved to CSV, Excel, SQLite, PostgreSQL,
 or Parquet.
@@ -93,6 +106,12 @@ With autonomous daemon support (APScheduler + PyYAML):
 pip install "dccd[daemon]"
 ```
 
+With the web UI (FastAPI + htmx — `dccd ui`):
+
+```bash
+pip install "dccd[daemon,ui]"
+```
+
 From source:
 
 ```bash
@@ -127,6 +146,9 @@ Stream real-time data (order book, trades) via WebSocket with automatic reconnec
 **Daemon** `dccd.daemon`  
 Autonomous, server-side collector driven by a YAML config. Runs REST jobs on a schedule (APScheduler), opens WebSocket streams for real-time collection, and periodically syncs all local data to one or more remote destinations (NAS, S3, SFTP, …) via rclone. Multiple remotes and a configurable sync interval are supported; collection is never blocked by remote availability.
 
+**Web UI** `dccd.daemon.api`  
+Optional browser interface (FastAPI + htmx) mirroring the CLI: dashboard of live health metrics, data inventory, job management (add/remove pairs, launch and cancel backfills), log tail, config editor, and remote-storage status. Runs standalone (`dccd ui`) or embedded in `dccd start`.
+
 ### Output formats
 
 Historical data can be saved as **CSV**, **Excel** (`.xlsx`), **SQLite**, **PostgreSQL** (via SQLAlchemy), or **Parquet**.
@@ -241,6 +263,9 @@ dccd remove --exchange kraken --pair ETH/USD --span 86400 --config config.yml
 # Inspect all data on disk (OHLC, trades, orderbook)
 dccd inventory --config config.yml
 
+# Web UI — dashboard, inventory, jobs, logs, config (needs: pip install "dccd[daemon,ui]")
+dccd ui --config config.yml          # http://127.0.0.1:8080
+
 # Enable shell tab-completion (run once after install)
 dccd --install-completion
 ```

{dccd-2.3.3 → dccd-2.4.0}/README.md

@@ -1,9 +1,9 @@
 <picture>
   <source media="(prefers-color-scheme: dark)" srcset="https://raw.githubusercontent.com/ArthurBernard/Download_Crypto_Currencies_Data/develop/doc/source/_static/logo-dark-transparent.svg">
-  <img alt="dccd logo" src="https://raw.githubusercontent.com/ArthurBernard/Download_Crypto_Currencies_Data/develop/doc/source/_static/logo-light-transparent.svg" height="130px" align="left">
+  <img alt="dccd logo" src="https://raw.githubusercontent.com/ArthurBernard/Download_Crypto_Currencies_Data/develop/doc/source/_static/logo-light-transparent.svg" height="180px" align="left">
 </picture>
 
-# Download Crypto-Currency Data
+# **Download Crypto-Currency Data**
 
 [![Python versions](https://img.shields.io/pypi/pyversions/dccd)](https://pypi.org/project/dccd/)
 [![PyPI](https://img.shields.io/pypi/v/dccd.svg)](https://pypi.org/project/dccd/)
@@ -15,6 +15,8 @@
 [![Docstring coverage](https://raw.githubusercontent.com/ArthurBernard/Download_Crypto_Currencies_Data/badges/interrogate_badge.svg)](https://github.com/ArthurBernard/Download_Crypto_Currencies_Data)
 [![Downloads](https://pepy.tech/badge/dccd)](https://pepy.tech/project/dccd)
 
+___
+
 Python package to download crypto-currency data (OHLCV, trades, order book) from multiple
 exchanges via REST and WebSocket APIs. Data can be saved to CSV, Excel, SQLite, PostgreSQL,
 or Parquet.
@@ -31,6 +33,12 @@ With autonomous daemon support (APScheduler + PyYAML):
 pip install "dccd[daemon]"
 ```
 
+With the web UI (FastAPI + htmx — `dccd ui`):
+
+```bash
+pip install "dccd[daemon,ui]"
+```
+
 From source:
 
 ```bash
@@ -65,6 +73,9 @@ Stream real-time data (order book, trades) via WebSocket with automatic reconnec
 **Daemon** `dccd.daemon`  
 Autonomous, server-side collector driven by a YAML config. Runs REST jobs on a schedule (APScheduler), opens WebSocket streams for real-time collection, and periodically syncs all local data to one or more remote destinations (NAS, S3, SFTP, …) via rclone. Multiple remotes and a configurable sync interval are supported; collection is never blocked by remote availability.
 
+**Web UI** `dccd.daemon.api`  
+Optional browser interface (FastAPI + htmx) mirroring the CLI: dashboard of live health metrics, data inventory, job management (add/remove pairs, launch and cancel backfills), log tail, config editor, and remote-storage status. Runs standalone (`dccd ui`) or embedded in `dccd start`.
+
 ### Output formats
 
 Historical data can be saved as **CSV**, **Excel** (`.xlsx`), **SQLite**, **PostgreSQL** (via SQLAlchemy), or **Parquet**.
@@ -179,6 +190,9 @@ dccd remove --exchange kraken --pair ETH/USD --span 86400 --config config.yml
 # Inspect all data on disk (OHLC, trades, orderbook)
 dccd inventory --config config.yml
 
+# Web UI — dashboard, inventory, jobs, logs, config (needs: pip install "dccd[daemon,ui]")
+dccd ui --config config.yml          # http://127.0.0.1:8080
+
 # Enable shell tab-completion (run once after install)
 dccd --install-completion
 ```