ml-dash 0.6.6__py3-none-any.whl → 0.6.9__py3-none-any.whl

{ml_dash-0.6.6.dist-info → ml_dash-0.6.9.dist-info}/METADATA

@@ -1,6 +1,6 @@
 Metadata-Version: 2.3
 Name: ml-dash
-Version: 0.6.6
+Version: 0.6.9
 Summary: ML experiment tracking and data storage
 Keywords: machine-learning,experiment-tracking,mlops,data-storage
 Author: Ge Yang, Tom Tao
@@ -68,10 +68,11 @@ Description-Content-Type: text/markdown
 
 # ML-Dash
 
-A simple and flexible SDK for ML experiment tracking and data storage.
+A simple and flexible SDK for ML experiment tracking and data storage with background buffering for high-performance training.
 
 ## Features
 
+### Core Features
 - **Three Usage Styles**: Pre-configured singleton (dxp), context manager, or direct instantiation
 - **Dual Operation Modes**: Remote (API server) or local (filesystem)
 - **OAuth2 Authentication**: Secure device flow authentication for CLI and SDK
@@ -82,6 +83,13 @@ A simple and flexible SDK for ML experiment tracking and data storage.
 - **Rich Metadata**: Tags, bindrs, descriptions, and custom metadata support
 - **Simple API**: Minimal configuration, maximum flexibility
 
+### Performance Features (New in 0.6.7)
+- **Background Buffering**: Non-blocking I/O operations eliminate training interruptions
+- **Automatic Batching**: Time-based (5s) and size-based (100 items) flush triggers
+- **Track API**: Time-series data tracking for robotics, RL, and sequential experiments
+- **Numpy Image Support**: Direct saving of numpy arrays as PNG/JPEG images
+- **Parallel Uploads**: ThreadPoolExecutor for efficient file uploads
+
 ## Installation
 
 <table>
@@ -93,14 +101,14 @@ A simple and flexible SDK for ML experiment tracking and data storage.
 <td>
 
 ```bash
-uv add ml-dash==0.6.2rc1
+uv add ml-dash
 ```
 
 </td>
 <td>
 
 ```bash
-pip install ml-dash==0.6.2rc1
+pip install ml-dash
 ```
 
 </td>
@@ -159,7 +167,75 @@ with Experiment(
 
 ```
 
-See [docs/getting-started.md](docs/getting-started.md) for more examples.
+## New Features in 0.6.7
+
+### 🚀 Background Buffering (Non-blocking I/O)
+
+All write operations are now buffered and executed in background threads:
+
+```python
+with Experiment("my-project/exp").run as experiment:
+    for i in range(10000):
+        # Non-blocking! Returns immediately
+        experiment.log(f"Step {i}")
+        experiment.metrics("train").log(loss=loss, accuracy=acc)
+        experiment.files("frames").save_image(frame, to=f"frame_{i}.jpg")
+
+    # All data automatically flushed when context exits
+```
+
+Configure buffering via environment variables:
+```bash
+export ML_DASH_BUFFER_ENABLED=true
+export ML_DASH_FLUSH_INTERVAL=5.0
+export ML_DASH_LOG_BATCH_SIZE=100
+```
+
+### 📊 Track API (Time-Series Data)
+
+Perfect for robotics, RL, and sequential experiments:
+
+```python
+with Experiment("robotics/training").run as experiment:
+    for step in range(1000):
+        # Track robot position over time
+        experiment.track("robot/position").append({
+            "step": step,
+            "x": position[0],
+            "y": position[1],
+            "z": position[2]
+        })
+
+        # Track control signals
+        experiment.track("robot/control").append({
+            "step": step,
+            "motor1": ctrl[0],
+            "motor2": ctrl[1]
+        })
+```
+
+### 🖼️ Numpy Image Support
+
+Save numpy arrays directly as images (PNG/JPEG):
+
+```python
+import numpy as np
+
+with Experiment("vision/training").run as experiment:
+    # From MuJoCo, OpenCV, PIL, etc.
+    pixels = renderer.render()  # numpy array
+
+    # Save as PNG (lossless)
+    experiment.files("frames").save_image(pixels, to="frame.png")
+
+    # Save as JPEG with quality control
+    experiment.files("frames").save_image(pixels, to="frame.jpg", quality=85)
+
+    # Auto-detection also works
+    experiment.files("frames").save(pixels, to="frame.jpg")
+```
+
+See [CHANGELOG.md](CHANGELOG.md) for complete release notes.
 
 ## Development Setup
 

{ml_dash-0.6.6.dist-info → ml_dash-0.6.9.dist-info}/RECORD

@@ -6,20 +6,21 @@ ml_dash/auth/device_secret.py,sha256=qUsz6M9S1GEIukvmz57eJEp57srSx74O4MU9mZEeDlE
 ml_dash/auth/exceptions.py,sha256=IeBwUzoaTyFtPwd4quFOIel49inIzuabe_ChEeEXEWI,725
 ml_dash/auth/token_storage.py,sha256=L18W8J7D1LlCDlY3Q32l0RXeNh0o7YVDQeeGYm64Dgw,8163
 ml_dash/auto_start.py,sha256=FHTTui33bxfk5rHf-VY2RFcd2JQ_LsNpkUu7Qtpc-GY,1721
+ml_dash/buffer.py,sha256=i4-PZ703_yuKJPAXpmWBGm8jHAAdIBqiA0NIZQEc3wo,26201
 ml_dash/cli.py,sha256=X8LsQA8Wfa1XuXsbvePaGo6NYer7f8CNzy33VT3jrqg,2740
 ml_dash/cli_commands/__init__.py,sha256=bjAmV7MsW-bhtW_4SnLJ0Cfkt9h82vMDC8ebW1Ke8KE,38
 ml_dash/cli_commands/api.py,sha256=NekZEJGWNpIfB6YrsrOw7kw7rZKjVudwgJWPZIy6ANQ,4535
 ml_dash/cli_commands/create.py,sha256=i6LPA6vefpHUeXncBNzQsLnwF5EM2uF6IX4g7vTDYXo,4400
-ml_dash/cli_commands/download.py,sha256=LeZXjQSEPIxZALuo90fj8RHjFWIbtGPE0F625sD3cU8,28054
-ml_dash/cli_commands/list.py,sha256=oc_yJXFhsvGgr3JedG2j7747yX69Qc546geIi4DQ54k,16129
+ml_dash/cli_commands/download.py,sha256=Jw-ZeVH8SL9t2yRNCwSmQ0qUOzI4_iWGWt7SwAfM4Ig,33853
+ml_dash/cli_commands/list.py,sha256=H442wOAcWYtDwq6BS7lpZbkKhqfTXBCHGctbw8zT1Zw,20841
 ml_dash/cli_commands/login.py,sha256=zX-urtUrfzg2qOGtKNYQgj6UloN9kzj4zEO6h_xwuNs,6782
 ml_dash/cli_commands/logout.py,sha256=lTUUNyRXqvo61qNkCd4KBrPUujDAHnNqsHkU6bHie0U,1332
-ml_dash/cli_commands/profile.py,sha256=BaSM6BAN3YM4tw95iKV_nypKZxwsB3PoAAejQcYip5E,2351
-ml_dash/cli_commands/upload.py,sha256=1kTmnw4hAevl5mtB1GKlzEh2sPoudv0LTUNhCg0dIXs,45459
-ml_dash/client.py,sha256=VYOW-JNtHEonHoeS7InbyMXKRSrWFcRjo7onhqkGXKg,54659
+ml_dash/cli_commands/profile.py,sha256=AsdwAA2bmSTVnYyJ31iddkSwYJfYqJ60V1UGjFpa3YI,5869
+ml_dash/cli_commands/upload.py,sha256=SSUfXC3qoNpoFvPM_ia-ing_N50LNiAvMy9op6FM9Ew,49664
+ml_dash/client.py,sha256=L-FZysVAuIovJJZ1MlDMPhOPJFyL77pMuBxtucG88x8,62005
 ml_dash/config.py,sha256=oz2xvoBh2X_xUXWr92cPD5nFxXMT5LxVNypv5B5O0fA,3116
-ml_dash/experiment.py,sha256=JCLSWJMOSHQ-dAfR4hOwB07BpNoXzbWTY9lk4VOVRKY,37678
-ml_dash/files.py,sha256=bihUHKpdknytLGuGgkcvhh585nziZrvYjiHl6rHnoD0,49227
+ml_dash/experiment.py,sha256=sq5Bu-vcKhzTQlUsI6SzIHUZyUkxn7ZSMp_AbhFe4Bw,43462
+ml_dash/files.py,sha256=tGJCTxPfd9vmfvIEqstZjzLvqmHzMZffPXHz0jU9bYU,54441
 ml_dash/log.py,sha256=E-DLg0vejVLLEyShJ_r0LneDMI0XU7XTH5iKWYJe9jI,5298
 ml_dash/metric.py,sha256=ghD1jnuv6dbjV1Jlo7q0mx9UEzpdto2Y1-oDWrSfg04,25809
 ml_dash/params.py,sha256=pPFvknJAJX5uhckzjO1r-HNnKbQFFKDISFmOXNET5eY,9046
@@ -27,8 +28,9 @@ ml_dash/py.typed,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
 ml_dash/remote_auto_start.py,sha256=5fvQDHv1CWEKFb6WAa5_uyEInwV_SvotXjOO_6i6ZKE,1687
 ml_dash/run.py,sha256=_a1l5qswwMgrhvajx_lI-I5IXhfHDeH3hfLAJ7Uk_Gs,8847
 ml_dash/snowflake.py,sha256=14rEpRU5YltsmmmZW0EMUy_hdv5S5ME9gWVtmdmwfiU,4917
-ml_dash/storage.py,sha256=jJ0mYCeBIMQ_dQeNLaCiW0fndsliG68w-TmCI1HyYZc,32926
-ml_dash-0.6.6.dist-info/WHEEL,sha256=z-mOpxbJHqy3cq6SvUThBZdaLGFZzdZPtgWLcP2NKjQ,79
-ml_dash-0.6.6.dist-info/entry_points.txt,sha256=dYs2EHX1uRNO7AQGNnVaJJpgiy0Z9q7tiy4fHSyaf3Q,46
-ml_dash-0.6.6.dist-info/METADATA,sha256=ARlHyG-ZdMBqW-WSJjjaKuqwo2bm2M5X7ENkZ-yI0Z0,7203
-ml_dash-0.6.6.dist-info/RECORD,,
+ml_dash/storage.py,sha256=x1W-dK6wQY36-LVOJ4kA8Dn07ObNQuIErQWJ3b0PoGY,44910
+ml_dash/track.py,sha256=Dfg1ZnmKZ_FlE5ZfG8Qld_wN4RIMs3nrOxrxwf3thiY,8164
+ml_dash-0.6.9.dist-info/WHEEL,sha256=z-mOpxbJHqy3cq6SvUThBZdaLGFZzdZPtgWLcP2NKjQ,79
+ml_dash-0.6.9.dist-info/entry_points.txt,sha256=dYs2EHX1uRNO7AQGNnVaJJpgiy0Z9q7tiy4fHSyaf3Q,46
+ml_dash-0.6.9.dist-info/METADATA,sha256=f2YU7ukCO9VmIQ1zrctXaRBOA5D6t5caT89JLMD6Sxw,9535
+ml_dash-0.6.9.dist-info/RECORD,,