marpledata 3.6.0.dev2__tar.gz → 3.7.0__tar.gz

{marpledata-3.6.0.dev2 → marpledata-3.7.0}/CHANGELOG.md

@@ -5,7 +5,14 @@ All notable changes to the Python SDK package `marpledata` will be documented in
 The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
 and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
-## [Unreleased]
+## [3.7.0] - 2026-09-28
+
+### Changed
+
+- Clarify docs to use add_signals() for bulk adding signals
+- `Dataset.add_signal` and `Dataset.add_signals` can upload onto a dataset in `POSTPROCESSING_FAILED`
+
+## [3.6.0] - 2026-09-04
 
 ### Changed
 
@@ -20,8 +27,9 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
   - `Dataset.run` / `DB.run_script` to execute a stored processing script against a dataset via a server-side sandbox job.
   - `DataStream.scripts`, `DataStream.update`, and `DataStream.rerun_processing` (`DB.rerun_processing`) to edit a stream and set the script pipeline
   - `Dataset.rerun_processing` and `Dataset.get_debug_messages`.
-- `DB.delete_signals`, `Dataset.delete_signal` / `Dataset.delete_signals`, and `Signal.delete` to remove signals from a dataset.
-- `Dataset.reingest` to reingest a dataset from its original uploaded file, with optional `plugin_args`.
+  - `DB.delete_signals`, `Dataset.delete_signal` / `Dataset.delete_signals`, and `Signal.delete` to remove signals from a dataset.
+  - `Dataset.reingest` to reingest a dataset from its original uploaded file, with optional `plugin_args`.
+  - `logger.debug` lines on SDK mutations (`add_signal`, `update_metadata`, …), off by default. Call `db.verbose()` to print them.
 
 ### Fixed
 

{marpledata-3.6.0.dev2 → marpledata-3.7.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.5
 Name: marpledata
-Version: 3.6.0.dev2
+Version: 3.7.0
 Summary: Marple SDK for Python
 Project-URL: Homepage, https://www.marpledata.com/
 Project-URL: Documentation, https://marpledata.gitlab.io/marple-sdk/
@@ -78,6 +78,7 @@ API_TOKEN = "<your api token>"
 API_URL = "https://db.marpledata.com/api/v1"  # optional if using the default SaaS
 
 db = DB(API_TOKEN, API_URL)
+db.verbose()  # print SDK mutation activity (push_file, add_signal, …) to stdout
 
 db.check_connection()
 
@@ -98,6 +99,8 @@ a conflict without overwrite raises `SignalsAlreadyExistError`.
 A Series, or a DataFrame without a `time` column, takes its times from a `DatetimeIndex` or
 `TimedeltaIndex`. Indexed DataFrames must still have a `value` and/or `value_text` column.
 
+Warning: for performance reasons, prefer adding signals in bulk using `add_signals` over multiple usages of `add_signal`.
+
 ```python
 # Single signal: wait until available before reading
 speed = dataset.get_signal("car.speed").get_data()
@@ -127,6 +130,7 @@ dataset.add_signal("car.custom", samples)
 #### Processing scripts
 
 Write a `process(dataset)` function, store it, and try it on any imported dataset. This runs on the server and writes to that dataset.
+Warning: for performance reasons, prefer adding signals in bulk using `add_signals` over multiple usages of `add_signal`.
 
 ```python
 source = """

{marpledata-3.6.0.dev2 → marpledata-3.7.0}/README.md

@@ -43,6 +43,7 @@ API_TOKEN = "<your api token>"
 API_URL = "https://db.marpledata.com/api/v1"  # optional if using the default SaaS
 
 db = DB(API_TOKEN, API_URL)
+db.verbose()  # print SDK mutation activity (push_file, add_signal, …) to stdout
 
 db.check_connection()
 
@@ -63,6 +64,8 @@ a conflict without overwrite raises `SignalsAlreadyExistError`.
 A Series, or a DataFrame without a `time` column, takes its times from a `DatetimeIndex` or
 `TimedeltaIndex`. Indexed DataFrames must still have a `value` and/or `value_text` column.
 
+Warning: for performance reasons, prefer adding signals in bulk using `add_signals` over multiple usages of `add_signal`.
+
 ```python
 # Single signal: wait until available before reading
 speed = dataset.get_signal("car.speed").get_data()
@@ -92,6 +95,7 @@ dataset.add_signal("car.custom", samples)
 #### Processing scripts
 
 Write a `process(dataset)` function, store it, and try it on any imported dataset. This runs on the server and writes to that dataset.
+Warning: for performance reasons, prefer adding signals in bulk using `add_signals` over multiple usages of `add_signal`.
 
 ```python
 source = """

{marpledata-3.6.0.dev2 → marpledata-3.7.0}/docs/getting-started.rst

@@ -40,6 +40,7 @@ After import, you can add derived signals with
 ``dataset.add_signal(...)`` / ``dataset.add_signals([...])``. For custom
 ingest without file parsing, use ``stream.add_dataset(...)`` then
 ``add_signal``. See :doc:`tutorials` for a full example.
+Warning: for performance reasons, prefer adding signals in bulk using ``add_signals`` over multiple usages of ``add_signal``.
 
 ``stream.push_file(...)`` starts an ingestion and lets the Marple DB API choose
 the best upload mode for the deployment and file size. For large files, use a

{marpledata-3.6.0.dev2 → marpledata-3.7.0}/docs/tutorials.rst

@@ -46,6 +46,8 @@ Add signals after import, or start with an empty dataset using
 A Series, or a DataFrame without a ``time`` column, takes its times from a
 ``DatetimeIndex`` or ``TimedeltaIndex``.
 
+Warning: for performance reasons, prefer adding signals in bulk using ``add_signals`` over multiple usages of ``add_signal``.
+
 .. code-block:: python
 
    speed = dataset.get_signal("car.speed").get_data()
@@ -83,6 +85,7 @@ Processing scripts
 
 Write a ``process(dataset)`` function, store it, and try it on any imported dataset.
 This runs on the server and writes to that dataset.
+Warning: for performance reasons, prefer adding signals in bulk using ``add_signals`` over multiple usages of ``add_signal``.
 
 .. code-block:: python
 

{marpledata-3.6.0.dev2 → marpledata-3.7.0}/example.py

@@ -2,6 +2,7 @@ import os
 import re
 
 import dotenv
+
 from src.marple.db import DB, Dataset
 
 dotenv.load_dotenv()
@@ -11,6 +12,7 @@ if api_token is None:
 
 url = os.getenv("MDB_URL")
 db = DB(api_token, url)
+db.verbose()  # print SDK mutation activity (push_file, add_signal, …) to stdout
 db.check_connection()
 
 stream_name = "CSV Stream"

{marpledata-3.6.0.dev2 → marpledata-3.7.0}/pyproject.toml

@@ -1,6 +1,6 @@
 [project]
 name = "marpledata"
-version = "3.6.0.dev2"
+version = "3.7.0"
 description = "Marple SDK for Python"
 authors = [
   { name = "Matthias Baert", email = "support@marpledata.com" },

{marpledata-3.6.0.dev2 → marpledata-3.7.0}/src/marple/__init__.py

@@ -3,4 +3,4 @@ from .db import DB
 from .insight import Insight
 
 __all__ = ["DB", "Insight", "db"]
-__version__ = "3.6.0.dev2"
+__version__ = "3.7.0"

{marpledata-3.6.0.dev2 → marpledata-3.7.0}/src/marple/db/__init__.py

@@ -1,14 +1,15 @@
 import warnings
 from functools import wraps
 from pathlib import Path
-from typing import TYPE_CHECKING, Any, Literal, Optional, Sequence
+from typing import TYPE_CHECKING, Any, Literal, Optional, Sequence, TextIO
 
 import pandas as pd
 from pydantic import ValidationError
 from requests import Response
 from requests.exceptions import ConnectionError
 
-from marple.db import sql
+from marple.db import activity, sql
+from marple.db.activity import logger
 from marple.db.constants import LAKE_ARROW_SCHEMA as _LAKE_ARROW_SCHEMA
 from marple.db.constants import SAAS_URL
 from marple.db.constants import SCHEMA as _SCHEMA
@@ -156,6 +157,10 @@ class DB:
         self._refresh_stream_cache(r)
         return True
 
+    def verbose(self, enabled: bool = True, file: TextIO | None = None) -> None:
+        """Turn SDK mutation activity logging on or off (stdout by default)."""
+        activity.verbose(enabled, file)
+
     # Stream functions #
 
     def create_stream(
@@ -313,7 +318,9 @@ class DB:
                 "script": Script.resolve_source(script),
             },
         )
-        return Script(client=self.client, **validate_response(r, "Create script failed"))
+        created = Script(client=self.client, **validate_response(r, "Create script failed"))
+        logger.debug(f"Created script {name}")
+        return created
 
     def delete_script(self, script_id: int) -> None:
         """
@@ -324,6 +331,7 @@ class DB:
         """
         r = self.delete(f"/script/{script_id}")
         validate_response(r, "Delete script failed")
+        logger.debug(f"Deleted script {script_id}")
 
     def _refresh_stream_cache(self, r: Response | None = None) -> None:
         if r is None:

marpledata-3.7.0/src/marple/db/activity.py

@@ -0,0 +1,28 @@
+import logging
+import sys
+from typing import TextIO
+
+logger = logging.getLogger("marple.sdk")
+logger.addHandler(logging.NullHandler())
+logger.propagate = False
+
+_handler: logging.Handler | None = None
+
+
+def verbose(enabled: bool = True, file: TextIO | None = None) -> None:
+    """Turn SDK mutation activity logging on or off (stdout by default)."""
+    global _handler
+    if enabled:
+        logger.setLevel(logging.DEBUG)
+        if _handler is not None:
+            return
+        _handler = logging.StreamHandler(file or sys.stdout)
+        _handler.setFormatter(logging.Formatter("%(message)s"))
+        logger.addHandler(_handler)
+        return
+
+    if _handler is not None:
+        logger.removeHandler(_handler)
+        _handler.close()
+        _handler = None
+    logger.setLevel(logging.NOTSET)

{marpledata-3.6.0.dev2 → marpledata-3.7.0}/src/marple/db/dataset.py

@@ -15,6 +15,7 @@ import pyarrow.parquet as pq
 from pandas._typing import AggFuncType, Frequency
 from pydantic import BaseModel, ConfigDict, Field, PrivateAttr, ValidationError
 
+from marple.db.activity import logger
 from marple.db.constants import (
     COL_SIG,
     COL_TIME,
@@ -55,6 +56,14 @@ STABLE_STATUSES = [
 ]
 BUSY_STATUSES = [v for v in ImportStatus if v not in STABLE_STATUSES]
 
+# A processing script may write in these statuses. POSTPROCESSING is in-flight;
+# only the stable members can start a run.
+SCRIPTABLE_STATUSES = [
+    ImportStatus.FINISHED,
+    ImportStatus.POSTPROCESSING,
+    ImportStatus.POSTPROCESSING_FAILED,
+]
+
 GET_SIGNALS_CHUNK_SIZE = 200
 
 
@@ -333,6 +342,8 @@ class Dataset(BaseModel):
         new_metadata = metadata if overwrite else {**self.metadata, **metadata}
         r = self._client.post(f"/stream/{self.datastream_id}/dataset/{self.id}/metadata", json=new_metadata)
         validate_response(r, "Update metadata failed")
+        suffix = " (overwrite=True)" if overwrite else ""
+        logger.debug(f"Updated dataset metadata: {metadata}{suffix}")
         return self.fetch(self._client, self.id)
 
     def upsert_signals(self, signals: list[dict]) -> None:
@@ -347,6 +358,7 @@ class Dataset(BaseModel):
         """
         r = self._client.post(f"/stream/{self.datastream_id}/dataset/{self.id}/signals", json=signals)
         validate_response(r, "Upsert signals failed")
+        logger.debug(f"Upserted metadata for {len(signals)} signals from dataset {self.path}")
 
     def add_signal(
         self,
@@ -369,6 +381,8 @@ class Dataset(BaseModel):
         Returns the new signal immediately after upload completes. Call
         :meth:`Signal.wait_until_available` to wait until the signal is available.
 
+        Warning: for performance reasons, prefer adding signals in bulk using ``add_signals`` over multiple usages of ``add_signal``.
+
         Args:
             name: Signal name.
             data: Signal samples (DataFrame, Series, Arrow table, or parquet path).
@@ -408,13 +422,15 @@ class Dataset(BaseModel):
             return []
         if len(signals) > MAX_SIGNALS_PER_ADD:
             raise ValueError(f"Provide at most {MAX_SIGNALS_PER_ADD} signals per call")
-        if self.import_status not in (ImportStatus.FINISHED, ImportStatus.POSTPROCESSING):
+        if self.import_status not in SCRIPTABLE_STATUSES:
             raise ValueError(f"Dataset {self.id} is not in a writable state (status: {self.import_status})")
 
         signal_ids = run_signal_uploads(self, signals, overwrite=overwrite, concurrency=concurrency)
         for signal_id in signal_ids:  # Invalidate new signals from cache
             if signal_id in self._signals:
                 del self._signals[signal_id]
+        names = [item.name if isinstance(item, SignalUpload) else item["name"] for item in signals]
+        logger.debug(f"Added {', '.join(names)} to {self.path} (overwrite={overwrite})")
         return signal_ids
 
     def append(
@@ -461,6 +477,7 @@ class Dataset(BaseModel):
             timeout=self._client.STORAGE_TIMEOUT,
         )
         validate_response(r, "Append data failed")
+        logger.debug(f"Appended {len(data)} rows to realtime dataset {self.path}")
 
     def cool(self) -> "Dataset":
         """
@@ -481,6 +498,7 @@ class Dataset(BaseModel):
 
         r = self._client.post(f"/stream/{self.datastream_id}/dataset/{self.id}/cool")
         validate_response(r, "Cool dataset failed")
+        logger.debug(f"Started cooling dataset {self.path}")
         return self.fetch(self._client, self.id)
 
     def reingest(self, plugin_args: str | None = None) -> "Dataset":
@@ -500,6 +518,7 @@ class Dataset(BaseModel):
         kwargs = {} if plugin_args is None else {"json": {"plugin_args": plugin_args}}
         r = self._client.post(f"/stream/{self.datastream_id}/dataset/{self.id}/reingest", **kwargs)
         validate_response(r, "Reingest dataset failed")
+        logger.debug(f"Started reingest of dataset {self.path}")
         return self.fetch(self._client, self.id)
 
     def wait_for_import(self, timeout: float = 60, force_fetch: bool = False) -> "Dataset":
@@ -551,6 +570,7 @@ class Dataset(BaseModel):
         validate_response(r, "Delete signals failed")
         for signal_id in to_delete:
             self._signals.pop(signal_id, None)
+        logger.debug(f"Deleted {len(to_delete)} signals from dataset {self.path}")
 
     def delete(self) -> None:
         """
@@ -561,6 +581,7 @@ class Dataset(BaseModel):
         """
         r = self._client.post(f"/stream/{self.datastream_id}/dataset/{self.id}/delete")
         validate_response(r, "Delete dataset failed")
+        logger.debug(f"Deleted dataset {self.path}")
 
     def rerun_processing(self) -> "Dataset":
         """
@@ -574,6 +595,7 @@ class Dataset(BaseModel):
             json=[self.id],
         )
         validate_response(r, "Rerun processing failed")
+        logger.debug(f"Reran processing for dataset {self.path}")
         return self.fetch(self._client, self.id)
 
     def get_debug_messages(self) -> list[str]:
@@ -641,6 +663,7 @@ class Dataset(BaseModel):
         if job.status == SandboxJobStatus.FAILED:
             raise RuntimeError(f"Script failed (job {job.id}): {job.log or 'no log'}")
 
+        logger.debug(f"Ran script {script_id} on dataset {self.path}")
         return self.fetch(self._client, self.id)
 
 

{marpledata-3.6.0.dev2 → marpledata-3.7.0}/src/marple/db/datastream.py

@@ -7,6 +7,7 @@ from typing import Any, Literal, Optional
 
 from pydantic import BaseModel, Field, PrivateAttr, field_validator
 
+from marple.db.activity import logger
 from marple.db.dataset import Dataset, DatasetList
 from marple.utils import (
     OMITTED,
@@ -123,6 +124,7 @@ class DataStream(BaseModel):
             json={"dataset_name": dataset_name, "metadata": metadata or {}},
         )
         r_json = validate_response(r, "Add dataset failed")
+        logger.debug(f"Added dataset {dataset_name}")
         return self.get_dataset(r_json["dataset_id"])
 
     def push_file(
@@ -171,6 +173,7 @@ class DataStream(BaseModel):
             self._abort_upload(init.ingestion_id, str(exc) or type(exc).__name__)
             raise
 
+        logger.debug(f"Pushed file {file_name or path.name}")
         return self.get_dataset(init.dataset_id)
 
     def _init_ingestion(
@@ -337,6 +340,7 @@ class DataStream(BaseModel):
 
         r = self._client.post(f"/stream/update/{self.id}", json=payload)
         validate_response(r, "Update stream failed")
+        logger.debug(f"Updated stream {self.name}: {payload}")
         return self.fetch(self._client, self.id)
 
     def rerun_processing(self, dataset_ids: Sequence[int] | None = None) -> None:
@@ -354,6 +358,8 @@ class DataStream(BaseModel):
                 raise ValueError("rerun_processing requires at least one dataset id")
             r = self._client.post(f"/stream/{self.id}/processing/datasets", json=ids)
         validate_response(r, "Rerun processing failed")
+        target = f"{len(dataset_ids)} datasets" if dataset_ids is not None else "all datasets"
+        logger.debug(f"Reran processing for stream {self.name} ({target})")
 
     def delete(self) -> None:
         """
@@ -364,3 +370,4 @@ class DataStream(BaseModel):
         """
         r = self._client.post(f"/stream/{self.id}/delete")
         validate_response(r, "Delete stream failed")
+        logger.debug(f"Deleted stream {self.name}")

{marpledata-3.6.0.dev2 → marpledata-3.7.0}/src/marple/db/script.py

@@ -5,6 +5,7 @@ from typing import Any
 
 from pydantic import BaseModel, Field, PrivateAttr, field_validator
 
+from marple.db.activity import logger
 from marple.utils import OMITTED, DBClient, Omitted, validate_response
 
 
@@ -132,12 +133,16 @@ class Script(BaseModel):
             payload["script"] = self.resolve_source(script)
 
         r = self._client.post(f"/script/{self.id}", json=payload)
-        return Script(client=self._client, **validate_response(r, "Update script failed"))
+        updated = Script(client=self._client, **validate_response(r, "Update script failed"))
+        logger.debug(f"Updated script {self.name}: {payload}")
+        return updated
 
     def duplicate(self) -> "Script":
         """Create a copy of this script, including version history and stream attachments."""
         r = self._client.post(f"/script/{self.id}/duplicate")
-        return Script(client=self._client, **validate_response(r, "Duplicate script failed"))
+        copy = Script(client=self._client, **validate_response(r, "Duplicate script failed"))
+        logger.debug(f"Duplicated script {self.name}")
+        return copy
 
     def delete(self) -> None:
         """
@@ -148,6 +153,7 @@ class Script(BaseModel):
         """
         r = self._client.delete(f"/script/{self.id}")
         validate_response(r, "Delete script failed")
+        logger.debug(f"Deleted script {self.name}")
 
     @staticmethod
     def resolve_source(script: Path | str) -> str:

{marpledata-3.6.0.dev2 → marpledata-3.7.0}/src/marple/db/signal.py

@@ -7,6 +7,7 @@ from typing import Literal
 import pandas as pd
 from pydantic import BaseModel, PrivateAttr
 
+from marple.db.activity import logger
 from marple.utils import DBClient, validate_response
 
 
@@ -150,3 +151,4 @@ class Signal(BaseModel):
             json={"signal_ids": [self.id]},
         )
         validate_response(r, "Delete signal failed")
+        logger.debug(f"Deleted signal {self.name}")

marpledata-3.7.0/tests/test_activity.py

@@ -0,0 +1,52 @@
+from io import StringIO
+from unittest.mock import patch
+
+import pytest
+
+from marple.db import DB
+from marple.db.activity import logger, verbose
+
+
+@pytest.fixture(autouse=True)
+def _reset_verbose():
+    verbose(False)
+    yield
+    verbose(False)
+
+
+def test_verbose_writes_debug_to_file():
+    buf = StringIO()
+    verbose(True, buf)
+    logger.debug("hello activity")
+    assert "hello activity" in buf.getvalue()
+
+
+def test_verbose_true_is_idempotent():
+    buf = StringIO()
+    verbose(True, buf)
+    verbose(True, buf)
+    logger.debug("once")
+    assert buf.getvalue().count("once") == 1
+
+
+def test_verbose_false_stops_output():
+    buf = StringIO()
+    verbose(True, buf)
+    logger.debug("before")
+    verbose(False)
+    logger.debug("after")
+    assert "before" in buf.getvalue()
+    assert "after" not in buf.getvalue()
+
+
+def test_db_verbose_delegates():
+    with patch.object(DB, "check_connection", return_value=True):
+        with patch("marple.utils.DBClient"):
+            db = DB("token")
+    buf = StringIO()
+    db.verbose(True, buf)
+    logger.debug("via db")
+    assert "via db" in buf.getvalue()
+    db.verbose(False)
+    logger.debug("off")
+    assert "off" not in buf.getvalue()

{marpledata-3.6.0.dev2 → marpledata-3.7.0}/tests/test_db.py

@@ -1,5 +1,6 @@
 import random
 import re
+from datetime import datetime
 from pathlib import Path
 from tempfile import TemporaryDirectory
 from typing import Literal
@@ -12,7 +13,7 @@ from requests import HTTPError
 import marple
 from marple import DB
 from marple.db import Dataset, DatasetList, DataStream
-from support import EXAMPLE_CSV, isolated_stream, unique_name
+from support import EXAMPLE_CSV, ingest_dataset, isolated_stream, unique_name
 
 pytestmark = pytest.mark.integration
 
@@ -313,13 +314,16 @@ def test_push_file_plugin_args(example_stream: DataStream) -> None:
     assert dataset.plugin_args == "--use-index"
 
 
-def test_dataset_reingest(example_dataset: Dataset) -> None:
-    reingested = example_dataset.reingest().wait_for_import(timeout=180)
-    assert reingested.id == example_dataset.id
+def test_dataset_reingest(example_stream: DataStream) -> None:
+    # Separate dataset on the shared session stream so reingest does not mutate
+    # example_dataset (Insight export and other shared consumers).
+    dataset = ingest_dataset(example_stream, metadata={"test": "reingest"})
+    reingested = dataset.reingest().wait_for_import(timeout=180)
+    assert reingested.id == dataset.id
     assert reingested.import_status == "FINISHED"
 
     with_args = reingested.reingest(plugin_args="--use-index").wait_for_import(timeout=180)
-    assert with_args.id == example_dataset.id
+    assert with_args.id == dataset.id
     assert with_args.import_status == "FINISHED"
     assert with_args.plugin_args == "--use-index"
 

{marpledata-3.6.0.dev2 → marpledata-3.7.0}/tests/test_signal_upload.py

@@ -23,6 +23,7 @@ from marple.db.constants import (
     MAX_SIGNALS_PER_ADD,
     ROW_GROUP_SIZE,
 )
+from marple.db.dataset import SCRIPTABLE_STATUSES
 from marple.db.signal_upload import (
     ParquetUploadMetadata,
     PresignedParquetFile,
@@ -328,10 +329,24 @@ def test_add_signals_rejects_too_many() -> None:
         Dataset.add_signals(dataset, too_many)
 
 
+def test_add_signals_allows_scriptable_statuses(monkeypatch: pytest.MonkeyPatch) -> None:
+    monkeypatch.setattr("marple.db.dataset.run_signal_uploads", lambda *_args, **_kwargs: [1])
+    for status in SCRIPTABLE_STATUSES:
+        dataset = cast(Dataset, SimpleNamespace(id=1, path="demo", import_status=status, _signals={}))
+        assert Dataset.add_signals(dataset, [{"name": "s", "data": object()}]) == [1]
+
+
+def test_add_signals_rejects_status_outside_scriptable() -> None:
+    dataset = cast(Dataset, SimpleNamespace(id=1, import_status="LIVE"))
+    with pytest.raises(ValueError, match="not in a writable state"):
+        Dataset.add_signals(dataset, [{"name": "s", "data": object()}])
+
+
 def test_delete_signals_posts_and_clears_cache() -> None:
     client = MagicMock()
     client.post.return_value = SimpleNamespace(status_code=200, json=lambda: {"status": "success"})
     dataset = SimpleNamespace(
+        path="dataset/10",
         id=10,
         datastream_id=5,
         n_signals=3,

{marpledata-3.6.0.dev2 → marpledata-3.7.0}/uv.lock

@@ -833,7 +833,7 @@ wheels = [
 
 [[package]]
 name = "marpledata"
-version = "3.6.0.dev2"
+version = "3.7.0"
 source = { editable = "." }
 dependencies = [
     { name = "azure-storage-blob" },

marpledata-3.6.0.dev2/.uv-cache/.gitignore

@@ -1 +0,0 @@
-*

marpledata-3.6.0.dev2/.uv-cache/CACHEDIR.TAG

@@ -1 +0,0 @@
-Signature: 8a477f597d28d172789f06886806bc55

marpledata-3.6.0.dev2/docs/api/marple.Insight.rst

@@ -1,33 +0,0 @@
-marple.Insight
-==============
-
-.. currentmodule:: marple
-
-.. autoclass:: Insight
-
-   
-   .. automethod:: __init__
-
-   
-   .. rubric:: Methods
-
-   .. autosummary::
-   
-      ~Insight.check_connection
-      ~Insight.delete
-      ~Insight.export_data
-      ~Insight.export_data_mdb
-      ~Insight.get
-      ~Insight.get_dataset
-      ~Insight.get_dataset_mdb
-      ~Insight.get_datasets
-      ~Insight.get_signals
-      ~Insight.get_signals_mdb
-      ~Insight.patch
-      ~Insight.post
-   
-   
-
-   
-   
-   

marpledata-3.6.0.dev2/docs/api/marple.db.DB.rst

@@ -1,60 +0,0 @@
-marple.db.DB
-============
-
-.. currentmodule:: marple.db
-
-.. autoclass:: DB
-
-   
-   .. automethod:: __init__
-
-   
-   .. rubric:: Methods
-
-   .. autosummary::
-   
-      ~DB.add_dataset
-      ~DB.check_connection
-      ~DB.connect_trino
-      ~DB.create_script
-      ~DB.create_stream
-      ~DB.dataset_append
-      ~DB.dataset_cool
-      ~DB.delete
-      ~DB.delete_dataset
-      ~DB.delete_script
-      ~DB.delete_stream
-      ~DB.download_original
-      ~DB.download_signal
-      ~DB.get
-      ~DB.get_dataset
-      ~DB.get_datasets
-      ~DB.get_script
-      ~DB.get_scripts
-      ~DB.get_signal
-      ~DB.get_signals
-      ~DB.get_status
-      ~DB.get_stream
-      ~DB.get_streams
-      ~DB.patch
-      ~DB.post
-      ~DB.push_file
-      ~DB.query
-      ~DB.rerun_processing
-      ~DB.run_script
-      ~DB.update_metadata
-      ~DB.update_stream
-      ~DB.upsert_signals
-   
-   
-
-   
-   
-   .. rubric:: Attributes
-
-   .. autosummary::
-   
-      ~DB.trino_info
-      ~DB.client
-   
-   

marpledata-3.6.0.dev2/docs/api/marple.db.DataStream.rst

@@ -1,55 +0,0 @@
-marple.db.DataStream
-====================
-
-.. currentmodule:: marple.db
-
-.. autoclass:: DataStream
-
-   
-   .. automethod:: __init__
-
-   
-   .. rubric:: Methods
-
-   .. autosummary::
-   
-      ~DataStream.add_dataset
-      ~DataStream.delete
-      ~DataStream.fetch
-      ~DataStream.get_dataset
-      ~DataStream.get_datasets
-      ~DataStream.push_file
-      ~DataStream.refresh
-      ~DataStream.rerun_processing
-      ~DataStream.update
-   
-   
-
-   
-   
-   .. rubric:: Attributes
-
-   .. autosummary::
-   
-      ~DataStream.type
-      ~DataStream.id
-      ~DataStream.name
-      ~DataStream.description
-      ~DataStream.datapool
-      ~DataStream.layer_shifts
-      ~DataStream.version_id
-      ~DataStream.insight_workspace
-      ~DataStream.insight_project
-      ~DataStream.created_at
-      ~DataStream.last_updated
-      ~DataStream.last_ingested
-      ~DataStream.n_datasets
-      ~DataStream.n_datapoints
-      ~DataStream.cold_bytes
-      ~DataStream.hot_bytes
-      ~DataStream.plugin
-      ~DataStream.plugin_args
-      ~DataStream.signal_reduction
-      ~DataStream.scripts
-   
-   

marpledata-3.6.0.dev2/docs/api/marple.db.Dataset.rst

@@ -1,67 +0,0 @@
-marple.db.Dataset
-=================
-
-.. currentmodule:: marple.db
-
-.. autoclass:: Dataset
-
-   
-   .. automethod:: __init__
-
-   
-   .. rubric:: Methods
-
-   .. autosummary::
-   
-      ~Dataset.add_signal
-      ~Dataset.add_signals
-      ~Dataset.append
-      ~Dataset.cool
-      ~Dataset.delete
-      ~Dataset.download
-      ~Dataset.fetch
-      ~Dataset.get_data
-      ~Dataset.get_debug_messages
-      ~Dataset.get_signal
-      ~Dataset.get_signals
-      ~Dataset.reingest
-      ~Dataset.rerun_processing
-      ~Dataset.run
-      ~Dataset.update_metadata
-      ~Dataset.upsert_signals
-      ~Dataset.wait_for_import
-   
-   
-
-   
-   
-   .. rubric:: Attributes
-
-   .. autosummary::
-   
-      ~Dataset.id
-      ~Dataset.datastream_id
-      ~Dataset.datastream_version
-      ~Dataset.created_at
-      ~Dataset.created_by
-      ~Dataset.import_status
-      ~Dataset.import_progress
-      ~Dataset.import_message
-      ~Dataset.import_time
-      ~Dataset.path
-      ~Dataset.metadata
-      ~Dataset.cold_path
-      ~Dataset.cold_bytes
-      ~Dataset.hot_bytes
-      ~Dataset.backup_path
-      ~Dataset.backup_size
-      ~Dataset.plugin
-      ~Dataset.plugin_args
-      ~Dataset.n_datapoints
-      ~Dataset.n_signals
-      ~Dataset.timestamp_start
-      ~Dataset.timestamp_stop
-      ~Dataset.import_speed
-      ~Dataset.parquet_version
-   
-   

marpledata-3.6.0.dev2/docs/api/marple.db.DatasetList.rst

@@ -1,40 +0,0 @@
-marple.db.DatasetList
-=====================
-
-.. currentmodule:: marple.db
-
-.. autoclass:: DatasetList
-
-   
-   .. automethod:: __init__
-
-   
-   .. rubric:: Methods
-
-   .. autosummary::
-   
-      ~DatasetList.append
-      ~DatasetList.clear
-      ~DatasetList.count
-      ~DatasetList.extend
-      ~DatasetList.from_dicts
-      ~DatasetList.get_data
-      ~DatasetList.index
-      ~DatasetList.insert
-      ~DatasetList.pop
-      ~DatasetList.remove
-      ~DatasetList.reverse
-      ~DatasetList.sort
-      ~DatasetList.to_pandas
-      ~DatasetList.wait_for_import
-      ~DatasetList.where
-      ~DatasetList.where_dataset
-      ~DatasetList.where_imported
-      ~DatasetList.where_metadata
-      ~DatasetList.where_signal
-   
-   
-
-   
-   
-   

marpledata-3.6.0.dev2/docs/api/marple.db.LAKE_ARROW_SCHEMA.rst

@@ -1,6 +0,0 @@
-marple.db.LAKE\_ARROW\_SCHEMA
-=============================
-
-.. currentmodule:: marple.db
-
-.. autodata:: LAKE_ARROW_SCHEMA

marpledata-3.6.0.dev2/docs/api/marple.db.SCHEMA.rst

@@ -1,6 +0,0 @@
-marple.db.SCHEMA
-================
-
-.. currentmodule:: marple.db
-
-.. autodata:: SCHEMA

marpledata-3.6.0.dev2/docs/api/marple.db.SandboxJob.rst

@@ -1,43 +0,0 @@
-marple.db.SandboxJob
-====================
-
-.. currentmodule:: marple.db
-
-.. autoclass:: SandboxJob
-
-   
-   .. automethod:: __init__
-   
-
-   
-   .. rubric:: Methods
-
-   .. autosummary::
-   
-      ~SandboxJob.fetch
-   
-   
-
-   
-   
-   .. rubric:: Attributes
-
-   .. autosummary::
-   
-      ~SandboxJob.id
-      ~SandboxJob.dataset_id
-      ~SandboxJob.stream_id
-      ~SandboxJob.script_id
-      ~SandboxJob.script_version
-      ~SandboxJob.script_index
-      ~SandboxJob.ingestion_id
-      ~SandboxJob.status
-      ~SandboxJob.batch_job_id
-      ~SandboxJob.token_id
-      ~SandboxJob.log
-      ~SandboxJob.created_by
-      ~SandboxJob.created_at
-      ~SandboxJob.started_at
-      ~SandboxJob.finished_at
-   
-   

marpledata-3.6.0.dev2/docs/api/marple.db.SandboxJobStatus.rst

@@ -1,28 +0,0 @@
-marple.db.SandboxJobStatus
-==========================
-
-.. currentmodule:: marple.db
-
-.. autoclass:: SandboxJobStatus
-
-   
-   .. rubric:: Methods
-
-   .. autosummary::
-   
-      ~SandboxJobStatus.is_terminal
-   
-   
-
-   
-   
-   .. rubric:: Members
-
-   .. autosummary::
-   
-      ~SandboxJobStatus.QUEUED
-      ~SandboxJobStatus.RUNNING
-      ~SandboxJobStatus.SUCCEEDED
-      ~SandboxJobStatus.FAILED
-   
-   

marpledata-3.6.0.dev2/docs/api/marple.db.Script.rst

@@ -1,41 +0,0 @@
-marple.db.Script
-================
-
-.. currentmodule:: marple.db
-
-.. autoclass:: Script
-
-   
-   .. automethod:: __init__
-
-   
-   .. rubric:: Methods
-
-   .. autosummary::
-   
-      ~Script.delete
-      ~Script.duplicate
-      ~Script.fetch
-      ~Script.refresh
-      ~Script.update
-   
-   
-
-   
-   
-   .. rubric:: Attributes
-
-   .. autosummary::
-   
-      ~Script.id
-      ~Script.name
-      ~Script.description
-      ~Script.created_at
-      ~Script.created_by
-      ~Script.updated_at
-      ~Script.updated_by
-      ~Script.streams
-      ~Script.versions
-      ~Script.source
-   
-   

marpledata-3.6.0.dev2/docs/api/marple.db.ScriptVersion.rst

@@ -1,21 +0,0 @@
-marple.db.ScriptVersion
-=======================
-
-.. currentmodule:: marple.db
-
-.. autoclass:: ScriptVersion
-
-   
-   .. automethod:: __init__
-
-   
-   .. rubric:: Attributes
-
-   .. autosummary::
-   
-      ~ScriptVersion.id
-      ~ScriptVersion.script
-      ~ScriptVersion.updated_at
-      ~ScriptVersion.updated_by
-   
-   

marpledata-3.6.0.dev2/docs/api/marple.db.Signal.rst

@@ -1,47 +0,0 @@
-marple.db.Signal
-================
-
-.. currentmodule:: marple.db
-
-.. autoclass:: Signal
-
-   
-   .. automethod:: __init__
-
-   
-   .. rubric:: Methods
-
-   .. autosummary::
-   
-      ~Signal.cache_parquet
-      ~Signal.get_data
-      ~Signal.list_parquet_files
-      ~Signal.wait_until_available
-   
-   
-
-   
-   
-   .. rubric:: Attributes
-
-   .. autosummary::
-   
-      ~Signal.id
-      ~Signal.name
-      ~Signal.unit
-      ~Signal.description
-      ~Signal.metadata
-      ~Signal.storage_status
-      ~Signal.cold_bytes
-      ~Signal.hot_bytes
-      ~Signal.count
-      ~Signal.stats
-      ~Signal.count_value
-      ~Signal.count_text
-      ~Signal.time_min
-      ~Signal.time_max
-      ~Signal.parquet_version
-      ~Signal.datastream_id
-      ~Signal.dataset_id
-   
-   

marpledata-3.6.0.dev2/docs/api/marple.db.SignalUpload.rst

@@ -1,31 +0,0 @@
-marple.db.SignalUpload
-======================
-
-.. currentmodule:: marple.db
-
-.. autoclass:: SignalUpload
-
-   
-   .. automethod:: __init__
-
-   
-   .. rubric:: Methods
-
-   .. autosummary::
-   
-      ~SignalUpload.plan_upload
-   
-   
-
-   
-   
-   .. rubric:: Attributes
-
-   .. autosummary::
-   
-      ~SignalUpload.name
-      ~SignalUpload.data
-      ~SignalUpload.metadata
-      ~SignalUpload.priority
-   
-   

marpledata-3.6.0.dev2/docs/api/marple.db.SignalsAlreadyExistError.rst

@@ -1,6 +0,0 @@
-marple.db.SignalsAlreadyExistError
-==================================
-
-.. currentmodule:: marple.db
-
-.. autoexception:: SignalsAlreadyExistError