current-data-py 0.1.11__tar.gz → 0.1.12__tar.gz

{current_data_py-0.1.11 → current_data_py-0.1.12}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: current-data-py
-Version: 0.1.11
+Version: 0.1.12
 Summary: Current Data protobuf messages and schema metadata
 Requires-Python: >=3.9
 Description-Content-Type: text/markdown
@@ -8,9 +8,9 @@ Requires-Dist: protobuf>=3.20
 Requires-Dist: turbodata==0.1.0
 Requires-Dist: grpcio>=1.51.1
 Requires-Dist: alibabacloud-oss-v2<2,>=1.4.0
-Provides-Extra: decode
-Requires-Dist: av>=12; extra == "decode"
-Requires-Dist: pillow>=9; extra == "decode"
+Requires-Dist: tos<3,>=2.9
+Requires-Dist: av>=12
+Requires-Dist: pillow>=9
 
 # current-data-py
 
@@ -170,9 +170,8 @@ retry or fall back to earlier RPC versions. Old servers return `UNIMPLEMENTED`;
 unconfigured destinations return `FAILED_PRECONDITION`. A response whose
 provider differs from the request raises `ValueError`.
 
-These methods only fetch credentials. Pass TOS credentials to a native TOS
-client and refresh them before expiration. `OSSClient`, `DataClient`, metadata
-registration and signed URLs have not been extended to TOS by this change.
+These methods only fetch credentials. For file transfers and TD reads with automatic
+credential refresh, see [TOS](#tos). Signed download URLs remain OSS-only.
 
 ## Remote TD reads
 
@@ -180,12 +179,11 @@ registration and signed URLs have not been extended to TOS by this change.
 
 > [!IMPORTANT]
 > **Video decoding requires PyAV, Pillow and the FFmpeg native libraries used by
-> PyAV.** `open_td()` enables decoding by default, but a base `current-data-py`
-> installation does not install the video dependencies. Install the `[decode]`
-> extra in every environment that decodes video, including DataLoader workers.
+> PyAV.** `current-data-py` installs PyAV and Pillow by default. Install the package
+> in every environment that decodes video, including DataLoader workers.
 
 ```bash
-python -m pip install --only-binary=av,pillow 'current-data-py[decode]'
+python -m pip install --only-binary=av,pillow current-data-py
 ```
 
 - **Prebuilt wheels:** PyAV wheels bundle FFmpeg libraries on supported platforms;
@@ -272,8 +270,9 @@ to each call.
 
 ### Storage and credentials
 
-`DataClient.open_td()` accepts an optional `bucket` argument. Without it, reads
-use the management service's `OSS_READ_BUCKET` and `OSS_READ_PREFIX` defaults.
+`DataClient.open_td()` accepts optional `bucket` and `provider` arguments. OSS
+references without either selection retain the service's `OSS_READ_BUCKET` and
+`OSS_READ_PREFIX` defaults. See [TOS](#tos) for provider selection.
 With it, the SDK uses `GetReadCredentialsV2` for whole-bucket credentials in the
 bucket's region, limited by the server's RAM role, and selects the first matching
 storage in the reference. An explicit bucket does not inherit the default prefix.
@@ -336,6 +335,28 @@ with ManagementClient(address=os.environ["MANAGEMENT_ADDRESS"]) as management:
   Deploy the V2 credential APIs and configure bucket regions before using reads
   or the upload `data_kind` option.
 
+## TOS
+
+`TOSClient` obtains and refreshes V3 credentials from Management. Keep
+`ManagementClient` open during transfers.
+
+```python
+import os
+from current_data_py.management import ManagementClient
+from current_data_py.tos import TOSClient
+
+with ManagementClient() as management:
+    with TOSClient(management, permission="read", bucket=os.environ["TOS_READ_BUCKET"],
+                   endpoint="https://tos-accelerate.volces.com") as source:
+        source.download_file(os.environ["SOURCE_OBJECT_KEY"], "/tmp/input.h5")
+```
+
+For uploads, use `permission="upload", data_type="YAM", data_kind="CONVERTED"`;
+register the returned bucket and uploaded object key in `Metadata.storages`. To read a
+TD file, use `DataClient.open_td(reference, provider="tos", bucket=bucket)`.
+`endpoint=` changes the network endpoint without changing the signing region;
+it cannot be combined with `use_internal_endpoint=True`.
+
 ## Pre-annotation
 
 `current_data_py.labeling.LabelingClient` wraps the pre-annotation RPCs
@@ -399,6 +420,8 @@ python -I tests/check_management.py
 python -I tests/check_labeling.py
 python -I tests/check_remote.py
 python -I tests/check_oss.py
+# With the tos extra installed:
+python -I tests/check_tos.py
 ```
 
 ## 推送

current_data_py-0.1.11/current_data_py.egg-info/PKG-INFO → current_data_py-0.1.12/README.md

@@ -1,17 +1,3 @@
-Metadata-Version: 2.4
-Name: current-data-py
-Version: 0.1.11
-Summary: Current Data protobuf messages and schema metadata
-Requires-Python: >=3.9
-Description-Content-Type: text/markdown
-Requires-Dist: protobuf>=3.20
-Requires-Dist: turbodata==0.1.0
-Requires-Dist: grpcio>=1.51.1
-Requires-Dist: alibabacloud-oss-v2<2,>=1.4.0
-Provides-Extra: decode
-Requires-Dist: av>=12; extra == "decode"
-Requires-Dist: pillow>=9; extra == "decode"
-
 # current-data-py
 
 ## Environment
@@ -170,9 +156,8 @@ retry or fall back to earlier RPC versions. Old servers return `UNIMPLEMENTED`;
 unconfigured destinations return `FAILED_PRECONDITION`. A response whose
 provider differs from the request raises `ValueError`.
 
-These methods only fetch credentials. Pass TOS credentials to a native TOS
-client and refresh them before expiration. `OSSClient`, `DataClient`, metadata
-registration and signed URLs have not been extended to TOS by this change.
+These methods only fetch credentials. For file transfers and TD reads with automatic
+credential refresh, see [TOS](#tos). Signed download URLs remain OSS-only.
 
 ## Remote TD reads
 
@@ -180,12 +165,11 @@ registration and signed URLs have not been extended to TOS by this change.
 
 > [!IMPORTANT]
 > **Video decoding requires PyAV, Pillow and the FFmpeg native libraries used by
-> PyAV.** `open_td()` enables decoding by default, but a base `current-data-py`
-> installation does not install the video dependencies. Install the `[decode]`
-> extra in every environment that decodes video, including DataLoader workers.
+> PyAV.** `current-data-py` installs PyAV and Pillow by default. Install the package
+> in every environment that decodes video, including DataLoader workers.
 
 ```bash
-python -m pip install --only-binary=av,pillow 'current-data-py[decode]'
+python -m pip install --only-binary=av,pillow current-data-py
 ```
 
 - **Prebuilt wheels:** PyAV wheels bundle FFmpeg libraries on supported platforms;
@@ -272,8 +256,9 @@ to each call.
 
 ### Storage and credentials
 
-`DataClient.open_td()` accepts an optional `bucket` argument. Without it, reads
-use the management service's `OSS_READ_BUCKET` and `OSS_READ_PREFIX` defaults.
+`DataClient.open_td()` accepts optional `bucket` and `provider` arguments. OSS
+references without either selection retain the service's `OSS_READ_BUCKET` and
+`OSS_READ_PREFIX` defaults. See [TOS](#tos) for provider selection.
 With it, the SDK uses `GetReadCredentialsV2` for whole-bucket credentials in the
 bucket's region, limited by the server's RAM role, and selects the first matching
 storage in the reference. An explicit bucket does not inherit the default prefix.
@@ -336,6 +321,28 @@ with ManagementClient(address=os.environ["MANAGEMENT_ADDRESS"]) as management:
   Deploy the V2 credential APIs and configure bucket regions before using reads
   or the upload `data_kind` option.
 
+## TOS
+
+`TOSClient` obtains and refreshes V3 credentials from Management. Keep
+`ManagementClient` open during transfers.
+
+```python
+import os
+from current_data_py.management import ManagementClient
+from current_data_py.tos import TOSClient
+
+with ManagementClient() as management:
+    with TOSClient(management, permission="read", bucket=os.environ["TOS_READ_BUCKET"],
+                   endpoint="https://tos-accelerate.volces.com") as source:
+        source.download_file(os.environ["SOURCE_OBJECT_KEY"], "/tmp/input.h5")
+```
+
+For uploads, use `permission="upload", data_type="YAM", data_kind="CONVERTED"`;
+register the returned bucket and uploaded object key in `Metadata.storages`. To read a
+TD file, use `DataClient.open_td(reference, provider="tos", bucket=bucket)`.
+`endpoint=` changes the network endpoint without changing the signing region;
+it cannot be combined with `use_internal_endpoint=True`.
+
 ## Pre-annotation
 
 `current_data_py.labeling.LabelingClient` wraps the pre-annotation RPCs
@@ -399,6 +406,8 @@ python -I tests/check_management.py
 python -I tests/check_labeling.py
 python -I tests/check_remote.py
 python -I tests/check_oss.py
+# With the tos extra installed:
+python -I tests/check_tos.py
 ```
 
 ## 推送

current_data_py-0.1.11/README.md → current_data_py-0.1.12/current_data_py.egg-info/PKG-INFO

@@ -1,3 +1,17 @@
+Metadata-Version: 2.4
+Name: current-data-py
+Version: 0.1.12
+Summary: Current Data protobuf messages and schema metadata
+Requires-Python: >=3.9
+Description-Content-Type: text/markdown
+Requires-Dist: protobuf>=3.20
+Requires-Dist: turbodata==0.1.0
+Requires-Dist: grpcio>=1.51.1
+Requires-Dist: alibabacloud-oss-v2<2,>=1.4.0
+Requires-Dist: tos<3,>=2.9
+Requires-Dist: av>=12
+Requires-Dist: pillow>=9
+
 # current-data-py
 
 ## Environment
@@ -156,9 +170,8 @@ retry or fall back to earlier RPC versions. Old servers return `UNIMPLEMENTED`;
 unconfigured destinations return `FAILED_PRECONDITION`. A response whose
 provider differs from the request raises `ValueError`.
 
-These methods only fetch credentials. Pass TOS credentials to a native TOS
-client and refresh them before expiration. `OSSClient`, `DataClient`, metadata
-registration and signed URLs have not been extended to TOS by this change.
+These methods only fetch credentials. For file transfers and TD reads with automatic
+credential refresh, see [TOS](#tos). Signed download URLs remain OSS-only.
 
 ## Remote TD reads
 
@@ -166,12 +179,11 @@ registration and signed URLs have not been extended to TOS by this change.
 
 > [!IMPORTANT]
 > **Video decoding requires PyAV, Pillow and the FFmpeg native libraries used by
-> PyAV.** `open_td()` enables decoding by default, but a base `current-data-py`
-> installation does not install the video dependencies. Install the `[decode]`
-> extra in every environment that decodes video, including DataLoader workers.
+> PyAV.** `current-data-py` installs PyAV and Pillow by default. Install the package
+> in every environment that decodes video, including DataLoader workers.
 
 ```bash
-python -m pip install --only-binary=av,pillow 'current-data-py[decode]'
+python -m pip install --only-binary=av,pillow current-data-py
 ```
 
 - **Prebuilt wheels:** PyAV wheels bundle FFmpeg libraries on supported platforms;
@@ -258,8 +270,9 @@ to each call.
 
 ### Storage and credentials
 
-`DataClient.open_td()` accepts an optional `bucket` argument. Without it, reads
-use the management service's `OSS_READ_BUCKET` and `OSS_READ_PREFIX` defaults.
+`DataClient.open_td()` accepts optional `bucket` and `provider` arguments. OSS
+references without either selection retain the service's `OSS_READ_BUCKET` and
+`OSS_READ_PREFIX` defaults. See [TOS](#tos) for provider selection.
 With it, the SDK uses `GetReadCredentialsV2` for whole-bucket credentials in the
 bucket's region, limited by the server's RAM role, and selects the first matching
 storage in the reference. An explicit bucket does not inherit the default prefix.
@@ -322,6 +335,28 @@ with ManagementClient(address=os.environ["MANAGEMENT_ADDRESS"]) as management:
   Deploy the V2 credential APIs and configure bucket regions before using reads
   or the upload `data_kind` option.
 
+## TOS
+
+`TOSClient` obtains and refreshes V3 credentials from Management. Keep
+`ManagementClient` open during transfers.
+
+```python
+import os
+from current_data_py.management import ManagementClient
+from current_data_py.tos import TOSClient
+
+with ManagementClient() as management:
+    with TOSClient(management, permission="read", bucket=os.environ["TOS_READ_BUCKET"],
+                   endpoint="https://tos-accelerate.volces.com") as source:
+        source.download_file(os.environ["SOURCE_OBJECT_KEY"], "/tmp/input.h5")
+```
+
+For uploads, use `permission="upload", data_type="YAM", data_kind="CONVERTED"`;
+register the returned bucket and uploaded object key in `Metadata.storages`. To read a
+TD file, use `DataClient.open_td(reference, provider="tos", bucket=bucket)`.
+`endpoint=` changes the network endpoint without changing the signing region;
+it cannot be combined with `use_internal_endpoint=True`.
+
 ## Pre-annotation
 
 `current_data_py.labeling.LabelingClient` wraps the pre-annotation RPCs
@@ -385,6 +420,8 @@ python -I tests/check_management.py
 python -I tests/check_labeling.py
 python -I tests/check_remote.py
 python -I tests/check_oss.py
+# With the tos extra installed:
+python -I tests/check_tos.py
 ```
 
 ## 推送

{current_data_py-0.1.11 → current_data_py-0.1.12}/current_data_py.egg-info/SOURCES.txt

@@ -7,11 +7,13 @@ management.py
 oss.py
 pyproject.toml
 setup.py
+tos.py
 ./__init__.py
 ./decoding.py
 ./labeling.py
 ./management.py
 ./oss.py
+./tos.py
 ./examples/__init__.py
 ./examples/list_schemas.py
 ./examples/read_remote_td.py
@@ -20,6 +22,7 @@ setup.py
 ./remote/__init__.py
 ./remote/client.py
 ./remote/source.py
+./remote/tos_source.py
 ./schema/__init__.py
 ./schema/message_metadata.py
 current_data_py.egg-info/PKG-INFO
@@ -35,6 +38,7 @@ examples/write_td.py
 remote/__init__.py
 remote/client.py
 remote/source.py
+remote/tos_source.py
 schema/__init__.py
 schema/message_metadata.py
 tests/check_environment.py

{current_data_py-0.1.11 → current_data_py-0.1.12}/current_data_py.egg-info/requires.txt

@@ -2,7 +2,6 @@ protobuf>=3.20
 turbodata==0.1.0
 grpcio>=1.51.1
 alibabacloud-oss-v2<2,>=1.4.0
-
-[decode]
+tos<3,>=2.9
 av>=12
 pillow>=9

{current_data_py-0.1.11 → current_data_py-0.1.12}/decoding.py

@@ -67,12 +67,9 @@ class DecodedMessage:
 class _VideoStream:
     """Hold one topic's H.264 decoder for the lifetime of a forward iterator."""
     def __init__(self, *, keep_timestamp=None):
-        """Load optional video dependencies and create a fresh decoder."""
-        try:
-            import av
-            from PIL import Image  # noqa: F401
-        except ImportError as exc:
-            raise ImportError("Video decoding requires pip install 'current-data-py[decode]'") from exc
+        """Load video dependencies and create a fresh decoder."""
+        import av
+        from PIL import Image  # noqa: F401
         self.av = av
         self.codec = av.CodecContext.create("h264", "r")
         self.codec.thread_count = 1

{current_data_py-0.1.11 → current_data_py-0.1.12}/management.py

@@ -8,14 +8,13 @@ import current_data_py as _package
 from . import DEFAULT_ADDRESS  # Compatibility export; configure current_data_py.DEFAULT_ADDRESS.
 
 from ._proto.management.metadata import metadata_pb2
-from ._proto.management.metadata.metadata_pb2 import Metadata, MetadataFilter
+from ._proto.management.metadata.metadata_pb2 import Metadata, MetadataFilter, StorageProvider
 from ._proto.management.service import service_pb2, service_pb2_grpc
 from ._proto.management.service.service_pb2 import (
     DataKind,
     GetReadCredentialsResponse,
     GetUploadCredentialsResponse,
     StorageCredentials,
-    StorageProvider,
 )
 
 
@@ -30,9 +29,10 @@ __all__ = [
 
 def _storage_provider(value: Union[int, str]) -> int:
     if isinstance(value, str):
+        value = value.upper()
         name = value if value.startswith("STORAGE_PROVIDER_") else "STORAGE_PROVIDER_" + value
         value = StorageProvider.Value(name)
-    if isinstance(value, bool) or value not in (service_pb2.STORAGE_PROVIDER_OSS, service_pb2.STORAGE_PROVIDER_TOS):
+    if isinstance(value, bool) or value not in (metadata_pb2.STORAGE_PROVIDER_OSS, metadata_pb2.STORAGE_PROVIDER_TOS):
         raise ValueError("provider must explicitly select OSS or TOS")
     return value
 

current_data_py-0.1.12/proto_gen/python/management/metadata/metadata_pb2.py

@@ -0,0 +1,64 @@
+# -*- coding: utf-8 -*-
+# Generated by the protocol buffer compiler.  DO NOT EDIT!
+# source: management/metadata/metadata.proto
+"""Generated protocol buffer code."""
+from google.protobuf.internal import builder as _builder
+from google.protobuf import descriptor as _descriptor
+from google.protobuf import descriptor_pool as _descriptor_pool
+from google.protobuf import symbol_database as _symbol_database
+# @@protoc_insertion_point(imports)
+
+_sym_db = _symbol_database.Default()
+
+
+from google.protobuf import duration_pb2 as google_dot_protobuf_dot_duration__pb2
+from google.protobuf import timestamp_pb2 as google_dot_protobuf_dot_timestamp__pb2
+
+
+DESCRIPTOR = _descriptor_pool.Default().AddSerializedFile(b'\n\"management/metadata/metadata.proto\x12\x16management.metadata.v1\x1a\x1egoogle/protobuf/duration.proto\x1a\x1fgoogle/protobuf/timestamp.proto\"\xa6\x03\n\x08Metadata\x12\n\n\x02id\x18\x01 \x01(\t\x12\x0c\n\x04name\x18\x02 \x01(\t\x12.\n\ncreated_at\x18\x03 \x01(\x0b\x32\x1a.google.protobuf.Timestamp\x12.\n\nupdated_at\x18\x04 \x01(\x0b\x32\x1a.google.protobuf.Timestamp\x12\x31\n\x08storages\x18\x05 \x03(\x0b\x32\x1f.management.metadata.v1.Storage\x12\x33\n\tfile_info\x18\x06 \x01(\x0b\x32 .management.metadata.v1.FileInfo\x12/\n\x07\x64\x65vices\x18\x07 \x03(\x0b\x32\x1e.management.metadata.v1.Device\x12=\n\x0erecording_info\x18\x08 \x01(\x0b\x32%.management.metadata.v1.RecordingInfo\x12\x33\n\tdata_type\x18\t \x01(\x0e\x32 .management.metadata.v1.DataType\x12\x13\n\x0boptional_id\x18\n \x01(\t\"h\n\x07Storage\x12\x0e\n\x06\x62ucket\x18\x01 \x01(\t\x12\x12\n\nobject_key\x18\x02 \x01(\t\x12\x39\n\x08provider\x18\x03 \x01(\x0e\x32\'.management.metadata.v1.StorageProvider\"_\n\x08\x46ileInfo\x12\x12\n\nsize_bytes\x18\x01 \x01(\x03\x12-\n\x06topics\x18\x02 \x03(\x0b\x32\x1d.management.metadata.v1.Topic\x12\x10\n\x08\x63hecksum\x18\x03 \x01(\t\"3\n\x05Topic\x12\x0c\n\x04name\x18\x01 \x01(\t\x12\x0f\n\x07samples\x18\x02 \x01(\x03\x12\x0b\n\x03\x66ps\x18\x03 \x01(\x02\"\x9c\x02\n\x06\x44\x65vice\x12\r\n\x05model\x18\x01 \x01(\t\x12\x30\n\x04type\x18\x02 \x01(\x0e\x32\".management.metadata.v1.DeviceType\x12\x18\n\x10\x66irmware_version\x18\x03 \x01(\t\x12\x0b\n\x03\x66ps\x18\x04 \x01(\x02\x12\x32\n\x08modality\x18\x05 \x01(\x0e\x32 .management.metadata.v1.Modality\x12>\n\x0fmount_body_part\x18\x06 \x01(\x0e\x32%.management.metadata.v1.MountBodyPart\x12\x36\n\nresolution\x18\x07 \x01(\x0b\x32\".management.metadata.v1.Resolution\"+\n\nResolution\x12\x0e\n\x06height\x18\x01 \x01(\r\x12\r\n\x05width\x18\x02 \x01(\r\"\x8b\x02\n\rRecordingInfo\x12\x39\n\x0erecording_time\x18\x01 \x01(\x0b\x32!.management.metadata.v1.TimeRange\x12+\n\x08\x64uration\x18\x02 \x01(\x0b\x32\x19.google.protobuf.Duration\x12\x32\n\x08location\x18\x03 \x01(\x0b\x32 .management.metadata.v1.Location\x12*\n\x04task\x18\x04 \x01(\x0b\x32\x1c.management.metadata.v1.Task\x12\x32\n\x08operator\x18\x05 \x01(\x0b\x32 .management.metadata.v1.Operator\"J\n\x08Location\x12\x19\n\x11\x63oordinate_system\x18\x01 \x01(\t\x12\x10\n\x08latitude\x18\x02 \x01(\x01\x12\x11\n\tlongitude\x18\x03 \x01(\x01\"}\n\x04Task\x12\x0c\n\x04name\x18\x01 \x01(\t\x12\x13\n\x0b\x64\x65scription\x18\x02 \x01(\t\x12\r\n\x05scene\x18\x03 \x01(\t\x12\x43\n\x11\x63ollection_method\x18\x04 \x01(\x0b\x32(.management.metadata.v1.CollectionMethod\"9\n\x10\x43ollectionMethod\x12\x13\n\x0b\x64\x65scription\x18\x01 \x01(\t\x12\x10\n\x08paradigm\x18\x02 \x01(\t\"L\n\x08Operator\x12\n\n\x02id\x18\x01 \x01(\t\x12\x10\n\x08\x61rm_span\x18\x02 \x01(\x01\x12\x0e\n\x06height\x18\x03 \x01(\x01\x12\x12\n\nleg_length\x18\x04 \x01(\x01\"\xe8\x01\n\x0eMetadataFilter\x12\x13\n\x0bname_prefix\x18\x01 \x01(\t\x12\x34\n\ndata_types\x18\x02 \x03(\x0e\x32 .management.metadata.v1.DataType\x12\x42\n\x17recording_started_range\x18\x03 \x01(\x0b\x32!.management.metadata.v1.TimeRange\x12G\n\x18recording_duration_range\x18\x04 \x01(\x0b\x32%.management.metadata.v1.DurationRange\"]\n\tTimeRange\x12(\n\x04\x66rom\x18\x01 \x01(\x0b\x32\x1a.google.protobuf.Timestamp\x12&\n\x02to\x18\x02 \x01(\x0b\x32\x1a.google.protobuf.Timestamp\"_\n\rDurationRange\x12&\n\x03min\x18\x01 \x01(\x0b\x32\x19.google.protobuf.Duration\x12&\n\x03max\x18\x02 \x01(\x0b\x32\x19.google.protobuf.Duration*g\n\x0fStorageProvider\x12 \n\x1cSTORAGE_PROVIDER_UNSPECIFIED\x10\x00\x12\x18\n\x14STORAGE_PROVIDER_OSS\x10\x01\x12\x18\n\x14STORAGE_PROVIDER_TOS\x10\x02*S\n\nDeviceType\x12\x1b\n\x17\x44\x45VICE_TYPE_UNSPECIFIED\x10\x00\x12\x13\n\x0f\x44\x45VICE_TYPE_CAM\x10\x01\x12\x13\n\x0f\x44\x45VICE_TYPE_IMU\x10\x02*J\n\x08Modality\x12\x18\n\x14MODALITY_UNSPECIFIED\x10\x00\x12\x10\n\x0cMODALITY_RGB\x10\x01\x12\x12\n\x0eMODALITY_DEPTH\x10\x02*0\n\rMountBodyPart\x12\x1f\n\x1bMOUNT_BODY_PART_UNSPECIFIED\x10\x00*j\n\x08\x44\x61taType\x12\x19\n\x15\x44\x41TA_TYPE_UNSPECIFIED\x10\x00\x12\x16\n\x12\x44\x41TA_TYPE_EGOSUITE\x10\x01\x12\x11\n\rDATA_TYPE_YAM\x10\x02\x12\x18\n\x14\x44\x41TA_TYPE_CURRENT_V2\x10\x03\x42*Z(proto_gen/management/metadata;metadatapbb\x06proto3')
+
+_builder.BuildMessageAndEnumDescriptors(DESCRIPTOR, globals())
+_builder.BuildTopDescriptorsAndMessages(DESCRIPTOR, 'management.metadata.metadata_pb2', globals())
+if _descriptor._USE_C_DESCRIPTORS == False:
+
+  DESCRIPTOR._options = None
+  DESCRIPTOR._serialized_options = b'Z(proto_gen/management/metadata;metadatapb'
+  _STORAGEPROVIDER._serialized_start=2177
+  _STORAGEPROVIDER._serialized_end=2280
+  _DEVICETYPE._serialized_start=2282
+  _DEVICETYPE._serialized_end=2365
+  _MODALITY._serialized_start=2367
+  _MODALITY._serialized_end=2441
+  _MOUNTBODYPART._serialized_start=2443
+  _MOUNTBODYPART._serialized_end=2491
+  _DATATYPE._serialized_start=2493
+  _DATATYPE._serialized_end=2599
+  _METADATA._serialized_start=128
+  _METADATA._serialized_end=550
+  _STORAGE._serialized_start=552
+  _STORAGE._serialized_end=656
+  _FILEINFO._serialized_start=658
+  _FILEINFO._serialized_end=753
+  _TOPIC._serialized_start=755
+  _TOPIC._serialized_end=806
+  _DEVICE._serialized_start=809
+  _DEVICE._serialized_end=1093
+  _RESOLUTION._serialized_start=1095
+  _RESOLUTION._serialized_end=1138
+  _RECORDINGINFO._serialized_start=1141
+  _RECORDINGINFO._serialized_end=1408
+  _LOCATION._serialized_start=1410
+  _LOCATION._serialized_end=1484
+  _TASK._serialized_start=1486
+  _TASK._serialized_end=1611
+  _COLLECTIONMETHOD._serialized_start=1613
+  _COLLECTIONMETHOD._serialized_end=1670
+  _OPERATOR._serialized_start=1672
+  _OPERATOR._serialized_end=1748
+  _METADATAFILTER._serialized_start=1751
+  _METADATAFILTER._serialized_end=1983
+  _TIMERANGE._serialized_start=1985
+  _TIMERANGE._serialized_end=2078
+  _DURATIONRANGE._serialized_start=2080
+  _DURATIONRANGE._serialized_end=2175
+# @@protoc_insertion_point(module_scope)

current_data_py-0.1.12/proto_gen/python/management/service/service_pb2.py

@@ -0,0 +1,80 @@
+# -*- coding: utf-8 -*-
+# Generated by the protocol buffer compiler.  DO NOT EDIT!
+# source: management/service/service.proto
+"""Generated protocol buffer code."""
+from google.protobuf.internal import builder as _builder
+from google.protobuf import descriptor as _descriptor
+from google.protobuf import descriptor_pool as _descriptor_pool
+from google.protobuf import symbol_database as _symbol_database
+# @@protoc_insertion_point(imports)
+
+_sym_db = _symbol_database.Default()
+
+
+from google.protobuf import timestamp_pb2 as google_dot_protobuf_dot_timestamp__pb2
+from management.metadata import metadata_pb2 as management_dot_metadata_dot_metadata__pb2
+
+
+DESCRIPTOR = _descriptor_pool.Default().AddSerializedFile(b'\n management/service/service.proto\x12\x15management.service.v1\x1a\x1fgoogle/protobuf/timestamp.proto\x1a\"management/metadata/metadata.proto\"R\n\x1bGetUploadCredentialsRequest\x12\x33\n\tdata_type\x18\x01 \x01(\x0e\x32 .management.metadata.v1.DataType\"\xa7\x01\n\x1dGetUploadCredentialsV2Request\x12\x33\n\tdata_type\x18\x01 \x01(\x0e\x32 .management.metadata.v1.DataType\x12\x32\n\tdata_kind\x18\x02 \x01(\x0e\x32\x1f.management.service.v1.DataKind\x12\x1d\n\x15use_internal_endpoint\x18\x03 \x01(\x08\"\xe5\x01\n\x1cGetUploadCredentialsResponse\x12\x15\n\raccess_key_id\x18\x01 \x01(\t\x12\x19\n\x11\x61\x63\x63\x65ss_key_secret\x18\x02 \x01(\t\x12\x16\n\x0esecurity_token\x18\x03 \x01(\t\x12.\n\nexpires_at\x18\x04 \x01(\x0b\x32\x1a.google.protobuf.Timestamp\x12\x14\n\x0coss_endpoint\x18\x05 \x01(\t\x12\x0e\n\x06\x62ucket\x18\x06 \x01(\t\x12\x15\n\robject_prefix\x18\x07 \x01(\t\x12\x0e\n\x06region\x18\x08 \x01(\t\"\xe2\x01\n\x1dGetUploadCredentialsV3Request\x12\x39\n\x08provider\x18\x01 \x01(\x0e\x32\'.management.metadata.v1.StorageProvider\x12\x33\n\tdata_type\x18\x02 \x01(\x0e\x32 .management.metadata.v1.DataType\x12\x32\n\tdata_kind\x18\x03 \x01(\x0e\x32\x1f.management.service.v1.DataKind\x12\x1d\n\x15use_internal_endpoint\x18\x04 \x01(\x08\"\x87\x01\n\x1bGetReadCredentialsV3Request\x12\x39\n\x08provider\x18\x01 \x01(\x0e\x32\'.management.metadata.v1.StorageProvider\x12\x0e\n\x06\x62ucket\x18\x02 \x01(\t\x12\x1d\n\x15use_internal_endpoint\x18\x03 \x01(\x08\"\x92\x02\n\x12StorageCredentials\x12\x39\n\x08provider\x18\x01 \x01(\x0e\x32\'.management.metadata.v1.StorageProvider\x12\x10\n\x08\x65ndpoint\x18\x02 \x01(\t\x12\x0e\n\x06region\x18\x03 \x01(\t\x12\x0e\n\x06\x62ucket\x18\x04 \x01(\t\x12\x15\n\robject_prefix\x18\x05 \x01(\t\x12\x15\n\raccess_key_id\x18\x06 \x01(\t\x12\x19\n\x11\x61\x63\x63\x65ss_key_secret\x18\x07 \x01(\t\x12\x16\n\x0esecurity_token\x18\x08 \x01(\t\x12.\n\nexpires_at\x18\t \x01(\x0b\x32\x1a.google.protobuf.Timestamp\"r\n\x16\x43reateUploadURLRequest\x12\x0f\n\x07\x64\x61ta_id\x18\x01 \x01(\t\x12\x33\n\tdata_type\x18\x02 \x01(\x0e\x32 .management.metadata.v1.DataType\x12\x12\n\nobject_key\x18\x03 \x01(\t\"z\n\x17\x43reateUploadURLResponse\x12\x0b\n\x03url\x18\x01 \x01(\t\x12\x0e\n\x06\x62ucket\x18\x02 \x01(\t\x12\x12\n\nobject_key\x18\x03 \x01(\t\x12.\n\nexpires_at\x18\x04 \x01(\x0b\x32\x1a.google.protobuf.Timestamp\"E\n\x13RegisterDataRequest\x12.\n\x04\x64\x61ta\x18\x01 \x01(\x0b\x32 .management.metadata.v1.Metadata\"F\n\x14RegisterDataResponse\x12.\n\x04\x64\x61ta\x18\x01 \x01(\x0b\x32 .management.metadata.v1.Metadata\"Y\n\x14\x41ppendStorageRequest\x12\x0f\n\x07\x64\x61ta_id\x18\x01 \x01(\t\x12\x30\n\x07storage\x18\x02 \x01(\x0b\x32\x1f.management.metadata.v1.Storage\"G\n\x15\x41ppendStorageResponse\x12.\n\x04\x64\x61ta\x18\x01 \x01(\x0b\x32 .management.metadata.v1.Metadata\"p\n\x0fListDataRequest\x12\x11\n\tpage_size\x18\x01 \x01(\x05\x12\x12\n\npage_token\x18\x02 \x01(\t\x12\x36\n\x06\x66ilter\x18\x03 \x01(\x0b\x32&.management.metadata.v1.MetadataFilter\"[\n\x10ListDataResponse\x12.\n\x04\x64\x61ta\x18\x01 \x03(\x0b\x32 .management.metadata.v1.Metadata\x12\x17\n\x0fnext_page_token\x18\x02 \x01(\t\"6\n\x0eGetDataRequest\x12\x0f\n\x07\x64\x61ta_id\x18\x01 \x01(\t\x12\x13\n\x0boptional_id\x18\x02 \x01(\t\"A\n\x0fGetDataResponse\x12.\n\x04\x64\x61ta\x18\x01 \x01(\x0b\x32 .management.metadata.v1.Metadata\"+\n\x18\x43reateDownloadURLRequest\x12\x0f\n\x07\x64\x61ta_id\x18\x01 \x01(\t\"X\n\x19\x43reateDownloadURLResponse\x12\x0b\n\x03url\x18\x01 \x01(\t\x12.\n\nexpires_at\x18\x02 \x01(\x0b\x32\x1a.google.protobuf.Timestamp\"K\n\x11SelectDataRequest\x12\x36\n\x06\x66ilter\x18\x01 \x01(\x0b\x32&.management.metadata.v1.MetadataFilter\"&\n\x12SelectDataResponse\x12\x10\n\x08\x64\x61ta_ids\x18\x01 \x03(\t\"l\n\x1bStreamDataReferencesRequest\x12\x36\n\x06\x66ilter\x18\x01 \x01(\x0b\x32&.management.metadata.v1.MetadataFilter\x12\x15\n\rreturn_fields\x18\x02 \x03(\t\"N\n\x1cStreamDataReferencesResponse\x12.\n\x04\x64\x61ta\x18\x01 \x03(\x0b\x32 .management.metadata.v1.Metadata\"+\n\x19GetReadCredentialsRequest\x12\x0e\n\x06\x62ucket\x18\x01 \x01(\t\"L\n\x1bGetReadCredentialsV2Request\x12\x0e\n\x06\x62ucket\x18\x01 \x01(\t\x12\x1d\n\x15use_internal_endpoint\x18\x02 \x01(\x08\"\xcc\x01\n\x1aGetReadCredentialsResponse\x12\x15\n\raccess_key_id\x18\x01 \x01(\t\x12\x19\n\x11\x61\x63\x63\x65ss_key_secret\x18\x02 \x01(\t\x12\x16\n\x0esecurity_token\x18\x03 \x01(\t\x12.\n\nexpires_at\x18\x04 \x01(\x0b\x32\x1a.google.protobuf.Timestamp\x12\x14\n\x0coss_endpoint\x18\x05 \x01(\t\x12\x0e\n\x06region\x18\x06 \x01(\t\x12\x0e\n\x06\x62ucket\x18\x07 \x01(\t*Q\n\x08\x44\x61taKind\x12\x19\n\x15\x44\x41TA_KIND_UNSPECIFIED\x10\x00\x12\x11\n\rDATA_KIND_RAW\x10\x01\x12\x17\n\x13\x44\x41TA_KIND_CONVERTED\x10\x02\x32\xe7\x0c\n\x15\x44\x61taManagementService\x12\x81\x01\n\x14StreamDataReferences\x12\x32.management.service.v1.StreamDataReferencesRequest\x1a\x33.management.service.v1.StreamDataReferencesResponse0\x01\x12y\n\x12GetReadCredentials\x12\x30.management.service.v1.GetReadCredentialsRequest\x1a\x31.management.service.v1.GetReadCredentialsResponse\x12}\n\x14GetReadCredentialsV2\x12\x32.management.service.v1.GetReadCredentialsV2Request\x1a\x31.management.service.v1.GetReadCredentialsResponse\x12u\n\x14GetReadCredentialsV3\x12\x32.management.service.v1.GetReadCredentialsV3Request\x1a).management.service.v1.StorageCredentials\x12g\n\x0cRegisterData\x12*.management.service.v1.RegisterDataRequest\x1a+.management.service.v1.RegisterDataResponse\x12j\n\rAppendStorage\x12+.management.service.v1.AppendStorageRequest\x1a,.management.service.v1.AppendStorageResponse\x12p\n\x0f\x43reateUploadURL\x12-.management.service.v1.CreateUploadURLRequest\x1a..management.service.v1.CreateUploadURLResponse\x12\x7f\n\x14GetUploadCredentials\x12\x32.management.service.v1.GetUploadCredentialsRequest\x1a\x33.management.service.v1.GetUploadCredentialsResponse\x12\x83\x01\n\x16GetUploadCredentialsV2\x12\x34.management.service.v1.GetUploadCredentialsV2Request\x1a\x33.management.service.v1.GetUploadCredentialsResponse\x12y\n\x16GetUploadCredentialsV3\x12\x34.management.service.v1.GetUploadCredentialsV3Request\x1a).management.service.v1.StorageCredentials\x12[\n\x08ListData\x12&.management.service.v1.ListDataRequest\x1a\'.management.service.v1.ListDataResponse\x12X\n\x07GetData\x12%.management.service.v1.GetDataRequest\x1a&.management.service.v1.GetDataResponse\x12v\n\x11\x43reateDownloadURL\x12/.management.service.v1.CreateDownloadURLRequest\x1a\x30.management.service.v1.CreateDownloadURLResponse\x12\x61\n\nSelectData\x12(.management.service.v1.SelectDataRequest\x1a).management.service.v1.SelectDataResponseB(Z&proto_gen/management/service;servicepbb\x06proto3')
+
+_builder.BuildMessageAndEnumDescriptors(DESCRIPTOR, globals())
+_builder.BuildTopDescriptorsAndMessages(DESCRIPTOR, 'management.service.service_pb2', globals())
+if _descriptor._USE_C_DESCRIPTORS == False:
+
+  DESCRIPTOR._options = None
+  DESCRIPTOR._serialized_options = b'Z&proto_gen/management/service;servicepb'
+  _DATAKIND._serialized_start=2907
+  _DATAKIND._serialized_end=2988
+  _GETUPLOADCREDENTIALSREQUEST._serialized_start=128
+  _GETUPLOADCREDENTIALSREQUEST._serialized_end=210
+  _GETUPLOADCREDENTIALSV2REQUEST._serialized_start=213
+  _GETUPLOADCREDENTIALSV2REQUEST._serialized_end=380
+  _GETUPLOADCREDENTIALSRESPONSE._serialized_start=383
+  _GETUPLOADCREDENTIALSRESPONSE._serialized_end=612
+  _GETUPLOADCREDENTIALSV3REQUEST._serialized_start=615
+  _GETUPLOADCREDENTIALSV3REQUEST._serialized_end=841
+  _GETREADCREDENTIALSV3REQUEST._serialized_start=844
+  _GETREADCREDENTIALSV3REQUEST._serialized_end=979
+  _STORAGECREDENTIALS._serialized_start=982
+  _STORAGECREDENTIALS._serialized_end=1256
+  _CREATEUPLOADURLREQUEST._serialized_start=1258
+  _CREATEUPLOADURLREQUEST._serialized_end=1372
+  _CREATEUPLOADURLRESPONSE._serialized_start=1374
+  _CREATEUPLOADURLRESPONSE._serialized_end=1496
+  _REGISTERDATAREQUEST._serialized_start=1498
+  _REGISTERDATAREQUEST._serialized_end=1567
+  _REGISTERDATARESPONSE._serialized_start=1569
+  _REGISTERDATARESPONSE._serialized_end=1639
+  _APPENDSTORAGEREQUEST._serialized_start=1641
+  _APPENDSTORAGEREQUEST._serialized_end=1730
+  _APPENDSTORAGERESPONSE._serialized_start=1732
+  _APPENDSTORAGERESPONSE._serialized_end=1803
+  _LISTDATAREQUEST._serialized_start=1805
+  _LISTDATAREQUEST._serialized_end=1917
+  _LISTDATARESPONSE._serialized_start=1919
+  _LISTDATARESPONSE._serialized_end=2010
+  _GETDATAREQUEST._serialized_start=2012
+  _GETDATAREQUEST._serialized_end=2066
+  _GETDATARESPONSE._serialized_start=2068
+  _GETDATARESPONSE._serialized_end=2133
+  _CREATEDOWNLOADURLREQUEST._serialized_start=2135
+  _CREATEDOWNLOADURLREQUEST._serialized_end=2178
+  _CREATEDOWNLOADURLRESPONSE._serialized_start=2180
+  _CREATEDOWNLOADURLRESPONSE._serialized_end=2268
+  _SELECTDATAREQUEST._serialized_start=2270
+  _SELECTDATAREQUEST._serialized_end=2345
+  _SELECTDATARESPONSE._serialized_start=2347
+  _SELECTDATARESPONSE._serialized_end=2385
+  _STREAMDATAREFERENCESREQUEST._serialized_start=2387
+  _STREAMDATAREFERENCESREQUEST._serialized_end=2495
+  _STREAMDATAREFERENCESRESPONSE._serialized_start=2497
+  _STREAMDATAREFERENCESRESPONSE._serialized_end=2575
+  _GETREADCREDENTIALSREQUEST._serialized_start=2577
+  _GETREADCREDENTIALSREQUEST._serialized_end=2620
+  _GETREADCREDENTIALSV2REQUEST._serialized_start=2622
+  _GETREADCREDENTIALSV2REQUEST._serialized_end=2698
+  _GETREADCREDENTIALSRESPONSE._serialized_start=2701
+  _GETREADCREDENTIALSRESPONSE._serialized_end=2905
+  _DATAMANAGEMENTSERVICE._serialized_start=2991
+  _DATAMANAGEMENTSERVICE._serialized_end=4630
+# @@protoc_insertion_point(module_scope)

{current_data_py-0.1.11 → current_data_py-0.1.12}/proto_gen/python/management/service/service_pb2_grpc.py

@@ -39,6 +39,11 @@ class DataManagementServiceStub(object):
                 request_serializer=management_dot_service_dot_service__pb2.RegisterDataRequest.SerializeToString,
                 response_deserializer=management_dot_service_dot_service__pb2.RegisterDataResponse.FromString,
                 )
+        self.AppendStorage = channel.unary_unary(
+                '/management.service.v1.DataManagementService/AppendStorage',
+                request_serializer=management_dot_service_dot_service__pb2.AppendStorageRequest.SerializeToString,
+                response_deserializer=management_dot_service_dot_service__pb2.AppendStorageResponse.FromString,
+                )
         self.CreateUploadURL = channel.unary_unary(
                 '/management.service.v1.DataManagementService/CreateUploadURL',
                 request_serializer=management_dot_service_dot_service__pb2.CreateUploadURLRequest.SerializeToString,
@@ -114,6 +119,12 @@ class DataManagementServiceServicer(object):
         context.set_details('Method not implemented!')
         raise NotImplementedError('Method not implemented!')
 
+    def AppendStorage(self, request, context):
+        """Missing associated documentation comment in .proto file."""
+        context.set_code(grpc.StatusCode.UNIMPLEMENTED)
+        context.set_details('Method not implemented!')
+        raise NotImplementedError('Method not implemented!')
+
     def CreateUploadURL(self, request, context):
         """Missing associated documentation comment in .proto file."""
         context.set_code(grpc.StatusCode.UNIMPLEMENTED)
@@ -190,6 +201,11 @@ def add_DataManagementServiceServicer_to_server(servicer, server):
                     request_deserializer=management_dot_service_dot_service__pb2.RegisterDataRequest.FromString,
                     response_serializer=management_dot_service_dot_service__pb2.RegisterDataResponse.SerializeToString,
             ),
+            'AppendStorage': grpc.unary_unary_rpc_method_handler(
+                    servicer.AppendStorage,
+                    request_deserializer=management_dot_service_dot_service__pb2.AppendStorageRequest.FromString,
+                    response_serializer=management_dot_service_dot_service__pb2.AppendStorageResponse.SerializeToString,
+            ),
             'CreateUploadURL': grpc.unary_unary_rpc_method_handler(
                     servicer.CreateUploadURL,
                     request_deserializer=management_dot_service_dot_service__pb2.CreateUploadURLRequest.FromString,
@@ -325,6 +341,23 @@ class DataManagementService(object):
             options, channel_credentials,
             insecure, call_credentials, compression, wait_for_ready, timeout, metadata)
 
+    @staticmethod
+    def AppendStorage(request,
+            target,
+            options=(),
+            channel_credentials=None,
+            call_credentials=None,
+            insecure=False,
+            compression=None,
+            wait_for_ready=None,
+            timeout=None,
+            metadata=None):
+        return grpc.experimental.unary_unary(request, target, '/management.service.v1.DataManagementService/AppendStorage',
+            management_dot_service_dot_service__pb2.AppendStorageRequest.SerializeToString,
+            management_dot_service_dot_service__pb2.AppendStorageResponse.FromString,
+            options, channel_credentials,
+            insecure, call_credentials, compression, wait_for_ready, timeout, metadata)
+
     @staticmethod
     def CreateUploadURL(request,
             target,