gen-worker 0.1.4__py3-none-any.whl

gen_worker-0.1.4.dist-info/METADATA

@@ -0,0 +1,113 @@
+Metadata-Version: 2.4
+Name: gen-worker
+Version: 0.1.4
+Summary: Add your description here
+Author-email: Paul Fidika <paul@fidika.com>
+Requires-Python: >=3.10
+Requires-Dist: aiohttp>=3.11.14
+Requires-Dist: backoff>=2.2.1
+Requires-Dist: grpcio>=1.71.0
+Requires-Dist: msgspec>=0.18.6
+Requires-Dist: protobuf>=5.26.1
+Requires-Dist: psutil>=7.0.0
+Requires-Dist: pyjwt[crypto]>=2.8.0
+Requires-Dist: tqdm>=4.66.0
+Provides-Extra: dev
+Requires-Dist: devpi-client>=7.2.0; extra == 'dev'
+Requires-Dist: grpcio-tools>=1.71.0; extra == 'dev'
+Provides-Extra: torch
+Requires-Dist: flashpack>=0.1.2; extra == 'torch'
+Requires-Dist: numpy>=1.26.0; extra == 'torch'
+Requires-Dist: safetensors>=0.4.3; extra == 'torch'
+Requires-Dist: torch>=2.6.0; extra == 'torch'
+Requires-Dist: torchaudio>=2.6.0; extra == 'torch'
+Requires-Dist: torchvision>=0.21.0; extra == 'torch'
+Description-Content-Type: text/markdown
+
+This is a python package, called gen_worker, which provides the worker runtime SDK:
+
+- Orchestrator gRPC client + job loop
+- Function discovery via @worker_function
+- ActionContext + errors + progress events
+- Model downloading from the Cozy hub (async + retries + progress)
+- Output uploads (presigned PUT or S3 creds)
+
+Torch-based model memory management is optional and installed via extras.
+
+---
+
+Files in src/gen_worker/pb must be auto-generated in the gen-orchestrator repo, using the proto files. Go in there and run `task proto`
+
+Install modes:
+
+- Core only: `gen-worker`
+- Torch runtime add-on: `gen-worker[torch]` (torch + torchvision + torchaudio + safetensors + flashpack + numpy)
+
+Example tenant projects live in `../worker-example-functions`. They use:
+
+- `pyproject.toml` + `uv.lock` for dependencies (no requirements.txt)
+- `cozy.toml` TOML manifest for deployment config (functions.modules, runtime.base_image, etc.)
+
+Dependency policy:
+
+- Require `pyproject.toml` and/or `uv.lock`
+- Do not use `requirements.txt`
+- Put Cozy deployment config in `cozy.toml`
+
+Example:
+
+```toml
+[functions]
+modules = ["functions"]
+
+[runtime]
+base_image = "ghcr.io/cozy/python-worker:cuda12.1-torch2.6"
+```
+
+Function signature:
+
+```python
+from gen_worker import worker_function, ResourceRequirements, ActionContext
+
+@worker_function(ResourceRequirements(model_family="sdxl", requires_gpu=True))
+def generate(ctx: ActionContext, payload: dict) -> dict:
+    return {"ok": True}
+```
+
+Dynamic checkpoints:
+
+- Use `ResourceRequirements(model_family=...)` to declare a family (e.g., "sdxl")
+- Pass the exact checkpoint at runtime via request payload (e.g., `model_ref`)
+
+Build contract (gen-builder):
+
+- Tenant code + `pyproject.toml`/`uv.lock` + `cozy.toml` are packaged together
+- gen-builder layers tenant code + deps on top of a python-worker base image
+- gen-orchestrator deploys the resulting worker image
+
+---
+
+Env hints:
+
+- `SCHEDULER_ADDR` sets the primary scheduler address.
+- `SCHEDULER_ADDRS` (comma-separated) provides seed addresses for leader discovery.
+- `WORKER_JWT` is accepted as the auth token if `AUTH_TOKEN` is not set.
+- `SCHEDULER_JWKS_URL` enables verification of `WORKER_JWT` before connecting.
+- JWT verification uses RSA and requires PyJWT crypto support (installed by default via `PyJWT[crypto]`).
+- `WORKER_MAX_INPUT_BYTES`, `WORKER_MAX_OUTPUT_BYTES`, `WORKER_MAX_UPLOAD_BYTES` cap payload sizes.
+- `WORKER_MAX_CONCURRENCY` limits concurrent runs; `ResourceRequirements(max_concurrency=...)` limits per-function.
+- `COZY_HUB_URL` base URL for Cozy hub downloads (used by core downloader).
+- `COZY_HUB_TOKEN` optional bearer token for Cozy hub downloads.
+- `MODEL_MANAGER_CLASS` optional ModelManager plugin (module:Class) loaded at startup.
+
+Error hints:
+
+- Use `gen_worker.errors.RetryableError` in worker functions to flag retryable failures.
+
+Output upload hints:
+
+- To upload raw bytes, include an `output_upload` object in the job input:
+  - Presigned PUT:
+    - `{"output_upload":{"put_url":"...","headers":{"Content-Type":"image/png"},"public_url":"https://..."}}`
+  - S3 creds:
+    - `{"output_upload":{"s3":{"bucket":"...","key":"...","region":"...","access_key_id":"...","secret_access_key":"..."}}}`

gen_worker-0.1.4.dist-info/RECORD

@@ -0,0 +1,38 @@
+gen_worker/__init__.py,sha256=oo5BosBdO7iy-_5cv4TnHVRzGa0ygMyAeD0K-mJV2t4,516
+gen_worker/decorators.py,sha256=7RfsVsH5YlR5lcTeL6CV3jpqzojTGIxlqTV7N4mPjYs,2476
+gen_worker/downloader.py,sha256=XjmbAgsY6HicA5xBOe0f7FSqfewoyoZIp9EF__1XiCM,2980
+gen_worker/entrypoint.py,sha256=C3Nz6JcAroTYgNwGSS2jAlyLuSxX-t7IupG9TaJPUII,6186
+gen_worker/errors.py,sha256=1947MCZSx5ehykpk43smEj47ClJ0OnQa1EErsvx7TqI,252
+gen_worker/model_interface.py,sha256=WFyW9kwhrW0ri7Bzs-m5DuTKQWETb8-UBPfwvIBKwiE,1180
+gen_worker/py.typed,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+gen_worker/types.py,sha256=Yn84xc4wJ9vAofjkfRwCH1wxjYo7CJacLAgJ7qIA8jE,1624
+gen_worker/worker.py,sha256=6v1xl9kvJ-VvL2QAp4pstA3yGfIGsgAj483JdsT2tr8,78996
+gen_worker/default_model_manager/__init__.py,sha256=8_CMt6sqvHyDppNpCyF7km1988hWDLruzsBCrW2el2I,172
+gen_worker/pb/__init__.py,sha256=IT0vsuJUAbWRkwr9zvywA3O3A1C10hla67uMUfw24JY,965
+gen_worker/pb/frontend_pb2.py,sha256=bWFV2ElpGvdwPsgzyzn4lWWzqBUp51lbyNHD2KvfJCk,3735
+gen_worker/pb/frontend_pb2_grpc.py,sha256=9yIkEWbK_q_qsRiGg3wmora2cbIOS7RdUjGrT1f1Itw,6852
+gen_worker/pb/worker_scheduler_pb2.py,sha256=ym_h5hLG37FrN03w_uqMbztQNkD1LU1WVB5GRRtU9jc,7286
+gen_worker/pb/worker_scheduler_pb2_grpc.py,sha256=PteKjn5HQfzj-xbgJ0YfQ8GO4KJBSCYgSu0C4Uzk37E,3727
+gen_worker/testing/__init__.py,sha256=nubuQCmjof2zS_KSPKgIgm9Iw50TfSuPeARwrkUDF2Q,38
+gen_worker/testing/stub_manager.py,sha256=89oxi--h6ht6SYz-OfDrgeDQvW00aOwsrG-uL3acZTM,2386
+gen_worker/torch_manager/__init__.py,sha256=mweyjnNIzNIescB8RyyOGFgOyW0u7Rn9FBUAgZjjjdY,155
+gen_worker/torch_manager/manager.py,sha256=yoLYNLWWV1E6KJmkLareHvKwtmxo1ZSiJzSLK_vmghQ,80113
+gen_worker/torch_manager/utils/config.py,sha256=IQHhP4mL1kr7GO_hBse_4LcFjOATpuSocIsjE9YMaEM,11643
+gen_worker/torch_manager/utils/device.py,sha256=eLFteGOFA5HFVxhoqVr42jiB3Z_5sQ-E_Nr09hCkMSU,755
+gen_worker/torch_manager/utils/diffusers_fix.py,sha256=GU5plsN0-kvUKsECxmtmEKpFSElHbYaGmXa2yhRKOo8,367
+gen_worker/torch_manager/utils/flashpack_loader.py,sha256=Pt68WwM1xFzQaF8mdMHV_QwH6j4vnEbgg9wq3FF8gxw,9913
+gen_worker/torch_manager/utils/globals.py,sha256=Rdc4Ny81Hym_tOKqpDFErnagGcMbCR-8PgvnppfPqhE,1452
+gen_worker/torch_manager/utils/load_models.py,sha256=o5IpwM6UT5tE0Uwq1WT_kz2pHU2DL-skk91a5-zDOd4,8239
+gen_worker/torch_manager/utils/local_cache.py,sha256=6uIkieqgXWZ5heqb15h8Cr5n5M1LdSN4DzXsd5Cr818,11716
+gen_worker/torch_manager/utils/model_downloader.py,sha256=9VLhgHzdB31md8fdjJdFZ9rRj85Ox6u7drXZa-xY1Hg,30907
+gen_worker/torch_manager/utils/parse_cli.py,sha256=FlbyOAkHc_5he7dBq5ET2OXZYFnnnKalbH5hZHYCcS0,2735
+gen_worker/torch_manager/utils/paths.py,sha256=PwJ2NjtlxiTXqyK9pq3NGf07Qh4RX5csmGbQTEq9B6k,480
+gen_worker/torch_manager/utils/repository.py,sha256=eov5LQRpTeWEJDiI1vSROpthGIZosNSq6sYccGDIZ5g,5736
+gen_worker/torch_manager/utils/utils.py,sha256=0XXQDyOsPNfjBRgJS5FGPVmKWOLhNE6UYgpeAE9PkAg,1327
+gen_worker/torch_manager/utils/base_types/architecture.py,sha256=47MGbJZeIF8rI305_Abov02m7KRAuyV88SAwTjq0gWs,4278
+gen_worker/torch_manager/utils/base_types/common.py,sha256=bIDa0tnjTwRDQH1vr9IRwpCdEQlwD2CYQH7GTuhg33Q,1251
+gen_worker/torch_manager/utils/base_types/config.py,sha256=Wej9jVeGFWWmI0rPU-TCMWOvoEYYQjc1FJgEyTVCd_c,1133
+gen_worker/torch_manager/utils/db/database.py,sha256=U1U114wti7ah5Pk-hr0-khYwji5jT4ALLwGFUuksyNg,1286
+gen_worker-0.1.4.dist-info/METADATA,sha256=xY_JgHgliPRXSa0FsFCt_oxTa71L-z5bIjK5508Geqg,4123
+gen_worker-0.1.4.dist-info/WHEEL,sha256=WLgqFyCfm_KASv4WHyYy0P3pM_m7J5L9k2skdKLirC8,87
+gen_worker-0.1.4.dist-info/RECORD,,

gen_worker-0.1.4.dist-info/WHEEL

@@ -0,0 +1,4 @@
+Wheel-Version: 1.0
+Generator: hatchling 1.28.0
+Root-Is-Purelib: true
+Tag: py3-none-any