clustermesh 0.9.0__py3-none-any.whl

clustermesh-0.9.0.dist-info/METADATA

@@ -0,0 +1,200 @@
+Metadata-Version: 2.4
+Name: clustermesh
+Version: 0.9.0
+Summary: Enterprise compute fabric — pip install on any machine to join a compute cluster
+Project-URL: Homepage, https://github.com/neetishsingh/ClusterMesh
+Project-URL: Documentation, https://github.com/neetishsingh/ClusterMesh/blob/main/docs/join-mesh.md
+Project-URL: Repository, https://github.com/neetishsingh/ClusterMesh
+Author: ClusterMesh Team
+License-Expression: MIT
+License-File: LICENSE
+Keywords: cluster,compute,distributed,grpc,mesh,scheduler
+Classifier: Development Status :: 4 - Beta
+Classifier: Environment :: Console
+Classifier: Intended Audience :: Developers
+Classifier: Intended Audience :: System Administrators
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Operating System :: OS Independent
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Topic :: System :: Clustering
+Classifier: Topic :: System :: Distributed Computing
+Requires-Python: >=3.11
+Requires-Dist: fastapi>=0.110
+Requires-Dist: grpcio>=1.60
+Requires-Dist: protobuf>=4.25
+Requires-Dist: psutil>=5.9
+Requires-Dist: pyyaml>=6.0
+Requires-Dist: uvicorn[standard]>=0.27
+Requires-Dist: websockets>=12.0
+Requires-Dist: zeroconf>=0.131
+Provides-Extra: dev
+Requires-Dist: grpcio-tools>=1.60; extra == 'dev'
+Requires-Dist: httpx>=0.27; extra == 'dev'
+Requires-Dist: hypothesis>=6.100; extra == 'dev'
+Requires-Dist: pytest-cov>=5.0; extra == 'dev'
+Requires-Dist: pytest>=8.0; extra == 'dev'
+Provides-Extra: discovery
+Requires-Dist: zeroconf>=0.131; extra == 'discovery'
+Provides-Extra: phase6
+Requires-Dist: psycopg[binary]>=3.1; extra == 'phase6'
+Requires-Dist: redis>=5.0; extra == 'phase6'
+Requires-Dist: zeroconf>=0.131; extra == 'phase6'
+Provides-Extra: postgres
+Requires-Dist: psycopg[binary]>=3.1; extra == 'postgres'
+Provides-Extra: redis
+Requires-Dist: redis>=5.0; extra == 'redis'
+Description-Content-Type: text/markdown
+
+# ClusterMesh (ComputeMesh)
+
+**An operating system for enterprise compute** — turn every laptop, desktop, VM, and GPU workstation into a single elastic, fault-tolerant compute cloud.
+
+> Full vision: [Sparkpool](./Sparkpool) · Architecture: [docs/architecture.md](./docs/architecture.md) · Roadmap: [docs/roadmap.md](./docs/roadmap.md)
+
+## The Problem
+
+Organizations sit on thousands of idle cores:
+
+| Resource | Typical utilization |
+|----------|---------------------|
+| CPU | 10–20% |
+| RAM | 30–50% |
+| GPU | 5–10% |
+
+Databricks, Kubernetes, Spark, and Ray all require **dedicated** compute. Nobody fully solves:
+
+> *"Use all idle enterprise hardware automatically and safely."*
+
+ClusterMesh does.
+
+## What We're Building
+
+```
+                    Control Plane
+                           │
+         ┌─────────────────┼─────────────────┐
+         │                 │                 │
+ Metadata Service    Scheduler Service    Auth Service
+         │                 │                 │
+         └─────────────────┼─────────────────┘
+                           │
+                     Driver Cluster (Raft HA)
+                           │
+      ┌────────────────────┼────────────────────┐
+      │                    │                    │
+   Agent-1             Agent-2              Agent-3
+  Laptop               Desktop                 VM
+```
+
+**Killer features:** idle compute harvesting · GPU sharing · live discovery · fault-tolerant scheduling · work stealing · preemption handling · checkpoint recovery · multi-office clustering
+
+## Join a worker (any Python machine)
+
+```bash
+pip install clustermesh
+clustermesh join DRIVER_IP:50050 --open    # local worker UI on :50052
+```
+
+See [docs/join-mesh.md](./docs/join-mesh.md) for full details.
+
+## Quick Start (development)
+
+```bash
+# Install in development mode
+python -m venv .venv
+source .venv/bin/activate
+pip install -e ".[dev]"
+
+# Run tests
+pytest
+
+# Run a simulated 50-node cluster demo
+python -m mesh.sim.demo
+
+# Phase 5: platform with React dashboard (build UI first)
+cd frontend && npm install && npm run build && cd ..
+mesh-platform --port 8080 --db clustermesh.db   # driver + API + UI
+# Phase 6 options
+mesh-platform --port 8080 --mdns --site bangalore          # advertise via mDNS
+mesh-platform --store-url postgres://user:pass@localhost/clustermesh
+mesh-platform --api-key your-secret-key                    # require auth on API
+mesh-agent --discover                                      # auto-find driver on LAN
+
+# Phase 7: multi-site mesh VPN
+mesh-platform --mesh-config config/sites.example.yaml --site bangalore
+mesh-relay --listen 0.0.0.0:6000 --target 127.0.0.1:50050   # standalone relay
+mesh-soak --hours 24 --nodes 50                              # accelerated 24h chaos test
+mesh-bench --nodes 1000                                       # placement SLA benchmark
+./scripts/dogfood.sh                                           # local dogfood run
+```
+
+## Project Structure
+
+```
+ClusterMesh/
+├── docs/                  # Architecture, testing strategy, roadmap
+├── mesh/                  # Core Python package
+│   ├── models/            # Node, Task, Job, Resource types
+│   ├── health/            # Heartbeat FSM, node health tracking
+│   ├── scheduler/         # Scoring, placement, pool routing
+│   ├── execution/         # TaskExecutor, TaskContext
+│   ├── recovery/          # Checkpointing, work stealing, replication
+│   ├── driver/            # JobManager, DriverCluster, gRPC server
+│   ├── agent/             # Daemon, monitor, preemption, library
+│   ├── proto/             # gRPC protobuf definitions
+│   ├── tasks/             # Task registry + built-ins
+│   ├── sdk/               # @task decorator, submit() API
+│   └── sim/               # SimAgent, SimCluster, chaos injection
+├── tests/                 # Unit + integration tests
+├── frontend/              # React dashboard (Vite + Tailwind)
+└── Sparkpool              # Original product vision document
+```
+
+## Current Status (Phase 8) ✅
+
+| Component | Status |
+|-----------|--------|
+| Phases 0–7 (full platform + mesh VPN) | ✅ Done |
+| Distributed memory fabric | ✅ Done |
+| 1000-node placement SLA (`mesh-bench`) | ✅ Done |
+| Memory dashboard + dogfood script | ✅ Done |
+
+## Developer SDK
+
+```python
+from mesh import task, submit, TaskContext
+
+@task(cpu=4, ram="8GB", checkpoint=True, total_work=1_000_000)
+def process_records(ctx: TaskContext):
+    for i in range(int(ctx.progress), 1_000_000):
+        ctx.set_progress(i + 1, records=i + 1)
+    return "done"
+
+# Sync submit — blocks until complete
+result = submit(process_records)
+
+# Async submit — returns JobHandle
+job = submit(process_records, async_=True)
+result = job.wait(timeout=3600)
+```
+
+See [docs/api-spec.md](./docs/api-spec.md) for the full SDK specification.
+
+## Documentation
+
+| Document | Description |
+|----------|-------------|
+| [Architecture](./docs/architecture.md) | System design, components, data flows |
+| [Fault Tolerance](./docs/fault-tolerance.md) | All 10 recovery mechanisms in detail |
+| [Testing Strategy](./docs/testing-strategy.md) | Test pyramid, scenarios, SLAs |
+| [Roadmap](./docs/roadmap.md) | Phased build plan with milestones |
+| [API Spec](./docs/api-spec.md) | Developer SDK and internal APIs |
+| [Join mesh](./docs/join-mesh.md) | `pip install clustermesh` and worker CLI |
+| [Publish to PyPI](./docs/publish-pypi.md) | Build, token setup, and upload guide |
+
+## License
+
+MIT — see [LICENSE](./LICENSE).

clustermesh-0.9.0.dist-info/RECORD

@@ -0,0 +1,95 @@
+mesh/__init__.py,sha256=xI92Z-9vXmvuANNYOe3OpcH3QEVDGv3sVhxTcrQjRko,190
+mesh/cli.py,sha256=TjRTIP2r4D7sJNcAk4FpgJrpwCIskBeLcGNMxivoAqc,6513
+mesh/agent/__init__.py,sha256=iZObG1xTPMbRszs-yXkLoNFnRmVBJzefEUuLd2Ib7ak,239
+mesh/agent/client.py,sha256=EIfyL7RkPF3j-RZiIyKAE1WR9aMKH1atq4bUnt-dr_M,4108
+mesh/agent/config.py,sha256=lsdFsYn29m8mFMmoeknhYZk0o4TpPnH71ZsfebXrx4g,923
+mesh/agent/daemon.py,sha256=pFb8-cWuT3mRf3IFT7GGtMS_p5ZgAqtQ0cTNH-gi8ao,6929
+mesh/agent/executor.py,sha256=HOgAkRJBzhG5sb6goyC6uHhNi2vCHwLQG4dtnoFa7fQ,4381
+mesh/agent/host_metrics.py,sha256=MctniLzdHj4RiynbpLLyURKXA5jK_L9a2VREf96_D68,7038
+mesh/agent/library.py,sha256=-Yh5y9ERp-IoK8Ds4dliU8AIJw_jzVb2Eny7zSNp4A8,156
+mesh/agent/monitor.py,sha256=eJERv4vId_dYv4-uV1G8lnHyhlz9xicA5jZzDB24n4s,6462
+mesh/agent/preemption.py,sha256=qzAgX15dcSnuGRPLIvtLs1aiKhmtC92xI4QUZvS8ATA,1231
+mesh/agent/server.py,sha256=s3HIQeRrbZOGcwWxrbnKd2K6oKnjRlxnFW5mMMOp0iM,3757
+mesh/agent/shell.py,sha256=3khwdUgW5cbAJTmtl1BGjEmfkIMdTKZrwkT5C9Imhjs,2314
+mesh/api/__init__.py,sha256=8nFb0OzAgWWhgq_u6tIZxsztxv1QYq3JSRrtn2AE7hg,170
+mesh/api/app.py,sha256=34XcZrO-kEC-KmA-hT2ho9wnFMexh7-aUVGL054N73Q,14862
+mesh/api/auth.py,sha256=SIWcDEtMJBtuLBtFNSDkOIVY0kacDpMNYHB0bBUgAm0,2173
+mesh/api/context.py,sha256=Q9BzLOJkYvI7vBmjbtz48dUf_muXtd_CO5epN1IaEOE,10185
+mesh/api/events.py,sha256=Fux3b6P6mYWrMWLKICQjsLDKaOPGMVLq9_UE5usNJlE,3481
+mesh/api/server.py,sha256=rrOEJHT_t2A_AiXDmd4W8CtgT-8GPiHTZBXooHKXv3E,6548
+mesh/discovery/__init__.py,sha256=ESEdoVQaDC6eWUSi7XxCe28orPpnwaxbJXgmNQIJoV8,226
+mesh/discovery/mdns.py,sha256=DvOhhohfkJkPaTKowdGtX5hK6BIbu2kd7qtxK2QLzqI,4613
+mesh/driver/__init__.py,sha256=akYI3w2KsNUSPx70yVcwbiIay9H1F5A8xNvz87LECFo,373
+mesh/driver/cluster.py,sha256=ZEN8hVxPHny1XfvMAW67fvamaNVw3xLzPaq-pzgCuH8,6715
+mesh/driver/job_manager.py,sha256=5IgTbbM18kRhoz5a1VtFkoFTLZ7OIUjI_Um_NgtLIso,20880
+mesh/driver/library_installer.py,sha256=v1IuOHWBvSJRisuOZPa5DRxmzRBl8bQmwQN4xCQcOec,7745
+mesh/driver/server.py,sha256=HZ4Z7SFM1cCAKt5jEucM-VKIRLB81zsBhLcMU-VFnmc,8956
+mesh/driver/ha/__init__.py,sha256=RHLh6NhVrLRqKHUL_ZHGcMYIbgQzClKR-xREajFh8Bc,196
+mesh/driver/ha/coordinator.py,sha256=HpyYVbaXSiJ8Ku0sS6eUlIpkn9vkSVTxi80Le8pFZ_4,1286
+mesh/driver/ha/election.py,sha256=zDbJ5QaO1MtNm6guAhr_YTy2e4JWJPLsFlp_V0n0WLk,2501
+mesh/execution/__init__.py,sha256=7GorfwmtwslGlcd0FjvHpny1mHWTtINgs_MFmeoWo2s,202
+mesh/execution/executor.py,sha256=BKaf6N5gbDc0OmX4wx8Wx3spAzPBZO2VqffOB0rJ22k,4919
+mesh/health/__init__.py,sha256=GiFSJVB7-qgMe-1PuSwTYebE7VltAnlTTA4v63k1zrQ,179
+mesh/health/heartbeat.py,sha256=uaiaW74DFhFcIs-6P0Cd-_xTx7j2h134f5PoDvhzfL8,4629
+mesh/libraries/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+mesh/libraries/manager.py,sha256=eJBzUEIDZpzRHmzIriaEwlbenrMd6k_8X2MPN7j8FAo,2851
+mesh/memory/__init__.py,sha256=HdMKtiesOu9Pa5UMHoIzoxU4mtcmyKlOyfrJwarxafw,212
+mesh/memory/fabric.py,sha256=qPon-9UXuLemXx8wNBUzU8dAhpN9CzXZVzsPpHge-NQ,5500
+mesh/meshvpn/__init__.py,sha256=myCvwi_rsx8nAH5c2zx4NspnbQUzkTfvXXt6I2_l5oA,232
+mesh/meshvpn/coordinator.py,sha256=tBFES6EZik5-oZjYASbuNLG8r9HqtGndSW57uK59wNw,3595
+mesh/meshvpn/relay.py,sha256=XW-nIe64hS6mpXOPl93J9VL0ifeWO4Ru9yYkCv1NP0w,3923
+mesh/meshvpn/site.py,sha256=2uRr-slTx51-a_0cZbNKlw0QG5Z9blBzdLxdDmbvP0Q,1939
+mesh/models/__init__.py,sha256=XPX2OdNDYngfeV6hTzR9i5uN8X2Km42SV1u7aZjSNtU,352
+mesh/models/enums.py,sha256=AfEWroFul_P3EaRV7Fkfip7uuB5XDaLZRl5KGB9FAZo,441
+mesh/models/job.py,sha256=jvib8hmLJjBl0eY-_XdDuDS_hLEAdzuiUhra-XZdpsQ,820
+mesh/models/node.py,sha256=Rpun25SXK3rmSj8I7c1HEw9mDtIaCGERGa2Xa4JV04Y,2602
+mesh/models/task.py,sha256=KmHHp4NFYrlRfWAS60W26p5wQ6yvZ6nPi6tMBC6zJDw,1534
+mesh/net/__init__.py,sha256=AbpHGcgLb-kRsJGnwFEktk7uzpZOCcBY74-YBdrKVGs,1
+mesh/net/address.py,sha256=incCO8mi0NK1lhOFcfhkI6IaCN-p6K0jTCzjPwwNbDo,1599
+mesh/notebook/__init__.py,sha256=vB789AFBOFI9WchxL1tSplTxo_93S6NHtXvA6Cfp3Nc,113
+mesh/notebook/runner.py,sha256=mYBGl6uMt-xJtKQ7zqRtbAS0YhtiyQ0eEbz9GN6eLVg,3245
+mesh/proto/__init__.py,sha256=3AFy1Kxx1ACSn8CEBSn_CaNeknckIE7hb5Zrh3LAVBU,142
+mesh/proto/mesh_pb2.py,sha256=H725YrP_NWVUajUwT3g4Pr-DGlUB2ndjGwo23OK0RmY,6986
+mesh/proto/mesh_pb2_grpc.py,sha256=dnmSNtttcxC-YliTWPlRFFDWTfO6argK7pcbfHIaxAg,20392
+mesh/recovery/__init__.py,sha256=BtbadLBfX3m3pgKSqPlOZspblUC0_Hw5ZQTdkySqTRk,442
+mesh/recovery/checkpoint.py,sha256=dDRO7twcYw9-HzBdlFuLQHck4I-rtHem_eT8bdHLZjk,1335
+mesh/recovery/replication.py,sha256=xoLBwurIi9dEgaSIVWnX0SdYTqmqjbh9kiN_3GDNtXE,3102
+mesh/recovery/speculation.py,sha256=HKFAlMfkM3qOinRwC4U8dc-AVbv6_XTNwQboi0JyUus,1919
+mesh/recovery/work_stealing.py,sha256=W8DMrEkJU9zHk7q7w8wj3F5yYDveJ-Hc8eF1v5Q1Dt0,2193
+mesh/scheduler/__init__.py,sha256=RAxLJC_8PHJJc806Dk890F-cAiGhC1a8hHW9xHzzQCQ,342
+mesh/scheduler/benchmark.py,sha256=HI3VS9is4UDE8N2cTUK7r06L9pcvAgZiDBCFAwEtQO4,3209
+mesh/scheduler/placement.py,sha256=i-kpIU81rH49gqgtp9d0YFd65tb56FZqrFsNgJFWMOo,3296
+mesh/scheduler/pools.py,sha256=BM-87vZdHaAX4nGpZBCLDfo_YoXkb9aP4cjFTyCsSiU,2234
+mesh/scheduler/rebalancing.py,sha256=lQahWrhphtvqsXMkJrAJhprv0w_XUnolS3e6wec2JHA,1959
+mesh/scheduler/scoring.py,sha256=bHt9jUDAjrRoOz0apdhMJokVr0BYkNdV_Vqy5YxqQ-s,1662
+mesh/sdk/__init__.py,sha256=RFUfRMS1aOs1Iha9UQaWlDvKsbGlRHKQeFaDg-7RolI,1644
+mesh/sdk/decorator.py,sha256=bciWmlPSQvVi-bw98iRSDaN30p6GsL0C9AlLhgUuOtQ,2924
+mesh/sdk/units.py,sha256=lfPKzmfEMhQiAaijQszLnhjEVxDERAy_1dwmW-2RMt0,1769
+mesh/sim/__init__.py,sha256=Bxm4OhVl-lbqmtl4KTIYGSK2dz7_powTYohwVs58qSs,297
+mesh/sim/agent.py,sha256=P8OuYXagCdKjRj1aV3bnprSxU3F_1oEFy4muKiu2aS0,2401
+mesh/sim/chaos.py,sha256=XF5ZY-jDNXuWyr8FhzKe_EdtcqQh0JUglSvH3imzkv0,2060
+mesh/sim/clock.py,sha256=RGHdgci8Q28RshiHEJ9J4T6MzCAIeRQA6xiNyeBJXtQ,509
+mesh/sim/cluster.py,sha256=YFgv7LsKSJfclbVGMHDLeLuxgsrTwe1zhIeG-FtP3OA,6807
+mesh/sim/demo.py,sha256=gE1MKQRtoomdGNzXE-aCyU37eicU8K57HWtxdoKnrkE,2306
+mesh/sim/soak.py,sha256=xytA12gh04OfFaA7MoO4HOw5GXpO-ZgRTP5tpi629mM,5779
+mesh/state/__init__.py,sha256=Sa3hNrLqaFlMR4CJtPDCOL2NX3vlphlC1TN__yLXr0g,241
+mesh/state/factory.py,sha256=OaPg_s-DrpoT8vuOiqL1u6fJncnPk9WXemQeB7STm3k,1367
+mesh/state/postgres_store.py,sha256=77sJK1Lq5B4pKfnB1_6JkEZFmBnnMsNQYjLGoMJHR0s,7658
+mesh/state/redis_store.py,sha256=Y_yIuxisRzmDMp1-VyqqiOUOnw4DDRvI3sd5h1u1OsM,4556
+mesh/state/serialize.py,sha256=t6Ze3WXH1Fn4zs9d19J1Y3Z_97JsM8-duyrzecZqACs,3770
+mesh/state/sqlite_store.py,sha256=Iqi6m02_0j-RiSs19Xrhelt-p-8SSYLctqELt4rTaSA,7007
+mesh/state/store.py,sha256=xofJtByw-YN4Vx9YRjdtxzj-omIGNKdvpS_NS17F73A,1176
+mesh/tasks/__init__.py,sha256=vCWU1R7kA9SSGilvQGRBOyIDnAfxJD2oUM_17-AB_40,187
+mesh/tasks/builtins.py,sha256=UM7kRiPMzm4ndxo7Gwfs6WV579rUGgmPa3vEcaoLQ54,1090
+mesh/tasks/registry.py,sha256=_lqjocN27rkGW4Jp7dMbPf9NjxYCbQ6nxLdRw8OAEYw,622
+mesh/worker/__init__.py,sha256=WBWRKh0i1h4KQDTL3_HfK1V6GApZxfyGrQW3B8ahL_U,175
+mesh/worker/runtime.py,sha256=KajGdlvrvGwC6aGG-swMNoKeSCv7ic4sl17Che_125A,2028
+mesh/worker/server.py,sha256=4x6Zku5sowi1nsrruFRaayE-lbVRnShkY_74AoJ29Zc,1138
+mesh/worker/state.py,sha256=YQfalJ1oS4PysZ_ifCbyT1yl8rX8tNF73GNoGAYtYKo,3997
+mesh/proto/mesh.proto,sha256=1ET-0aUiySdsgz_JUk968PQ5yi8v0GWLEJKSjubfEw4,2954
+mesh/worker/static/index.html,sha256=SkOmFYC9lY7UWcEPUClllP3TUkcaEIyB4T4yrFR3a1Q,7800
+clustermesh-0.9.0.dist-info/METADATA,sha256=mDyvKZmpvIQgsUs1iHQtENrUdvGvQh71_ATHZUVX6VY,7906
+clustermesh-0.9.0.dist-info/WHEEL,sha256=mffPy8wBnZQn2VnJUU5jE99KsxaSfiyMHV9Yt0aLVxs,87
+clustermesh-0.9.0.dist-info/entry_points.txt,sha256=_8bPIzZh7OV0Ep6aWDPKSqaDzGwMWZZ_ky8pSS2nkSQ,343
+clustermesh-0.9.0.dist-info/licenses/LICENSE,sha256=dhGDK8xXQf9uw6Qm9asXHSQvOoDSSvMegOthAN8iGlU,1073
+clustermesh-0.9.0.dist-info/RECORD,,

clustermesh-0.9.0.dist-info/WHEEL

@@ -0,0 +1,4 @@
+Wheel-Version: 1.0
+Generator: hatchling 1.30.1
+Root-Is-Purelib: true
+Tag: py3-none-any

clustermesh-0.9.0.dist-info/entry_points.txt

@@ -0,0 +1,10 @@
+[console_scripts]
+clustermesh = mesh.cli:main
+mesh-agent = mesh.agent.daemon:main
+mesh-bench = mesh.scheduler.benchmark:main
+mesh-dashboard = mesh.api.server:main
+mesh-demo = mesh.sim.demo:main
+mesh-driver = mesh.driver.server:main
+mesh-platform = mesh.api.server:main
+mesh-relay = mesh.meshvpn.relay:main_relay
+mesh-soak = mesh.sim.soak:main

clustermesh-0.9.0.dist-info/licenses/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 ClusterMesh Team
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

mesh/__init__.py

@@ -0,0 +1,7 @@
+"""ClusterMesh — Enterprise Compute Fabric."""
+
+from mesh.sdk import submit, task
+from mesh.execution import TaskContext
+
+__version__ = "0.9.0"
+__all__ = ["TaskContext", "submit", "task"]

mesh/agent/__init__.py

@@ -0,0 +1,7 @@
+"""ClusterMesh agent daemon."""
+
+from mesh.agent.config import AgentConfig
+from mesh.agent.daemon import AgentDaemon, main
+from mesh.agent.monitor import ResourceMonitor
+
+__all__ = ["AgentConfig", "AgentDaemon", "ResourceMonitor", "main"]

mesh/agent/client.py

@@ -0,0 +1,120 @@
+from __future__ import annotations
+
+import json
+import logging
+import time
+
+import grpc
+
+from mesh.agent.monitor import ResourceMonitor, ResourceSnapshot
+from mesh.proto import mesh_pb2, mesh_pb2_grpc
+
+logger = logging.getLogger(__name__)
+
+
+class DriverClient:
+    """gRPC client for agent → driver communication."""
+
+    def __init__(self, driver_address: str, node_id: str) -> None:
+        self.driver_address = driver_address
+        self.node_id = node_id
+        self._channel: grpc.Channel | None = None
+        self._stub: mesh_pb2_grpc.DriverStub | None = None
+        self.heartbeat_interval = 2.0
+
+    def connect(self) -> None:
+        self._channel = grpc.insecure_channel(self.driver_address)
+        self._stub = mesh_pb2_grpc.DriverStub(self._channel)
+
+    def close(self) -> None:
+        if self._channel:
+            self._channel.close()
+
+    @property
+    def stub(self) -> mesh_pb2_grpc.DriverStub:
+        if self._stub is None:
+            self.connect()
+        assert self._stub is not None
+        return self._stub
+
+    def register(
+        self,
+        hostname: str,
+        agent_address: str,
+        os_name: str,
+        location: str,
+        preemptible: bool,
+        snapshot: ResourceSnapshot,
+        libraries: list[str],
+    ) -> mesh_pb2.RegisterResponse:
+        req = mesh_pb2.RegisterRequest(
+            node_id=self.node_id,
+            hostname=hostname,
+            agent_address=agent_address,
+            os_name=os_name,
+            location=location,
+            preemptible=preemptible,
+            resources=self._resource_msg(snapshot),
+            libraries=libraries,
+        )
+        resp = self.stub.RegisterNode(req, timeout=10)
+        if resp.accepted:
+            self.heartbeat_interval = resp.heartbeat_interval_seconds or 2.0
+        return resp
+
+    def heartbeat(self) -> mesh_pb2.HeartbeatResponse:
+        req = mesh_pb2.HeartbeatRequest(node_id=self.node_id, timestamp=time.time())
+        return self.stub.Heartbeat(req, timeout=5)
+
+    def report_resources(self, snapshot: ResourceSnapshot) -> mesh_pb2.Ack:
+        msg = self._resource_msg(snapshot)
+        msg.node_id = self.node_id
+        return self.stub.ReportResources(msg, timeout=5)
+
+    def preemption_warning(self, cpu_utilization: float, reason: str) -> mesh_pb2.Ack:
+        req = mesh_pb2.PreemptionRequest(
+            node_id=self.node_id,
+            cpu_utilization=cpu_utilization,
+            reason=reason,
+        )
+        return self.stub.PreemptionWarning(req, timeout=5)
+
+    def task_progress(self, task_id: str, progress: float, total_work: float, state: dict) -> mesh_pb2.Ack:
+        req = mesh_pb2.TaskProgressReport(
+            task_id=task_id,
+            node_id=self.node_id,
+            progress=progress,
+            total_work=total_work,
+            state_json=json.dumps(state),
+        )
+        return self.stub.TaskProgress(req, timeout=5)
+
+    def task_complete(
+        self, task_id: str, success: bool, result: object = None, error: str = ""
+    ) -> mesh_pb2.Ack:
+        req = mesh_pb2.TaskCompleteReport(
+            task_id=task_id,
+            node_id=self.node_id,
+            success=success,
+            result_json=json.dumps(result) if result is not None else "",
+            error=error or "",
+        )
+        return self.stub.TaskComplete(req, timeout=5)
+
+    def _resource_msg(self, s: ResourceSnapshot) -> mesh_pb2.ResourceReport:
+        return mesh_pb2.ResourceReport(
+            node_id=self.node_id,
+            cpu_cores_total=s.cpu_cores_total,
+            cpu_cores_physical=s.cpu_cores_physical or s.cpu_cores_total,
+            cpu_cores_free=s.cpu_cores_free,
+            ram_gb_total=s.ram_gb_total,
+            ram_gb_free=s.ram_gb_free,
+            gpu_count=s.gpu_count,
+            vram_gb_free=s.vram_gb_free,
+            cuda_version=s.cuda_version or "",
+            network_gbps=s.network_gbps,
+            battery_pct=s.battery_pct or -1,
+            cpu_utilization=s.cpu_utilization,
+            user_active=s.user_active,
+            host_metrics_json=s.host_metrics_json or "",
+        )

mesh/agent/config.py

@@ -0,0 +1,28 @@
+from __future__ import annotations
+
+from dataclasses import dataclass
+import os
+
+
+@dataclass
+class AgentConfig:
+    node_id: str = ""
+    driver_address: str = "localhost:50050"
+    agent_address: str = "localhost:50051"
+    location: str = "default"
+    preemptible: bool = True
+    heartbeat_interval: float = 2.0
+    resource_interval: float = 1.0
+    cpu_preemption_threshold: float = 0.85
+
+    @classmethod
+    def from_env(cls) -> AgentConfig:
+        import socket
+        hostname = socket.gethostname()
+        return cls(
+            node_id=os.environ.get("MESH_NODE_ID", hostname),
+            driver_address=os.environ.get("MESH_DRIVER_ADDRESS", "localhost:50050"),
+            agent_address=os.environ.get("MESH_AGENT_ADDRESS", "localhost:50051"),
+            location=os.environ.get("MESH_LOCATION", "default"),
+            preemptible=os.environ.get("MESH_PREEMPTIBLE", "true").lower() == "true",
+        )