macfleet 2.1.1__tar.gz → 2.2.0__tar.gz

macfleet-2.2.0/PKG-INFO

@@ -0,0 +1,233 @@
+Metadata-Version: 2.2
+Name: macfleet
+Version: 2.2.0
+Summary: Pool Apple Silicon Macs for distributed compute and ML training
+Author: MacFleet Contributors
+License: MIT
+Project-URL: Homepage, https://github.com/vikranthreddimasu/MacFleet
+Project-URL: Documentation, https://github.com/vikranthreddimasu/MacFleet#readme
+Project-URL: Repository, https://github.com/vikranthreddimasu/MacFleet
+Project-URL: Issues, https://github.com/vikranthreddimasu/MacFleet/issues
+Keywords: distributed,machine-learning,apple-silicon,mps,mlx,pytorch,training,gpu-pooling,data-parallel
+Classifier: Development Status :: 3 - Alpha
+Classifier: Intended Audience :: Developers
+Classifier: Intended Audience :: Science/Research
+Classifier: Operating System :: MacOS
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
+Requires-Python: >=3.11
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: zeroconf>=0.131.0
+Requires-Dist: rich>=13.0.0
+Requires-Dist: click>=8.1.0
+Requires-Dist: numpy>=1.24.0
+Requires-Dist: msgpack>=1.0.0
+Requires-Dist: cloudpickle>=3.0.0
+Requires-Dist: cryptography>=42.0.0
+Requires-Dist: pydantic>=2.0.0
+Requires-Dist: qrcode>=7.0
+Provides-Extra: torch
+Requires-Dist: torch>=2.1.0; extra == "torch"
+Provides-Extra: mlx
+Requires-Dist: mlx>=0.5.0; extra == "mlx"
+Provides-Extra: yaml
+Requires-Dist: pyyaml>=6.0; extra == "yaml"
+Provides-Extra: all
+Requires-Dist: torch>=2.1.0; extra == "all"
+Requires-Dist: mlx>=0.5.0; extra == "all"
+Requires-Dist: pyyaml>=6.0; extra == "all"
+Provides-Extra: dev
+Requires-Dist: pytest>=7.0.0; extra == "dev"
+Requires-Dist: pytest-asyncio>=0.23.0; extra == "dev"
+Requires-Dist: ruff>=0.3.0; extra == "dev"
+Requires-Dist: mypy>=1.8.0; extra == "dev"
+Requires-Dist: pytest-cov>=4.1.0; extra == "dev"
+Requires-Dist: hypothesis>=6.0.0; extra == "dev"
+Provides-Extra: docs
+Requires-Dist: mkdocs-material>=9.5.0; extra == "docs"
+Requires-Dist: mkdocs>=1.5.0; extra == "docs"
+
+# MacFleet
+
+**Distributed ML training on Apple Silicon.** Pool your Macs into a
+cluster in 5 seconds, run PyTorch or MLX across them, keep zero cloud
+spend.
+
+```
+  macfleet join              macfleet join            macfleet join
+ ┌──────────────┐          ┌──────────────┐          ┌──────────────┐
+ │  MacBook Pro │◄────────►│  MacBook Air │◄────────►│  Mac Studio  │
+ │  M4 Pro      │  WiFi /  │  M4          │  WiFi /  │  M4 Ultra    │
+ │  16 GPU cores│  ETH /   │  10 GPU cores│  ETH /   │  60 GPU cores│
+ │  48 GB RAM   │  TB4     │  16 GB RAM   │  TB4     │  192 GB RAM  │
+ └──────────────┘          └──────────────┘          └──────────────┘
+         ▲                          ▲                          ▲
+         └──────────────────────────┴──────────────────────────┘
+                        Ring AllReduce (gradient sync)
+```
+
+## Why MacFleet
+
+Apple Silicon is everywhere. Every researcher, student, and founder
+has a serious ML machine on their desk. What's missing is a way to
+team them up.
+
+- **PyTorch on MPS has no distributed story.** NCCL is CUDA-only.
+  Gloo is broken on MPS. Single-GPU-on-MPS only.
+- **MLX is native** but most researchers' code is still PyTorch.
+- **Cloud is expensive** and the iteration loop is slow.
+
+MacFleet fills that gap. Any two Macs on the same WiFi can pool their
+GPUs. Security is baked in (HMAC + TLS). Adaptive compression keeps
+WiFi viable for gradient sync. The framework-agnostic core lets you
+pick your engine (`torch` or `mlx`) per call.
+
+## Install
+
+```bash
+pip install macfleet                    # core
+pip install "macfleet[torch]"           # + PyTorch
+pip install "macfleet[mlx]"             # + Apple MLX
+pip install "macfleet[all]"             # everything
+```
+
+## The 5-minute path
+
+**1. Scaffold a starter script:**
+
+```bash
+macfleet quickstart
+# Wrote my_macfleet_demo.py
+```
+
+**2. Run it:**
+
+```bash
+python my_macfleet_demo.py
+# Pool world size: 1
+# Training done: {'loss': 0.31, 'epochs': 10, 'time_sec': 1.4}
+```
+
+**3. Pair a second Mac:**
+
+On Mac #1:
+
+```bash
+macfleet join --bootstrap
+# prints a QR code + pairing URL, also copies URL to pasteboard
+```
+
+On Mac #2 (same Apple ID → Handoff pasteboard sync):
+
+```bash
+macfleet pair && macfleet join
+```
+
+Or: scan the QR from Mac #1 with your iPhone camera. Tap the link.
+Done.
+
+**4. Set `enable_pool_distributed=True` in your script** — training now
+spans both Macs.
+
+## Features
+
+- **Dual engine** — PyTorch (MPS) and Apple MLX, same pool infrastructure
+- **Zero config** — mDNS discovery, no coordinator setup, no config files
+- **Safe task dispatch** — `@macfleet.task` registry + msgpack args
+  (no cloudpickle on the wire)
+- **Adaptive compression** — auto-selects TopK + FP16 based on link
+  speed (locally; sparse-on-wire arrives in v2.3, see TODOS.md
+  Issue 3)
+- **Heterogeneous scheduling** — faster Macs get bigger batches,
+  adjusts for thermal throttling
+- **Secure by default** — auto-generated fleet tokens, HMAC mutual
+  auth, mandatory TLS, per-IP rate limiting
+- **Framework-agnostic core** — communication layer uses only numpy,
+  never imports torch or mlx
+
+## Security
+
+Security is on by default. The first `macfleet join` auto-generates a
+fleet token at `~/.macfleet/token` (mode 0600). See the
+[security reference](docs/reference/security.md) for the full threat
+model.
+
+Short version:
+
+- **Fleet isolation** — nodes with different tokens can't see each
+  other on the network (mDNS service type is scoped by fleet hash)
+- **Mutual authentication** — HMAC-SHA256 challenge-response on every
+  connection, plus signed hardware profile exchange (v2.2)
+- **Encryption** — TLS mandatory whenever auth is enabled
+- **Rate limiting** — 5 failed auth attempts per IP → 5-minute ban,
+  exponential backoff in between (heartbeat read timeout tightened to
+  1s to stop slowloris)
+- **No cloudpickle over the wire** — `@macfleet.task` routes
+  registered callables by name, not by pickled closures
+
+## CLI
+
+```
+macfleet join         Join the pool (auto-discovers peers)
+macfleet pair         Read a pairing URL from pasteboard / stdin
+macfleet status       Show pool members and network info
+macfleet info         Show local hardware profile
+macfleet train        Run training (demo or custom script)
+macfleet bench        Benchmark compute, network, or allreduce
+macfleet doctor       System health check
+macfleet quickstart   Write a starter training script
+```
+
+## How it works
+
+MacFleet uses **data parallelism**: every Mac holds a full copy of the
+model, trains on a weighted portion of the data, and averages
+gradients via Ring AllReduce after each step.
+
+The compression layer (TopK + FP16) is applied locally before the
+allreduce; v2.2 transmits dense gradients on the wire (sparse
+allreduce is on the v2.3 roadmap as Issue 3). The bandwidth savings
+table below describes the **target** ratios once sparse-on-wire ships:
+
+| Network       | Compression     | 100 MB gradients (v2.3 target) |
+|---------------|-----------------|--------------------------------|
+| Thunderbolt 4 | None            | 100 MB                         |
+| Ethernet      | TopK 10% + FP16 | ~5 MB                          |
+| WiFi          | TopK 1% + FP16  | ~500 KB                        |
+
+## Requirements
+
+- macOS 14+ with Apple Silicon (M1/M2/M3/M4)
+- Python 3.11+
+- PyTorch 2.1+ or MLX 0.5+ (optional, pick your engine)
+
+## Documentation
+
+Full docs: run `mkdocs serve` after `pip install "macfleet[docs]"`, or
+read the Markdown source in `docs/`:
+
+- [Quickstart](docs/getting-started/quickstart.md)
+- [Pairing flows](docs/getting-started/pairing.md)
+- [Pool.train API](docs/guides/train.md)
+- [@macfleet.task](docs/guides/tasks.md)
+- [Dashboard](docs/guides/dashboard.md)
+- [Security](docs/reference/security.md)
+- [Wire protocol](docs/reference/protocol.md)
+
+## Development
+
+```bash
+git clone https://github.com/vikranthreddimasu/MacFleet.git
+cd MacFleet
+pip install -e ".[dev,all]"
+make test       # 447 tests
+make lint       # ruff + mypy
+```
+
+## License
+
+MIT

macfleet-2.2.0/README.md

@@ -0,0 +1,180 @@
+# MacFleet
+
+**Distributed ML training on Apple Silicon.** Pool your Macs into a
+cluster in 5 seconds, run PyTorch or MLX across them, keep zero cloud
+spend.
+
+```
+  macfleet join              macfleet join            macfleet join
+ ┌──────────────┐          ┌──────────────┐          ┌──────────────┐
+ │  MacBook Pro │◄────────►│  MacBook Air │◄────────►│  Mac Studio  │
+ │  M4 Pro      │  WiFi /  │  M4          │  WiFi /  │  M4 Ultra    │
+ │  16 GPU cores│  ETH /   │  10 GPU cores│  ETH /   │  60 GPU cores│
+ │  48 GB RAM   │  TB4     │  16 GB RAM   │  TB4     │  192 GB RAM  │
+ └──────────────┘          └──────────────┘          └──────────────┘
+         ▲                          ▲                          ▲
+         └──────────────────────────┴──────────────────────────┘
+                        Ring AllReduce (gradient sync)
+```
+
+## Why MacFleet
+
+Apple Silicon is everywhere. Every researcher, student, and founder
+has a serious ML machine on their desk. What's missing is a way to
+team them up.
+
+- **PyTorch on MPS has no distributed story.** NCCL is CUDA-only.
+  Gloo is broken on MPS. Single-GPU-on-MPS only.
+- **MLX is native** but most researchers' code is still PyTorch.
+- **Cloud is expensive** and the iteration loop is slow.
+
+MacFleet fills that gap. Any two Macs on the same WiFi can pool their
+GPUs. Security is baked in (HMAC + TLS). Adaptive compression keeps
+WiFi viable for gradient sync. The framework-agnostic core lets you
+pick your engine (`torch` or `mlx`) per call.
+
+## Install
+
+```bash
+pip install macfleet                    # core
+pip install "macfleet[torch]"           # + PyTorch
+pip install "macfleet[mlx]"             # + Apple MLX
+pip install "macfleet[all]"             # everything
+```
+
+## The 5-minute path
+
+**1. Scaffold a starter script:**
+
+```bash
+macfleet quickstart
+# Wrote my_macfleet_demo.py
+```
+
+**2. Run it:**
+
+```bash
+python my_macfleet_demo.py
+# Pool world size: 1
+# Training done: {'loss': 0.31, 'epochs': 10, 'time_sec': 1.4}
+```
+
+**3. Pair a second Mac:**
+
+On Mac #1:
+
+```bash
+macfleet join --bootstrap
+# prints a QR code + pairing URL, also copies URL to pasteboard
+```
+
+On Mac #2 (same Apple ID → Handoff pasteboard sync):
+
+```bash
+macfleet pair && macfleet join
+```
+
+Or: scan the QR from Mac #1 with your iPhone camera. Tap the link.
+Done.
+
+**4. Set `enable_pool_distributed=True` in your script** — training now
+spans both Macs.
+
+## Features
+
+- **Dual engine** — PyTorch (MPS) and Apple MLX, same pool infrastructure
+- **Zero config** — mDNS discovery, no coordinator setup, no config files
+- **Safe task dispatch** — `@macfleet.task` registry + msgpack args
+  (no cloudpickle on the wire)
+- **Adaptive compression** — auto-selects TopK + FP16 based on link
+  speed (locally; sparse-on-wire arrives in v2.3, see TODOS.md
+  Issue 3)
+- **Heterogeneous scheduling** — faster Macs get bigger batches,
+  adjusts for thermal throttling
+- **Secure by default** — auto-generated fleet tokens, HMAC mutual
+  auth, mandatory TLS, per-IP rate limiting
+- **Framework-agnostic core** — communication layer uses only numpy,
+  never imports torch or mlx
+
+## Security
+
+Security is on by default. The first `macfleet join` auto-generates a
+fleet token at `~/.macfleet/token` (mode 0600). See the
+[security reference](docs/reference/security.md) for the full threat
+model.
+
+Short version:
+
+- **Fleet isolation** — nodes with different tokens can't see each
+  other on the network (mDNS service type is scoped by fleet hash)
+- **Mutual authentication** — HMAC-SHA256 challenge-response on every
+  connection, plus signed hardware profile exchange (v2.2)
+- **Encryption** — TLS mandatory whenever auth is enabled
+- **Rate limiting** — 5 failed auth attempts per IP → 5-minute ban,
+  exponential backoff in between (heartbeat read timeout tightened to
+  1s to stop slowloris)
+- **No cloudpickle over the wire** — `@macfleet.task` routes
+  registered callables by name, not by pickled closures
+
+## CLI
+
+```
+macfleet join         Join the pool (auto-discovers peers)
+macfleet pair         Read a pairing URL from pasteboard / stdin
+macfleet status       Show pool members and network info
+macfleet info         Show local hardware profile
+macfleet train        Run training (demo or custom script)
+macfleet bench        Benchmark compute, network, or allreduce
+macfleet doctor       System health check
+macfleet quickstart   Write a starter training script
+```
+
+## How it works
+
+MacFleet uses **data parallelism**: every Mac holds a full copy of the
+model, trains on a weighted portion of the data, and averages
+gradients via Ring AllReduce after each step.
+
+The compression layer (TopK + FP16) is applied locally before the
+allreduce; v2.2 transmits dense gradients on the wire (sparse
+allreduce is on the v2.3 roadmap as Issue 3). The bandwidth savings
+table below describes the **target** ratios once sparse-on-wire ships:
+
+| Network       | Compression     | 100 MB gradients (v2.3 target) |
+|---------------|-----------------|--------------------------------|
+| Thunderbolt 4 | None            | 100 MB                         |
+| Ethernet      | TopK 10% + FP16 | ~5 MB                          |
+| WiFi          | TopK 1% + FP16  | ~500 KB                        |
+
+## Requirements
+
+- macOS 14+ with Apple Silicon (M1/M2/M3/M4)
+- Python 3.11+
+- PyTorch 2.1+ or MLX 0.5+ (optional, pick your engine)
+
+## Documentation
+
+Full docs: run `mkdocs serve` after `pip install "macfleet[docs]"`, or
+read the Markdown source in `docs/`:
+
+- [Quickstart](docs/getting-started/quickstart.md)
+- [Pairing flows](docs/getting-started/pairing.md)
+- [Pool.train API](docs/guides/train.md)
+- [@macfleet.task](docs/guides/tasks.md)
+- [Dashboard](docs/guides/dashboard.md)
+- [Security](docs/reference/security.md)
+- [Wire protocol](docs/reference/protocol.md)
+
+## Development
+
+```bash
+git clone https://github.com/vikranthreddimasu/MacFleet.git
+cd MacFleet
+pip install -e ".[dev,all]"
+make test       # 447 tests
+make lint       # ruff + mypy
+```
+
+## License
+
+MIT

{macfleet-2.1.1 → macfleet-2.2.0}/macfleet/__init__.py

@@ -6,11 +6,24 @@ Zero-config discovery. Framework-agnostic engines. Adaptive networking.
 """
 
 import logging
+from typing import TYPE_CHECKING
 
-__version__ = "2.1.1"
+__version__ = "2.2.0"
 
 logging.getLogger(__name__).addHandler(logging.NullHandler())
 
+# Type checkers see real symbols here; runtime uses __getattr__ below to
+# keep heavy framework imports off the cold path.
+if TYPE_CHECKING:
+    from macfleet.compute.models import RemoteTaskError, TaskFuture
+    from macfleet.compute.registry import task
+    from macfleet.engines.mlx_engine import MLXEngine
+    from macfleet.engines.torch_engine import TorchEngine
+    from macfleet.sdk.decorators import distributed
+    from macfleet.sdk.pool import Pool
+    from macfleet.sdk.train import train
+    from macfleet.training.data_parallel import DataParallel
+
 
 def __getattr__(name: str):
     """Lazy imports for heavy modules (avoid importing torch/mlx at module load)."""
@@ -38,6 +51,10 @@ def __getattr__(name: str):
     if name == "RemoteTaskError":
         from macfleet.compute.models import RemoteTaskError
         return RemoteTaskError
+    # v2.2 PR 7: @macfleet.task decorator
+    if name == "task":
+        from macfleet.compute.registry import task
+        return task
     raise AttributeError(f"module 'macfleet' has no attribute {name!r}")
 
 
@@ -51,4 +68,5 @@ __all__ = [
     "MLXEngine",
     "TaskFuture",
     "RemoteTaskError",
+    "task",
 ]