superbrain-distributed-sdk 0.2.0 → 0.2.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +17 -14
- package/package.json +1 -1
package/README.md
CHANGED
|
@@ -90,22 +90,25 @@ const received = JSON.parse((await clientB.read(ctxPtr, 0, 0)).toString());
|
|
|
90
90
|
## 📊 Architecture
|
|
91
91
|
|
|
92
92
|
```
|
|
93
|
-
Your LLM App
|
|
94
|
-
|
|
95
|
-
│
|
|
96
|
-
│
|
|
97
|
-
│
|
|
98
|
-
│
|
|
99
|
-
│
|
|
100
|
-
│
|
|
101
|
-
|
|
102
|
-
|
|
103
|
-
|
|
93
|
+
Your LLM App (SDK) SuperBrain Cluster
|
|
94
|
+
┌─────────────────────────┐
|
|
95
|
+
│ allocate(size) ────────┼──(1)──► Coordinator (Control Plane)
|
|
96
|
+
│ free(ptr_id) ────────┼──(5)──► Maps pointers → node locations
|
|
97
|
+
│ │ │
|
|
98
|
+
│ │ (2) pointer map returned
|
|
99
|
+
│ │ │
|
|
100
|
+
│ write(ptr_id, data) ───┼──(3)──►┌───────▼──────────────┐
|
|
101
|
+
│ read(ptr_id) ────────┼──(4)──►│ Memory Nodes │
|
|
102
|
+
└─────────────────────────┘ │ (Data Plane) │
|
|
103
|
+
│ 1TB+ pooled RAM │
|
|
104
|
+
└──────────────────────┘
|
|
105
|
+
|
|
106
|
+
CRITICAL: write() and read() bypass the Coordinator entirely.
|
|
107
|
+
They stream directly to the Memory Nodes over gRPC for maximum throughput (~100 MB/s).
|
|
108
|
+
The Coordinator is ONLY in the control path (allocate + free).
|
|
104
109
|
```
|
|
105
110
|
|
|
106
|
-
**
|
|
107
|
-
**Data plane** (Memory Nodes): Direct gRPC streams for maximum throughput.
|
|
108
|
-
**Client**: Talks to nodes directly after allocation — Coordinator is never in the hot path.
|
|
111
|
+
**Why this matters**: The Coordinator never becomes a bottleneck for your data. 1000 agents can read/write simultaneously to different nodes without fighting for the same control plane.
|
|
109
112
|
|
|
110
113
|
---
|
|
111
114
|
|