wse-client 1.4.0 → 1.4.1

package/README.md

@@ -20,7 +20,7 @@ Building real-time features between React and Python is painful. You need WebSoc
 
 Install `wse-server` on your backend, `wse-client` on your frontend (React or Python). Everything works immediately: auto-reconnection, message encryption, sequence ordering, offline queues, health monitoring. No configuration required for the defaults. Override what you need.
 
-The engine is Rust-accelerated via PyO3. Up to **14M msg/s** JSON, **30M msg/s** compressed — benchmarked on AMD EPYC 7502P (32 cores) with the Rust stress-test client ([results](docs/BENCHMARKS_RUST_CLIENT.md)). Sub-millisecond connection latency (0.38ms median) with Rust JWT authentication.
+The engine is Rust-accelerated via PyO3. **14M msg/s** JSON, **30M msg/s** binary, **2.1M deliveries/s** fan-out, **500K concurrent connections** with zero message loss -- benchmarked on AMD EPYC 7502P. Multi-instance horizontal scaling via Redis pub/sub. Sub-millisecond latency (0.38 ms) with Rust JWT authentication.
 
 ---
 
@@ -141,7 +141,7 @@ Connection quality scoring (excellent / good / fair / poor), latency tracking, j
 
 ### Scaling
 
-Redis pub/sub for multi-process fan-out. Run multiple server workers behind a load balancer. Clients get messages from any worker. Fire-and-forget delivery with sub-millisecond latency.
+Redis pub/sub for multi-instance fan-out. Run N server instances behind a load balancer -- publish on any instance, all subscribers receive the message regardless of which instance they're connected to. Pipelined PUBLISH (up to 64 per round-trip), circuit breaker, exponential backoff with jitter, dead letter queue for failed messages. Capacity scales linearly with instances: tested up to 1.04M deliveries/s per instance.
 
 ### Rust Performance
 
@@ -169,7 +169,8 @@ Compression, sequencing, filtering, rate limiting, and the WebSocket server itse
 | **Snapshot Provider** | Protocol for initial state delivery. Implement `get_snapshot(user_id, topics)` and clients receive current state immediately on subscribe -- no waiting for the next publish cycle. |
 | **Circuit Breaker** | Three-state machine (CLOSED / OPEN / HALF_OPEN). Sliding-window failure tracking. Automatic recovery probes. Prevents cascade failures when downstream services are unhealthy. |
 | **Message Categories** | `S` (snapshot), `U` (update), `WSE` (system). Category prefixing for client-side routing and filtering. |
-| **PubSub Bus** | Redis pub/sub with PSUBSCRIBE pattern matching. orjson fast-path serialization. Custom JSON encoder for UUID, datetime, Decimal. Non-blocking handler invocation. |
+| **Multi-Instance Orchestration** | Horizontal scaling via Redis pub/sub. Publish on any instance, all subscribers receive the message. Pipelined PUBLISH (64 commands/batch, 3 retries), circuit breaker (10-fail threshold, 60s reset), exponential backoff with jitter, dead letter queue (1000-entry ring buffer). 1.04M deliveries/s per instance, linear scaling with N instances. |
+| **PubSub Bus** | Redis pub/sub with PSUBSCRIBE pattern matching. Glob wildcard topic routing (`user:*:events`). orjson fast-path serialization. Non-blocking handler invocation. |
 | **Pluggable Security** | `EncryptionProvider` and `TokenProvider` protocols. Built-in: AES-GCM-256 with ECDH P-256 key exchange, HMAC-SHA256 signing, selective message signing. Rust-accelerated crypto (SHA-256, HMAC, AES-GCM, ECDH). |
 | **Rust JWT Authentication** | HS256 JWT validation in Rust during the WebSocket handshake. Zero GIL acquisition on the connection critical path. 0.01ms decode (85x faster than Python). Cookie extraction and `server_ready` sent from Rust before Python runs. |
 | **Lock-Free Server Queries** | `get_connection_count()` uses `AtomicUsize` — zero GIL, zero blocking, safe to call from async Python handlers. No channel round-trip to the tokio runtime. |
@@ -210,31 +211,69 @@ Compression, sequencing, filtering, rate limiting, and the WebSocket server itse
 
 ## Performance
 
-Rust-accelerated engine via PyO3. Benchmarked on localhost.
-
-### Apple M2 (8 cores)
-
-| Metric | Single Client | 10 Workers |
-|--------|--------------|------------|
-| **Sustained throughput (JSON)** | 113,000 msg/s | **356,000 msg/s** |
-| **Sustained throughput (MsgPack)** | 116,000 msg/s | **345,000 msg/s** |
-| **Burst throughput (JSON)** | 106,000 msg/s | **488,000 msg/s** |
-| **Connection latency** | **0.53 ms** median | 2.20 ms median |
-| **Ping RTT** | **0.09 ms** median | 0.18 ms median |
-| **64KB messages** | 43K msg/s (2.7 GB/s) | **164K msg/s (10.2 GB/s)** |
-
-### AMD EPYC 7502P (64 cores, 128 GB)
-
-| Metric | 64 Workers | 128 Workers |
-|--------|-----------|-------------|
-| **Sustained throughput (JSON)** | **2,045,000 msg/s** | 2,013,000 msg/s |
-| **Sustained throughput (MsgPack)** | **2,072,000 msg/s** | 2,041,000 msg/s |
-| **Burst throughput (JSON)** | 1,557,000 msg/s | **1,836,000 msg/s** |
-| **Connection latency** | 2.60 ms median | 2.96 ms median |
-| **Ping RTT** | 0.26 ms median | 0.41 ms median |
-| **64KB messages** | **256K msg/s (16.0 GB/s)** | 238K msg/s (14.9 GB/s) |
-
-See [BENCHMARKS.md](docs/BENCHMARKS.md) for full results and methodology.
+Rust-accelerated engine via PyO3. AMD EPYC 7502P (32 cores, 128 GB), Ubuntu 24.04, localhost.
+
+### Highlights
+
+| Metric | Value | Details |
+|--------|-------|---------|
+| **Peak throughput** | **14.2M msg/s** | JSON, Rust client, 500 connections |
+| **Peak binary** | **30M msg/s** | MsgPack/compressed, Rust client |
+| **Fan-out broadcast** | **2.1M deliveries/s** | Single-instance, zero message loss |
+| **Max connections** | **500,000** | Zero errors, zero gaps at every tier |
+| **Connection latency** | **0.38 ms** median | Rust JWT auth in handshake |
+| **Accept rate** | **15,020 conn/s** | Sustained connection establishment |
+| **Memory per conn** | **4.4 KB** | Rust core static overhead |
+
+### Point-to-Point (Rust Native Client)
+
+| Payload | Throughput | Bandwidth |
+|---------|-----------|-----------|
+| 64 bytes | **19.4M msg/s** | 1.2 GB/s |
+| 256 bytes | **12.5M msg/s** | 3.1 GB/s |
+| 1 KB | **10.3M msg/s** | 10.0 GB/s |
+| 16 KB | **1.2M msg/s** | **19.9 GB/s** |
+| 64 KB | **284K msg/s** | **18.2 GB/s** |
+
+### Point-to-Point (Python Multi-Process, 64 Workers)
+
+| Metric | JSON | MsgPack |
+|--------|------|---------|
+| **Sustained** | **2,045,000 msg/s** | **2,072,000 msg/s** |
+| **Burst** | 1,557,000 msg/s | 1,836,000 msg/s |
+| **64KB messages** | 256K msg/s (16.0 GB/s) | -- |
+| **Ping RTT** | 0.26 ms median | -- |
+
+### Point-to-Point (TypeScript/Node.js, 64 Processes)
+
+| Format | Throughput | Scaling |
+|--------|-----------|---------|
+| JSON | **7.0M msg/s** | 97% linear |
+| MsgPack | **7.9M msg/s** | +13% over JSON |
+
+### Fan-out Broadcast (Single-Instance)
+
+Server broadcasts to N subscribers. **Zero message loss at every tier.**
+
+| Subscribers | Deliveries/s | Bandwidth | p50 Latency |
+|-------------|-------------|-----------|-------------|
+| 10 | **2.1M** | 295 MB/s | 0.005 ms |
+| 1,000 | 1.4M | 185 MB/s | -- |
+| 10,000 | 1.2M | 163 MB/s | -- |
+| 100,000 | 1.7M | 234 MB/s | -- |
+| **500,000** | **1.4M** | 128 MB/s | -- |
+
+### Rust Acceleration vs Python
+
+| Component | Speedup | Rust | Python |
+|-----------|---------|------|--------|
+| JWT decode (HS256) | **85x** | 10 us | 850 us |
+| Msgpack parsing | **~50x** | -- | -- |
+| Rate limiter | **40x** | -- | -- |
+| HMAC-SHA256 | **22x** | -- | -- |
+| Compression (zlib) | **6.7x** | -- | -- |
+
+See benchmark docs for full results: [Overview](docs/BENCHMARKS.md) | [Rust Client](docs/BENCHMARKS_RUST_CLIENT.md) | [TypeScript Client](docs/BENCHMARKS_TS_CLIENT.md) | [Python Client](docs/BENCHMARKS_PYTHON_CLIENT.md) | [Fan-out](docs/BENCHMARKS_FANOUT.md)
 
 ---
 

package/dist/constants.d.ts

@@ -1,5 +1,5 @@
 export declare const WS_PROTOCOL_VERSION = 1;
-export declare const WS_CLIENT_VERSION = "1.3.9";
+export declare const WS_CLIENT_VERSION = "1.4.1";
 export declare const HEARTBEAT_INTERVAL = 15000;
 export declare const IDLE_TIMEOUT = 40000;
 export declare const CONNECTION_TIMEOUT = 10000;

package/dist/constants.js

@@ -5,7 +5,7 @@
 // Protocol Constants
 // ---------------------------------------------------------------------------
 export const WS_PROTOCOL_VERSION = 1;
-export const WS_CLIENT_VERSION = '1.3.9';
+export const WS_CLIENT_VERSION = '1.4.1';
 // ---------------------------------------------------------------------------
 // Connection Constants
 // ---------------------------------------------------------------------------

package/dist/index.d.ts

@@ -21,5 +21,5 @@ export type { OfflineQueueConfig } from './services/OfflineQueue';
 export { EventHandlers } from './handlers/EventHandlers';
 export { registerAllHandlers } from './handlers/index';
 export * from './constants';
-export declare const WSE_VERSION = "1.3.9";
+export declare const WSE_VERSION = "1.4.1";
 //# sourceMappingURL=index.d.ts.map

package/dist/index.js

@@ -44,5 +44,5 @@ export * from './constants';
 // ---------------------------------------------------------------------------
 // Version Info
 // ---------------------------------------------------------------------------
-export const WSE_VERSION = '1.3.9';
+export const WSE_VERSION = '1.4.1';
 //# sourceMappingURL=index.js.map

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "wse-client",
-  "version": "1.4.0",
+  "version": "1.4.1",
   "description": "WSE (WebSocket Engine) React client. Type-safe hooks, auto-reconnect, offline queue, E2E encryption.",
   "main": "dist/index.js",
   "module": "dist/index.js",