open-agents-ai 0.103.36 → 0.103.37

package/README.md

@@ -72,7 +72,8 @@ The agent uses tools autonomously in a loop — reading errors, fixing code, and
 - **Task templates** — specialized system prompts and tool recommendations for code, document, analysis, plan tasks
 - **Inference capability scoring** — canirun.ai-style hardware assessment at first launch: memory/compute/speed scores, per-model compatibility matrix, recommended model selection
 - **Auto-install everything** — first-run wizard auto-installs Ollama, curl, Python3, python3-venv with platform-aware package managers (apt, dnf, yum, pacman, apk, zypper, brew)
-- **P2P inference network** — `/p2p` mesh networking with secret-safe variable placeholders (`{{OA_VAR_*}}`), trust tiers (LOCAL/TEE/VERIFIED/PUBLIC), WebSocket peer mesh, and inference routing with automatic secret redaction/injection
+- **P2P inference network** — `/expose` local models or forward any `/endpoint` (Chutes, Groq, OpenRouter, etc.) through the libp2p P2P mesh. Passthrough mode (`/expose passthrough`) relays upstream API requests; `--loadbalance` distributes rate-limited token budgets across peers. `/expose config` provides an arrow-key menu for all settings. Gateway stats show budget remaining from `x-ratelimit-*` headers. Background daemon persists across OA restarts
+- **P2P mesh networking** — `/p2p` with secret-safe variable placeholders (`{{OA_VAR_*}}`), trust tiers (LOCAL/TEE/VERIFIED/PUBLIC), WebSocket peer mesh, and inference routing with automatic secret redaction/injection
 - **Secret vault** — `/secrets` manages API keys and credentials with AES-256-GCM encrypted persistence; secrets are automatically redacted before sending to untrusted inference peers and re-injected on response
 - **Auto-expanding context** — detects RAM/VRAM and creates an optimized model variant on first run
 - **Mid-task steering** — type while the agent works to add context without interrupting
@@ -277,7 +278,7 @@ On startup and `/model` switch, Open Agents detects your RAM/VRAM and creates an
 | `aiwg_workflow` | Execute AIWG commands and workflows |
 | **Nexus P2P & x402 Payments** | |
 | `nexus` | Decentralized agent networking — connect, rooms, DMs, peer discovery, invoke capabilities, metering, trust/blocking, IPFS storage |
-| `nexus:expose` | Expose local Ollama models as metered inference capabilities with OpenRouter-based pricing |
+| `nexus:expose` | Expose local models or forward upstream endpoints as metered inference capabilities with pricing, passthrough, and load balancing |
 | `nexus:wallet_create` | Generate secp256k1/EVM wallet (Base mainnet USDC) with AES-256-GCM encryption + x402-wallet.key |
 | `nexus:spend` | Sign EIP-3009 USDC TransferWithAuthorization — budget-checked, gasless for payer |
 | `nexus:remote_infer` | Route inference to a remote peer's model — auto-discovers peers, budget-checks, invokes, returns result |
@@ -956,8 +957,12 @@ The TUI features an animated multilingual phrase carousel, live metrics bar with
 | `/expose ollama` | Expose local inference via libp2p (default) |
 | `/expose ollama --tunnel` | Expose via cloudflared tunnel |
 | `/expose ollama --full` | Allow full Ollama API access (pull/delete) |
-| `/expose stop` | Stop the expose gateway |
-| `/expose status` | Show expose usage stats |
+| `/expose passthrough` | Forward configured `/endpoint` through libp2p P2P |
+| `/expose forward --loadbalance` | Passthrough with distributed rate-limit budget |
+| `/expose config` | Interactive expose configuration menu (arrow-key nav) |
+| `/expose stop` | Stop all expose gateways |
+| `/expose stop --libp2p` | Stop libp2p gateway only |
+| `/expose status` | Show expose usage stats + budget |
 | **Metrics & Updates** | |
 | `/cost` | Show token cost breakdown for the current session |
 | `/score` | Show inference capability scorecard (memory, compute, speed, model compatibility) |
@@ -1526,6 +1531,86 @@ Expose your local Ollama models to the decentralized nexus network, or consume a
 
 Transport: DHT + mDNS + NATS relay + circuit relay. Auth key is auto-generated and required for all requests. System metrics (CPU/GPU/memory) are available to consumers via the `system_metrics` capability. Without `--full`, destructive Ollama API endpoints (`/api/pull`, `/api/delete`, `/api/create`) are blocked.
 
+#### Passthrough & Forward Mode
+
+Forward any configured `/endpoint` (Chutes, Groq, OpenRouter, Together, vLLM, etc.) through the libp2p P2P network. Your node becomes a relay — peers connect to you via libp2p and you forward their requests to your upstream API:
+
+```bash
+# Set your upstream endpoint first
+/endpoint https://llm.chutes.ai --auth cpk_your_key_here
+
+# Expose it through P2P — peers discover and invoke via libp2p
+/expose passthrough
+# or equivalently:
+/expose forward
+
+# With load balancing: distributes daily token budget across peers
+/expose passthrough --loadbalance
+```
+
+**How it works:**
+- Your node registers inference capabilities on the P2P mesh using your upstream endpoint's models
+- Remote peers discover and invoke these capabilities via libp2p streams (DHT/mDNS/NATS)
+- Requests are forwarded to your upstream API, responses streamed back to the peer
+- The libp2p daemon persists in the background — it survives OA restarts and remains discoverable even when the TUI is closed
+- When you reopen OA, it reconnects to the existing daemon and resumes stats tracking
+
+**Rate limit distribution (`--loadbalance`):**
+- Captures `x-ratelimit-remaining-tokens` and `x-ratelimit-limit-tokens` headers from upstream API responses
+- Displays remaining token budget in the gateway stats under "Budget"
+- Distributes the total daily token budget across connected peers proportionally
+- Prevents any single peer from exhausting the shared budget
+
+#### Budget & Rate Limit Monitoring
+
+When exposing an upstream endpoint that returns rate-limit headers (most cloud providers do), the gateway stats automatically track your remaining budget:
+
+```
+  Expose Gateway Stats (libp2p passthrough)
+  Status             active
+  Transport          libp2p (passthrough)
+  Peer ID            12D3KooWSzC75QX...
+  Uptime             2h 15m
+  Total requests     847
+  Tokens in          125.4K
+  Tokens out         892.1K
+  Budget             1.2M/10M (12% left)
+
+  Models
+  qwen3.5-4b                    412 reqs  in:52.3K out:401.2K
+  qwen3.5-9b                    435 reqs  in:73.1K out:490.9K
+
+  Active Peers (3)
+  12D3KooWSwaCi1Jg...
+    Session: 1h 45m  Last seen: now  Requests: 523
+    Tokens: in:82.1K out:612.4K
+    · qwen3.5-4b 312req 401.2Ktok
+    · qwen3.5-9b 211req 293.3Ktok
+  12D3KooWKnCgxx7D...
+    Session: 45m  Last seen: 2m ago  Requests: 324
+    Tokens: in:43.3K out:279.7K
+    · qwen3.5-9b 224req 197.6Ktok
+```
+
+Internal capabilities (`system_metrics`, `__list_capabilities`) are hidden from all displays — both the full stats view and the compact status bar one-liner.
+
+#### `/expose config` — Interactive Configuration
+
+Arrow-key navigable menu for all expose settings:
+
+```bash
+/expose config
+```
+
+Shows options to:
+- View current stats
+- Stop all gateways
+- Start Ollama (libp2p or tunnel)
+- Start passthrough (with or without load balancing)
+- Start vLLM
+
+Uses the same arrow-key navigation pattern as `/model` and `/endpoint` selection.
+
 ### Endpoint Cascade Failover
 
 When you've used multiple endpoints, the agent automatically builds a failover cascade. If the primary endpoint fails with transient errors (502, connection refused, timeout), it transparently switches to the next endpoint that has the same model — then periodically probes the primary to return when it recovers:

package/dist/index.js

@@ -26371,10 +26371,15 @@ function renderSlashHelp() {
     ["/nexus", "Show nexus P2P network status (or connect/disconnect/rooms)"],
     ["/nexus connect", "Connect to the agent mesh network"],
     ["/nexus wallet", "Show wallet address and x402 payment status"],
-    ["/expose <backend>", "Share local inference via cloudflared tunnel"],
-    ["/expose <backend> --key", "Share with auto-generated auth key"],
-    ["/expose status", "Show gateway stats (requests, models, errors)"],
-    ["/expose stop", "Stop the expose gateway"],
+    ["/expose <backend>", "Expose local inference via libp2p (default)"],
+    ["/expose <backend> --tunnel", "Expose via cloudflared tunnel"],
+    ["/expose passthrough", "Forward configured /endpoint through libp2p P2P"],
+    ["/expose forward --loadbalance", "Passthrough with distributed rate-limit budget"],
+    ["/expose config", "Interactive expose configuration menu"],
+    ["/expose status", "Show gateway stats (requests, models, budget)"],
+    ["/expose stop", "Stop all expose gateways"],
+    ["/expose stop --tunnel", "Stop tunnel gateway only"],
+    ["/expose stop --libp2p", "Stop libp2p gateway only"],
     ["/p2p start", "Join the P2P agent mesh network"],
     ["/p2p status", "Show mesh peers and rooms"],
     ["/p2p stop", "Leave the mesh network"],

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "open-agents-ai",
-  "version": "0.103.36",
+  "version": "0.103.37",
   "description": "AI coding agent powered by open-source models (Ollama/vLLM) — interactive TUI with agentic tool-calling loop",
   "type": "module",
   "main": "./dist/index.js",