open-agents-ai 0.184.5 → 0.184.6
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +65 -0
- package/package.json +1 -1
package/README.md
CHANGED
|
@@ -109,6 +109,7 @@ The agent uses tools autonomously in a loop — reading errors, fixing code, and
|
|
|
109
109
|
- **Task templates** — specialized system prompts and tool recommendations for code, document, analysis, plan tasks
|
|
110
110
|
- **Inference capability scoring** — canirun.ai-style hardware assessment at first launch: memory/compute/speed scores, per-model compatibility matrix, recommended model selection
|
|
111
111
|
- **Auto-install everything** — first-run wizard auto-installs Ollama, curl, Python3, python3-venv with platform-aware package managers (apt, dnf, yum, pacman, apk, zypper, brew)
|
|
112
|
+
- **Sponsored inference** — `/sponsor` walks through a 5-step wizard to share your GPU with the world: select endpoints, choose banner animation (8 presets + AI-generated custom), set header message/links, configure transport (cloudflared/libp2p) + rate limits, and go live. Consumers discover sponsors via `/endpoint sponsor`. Secure proxy relay with per-IP rate limiting, daily token budgets, model allowlist, and concurrent request caps. Sponsor's raw API URL is never exposed. See [Sponsored Inference](#sponsored-inference--share-your-gpu-with-the-world) below
|
|
112
113
|
- **P2P inference network** — `/expose` local models or forward any `/endpoint` (Chutes, Groq, OpenRouter, etc.) through the libp2p P2P mesh. Passthrough mode (`/expose passthrough`) relays upstream API requests; `--loadbalance` distributes rate-limited token budgets across peers. `/expose config` provides an arrow-key menu for all settings. Gateway stats show budget remaining from `x-ratelimit-*` headers. Background daemon persists across OA restarts
|
|
113
114
|
- **P2P mesh networking** — `/p2p` with secret-safe variable placeholders (`{{OA_VAR_*}}`), trust tiers (LOCAL/TEE/VERIFIED/PUBLIC), WebSocket peer mesh, and inference routing with automatic secret redaction/injection
|
|
114
115
|
- **Secret vault** — `/secrets` manages API keys and credentials with AES-256-GCM encrypted persistence; secrets are automatically redacted before sending to untrusted inference peers and re-injected on response
|
|
@@ -1446,6 +1447,70 @@ nexus(action='budget_set', auto_approve_below='0.01') # Auto-approve micropayme
|
|
|
1446
1447
|
- All outbound messages scanned for key material before sending
|
|
1447
1448
|
- Keys NEVER appear in tool output, logs, or LLM context
|
|
1448
1449
|
|
|
1450
|
+
## Sponsored Inference — Share Your GPU With the World
|
|
1451
|
+
|
|
1452
|
+
Anyone running Open Agents can become an inference sponsor — sharing their local models (or forwarded cloud endpoints) with users worldwide through a secure, branded relay.
|
|
1453
|
+
|
|
1454
|
+
### For Sponsors: `/sponsor`
|
|
1455
|
+
|
|
1456
|
+
Run `/sponsor` to walk through the 5-step onboarding wizard:
|
|
1457
|
+
|
|
1458
|
+
```
|
|
1459
|
+
Step 1 → Select endpoints (auto-discovers local Ollama models + configured /endpoints)
|
|
1460
|
+
Step 2 → Choose banner animation (8 presets: wave, pulse, matrix, sparkle, radar, circuit, fire)
|
|
1461
|
+
or generate a custom animation with your local LLM
|
|
1462
|
+
Step 3 → Set header message + clickable link (displayed to consumers during inference)
|
|
1463
|
+
Step 4 → Configure transport (cloudflared tunnel and/or libp2p P2P mesh)
|
|
1464
|
+
+ rate limits (req/min, tokens/day, max concurrent, model allowlist)
|
|
1465
|
+
Step 5 → Review and Go Live
|
|
1466
|
+
```
|
|
1467
|
+
|
|
1468
|
+
**What happens under the hood:**
|
|
1469
|
+
- A secure reverse proxy starts on localhost, forwarding to your backend
|
|
1470
|
+
- Bearer token auth gate — unauthenticated requests rejected
|
|
1471
|
+
- Per-IP sliding window rate limiting + global daily token budget
|
|
1472
|
+
- Model allowlist enforcement (block models you don't want to share)
|
|
1473
|
+
- Token usage tracked from both Ollama and OpenAI response formats
|
|
1474
|
+
- Cloudflared tunnel creates a public HTTPS URL (or libp2p for decentralized relay)
|
|
1475
|
+
- Your raw API endpoint URL is **never exposed** — consumers only see the tunnel URL
|
|
1476
|
+
- Config persists to `.oa/sponsor/config.json` — survives restarts
|
|
1477
|
+
|
|
1478
|
+
**Management:**
|
|
1479
|
+
```bash
|
|
1480
|
+
/sponsor # Dashboard (when active) or wizard (when inactive)
|
|
1481
|
+
/sponsor status # Usage metrics: requests, tokens, active connections, unique users
|
|
1482
|
+
/sponsor pause # Stop serving, keep config
|
|
1483
|
+
/sponsor remove # Retire sponsorship entirely
|
|
1484
|
+
```
|
|
1485
|
+
|
|
1486
|
+
### For Consumers: `/endpoint sponsor`
|
|
1487
|
+
|
|
1488
|
+
Users who need inference can discover and connect to sponsors:
|
|
1489
|
+
|
|
1490
|
+
```bash
|
|
1491
|
+
/endpoint sponsor # Browse available sponsored endpoints
|
|
1492
|
+
# Arrow-key select → auto-configures as active endpoint
|
|
1493
|
+
/endpoint <url> --auth <key> # Direct connection with shared credentials
|
|
1494
|
+
```
|
|
1495
|
+
|
|
1496
|
+
When using sponsored inference, the sponsor's banner animation and message appear in your header area.
|
|
1497
|
+
|
|
1498
|
+
### Architecture
|
|
1499
|
+
|
|
1500
|
+
```
|
|
1501
|
+
Consumer OA ──→ Cloudflared Tunnel ──→ Sponsor Proxy ──→ Ollama/vLLM
|
|
1502
|
+
(HTTPS) (auth + rate limit) (local)
|
|
1503
|
+
│
|
|
1504
|
+
├─ Bearer token gate
|
|
1505
|
+
├─ Per-IP sliding window (N req/min)
|
|
1506
|
+
├─ Daily token budget tracking
|
|
1507
|
+
├─ Model allowlist enforcement
|
|
1508
|
+
├─ Concurrent request cap
|
|
1509
|
+
└─ Response header sanitization
|
|
1510
|
+
```
|
|
1511
|
+
|
|
1512
|
+
The tunnel fix uses debounced restarts with exponential cooldown (10s → 20s → 40s), stopping auto-restart after 3 consecutive failures to prevent Cloudflare rate limiting. Progress indicators emit every 5 seconds during startup, and specific error messages are shown for common failure modes (ENOENT, port conflict, 429, DNS).
|
|
1513
|
+
|
|
1449
1514
|
## Dream Mode — Creative Idle Exploration
|
|
1450
1515
|
|
|
1451
1516
|
When you're not actively tasking the agent, Dream Mode lets it creatively explore your codebase and generate improvement proposals autonomously. The system models real human sleep architecture with four stages per cycle:
|
package/package.json
CHANGED