@kotro-labs/proxy-engine 0.3.0 → 0.5.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/README.md
CHANGED
|
@@ -4,12 +4,12 @@
|
|
|
4
4
|
<img src="media/icon.png" alt="Kotro" width="72" height="72" />
|
|
5
5
|
</p>
|
|
6
6
|
|
|
7
|
-
npm distribution for the [Kotro Proxy Engine](https://github.com/kotro-labs/kotro-proxy-engine) — a local AI reverse proxy with streaming
|
|
7
|
+
npm distribution for the [Kotro Proxy Engine](https://github.com/kotro-labs/kotro-proxy-engine) — a local AI reverse proxy with a streaming prompt-state cache, PII redaction, and context compression for OpenAI and Anthropic SDKs.
|
|
8
8
|
|
|
9
9
|
## Features
|
|
10
10
|
|
|
11
11
|
- **Zero-config startup** — precompiled binary with no dependencies
|
|
12
|
-
- **
|
|
12
|
+
- **Prompt-state SSE cache** — exact-match replay on repeat prompts; `X-Kotro-Cache: HIT` on cache hits
|
|
13
13
|
- **Enterprise failover** — dynamic routing on 429/503 upstream errors
|
|
14
14
|
- **Operator dashboard** — local UI for observability (`http://127.0.0.1:9090/dashboard`)
|
|
15
15
|
- **Isolated telemetry** — `/metrics` binds to loopback by default, separate from LLM traffic
|
|
@@ -54,7 +54,7 @@ Operator → 127.0.0.1:9090/dashboard (telemetry — loopback only by defaul
|
|
|
54
54
|
|----------|---------|---------|
|
|
55
55
|
| `KOTRO_LISTEN_ADDR` | `:8080` | Proxy bind address |
|
|
56
56
|
| `KOTRO_UPSTREAM_URL` | `http://127.0.0.1:9000` | Provider base URL |
|
|
57
|
-
| `KOTRO_ENABLE_CACHE` | `true` |
|
|
57
|
+
| `KOTRO_ENABLE_CACHE` | `true` | Prompt-state SSE cache |
|
|
58
58
|
| `KOTRO_ENABLE_REDACTION` | `true` | PII guardrail |
|
|
59
59
|
| `KOTRO_ENABLE_COMPRESSION` | `true` | Context block dedup |
|
|
60
60
|
| `KOTRO_TRUST_UPSTREAM_GATEWAY` | `false` | Honor `X-Tenant-ID` only from trusted proxy CIDRs |
|
|
Binary file
|
|
Binary file
|
|
Binary file
|
|
Binary file
|