circle-ir-ai 2.56.0 → 2.57.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +55 -0
- package/dist/llm/adaptive-concurrency.d.ts +15 -0
- package/dist/llm/adaptive-concurrency.d.ts.map +1 -1
- package/dist/llm/adaptive-concurrency.js +23 -0
- package/dist/llm/adaptive-concurrency.js.map +1 -1
- package/dist/llm/adaptive-verify.d.ts +108 -0
- package/dist/llm/adaptive-verify.d.ts.map +1 -0
- package/dist/llm/adaptive-verify.js +252 -0
- package/dist/llm/adaptive-verify.js.map +1 -0
- package/dist/llm/ax-client.d.ts.map +1 -1
- package/dist/llm/ax-client.js +10 -0
- package/dist/llm/ax-client.js.map +1 -1
- package/dist/llm/config.d.ts.map +1 -1
- package/dist/llm/config.js +10 -4
- package/dist/llm/config.js.map +1 -1
- package/dist/llm/verification.d.ts.map +1 -1
- package/dist/llm/verification.js +97 -29
- package/dist/llm/verification.js.map +1 -1
- package/package.json +2 -2
package/CHANGELOG.md
CHANGED
|
@@ -5,6 +5,61 @@ All notable changes to this project will be documented in this file.
|
|
|
5
5
|
The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
|
|
6
6
|
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
|
|
7
7
|
|
|
8
|
+
## [2.57.0] - 2026-07-24
|
|
9
|
+
|
|
10
|
+
### Added — adaptive verifyBatch sizing + client-timeout back-off (cognium-ai#244)
|
|
11
|
+
|
|
12
|
+
Local frontier-class models (e.g. Qwen3-Coder-Next MLX on Apple Silicon) are
|
|
13
|
+
**prefill-bound** on verify: a verifyBatch call is ~4000 prompt tokens → ~25
|
|
14
|
+
output tokens, so ~99.7% of wall time is context ingestion. The old 60s
|
|
15
|
+
per-call timeout dropped ~94% of these mid-prefill on cache-cold sweeps
|
|
16
|
+
(client `AbortError`, `BrokenPipeError` server-side). Reliability on a
|
|
17
|
+
cache-cold hutool sweep went from **94% → <1% call failure** with the changes
|
|
18
|
+
below.
|
|
19
|
+
|
|
20
|
+
- **`LLM_TIMEOUT_MS` default 60000 → 180000.** The one default-behaviour
|
|
21
|
+
change. Cloud fast-models finish in <5s so the higher ceiling never fires
|
|
22
|
+
(behaviour unchanged); slow local models are no longer dropped mid-prefill.
|
|
23
|
+
Per-phase overrides (`LLM_TIMEOUT_MS_{DISCOVERY,VERIFICATION,COMPONENT}`) and
|
|
24
|
+
the universal `LLM_TIMEOUT_MS` still take precedence.
|
|
25
|
+
- **AIMD `onClientTimeout()`** (`adaptive-concurrency.ts`). A client-side
|
|
26
|
+
timeout on a *healthy* endpoint is the queue-depth analog of a 429, so it
|
|
27
|
+
now triggers the same multiplicative concurrency decrease (shared cooldown
|
|
28
|
+
collapses mixed 429/timeout bursts into one back-off). Additive — only fires
|
|
29
|
+
on timeouts, no effect on the healthy path.
|
|
30
|
+
- **Adaptive verify window + chunk** (new `adaptive-verify.ts`). Two AIMD
|
|
31
|
+
controllers, both **starting at the historical defaults so healthy/cloud
|
|
32
|
+
behaviour is unchanged** and only adapting *down* under pressure:
|
|
33
|
+
- `AdaptiveVerifyWindow` — shrinks `LLM_VERIFY_WINDOW_LINES` (start 80,
|
|
34
|
+
floor 40) when a call runs hot (≥150s) or fails; grows +5 on a clean
|
|
35
|
+
streak. The window is both the dominant prefill cost AND the dominant
|
|
36
|
+
accuracy driver, so the floor of 40 is a precision guardrail.
|
|
37
|
+
- `AdaptiveVerifyChunk` — shrinks `LLM_MAX_PAIRS_PER_CHUNK` (start 20,
|
|
38
|
+
floor 3) on failure; grows +1 on a streak.
|
|
39
|
+
- **Window↔chunk coupling:** as the window shrinks, each pair costs fewer
|
|
40
|
+
tokens, so chunk grows inversely (window 80→40 ⇒ chunk headroom ~2×) to
|
|
41
|
+
keep the token budget full and throughput up. Bounded by the token budget
|
|
42
|
+
and a HARD_MAX of 40 pairs.
|
|
43
|
+
- **New env overrides:** `LLM_VERIFY_WINDOW_{MIN,MAX}`,
|
|
44
|
+
`LLM_VERIFY_LATENCY_THRESHOLD_MS`, `LLM_MAX_PAIRS_PER_CHUNK_{MIN,MAX}`.
|
|
45
|
+
|
|
46
|
+
Regression: full suite **1499 pass / 3 skip** green. Static benchmarks
|
|
47
|
+
unchanged on circle-ir 3.192.0 — OWASP 100.0% (1415/1415), Juliet 100.0%
|
|
48
|
+
(243/243), SecuriBench 97.7% TPR / 6.7% FPR. All changes are additive to the
|
|
49
|
+
LLM-verify path; static analysis is untouched. Rollback: set
|
|
50
|
+
`LLM_TIMEOUT_MS=60000`, `LLM_VERIFY_WINDOW_MAX=80`, `LLM_MAX_PAIRS_PER_CHUNK_MAX=20`
|
|
51
|
+
to pin pre-2.57 behaviour.
|
|
52
|
+
|
|
53
|
+
## [2.56.1] - 2026-07-20
|
|
54
|
+
|
|
55
|
+
### Changed — bump circle-ir 3.175.0 → 3.176.0
|
|
56
|
+
|
|
57
|
+
Routine engine refresh; no layer API/behavior change. Full suite (1487) green
|
|
58
|
+
against 3.176.0. LLM01 app-code prompt-injection surface re-verified live
|
|
59
|
+
(`prompt_injection` sink + unsanitized flow still fire → adapter emits HIGH).
|
|
60
|
+
Fleet consumers follow to `^2.56.1` + circle-ir 3.176.0 so npm dedupes to a
|
|
61
|
+
single circle-ir 3.176.0.
|
|
62
|
+
|
|
8
63
|
## [2.56.0] - 2026-07-20
|
|
9
64
|
|
|
10
65
|
### Added — robust app-code prompt-injection recall in the trust layer (cognium-ai#211/#233)
|
|
@@ -50,6 +50,21 @@ export declare class AdaptiveConcurrency {
|
|
|
50
50
|
* Returns the (possibly unchanged) new concurrency.
|
|
51
51
|
*/
|
|
52
52
|
onRateLimited(): number;
|
|
53
|
+
/**
|
|
54
|
+
* cognium-ai#244 — report a client-side timeout (AbortError after the
|
|
55
|
+
* per-call timeout expires with no response). Symmetric to `onRateLimited`
|
|
56
|
+
* — same multiplicative decrease + shared cooldown window — because a
|
|
57
|
+
* client-timeout on a healthy endpoint is the queue-depth analog of a
|
|
58
|
+
* 429: the server is too slow to serve our request rate, so the right
|
|
59
|
+
* response is to reduce concurrency and probe back up on success.
|
|
60
|
+
*
|
|
61
|
+
* Sharing `lastDecreaseAt` with `onRateLimited` means a burst that mixes
|
|
62
|
+
* 429s and timeouts still halves only once per cooldown, matching the
|
|
63
|
+
* "one overload event" semantics.
|
|
64
|
+
*
|
|
65
|
+
* Returns the (possibly unchanged) new concurrency.
|
|
66
|
+
*/
|
|
67
|
+
onClientTimeout(): number;
|
|
53
68
|
/**
|
|
54
69
|
* Report a successful call. After `increaseAfterSuccesses` consecutive
|
|
55
70
|
* successes (and outside a cooldown), additively increase by 1 toward
|
|
@@ -1 +1 @@
|
|
|
1
|
-
{"version":3,"file":"adaptive-concurrency.d.ts","sourceRoot":"","sources":["../../src/llm/adaptive-concurrency.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;;GAeG;AAEH,MAAM,WAAW,yBAAyB;IACxC,yCAAyC;IACzC,KAAK,EAAE,MAAM,CAAC;IACd,4DAA4D;IAC5D,GAAG,EAAE,MAAM,CAAC;IACZ,mDAAmD;IACnD,GAAG,EAAE,MAAM,CAAC;IACZ,iDAAiD;IACjD,cAAc,EAAE,MAAM,CAAC;IACvB,2DAA2D;IAC3D,sBAAsB,EAAE,MAAM,CAAC;IAC/B;;;;OAIG;IACH,UAAU,EAAE,MAAM,CAAC;CACpB;AAED,eAAO,MAAM,uBAAuB,EAAE,yBAOrC,CAAC;AAMF,qBAAa,mBAAmB;IAC9B,OAAO,CAAC,GAAG,CAA4B;IACvC,OAAO,CAAC,GAAG,CAAe;IAC1B,OAAO,CAAC,QAAQ,CAAS;IACzB,OAAO,CAAC,aAAa,CAAK;IAC1B,OAAO,CAAC,cAAc,CAAa;gBAGjC,MAAM,GAAE,OAAO,CAAC,yBAAyB,CAAM,EAC/C,GAAG,GAAE,MAAM,MAAiB;IAU9B,kCAAkC;IAClC,IAAI,OAAO,IAAI,MAAM,CAEpB;IAED,sCAAsC;IACtC,IAAI,MAAM,IAAI,QAAQ,CAAC,yBAAyB,CAAC,CAEhD;IAED;;;;OAIG;IACH,aAAa,IAAI,MAAM;IAYvB;;;;OAIG;IACH,SAAS,IAAI,MAAM;CAcpB;AAED;;;;GAIG;AACH,wBAAgB,uBAAuB,CACrC,GAAG,EAAE,MAAM,GAAG,SAAS,GACtB;IAAE,IAAI,EAAE,UAAU,CAAA;CAAE,GAAG;IAAE,IAAI,EAAE,OAAO,CAAC;IAAC,KAAK,EAAE,MAAM,CAAA;CAAE,GAAG,IAAI,CAOhE;AAED,+DAA+D;AAC/D,wBAAgB,qBAAqB,CACnC,GAAG,GAAE,MAAM,CAAC,MAAM,EAAE,MAAM,GAAG,SAAS,CAAe,GACpD,OAAO,CAAC,yBAAyB,CAAC,CAcpC"}
|
|
1
|
+
{"version":3,"file":"adaptive-concurrency.d.ts","sourceRoot":"","sources":["../../src/llm/adaptive-concurrency.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;;GAeG;AAEH,MAAM,WAAW,yBAAyB;IACxC,yCAAyC;IACzC,KAAK,EAAE,MAAM,CAAC;IACd,4DAA4D;IAC5D,GAAG,EAAE,MAAM,CAAC;IACZ,mDAAmD;IACnD,GAAG,EAAE,MAAM,CAAC;IACZ,iDAAiD;IACjD,cAAc,EAAE,MAAM,CAAC;IACvB,2DAA2D;IAC3D,sBAAsB,EAAE,MAAM,CAAC;IAC/B;;;;OAIG;IACH,UAAU,EAAE,MAAM,CAAC;CACpB;AAED,eAAO,MAAM,uBAAuB,EAAE,yBAOrC,CAAC;AAMF,qBAAa,mBAAmB;IAC9B,OAAO,CAAC,GAAG,CAA4B;IACvC,OAAO,CAAC,GAAG,CAAe;IAC1B,OAAO,CAAC,QAAQ,CAAS;IACzB,OAAO,CAAC,aAAa,CAAK;IAC1B,OAAO,CAAC,cAAc,CAAa;gBAGjC,MAAM,GAAE,OAAO,CAAC,yBAAyB,CAAM,EAC/C,GAAG,GAAE,MAAM,MAAiB;IAU9B,kCAAkC;IAClC,IAAI,OAAO,IAAI,MAAM,CAEpB;IAED,sCAAsC;IACtC,IAAI,MAAM,IAAI,QAAQ,CAAC,yBAAyB,CAAC,CAEhD;IAED;;;;OAIG;IACH,aAAa,IAAI,MAAM;IAYvB;;;;;;;;;;;;;OAaG;IACH,eAAe,IAAI,MAAM;IAYzB;;;;OAIG;IACH,SAAS,IAAI,MAAM;CAcpB;AAED;;;;GAIG;AACH,wBAAgB,uBAAuB,CACrC,GAAG,EAAE,MAAM,GAAG,SAAS,GACtB;IAAE,IAAI,EAAE,UAAU,CAAA;CAAE,GAAG;IAAE,IAAI,EAAE,OAAO,CAAC;IAAC,KAAK,EAAE,MAAM,CAAA;CAAE,GAAG,IAAI,CAOhE;AAED,+DAA+D;AAC/D,wBAAgB,qBAAqB,CACnC,GAAG,GAAE,MAAM,CAAC,MAAM,EAAE,MAAM,GAAG,SAAS,CAAe,GACpD,OAAO,CAAC,yBAAyB,CAAC,CAcpC"}
|
|
@@ -63,6 +63,29 @@ export class AdaptiveConcurrency {
|
|
|
63
63
|
this._current = Math.max(this.cfg.min, Math.floor(this._current * this.cfg.decreaseFactor));
|
|
64
64
|
return this._current;
|
|
65
65
|
}
|
|
66
|
+
/**
|
|
67
|
+
* cognium-ai#244 — report a client-side timeout (AbortError after the
|
|
68
|
+
* per-call timeout expires with no response). Symmetric to `onRateLimited`
|
|
69
|
+
* — same multiplicative decrease + shared cooldown window — because a
|
|
70
|
+
* client-timeout on a healthy endpoint is the queue-depth analog of a
|
|
71
|
+
* 429: the server is too slow to serve our request rate, so the right
|
|
72
|
+
* response is to reduce concurrency and probe back up on success.
|
|
73
|
+
*
|
|
74
|
+
* Sharing `lastDecreaseAt` with `onRateLimited` means a burst that mixes
|
|
75
|
+
* 429s and timeouts still halves only once per cooldown, matching the
|
|
76
|
+
* "one overload event" semantics.
|
|
77
|
+
*
|
|
78
|
+
* Returns the (possibly unchanged) new concurrency.
|
|
79
|
+
*/
|
|
80
|
+
onClientTimeout() {
|
|
81
|
+
this.successStreak = 0;
|
|
82
|
+
const t = this.now();
|
|
83
|
+
if (t - this.lastDecreaseAt < this.cfg.cooldownMs)
|
|
84
|
+
return this._current;
|
|
85
|
+
this.lastDecreaseAt = t;
|
|
86
|
+
this._current = Math.max(this.cfg.min, Math.floor(this._current * this.cfg.decreaseFactor));
|
|
87
|
+
return this._current;
|
|
88
|
+
}
|
|
66
89
|
/**
|
|
67
90
|
* Report a successful call. After `increaseAfterSuccesses` consecutive
|
|
68
91
|
* successes (and outside a cooldown), additively increase by 1 toward
|
|
@@ -1 +1 @@
|
|
|
1
|
-
{"version":3,"file":"adaptive-concurrency.js","sourceRoot":"","sources":["../../src/llm/adaptive-concurrency.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;;GAeG;AAqBH,MAAM,CAAC,MAAM,uBAAuB,GAA8B;IAChE,KAAK,EAAE,CAAC;IACR,GAAG,EAAE,CAAC;IACN,GAAG,EAAE,EAAE;IACP,cAAc,EAAE,GAAG;IACnB,sBAAsB,EAAE,EAAE;IAC1B,UAAU,EAAE,IAAI;CACjB,CAAC;AAEF,SAAS,KAAK,CAAC,CAAS,EAAE,EAAU,EAAE,EAAU;IAC9C,OAAO,IAAI,CAAC,GAAG,CAAC,EAAE,EAAE,IAAI,CAAC,GAAG,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,CAAC;AACvC,CAAC;AAED,MAAM,OAAO,mBAAmB;IACtB,GAAG,CAA4B;IAC/B,GAAG,CAAe;IAClB,QAAQ,CAAS;IACjB,aAAa,GAAG,CAAC,CAAC;IAClB,cAAc,GAAG,CAAC,QAAQ,CAAC;IAEnC,YACE,SAA6C,EAAE,EAC/C,MAAoB,IAAI,CAAC,GAAG;QAE5B,IAAI,CAAC,GAAG,GAAG,EAAE,GAAG,uBAAuB,EAAE,GAAG,MAAM,EAAE,CAAC;QACrD,wEAAwE;QACxE,IAAI,IAAI,CAAC,GAAG,CAAC,GAAG,GAAG,CAAC;YAAE,IAAI,CAAC,GAAG,CAAC,GAAG,GAAG,CAAC,CAAC;QACvC,IAAI,IAAI,CAAC,GAAG,CAAC,GAAG,GAAG,IAAI,CAAC,GAAG,CAAC,GAAG;YAAE,IAAI,CAAC,GAAG,CAAC,GAAG,GAAG,IAAI,CAAC,GAAG,CAAC,GAAG,CAAC;QAC7D,IAAI,CAAC,GAAG,GAAG,GAAG,CAAC;QACf,IAAI,CAAC,QAAQ,GAAG,KAAK,CAAC,IAAI,CAAC,GAAG,CAAC,KAAK,EAAE,IAAI,CAAC,GAAG,CAAC,GAAG,EAAE,IAAI,CAAC,GAAG,CAAC,GAAG,CAAC,CAAC;IACpE,CAAC;IAED,kCAAkC;IAClC,IAAI,OAAO;QACT,OAAO,IAAI,CAAC,QAAQ,CAAC;IACvB,CAAC;IAED,sCAAsC;IACtC,IAAI,MAAM;QACR,OAAO,IAAI,CAAC,GAAG,CAAC;IAClB,CAAC;IAED;;;;OAIG;IACH,aAAa;QACX,IAAI,CAAC,aAAa,GAAG,CAAC,CAAC;QACvB,MAAM,CAAC,GAAG,IAAI,CAAC,GAAG,EAAE,CAAC;QACrB,IAAI,CAAC,GAAG,IAAI,CAAC,cAAc,GAAG,IAAI,CAAC,GAAG,CAAC,UAAU;YAAE,OAAO,IAAI,CAAC,QAAQ,CAAC;QACxE,IAAI,CAAC,cAAc,GAAG,CAAC,CAAC;QACxB,IAAI,CAAC,QAAQ,GAAG,IAAI,CAAC,GAAG,CACtB,IAAI,CAAC,GAAG,CAAC,GAAG,EACZ,IAAI,CAAC,KAAK,CAAC,IAAI,CAAC,QAAQ,GAAG,IAAI,CAAC,GAAG,CAAC,cAAc,CAAC,CACpD,CAAC;QACF,OAAO,IAAI,CAAC,QAAQ,CAAC;IACvB,CAAC;IAED;;;;OAIG;IACH,SAAS;QACP,MAAM,CAAC,GAAG,IAAI,CAAC,GAAG,EAAE,CAAC;QACrB,qEAAqE;QACrE,IAAI,CAAC,GAAG,IAAI,CAAC,cAAc,GAAG,IAAI,CAAC,GAAG,CAAC,UAAU;YAAE,OAAO,IAAI,CAAC,QAAQ,CAAC;QACxE,IAAI,CAAC,aAAa,EAAE,CAAC;QACrB,IACE,IAAI,CAAC,aAAa,IAAI,IAAI,CAAC,GAAG,CAAC,sBAAsB;YACrD,IAAI,CAAC,QAAQ,GAAG,IAAI,CAAC,GAAG,CAAC,GAAG,EAC5B,CAAC;YACD,IAAI,CAAC,QAAQ,GAAG,IAAI,CAAC,GAAG,CAAC,IAAI,CAAC,GAAG,CAAC,GAAG,EAAE,IAAI,CAAC,QAAQ,GAAG,CAAC,CAAC,CAAC;YAC1D,IAAI,CAAC,aAAa,GAAG,CAAC,CAAC;QACzB,CAAC;QACD,OAAO,IAAI,CAAC,QAAQ,CAAC;IACvB,CAAC;CACF;AAED;;;;GAIG;AACH,MAAM,UAAU,uBAAuB,CACrC,GAAuB;IAEvB,IAAI,GAAG,KAAK,SAAS;QAAE,OAAO,IAAI,CAAC;IACnC,MAAM,OAAO,GAAG,GAAG,CAAC,IAAI,EAAE,CAAC,WAAW,EAAE,CAAC;IACzC,IAAI,OAAO,KAAK,MAAM,IAAI,OAAO,KAAK,IAAI;QAAE,OAAO,EAAE,IAAI,EAAE,UAAU,EAAE,CAAC;IACxE,MAAM,CAAC,GAAG,QAAQ,CAAC,OAAO,EAAE,EAAE,CAAC,CAAC;IAChC,IAAI,MAAM,CAAC,QAAQ,CAAC,CAAC,CAAC,IAAI,CAAC,GAAG,CAAC;QAAE,OAAO,EAAE,IAAI,EAAE,OAAO,EAAE,KAAK,EAAE,CAAC,EAAE,CAAC;IACpE,OAAO,IAAI,CAAC;AACd,CAAC;AAED,+DAA+D;AAC/D,MAAM,UAAU,qBAAqB,CACnC,MAA0C,OAAO,CAAC,GAAG;IAErD,MAAM,GAAG,GAAG,CAAC,CAAqB,EAAsB,EAAE;QACxD,IAAI,CAAC,KAAK,SAAS;YAAE,OAAO,SAAS,CAAC;QACtC,MAAM,CAAC,GAAG,QAAQ,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC;QAC1B,OAAO,MAAM,CAAC,QAAQ,CAAC,CAAC,CAAC,IAAI,CAAC,GAAG,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,SAAS,CAAC;IACrD,CAAC,CAAC;IACF,MAAM,GAAG,GAAuC,EAAE,CAAC;IACnD,MAAM,KAAK,GAAG,GAAG,CAAC,GAAG,CAAC,qBAAqB,CAAC,CAAC;IAC7C,MAAM,GAAG,GAAG,GAAG,CAAC,GAAG,CAAC,mBAAmB,CAAC,CAAC;IACzC,MAAM,GAAG,GAAG,GAAG,CAAC,GAAG,CAAC,mBAAmB,CAAC,CAAC;IACzC,IAAI,KAAK,KAAK,SAAS;QAAE,GAAG,CAAC,KAAK,GAAG,KAAK,CAAC;IAC3C,IAAI,GAAG,KAAK,SAAS;QAAE,GAAG,CAAC,GAAG,GAAG,GAAG,CAAC;IACrC,IAAI,GAAG,KAAK,SAAS;QAAE,GAAG,CAAC,GAAG,GAAG,GAAG,CAAC;IACrC,OAAO,GAAG,CAAC;AACb,CAAC"}
|
|
1
|
+
{"version":3,"file":"adaptive-concurrency.js","sourceRoot":"","sources":["../../src/llm/adaptive-concurrency.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;;GAeG;AAqBH,MAAM,CAAC,MAAM,uBAAuB,GAA8B;IAChE,KAAK,EAAE,CAAC;IACR,GAAG,EAAE,CAAC;IACN,GAAG,EAAE,EAAE;IACP,cAAc,EAAE,GAAG;IACnB,sBAAsB,EAAE,EAAE;IAC1B,UAAU,EAAE,IAAI;CACjB,CAAC;AAEF,SAAS,KAAK,CAAC,CAAS,EAAE,EAAU,EAAE,EAAU;IAC9C,OAAO,IAAI,CAAC,GAAG,CAAC,EAAE,EAAE,IAAI,CAAC,GAAG,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,CAAC;AACvC,CAAC;AAED,MAAM,OAAO,mBAAmB;IACtB,GAAG,CAA4B;IAC/B,GAAG,CAAe;IAClB,QAAQ,CAAS;IACjB,aAAa,GAAG,CAAC,CAAC;IAClB,cAAc,GAAG,CAAC,QAAQ,CAAC;IAEnC,YACE,SAA6C,EAAE,EAC/C,MAAoB,IAAI,CAAC,GAAG;QAE5B,IAAI,CAAC,GAAG,GAAG,EAAE,GAAG,uBAAuB,EAAE,GAAG,MAAM,EAAE,CAAC;QACrD,wEAAwE;QACxE,IAAI,IAAI,CAAC,GAAG,CAAC,GAAG,GAAG,CAAC;YAAE,IAAI,CAAC,GAAG,CAAC,GAAG,GAAG,CAAC,CAAC;QACvC,IAAI,IAAI,CAAC,GAAG,CAAC,GAAG,GAAG,IAAI,CAAC,GAAG,CAAC,GAAG;YAAE,IAAI,CAAC,GAAG,CAAC,GAAG,GAAG,IAAI,CAAC,GAAG,CAAC,GAAG,CAAC;QAC7D,IAAI,CAAC,GAAG,GAAG,GAAG,CAAC;QACf,IAAI,CAAC,QAAQ,GAAG,KAAK,CAAC,IAAI,CAAC,GAAG,CAAC,KAAK,EAAE,IAAI,CAAC,GAAG,CAAC,GAAG,EAAE,IAAI,CAAC,GAAG,CAAC,GAAG,CAAC,CAAC;IACpE,CAAC;IAED,kCAAkC;IAClC,IAAI,OAAO;QACT,OAAO,IAAI,CAAC,QAAQ,CAAC;IACvB,CAAC;IAED,sCAAsC;IACtC,IAAI,MAAM;QACR,OAAO,IAAI,CAAC,GAAG,CAAC;IAClB,CAAC;IAED;;;;OAIG;IACH,aAAa;QACX,IAAI,CAAC,aAAa,GAAG,CAAC,CAAC;QACvB,MAAM,CAAC,GAAG,IAAI,CAAC,GAAG,EAAE,CAAC;QACrB,IAAI,CAAC,GAAG,IAAI,CAAC,cAAc,GAAG,IAAI,CAAC,GAAG,CAAC,UAAU;YAAE,OAAO,IAAI,CAAC,QAAQ,CAAC;QACxE,IAAI,CAAC,cAAc,GAAG,CAAC,CAAC;QACxB,IAAI,CAAC,QAAQ,GAAG,IAAI,CAAC,GAAG,CACtB,IAAI,CAAC,GAAG,CAAC,GAAG,EACZ,IAAI,CAAC,KAAK,CAAC,IAAI,CAAC,QAAQ,GAAG,IAAI,CAAC,GAAG,CAAC,cAAc,CAAC,CACpD,CAAC;QACF,OAAO,IAAI,CAAC,QAAQ,CAAC;IACvB,CAAC;IAED;;;;;;;;;;;;;OAaG;IACH,eAAe;QACb,IAAI,CAAC,aAAa,GAAG,CAAC,CAAC;QACvB,MAAM,CAAC,GAAG,IAAI,CAAC,GAAG,EAAE,CAAC;QACrB,IAAI,CAAC,GAAG,IAAI,CAAC,cAAc,GAAG,IAAI,CAAC,GAAG,CAAC,UAAU;YAAE,OAAO,IAAI,CAAC,QAAQ,CAAC;QACxE,IAAI,CAAC,cAAc,GAAG,CAAC,CAAC;QACxB,IAAI,CAAC,QAAQ,GAAG,IAAI,CAAC,GAAG,CACtB,IAAI,CAAC,GAAG,CAAC,GAAG,EACZ,IAAI,CAAC,KAAK,CAAC,IAAI,CAAC,QAAQ,GAAG,IAAI,CAAC,GAAG,CAAC,cAAc,CAAC,CACpD,CAAC;QACF,OAAO,IAAI,CAAC,QAAQ,CAAC;IACvB,CAAC;IAED;;;;OAIG;IACH,SAAS;QACP,MAAM,CAAC,GAAG,IAAI,CAAC,GAAG,EAAE,CAAC;QACrB,qEAAqE;QACrE,IAAI,CAAC,GAAG,IAAI,CAAC,cAAc,GAAG,IAAI,CAAC,GAAG,CAAC,UAAU;YAAE,OAAO,IAAI,CAAC,QAAQ,CAAC;QACxE,IAAI,CAAC,aAAa,EAAE,CAAC;QACrB,IACE,IAAI,CAAC,aAAa,IAAI,IAAI,CAAC,GAAG,CAAC,sBAAsB;YACrD,IAAI,CAAC,QAAQ,GAAG,IAAI,CAAC,GAAG,CAAC,GAAG,EAC5B,CAAC;YACD,IAAI,CAAC,QAAQ,GAAG,IAAI,CAAC,GAAG,CAAC,IAAI,CAAC,GAAG,CAAC,GAAG,EAAE,IAAI,CAAC,QAAQ,GAAG,CAAC,CAAC,CAAC;YAC1D,IAAI,CAAC,aAAa,GAAG,CAAC,CAAC;QACzB,CAAC;QACD,OAAO,IAAI,CAAC,QAAQ,CAAC;IACvB,CAAC;CACF;AAED;;;;GAIG;AACH,MAAM,UAAU,uBAAuB,CACrC,GAAuB;IAEvB,IAAI,GAAG,KAAK,SAAS;QAAE,OAAO,IAAI,CAAC;IACnC,MAAM,OAAO,GAAG,GAAG,CAAC,IAAI,EAAE,CAAC,WAAW,EAAE,CAAC;IACzC,IAAI,OAAO,KAAK,MAAM,IAAI,OAAO,KAAK,IAAI;QAAE,OAAO,EAAE,IAAI,EAAE,UAAU,EAAE,CAAC;IACxE,MAAM,CAAC,GAAG,QAAQ,CAAC,OAAO,EAAE,EAAE,CAAC,CAAC;IAChC,IAAI,MAAM,CAAC,QAAQ,CAAC,CAAC,CAAC,IAAI,CAAC,GAAG,CAAC;QAAE,OAAO,EAAE,IAAI,EAAE,OAAO,EAAE,KAAK,EAAE,CAAC,EAAE,CAAC;IACpE,OAAO,IAAI,CAAC;AACd,CAAC;AAED,+DAA+D;AAC/D,MAAM,UAAU,qBAAqB,CACnC,MAA0C,OAAO,CAAC,GAAG;IAErD,MAAM,GAAG,GAAG,CAAC,CAAqB,EAAsB,EAAE;QACxD,IAAI,CAAC,KAAK,SAAS;YAAE,OAAO,SAAS,CAAC;QACtC,MAAM,CAAC,GAAG,QAAQ,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC;QAC1B,OAAO,MAAM,CAAC,QAAQ,CAAC,CAAC,CAAC,IAAI,CAAC,GAAG,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,SAAS,CAAC;IACrD,CAAC,CAAC;IACF,MAAM,GAAG,GAAuC,EAAE,CAAC;IACnD,MAAM,KAAK,GAAG,GAAG,CAAC,GAAG,CAAC,qBAAqB,CAAC,CAAC;IAC7C,MAAM,GAAG,GAAG,GAAG,CAAC,GAAG,CAAC,mBAAmB,CAAC,CAAC;IACzC,MAAM,GAAG,GAAG,GAAG,CAAC,GAAG,CAAC,mBAAmB,CAAC,CAAC;IACzC,IAAI,KAAK,KAAK,SAAS;QAAE,GAAG,CAAC,KAAK,GAAG,KAAK,CAAC;IAC3C,IAAI,GAAG,KAAK,SAAS;QAAE,GAAG,CAAC,GAAG,GAAG,GAAG,CAAC;IACrC,IAAI,GAAG,KAAK,SAAS;QAAE,GAAG,CAAC,GAAG,GAAG,GAAG,CAAC;IACrC,OAAO,GAAG,CAAC;AACb,CAAC"}
|
|
@@ -0,0 +1,108 @@
|
|
|
1
|
+
/**
|
|
2
|
+
* cognium-ai#244 follow-up — adaptive verifyBatch sizing.
|
|
3
|
+
*
|
|
4
|
+
* Prefill-bound workloads (large-prompt verifyBatch on local LLMs)
|
|
5
|
+
* benefit from adjusting chunk pair-count and per-pair window-lines
|
|
6
|
+
* based on observed latency. This module provides two independent
|
|
7
|
+
* AIMD controllers that mirror the pattern in `adaptive-concurrency.ts`:
|
|
8
|
+
*
|
|
9
|
+
* - AdaptiveVerifyWindow: shrinks `windowLines` (default 80) toward
|
|
10
|
+
* `min` (default 40) when verifyBatch calls run hot. Direct prefill
|
|
11
|
+
* token reduction — real speed lever, but trades precision.
|
|
12
|
+
* Signal: latency threshold (default 150s) OR outright failure.
|
|
13
|
+
*
|
|
14
|
+
* - AdaptiveVerifyChunk: shrinks `maxPairsPerChunk` (default 20, the
|
|
15
|
+
* historical VERIFY_MAX_PAIRS_PER_CHUNK) toward `min` (default 3) on
|
|
16
|
+
* outright failure only. Less potent than window changes (chunking
|
|
17
|
+
* rounds through the same total prefill token count), but preserves
|
|
18
|
+
* per-pair precision. Healthy/cloud endpoints keep the historical 20.
|
|
19
|
+
*
|
|
20
|
+
* Both controllers share the AIMD contract: multiplicative decrease
|
|
21
|
+
* with cooldown to collapse bursts; additive increase after a clean
|
|
22
|
+
* success streak. Pure controllers (no I/O, injectable clock) so the
|
|
23
|
+
* behavior is unit-testable without a live endpoint.
|
|
24
|
+
*
|
|
25
|
+
* Env overrides:
|
|
26
|
+
* LLM_VERIFY_WINDOW_LINES — start value (default 80)
|
|
27
|
+
* LLM_VERIFY_WINDOW_MIN — floor (default 40)
|
|
28
|
+
* LLM_VERIFY_WINDOW_MAX — ceiling (default 120)
|
|
29
|
+
* LLM_VERIFY_LATENCY_THRESHOLD_MS — when to treat a slow-success
|
|
30
|
+
* as pressure (default 150000)
|
|
31
|
+
* LLM_MAX_PAIRS_PER_CHUNK — start value (default 20)
|
|
32
|
+
* LLM_MAX_PAIRS_PER_CHUNK_MIN — floor (default 3)
|
|
33
|
+
* LLM_MAX_PAIRS_PER_CHUNK_MAX — ceiling (default 20)
|
|
34
|
+
* CP_VERIFICATION_CHUNK_SIZE — alias for LLM_MAX_PAIRS_PER_CHUNK (start)
|
|
35
|
+
*/
|
|
36
|
+
export interface AdaptiveVerifyConfig {
|
|
37
|
+
start: number;
|
|
38
|
+
min: number;
|
|
39
|
+
max: number;
|
|
40
|
+
decreaseFactor: number;
|
|
41
|
+
increaseAfterSuccesses: number;
|
|
42
|
+
cooldownMs: number;
|
|
43
|
+
}
|
|
44
|
+
/**
|
|
45
|
+
* Adaptive per-pair window-lines controller.
|
|
46
|
+
*
|
|
47
|
+
* `onCall(durationMs, success)` is the single input:
|
|
48
|
+
* - `success=false` → multiplicative decrease (bursts collapsed by cooldown)
|
|
49
|
+
* - `success=true, slow` → multiplicative decrease (slow-success is pressure)
|
|
50
|
+
* - `success=true, fast` → contribute to success streak; grow +5 after N in a row
|
|
51
|
+
*
|
|
52
|
+
* The "slow" threshold defaults to 150s (83% of the 180s per-call
|
|
53
|
+
* timeout floor from #244). Configurable via
|
|
54
|
+
* `LLM_VERIFY_LATENCY_THRESHOLD_MS`. Grow step is +5 lines per streak
|
|
55
|
+
* (not +1) because window-lines matters at coarser granularity than
|
|
56
|
+
* pair-count and would otherwise take forever to climb back.
|
|
57
|
+
*/
|
|
58
|
+
export declare class AdaptiveVerifyWindow {
|
|
59
|
+
private cfg;
|
|
60
|
+
private latencyThresholdMs;
|
|
61
|
+
private now;
|
|
62
|
+
private _current;
|
|
63
|
+
private successStreak;
|
|
64
|
+
private lastDecreaseAt;
|
|
65
|
+
constructor(config?: Partial<AdaptiveVerifyConfig>, latencyThresholdMs?: number, now?: () => number);
|
|
66
|
+
get current(): number;
|
|
67
|
+
get config(): Readonly<AdaptiveVerifyConfig>;
|
|
68
|
+
/**
|
|
69
|
+
* Report a verifyBatch call outcome. Duration triggers shrinkage
|
|
70
|
+
* before failure fires — a 175s successful call is a warning that
|
|
71
|
+
* the next one may time out. Grow after clean success streak.
|
|
72
|
+
*/
|
|
73
|
+
onCall(durationMs: number, success: boolean): number;
|
|
74
|
+
}
|
|
75
|
+
/**
|
|
76
|
+
* Adaptive chunk (pair count) controller.
|
|
77
|
+
*
|
|
78
|
+
* Fires on outright failure only (not slow-but-successful), because
|
|
79
|
+
* chunk size trades overhead — cutting it doesn't reduce total prefill
|
|
80
|
+
* work per pair. Only makes sense to cut when a chunk is REJECTED
|
|
81
|
+
* (timeout / server error), signaling that the specific batch was
|
|
82
|
+
* too large for the endpoint at that moment.
|
|
83
|
+
*/
|
|
84
|
+
export declare class AdaptiveVerifyChunk {
|
|
85
|
+
private cfg;
|
|
86
|
+
private now;
|
|
87
|
+
private _current;
|
|
88
|
+
private successStreak;
|
|
89
|
+
private lastDecreaseAt;
|
|
90
|
+
constructor(config?: Partial<AdaptiveVerifyConfig>, now?: () => number);
|
|
91
|
+
get current(): number;
|
|
92
|
+
get config(): Readonly<AdaptiveVerifyConfig>;
|
|
93
|
+
/** Report a failed verifyBatch call. Multiplicative decrease. */
|
|
94
|
+
onFailure(): number;
|
|
95
|
+
/** Report a successful verifyBatch call. Grow +1 after streak. */
|
|
96
|
+
onSuccess(): number;
|
|
97
|
+
}
|
|
98
|
+
/** Lazy accessor for the module-level window controller. */
|
|
99
|
+
export declare function getVerifyWindowController(): AdaptiveVerifyWindow;
|
|
100
|
+
/** Lazy accessor for the module-level chunk controller. */
|
|
101
|
+
export declare function getVerifyChunkController(): AdaptiveVerifyChunk;
|
|
102
|
+
/** Convenience: current window-lines. Adaptive at each call site. */
|
|
103
|
+
export declare function getEffectiveVerifyWindowLines(): number;
|
|
104
|
+
/** Convenience: current max pairs per chunk. Adaptive at each call site. */
|
|
105
|
+
export declare function getEffectiveVerifyMaxPairs(): number;
|
|
106
|
+
/** For tests — clear singletons so env changes re-take effect. */
|
|
107
|
+
export declare function resetAdaptiveVerify(): void;
|
|
108
|
+
//# sourceMappingURL=adaptive-verify.d.ts.map
|
|
@@ -0,0 +1 @@
|
|
|
1
|
+
{"version":3,"file":"adaptive-verify.d.ts","sourceRoot":"","sources":["../../src/llm/adaptive-verify.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;GAkCG;AAEH,MAAM,WAAW,oBAAoB;IACnC,KAAK,EAAE,MAAM,CAAC;IACd,GAAG,EAAE,MAAM,CAAC;IACZ,GAAG,EAAE,MAAM,CAAC;IACZ,cAAc,EAAE,MAAM,CAAC;IACvB,sBAAsB,EAAE,MAAM,CAAC;IAC/B,UAAU,EAAE,MAAM,CAAC;CACpB;AAMD;;;;;;;;;;;;;GAaG;AACH,qBAAa,oBAAoB;IAC/B,OAAO,CAAC,GAAG,CAAuB;IAClC,OAAO,CAAC,kBAAkB,CAAS;IACnC,OAAO,CAAC,GAAG,CAAe;IAC1B,OAAO,CAAC,QAAQ,CAAS;IACzB,OAAO,CAAC,aAAa,CAAK;IAC1B,OAAO,CAAC,cAAc,CAAa;gBAGjC,MAAM,GAAE,OAAO,CAAC,oBAAoB,CAAM,EAC1C,kBAAkB,SAAU,EAC5B,GAAG,GAAE,MAAM,MAAiB;IAqB9B,IAAI,OAAO,IAAI,MAAM,CAEpB;IAED,IAAI,MAAM,IAAI,QAAQ,CAAC,oBAAoB,CAAC,CAE3C;IAED;;;;OAIG;IACH,MAAM,CAAC,UAAU,EAAE,MAAM,EAAE,OAAO,EAAE,OAAO,GAAG,MAAM;CA4BrD;AAED;;;;;;;;GAQG;AACH,qBAAa,mBAAmB;IAC9B,OAAO,CAAC,GAAG,CAAuB;IAClC,OAAO,CAAC,GAAG,CAAe;IAC1B,OAAO,CAAC,QAAQ,CAAS;IACzB,OAAO,CAAC,aAAa,CAAK;IAC1B,OAAO,CAAC,cAAc,CAAa;gBAGjC,MAAM,GAAE,OAAO,CAAC,oBAAoB,CAAM,EAC1C,GAAG,GAAE,MAAM,MAAiB;IAoB9B,IAAI,OAAO,IAAI,MAAM,CAEpB;IAED,IAAI,MAAM,IAAI,QAAQ,CAAC,oBAAoB,CAAC,CAE3C;IAED,iEAAiE;IACjE,SAAS,IAAI,MAAM;IAYnB,kEAAkE;IAClE,SAAS,IAAI,MAAM;CAapB;AA0BD,4DAA4D;AAC5D,wBAAgB,yBAAyB,IAAI,oBAAoB,CAchE;AAED,2DAA2D;AAC3D,wBAAgB,wBAAwB,IAAI,mBAAmB,CAgB9D;AAED,qEAAqE;AACrE,wBAAgB,6BAA6B,IAAI,MAAM,CAEtD;AAED,4EAA4E;AAC5E,wBAAgB,0BAA0B,IAAI,MAAM,CAEnD;AAED,kEAAkE;AAClE,wBAAgB,mBAAmB,IAAI,IAAI,CAG1C"}
|
|
@@ -0,0 +1,252 @@
|
|
|
1
|
+
/**
|
|
2
|
+
* cognium-ai#244 follow-up — adaptive verifyBatch sizing.
|
|
3
|
+
*
|
|
4
|
+
* Prefill-bound workloads (large-prompt verifyBatch on local LLMs)
|
|
5
|
+
* benefit from adjusting chunk pair-count and per-pair window-lines
|
|
6
|
+
* based on observed latency. This module provides two independent
|
|
7
|
+
* AIMD controllers that mirror the pattern in `adaptive-concurrency.ts`:
|
|
8
|
+
*
|
|
9
|
+
* - AdaptiveVerifyWindow: shrinks `windowLines` (default 80) toward
|
|
10
|
+
* `min` (default 40) when verifyBatch calls run hot. Direct prefill
|
|
11
|
+
* token reduction — real speed lever, but trades precision.
|
|
12
|
+
* Signal: latency threshold (default 150s) OR outright failure.
|
|
13
|
+
*
|
|
14
|
+
* - AdaptiveVerifyChunk: shrinks `maxPairsPerChunk` (default 20, the
|
|
15
|
+
* historical VERIFY_MAX_PAIRS_PER_CHUNK) toward `min` (default 3) on
|
|
16
|
+
* outright failure only. Less potent than window changes (chunking
|
|
17
|
+
* rounds through the same total prefill token count), but preserves
|
|
18
|
+
* per-pair precision. Healthy/cloud endpoints keep the historical 20.
|
|
19
|
+
*
|
|
20
|
+
* Both controllers share the AIMD contract: multiplicative decrease
|
|
21
|
+
* with cooldown to collapse bursts; additive increase after a clean
|
|
22
|
+
* success streak. Pure controllers (no I/O, injectable clock) so the
|
|
23
|
+
* behavior is unit-testable without a live endpoint.
|
|
24
|
+
*
|
|
25
|
+
* Env overrides:
|
|
26
|
+
* LLM_VERIFY_WINDOW_LINES — start value (default 80)
|
|
27
|
+
* LLM_VERIFY_WINDOW_MIN — floor (default 40)
|
|
28
|
+
* LLM_VERIFY_WINDOW_MAX — ceiling (default 120)
|
|
29
|
+
* LLM_VERIFY_LATENCY_THRESHOLD_MS — when to treat a slow-success
|
|
30
|
+
* as pressure (default 150000)
|
|
31
|
+
* LLM_MAX_PAIRS_PER_CHUNK — start value (default 20)
|
|
32
|
+
* LLM_MAX_PAIRS_PER_CHUNK_MIN — floor (default 3)
|
|
33
|
+
* LLM_MAX_PAIRS_PER_CHUNK_MAX — ceiling (default 20)
|
|
34
|
+
* CP_VERIFICATION_CHUNK_SIZE — alias for LLM_MAX_PAIRS_PER_CHUNK (start)
|
|
35
|
+
*/
|
|
36
|
+
function clamp(n, lo, hi) {
|
|
37
|
+
return Math.max(lo, Math.min(hi, n));
|
|
38
|
+
}
|
|
39
|
+
/**
|
|
40
|
+
* Adaptive per-pair window-lines controller.
|
|
41
|
+
*
|
|
42
|
+
* `onCall(durationMs, success)` is the single input:
|
|
43
|
+
* - `success=false` → multiplicative decrease (bursts collapsed by cooldown)
|
|
44
|
+
* - `success=true, slow` → multiplicative decrease (slow-success is pressure)
|
|
45
|
+
* - `success=true, fast` → contribute to success streak; grow +5 after N in a row
|
|
46
|
+
*
|
|
47
|
+
* The "slow" threshold defaults to 150s (83% of the 180s per-call
|
|
48
|
+
* timeout floor from #244). Configurable via
|
|
49
|
+
* `LLM_VERIFY_LATENCY_THRESHOLD_MS`. Grow step is +5 lines per streak
|
|
50
|
+
* (not +1) because window-lines matters at coarser granularity than
|
|
51
|
+
* pair-count and would otherwise take forever to climb back.
|
|
52
|
+
*/
|
|
53
|
+
export class AdaptiveVerifyWindow {
|
|
54
|
+
cfg;
|
|
55
|
+
latencyThresholdMs;
|
|
56
|
+
now;
|
|
57
|
+
_current;
|
|
58
|
+
successStreak = 0;
|
|
59
|
+
lastDecreaseAt = -Infinity;
|
|
60
|
+
constructor(config = {}, latencyThresholdMs = 150_000, now = Date.now) {
|
|
61
|
+
this.cfg = {
|
|
62
|
+
start: 80,
|
|
63
|
+
min: 40,
|
|
64
|
+
max: 120,
|
|
65
|
+
decreaseFactor: 0.5,
|
|
66
|
+
increaseAfterSuccesses: 6,
|
|
67
|
+
cooldownMs: 3000,
|
|
68
|
+
...config,
|
|
69
|
+
};
|
|
70
|
+
// Guardrails — verify precision floors at 20 lines of context;
|
|
71
|
+
// below that there's not enough to see even simple sanitizer
|
|
72
|
+
// patterns near a sink.
|
|
73
|
+
if (this.cfg.min < 20)
|
|
74
|
+
this.cfg.min = 20;
|
|
75
|
+
if (this.cfg.max < this.cfg.min)
|
|
76
|
+
this.cfg.max = this.cfg.min;
|
|
77
|
+
this.latencyThresholdMs = latencyThresholdMs;
|
|
78
|
+
this.now = now;
|
|
79
|
+
this._current = clamp(this.cfg.start, this.cfg.min, this.cfg.max);
|
|
80
|
+
}
|
|
81
|
+
get current() {
|
|
82
|
+
return this._current;
|
|
83
|
+
}
|
|
84
|
+
get config() {
|
|
85
|
+
return this.cfg;
|
|
86
|
+
}
|
|
87
|
+
/**
|
|
88
|
+
* Report a verifyBatch call outcome. Duration triggers shrinkage
|
|
89
|
+
* before failure fires — a 175s successful call is a warning that
|
|
90
|
+
* the next one may time out. Grow after clean success streak.
|
|
91
|
+
*/
|
|
92
|
+
onCall(durationMs, success) {
|
|
93
|
+
const isSlow = durationMs >= this.latencyThresholdMs;
|
|
94
|
+
if (!success || isSlow) {
|
|
95
|
+
this.successStreak = 0;
|
|
96
|
+
const t = this.now();
|
|
97
|
+
if (t - this.lastDecreaseAt < this.cfg.cooldownMs)
|
|
98
|
+
return this._current;
|
|
99
|
+
this.lastDecreaseAt = t;
|
|
100
|
+
this._current = Math.max(this.cfg.min, Math.floor(this._current * this.cfg.decreaseFactor));
|
|
101
|
+
return this._current;
|
|
102
|
+
}
|
|
103
|
+
// success and fast
|
|
104
|
+
const t = this.now();
|
|
105
|
+
if (t - this.lastDecreaseAt < this.cfg.cooldownMs)
|
|
106
|
+
return this._current;
|
|
107
|
+
this.successStreak++;
|
|
108
|
+
if (this.successStreak >= this.cfg.increaseAfterSuccesses &&
|
|
109
|
+
this._current < this.cfg.max) {
|
|
110
|
+
// +5 lines per grow step — coarser than pair-count because
|
|
111
|
+
// window-lines has smaller marginal impact per unit.
|
|
112
|
+
this._current = Math.min(this.cfg.max, this._current + 5);
|
|
113
|
+
this.successStreak = 0;
|
|
114
|
+
}
|
|
115
|
+
return this._current;
|
|
116
|
+
}
|
|
117
|
+
}
|
|
118
|
+
/**
|
|
119
|
+
* Adaptive chunk (pair count) controller.
|
|
120
|
+
*
|
|
121
|
+
* Fires on outright failure only (not slow-but-successful), because
|
|
122
|
+
* chunk size trades overhead — cutting it doesn't reduce total prefill
|
|
123
|
+
* work per pair. Only makes sense to cut when a chunk is REJECTED
|
|
124
|
+
* (timeout / server error), signaling that the specific batch was
|
|
125
|
+
* too large for the endpoint at that moment.
|
|
126
|
+
*/
|
|
127
|
+
export class AdaptiveVerifyChunk {
|
|
128
|
+
cfg;
|
|
129
|
+
now;
|
|
130
|
+
_current;
|
|
131
|
+
successStreak = 0;
|
|
132
|
+
lastDecreaseAt = -Infinity;
|
|
133
|
+
constructor(config = {}, now = Date.now) {
|
|
134
|
+
this.cfg = {
|
|
135
|
+
// Start at the historical VERIFY_MAX_PAIRS_PER_CHUNK default (20) so
|
|
136
|
+
// healthy/cloud endpoints are behaviourally unchanged; adapt DOWN
|
|
137
|
+
// toward `min` under failure pressure, and recover via onSuccess.
|
|
138
|
+
start: 20,
|
|
139
|
+
min: 3,
|
|
140
|
+
max: 20,
|
|
141
|
+
decreaseFactor: 0.5,
|
|
142
|
+
increaseAfterSuccesses: 8,
|
|
143
|
+
cooldownMs: 3000,
|
|
144
|
+
...config,
|
|
145
|
+
};
|
|
146
|
+
if (this.cfg.min < 1)
|
|
147
|
+
this.cfg.min = 1;
|
|
148
|
+
if (this.cfg.max < this.cfg.min)
|
|
149
|
+
this.cfg.max = this.cfg.min;
|
|
150
|
+
this.now = now;
|
|
151
|
+
this._current = clamp(this.cfg.start, this.cfg.min, this.cfg.max);
|
|
152
|
+
}
|
|
153
|
+
get current() {
|
|
154
|
+
return this._current;
|
|
155
|
+
}
|
|
156
|
+
get config() {
|
|
157
|
+
return this.cfg;
|
|
158
|
+
}
|
|
159
|
+
/** Report a failed verifyBatch call. Multiplicative decrease. */
|
|
160
|
+
onFailure() {
|
|
161
|
+
this.successStreak = 0;
|
|
162
|
+
const t = this.now();
|
|
163
|
+
if (t - this.lastDecreaseAt < this.cfg.cooldownMs)
|
|
164
|
+
return this._current;
|
|
165
|
+
this.lastDecreaseAt = t;
|
|
166
|
+
this._current = Math.max(this.cfg.min, Math.floor(this._current * this.cfg.decreaseFactor));
|
|
167
|
+
return this._current;
|
|
168
|
+
}
|
|
169
|
+
/** Report a successful verifyBatch call. Grow +1 after streak. */
|
|
170
|
+
onSuccess() {
|
|
171
|
+
const t = this.now();
|
|
172
|
+
if (t - this.lastDecreaseAt < this.cfg.cooldownMs)
|
|
173
|
+
return this._current;
|
|
174
|
+
this.successStreak++;
|
|
175
|
+
if (this.successStreak >= this.cfg.increaseAfterSuccesses &&
|
|
176
|
+
this._current < this.cfg.max) {
|
|
177
|
+
this._current = Math.min(this.cfg.max, this._current + 1);
|
|
178
|
+
this.successStreak = 0;
|
|
179
|
+
}
|
|
180
|
+
return this._current;
|
|
181
|
+
}
|
|
182
|
+
}
|
|
183
|
+
// ---------------------------------------------------------------------------
|
|
184
|
+
// Module-level singletons — one per Node process, lazily initialised so
|
|
185
|
+
// tests can override via `resetAdaptiveVerify()` + fresh env vars.
|
|
186
|
+
// ---------------------------------------------------------------------------
|
|
187
|
+
let _verifyWindow = null;
|
|
188
|
+
let _verifyChunk = null;
|
|
189
|
+
function firstPositiveInt(...raws) {
|
|
190
|
+
for (const raw of raws) {
|
|
191
|
+
if (!raw)
|
|
192
|
+
continue;
|
|
193
|
+
const n = parseInt(raw, 10);
|
|
194
|
+
if (Number.isFinite(n) && n > 0)
|
|
195
|
+
return n;
|
|
196
|
+
}
|
|
197
|
+
return null;
|
|
198
|
+
}
|
|
199
|
+
function envInt(name) {
|
|
200
|
+
const v = process.env[name];
|
|
201
|
+
if (!v)
|
|
202
|
+
return undefined;
|
|
203
|
+
const n = parseInt(v, 10);
|
|
204
|
+
return Number.isFinite(n) && n > 0 ? n : undefined;
|
|
205
|
+
}
|
|
206
|
+
/** Lazy accessor for the module-level window controller. */
|
|
207
|
+
export function getVerifyWindowController() {
|
|
208
|
+
if (_verifyWindow)
|
|
209
|
+
return _verifyWindow;
|
|
210
|
+
const cfg = {};
|
|
211
|
+
const start = envInt('LLM_VERIFY_WINDOW_LINES');
|
|
212
|
+
const min = envInt('LLM_VERIFY_WINDOW_MIN');
|
|
213
|
+
const max = envInt('LLM_VERIFY_WINDOW_MAX');
|
|
214
|
+
if (start !== undefined)
|
|
215
|
+
cfg.start = start;
|
|
216
|
+
if (min !== undefined)
|
|
217
|
+
cfg.min = min;
|
|
218
|
+
if (max !== undefined)
|
|
219
|
+
cfg.max = max;
|
|
220
|
+
_verifyWindow = new AdaptiveVerifyWindow(cfg, envInt('LLM_VERIFY_LATENCY_THRESHOLD_MS') ?? 150_000);
|
|
221
|
+
return _verifyWindow;
|
|
222
|
+
}
|
|
223
|
+
/** Lazy accessor for the module-level chunk controller. */
|
|
224
|
+
export function getVerifyChunkController() {
|
|
225
|
+
if (_verifyChunk)
|
|
226
|
+
return _verifyChunk;
|
|
227
|
+
const startFromEnv = firstPositiveInt(process.env.CP_VERIFICATION_CHUNK_SIZE, process.env.LLM_MAX_PAIRS_PER_CHUNK);
|
|
228
|
+
_verifyChunk = new AdaptiveVerifyChunk({
|
|
229
|
+
...(startFromEnv !== null ? { start: startFromEnv } : {}),
|
|
230
|
+
...(envInt('LLM_MAX_PAIRS_PER_CHUNK_MIN') !== undefined
|
|
231
|
+
? { min: envInt('LLM_MAX_PAIRS_PER_CHUNK_MIN') }
|
|
232
|
+
: {}),
|
|
233
|
+
...(envInt('LLM_MAX_PAIRS_PER_CHUNK_MAX') !== undefined
|
|
234
|
+
? { max: envInt('LLM_MAX_PAIRS_PER_CHUNK_MAX') }
|
|
235
|
+
: {}),
|
|
236
|
+
});
|
|
237
|
+
return _verifyChunk;
|
|
238
|
+
}
|
|
239
|
+
/** Convenience: current window-lines. Adaptive at each call site. */
|
|
240
|
+
export function getEffectiveVerifyWindowLines() {
|
|
241
|
+
return getVerifyWindowController().current;
|
|
242
|
+
}
|
|
243
|
+
/** Convenience: current max pairs per chunk. Adaptive at each call site. */
|
|
244
|
+
export function getEffectiveVerifyMaxPairs() {
|
|
245
|
+
return getVerifyChunkController().current;
|
|
246
|
+
}
|
|
247
|
+
/** For tests — clear singletons so env changes re-take effect. */
|
|
248
|
+
export function resetAdaptiveVerify() {
|
|
249
|
+
_verifyWindow = null;
|
|
250
|
+
_verifyChunk = null;
|
|
251
|
+
}
|
|
252
|
+
//# sourceMappingURL=adaptive-verify.js.map
|
|
@@ -0,0 +1 @@
|
|
|
1
|
+
{"version":3,"file":"adaptive-verify.js","sourceRoot":"","sources":["../../src/llm/adaptive-verify.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;GAkCG;AAWH,SAAS,KAAK,CAAC,CAAS,EAAE,EAAU,EAAE,EAAU;IAC9C,OAAO,IAAI,CAAC,GAAG,CAAC,EAAE,EAAE,IAAI,CAAC,GAAG,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,CAAC;AACvC,CAAC;AAED;;;;;;;;;;;;;GAaG;AACH,MAAM,OAAO,oBAAoB;IACvB,GAAG,CAAuB;IAC1B,kBAAkB,CAAS;IAC3B,GAAG,CAAe;IAClB,QAAQ,CAAS;IACjB,aAAa,GAAG,CAAC,CAAC;IAClB,cAAc,GAAG,CAAC,QAAQ,CAAC;IAEnC,YACE,SAAwC,EAAE,EAC1C,kBAAkB,GAAG,OAAO,EAC5B,MAAoB,IAAI,CAAC,GAAG;QAE5B,IAAI,CAAC,GAAG,GAAG;YACT,KAAK,EAAE,EAAE;YACT,GAAG,EAAE,EAAE;YACP,GAAG,EAAE,GAAG;YACR,cAAc,EAAE,GAAG;YACnB,sBAAsB,EAAE,CAAC;YACzB,UAAU,EAAE,IAAI;YAChB,GAAG,MAAM;SACV,CAAC;QACF,+DAA+D;QAC/D,6DAA6D;QAC7D,wBAAwB;QACxB,IAAI,IAAI,CAAC,GAAG,CAAC,GAAG,GAAG,EAAE;YAAE,IAAI,CAAC,GAAG,CAAC,GAAG,GAAG,EAAE,CAAC;QACzC,IAAI,IAAI,CAAC,GAAG,CAAC,GAAG,GAAG,IAAI,CAAC,GAAG,CAAC,GAAG;YAAE,IAAI,CAAC,GAAG,CAAC,GAAG,GAAG,IAAI,CAAC,GAAG,CAAC,GAAG,CAAC;QAC7D,IAAI,CAAC,kBAAkB,GAAG,kBAAkB,CAAC;QAC7C,IAAI,CAAC,GAAG,GAAG,GAAG,CAAC;QACf,IAAI,CAAC,QAAQ,GAAG,KAAK,CAAC,IAAI,CAAC,GAAG,CAAC,KAAK,EAAE,IAAI,CAAC,GAAG,CAAC,GAAG,EAAE,IAAI,CAAC,GAAG,CAAC,GAAG,CAAC,CAAC;IACpE,CAAC;IAED,IAAI,OAAO;QACT,OAAO,IAAI,CAAC,QAAQ,CAAC;IACvB,CAAC;IAED,IAAI,MAAM;QACR,OAAO,IAAI,CAAC,GAAG,CAAC;IAClB,CAAC;IAED;;;;OAIG;IACH,MAAM,CAAC,UAAkB,EAAE,OAAgB;QACzC,MAAM,MAAM,GAAG,UAAU,IAAI,IAAI,CAAC,kBAAkB,CAAC;QACrD,IAAI,CAAC,OAAO,IAAI,MAAM,EAAE,CAAC;YACvB,IAAI,CAAC,aAAa,GAAG,CAAC,CAAC;YACvB,MAAM,CAAC,GAAG,IAAI,CAAC,GAAG,EAAE,CAAC;YACrB,IAAI,CAAC,GAAG,IAAI,CAAC,cAAc,GAAG,IAAI,CAAC,GAAG,CAAC,UAAU;gBAAE,OAAO,IAAI,CAAC,QAAQ,CAAC;YACxE,IAAI,CAAC,cAAc,GAAG,CAAC,CAAC;YACxB,IAAI,CAAC,QAAQ,GAAG,IAAI,CAAC,GAAG,CACtB,IAAI,CAAC,GAAG,CAAC,GAAG,EACZ,IAAI,CAAC,KAAK,CAAC,IAAI,CAAC,QAAQ,GAAG,IAAI,CAAC,GAAG,CAAC,cAAc,CAAC,CACpD,CAAC;YACF,OAAO,IAAI,CAAC,QAAQ,CAAC;QACvB,CAAC;QACD,mBAAmB;QACnB,MAAM,CAAC,GAAG,IAAI,CAAC,GAAG,EAAE,CAAC;QACrB,IAAI,CAAC,GAAG,IAAI,CAAC,cAAc,GAAG,IAAI,CAAC,GAAG,CAAC,UAAU;YAAE,OAAO,IAAI,CAAC,QAAQ,CAAC;QACxE,IAAI,CAAC,aAAa,EAAE,CAAC;QACrB,IACE,IAAI,CAAC,aAAa,IAAI,IAAI,CAAC,GAAG,CAAC,sBAAsB;YACrD,IAAI,CAAC,QAAQ,GAAG,IAAI,CAAC,GAAG,CAAC,GAAG,EAC5B,CAAC;YACD,2DAA2D;YAC3D,qDAAqD;YACrD,IAAI,CAAC,QAAQ,GAAG,IAAI,CAAC,GAAG,CAAC,IAAI,CAAC,GAAG,CAAC,GAAG,EAAE,IAAI,CAAC,QAAQ,GAAG,CAAC,CAAC,CAAC;YAC1D,IAAI,CAAC,aAAa,GAAG,CAAC,CAAC;QACzB,CAAC;QACD,OAAO,IAAI,CAAC,QAAQ,CAAC;IACvB,CAAC;CACF;AAED;;;;;;;;GAQG;AACH,MAAM,OAAO,mBAAmB;IACtB,GAAG,CAAuB;IAC1B,GAAG,CAAe;IAClB,QAAQ,CAAS;IACjB,aAAa,GAAG,CAAC,CAAC;IAClB,cAAc,GAAG,CAAC,QAAQ,CAAC;IAEnC,YACE,SAAwC,EAAE,EAC1C,MAAoB,IAAI,CAAC,GAAG;QAE5B,IAAI,CAAC,GAAG,GAAG;YACT,qEAAqE;YACrE,kEAAkE;YAClE,kEAAkE;YAClE,KAAK,EAAE,EAAE;YACT,GAAG,EAAE,CAAC;YACN,GAAG,EAAE,EAAE;YACP,cAAc,EAAE,GAAG;YACnB,sBAAsB,EAAE,CAAC;YACzB,UAAU,EAAE,IAAI;YAChB,GAAG,MAAM;SACV,CAAC;QACF,IAAI,IAAI,CAAC,GAAG,CAAC,GAAG,GAAG,CAAC;YAAE,IAAI,CAAC,GAAG,CAAC,GAAG,GAAG,CAAC,CAAC;QACvC,IAAI,IAAI,CAAC,GAAG,CAAC,GAAG,GAAG,IAAI,CAAC,GAAG,CAAC,GAAG;YAAE,IAAI,CAAC,GAAG,CAAC,GAAG,GAAG,IAAI,CAAC,GAAG,CAAC,GAAG,CAAC;QAC7D,IAAI,CAAC,GAAG,GAAG,GAAG,CAAC;QACf,IAAI,CAAC,QAAQ,GAAG,KAAK,CAAC,IAAI,CAAC,GAAG,CAAC,KAAK,EAAE,IAAI,CAAC,GAAG,CAAC,GAAG,EAAE,IAAI,CAAC,GAAG,CAAC,GAAG,CAAC,CAAC;IACpE,CAAC;IAED,IAAI,OAAO;QACT,OAAO,IAAI,CAAC,QAAQ,CAAC;IACvB,CAAC;IAED,IAAI,MAAM;QACR,OAAO,IAAI,CAAC,GAAG,CAAC;IAClB,CAAC;IAED,iEAAiE;IACjE,SAAS;QACP,IAAI,CAAC,aAAa,GAAG,CAAC,CAAC;QACvB,MAAM,CAAC,GAAG,IAAI,CAAC,GAAG,EAAE,CAAC;QACrB,IAAI,CAAC,GAAG,IAAI,CAAC,cAAc,GAAG,IAAI,CAAC,GAAG,CAAC,UAAU;YAAE,OAAO,IAAI,CAAC,QAAQ,CAAC;QACxE,IAAI,CAAC,cAAc,GAAG,CAAC,CAAC;QACxB,IAAI,CAAC,QAAQ,GAAG,IAAI,CAAC,GAAG,CACtB,IAAI,CAAC,GAAG,CAAC,GAAG,EACZ,IAAI,CAAC,KAAK,CAAC,IAAI,CAAC,QAAQ,GAAG,IAAI,CAAC,GAAG,CAAC,cAAc,CAAC,CACpD,CAAC;QACF,OAAO,IAAI,CAAC,QAAQ,CAAC;IACvB,CAAC;IAED,kEAAkE;IAClE,SAAS;QACP,MAAM,CAAC,GAAG,IAAI,CAAC,GAAG,EAAE,CAAC;QACrB,IAAI,CAAC,GAAG,IAAI,CAAC,cAAc,GAAG,IAAI,CAAC,GAAG,CAAC,UAAU;YAAE,OAAO,IAAI,CAAC,QAAQ,CAAC;QACxE,IAAI,CAAC,aAAa,EAAE,CAAC;QACrB,IACE,IAAI,CAAC,aAAa,IAAI,IAAI,CAAC,GAAG,CAAC,sBAAsB;YACrD,IAAI,CAAC,QAAQ,GAAG,IAAI,CAAC,GAAG,CAAC,GAAG,EAC5B,CAAC;YACD,IAAI,CAAC,QAAQ,GAAG,IAAI,CAAC,GAAG,CAAC,IAAI,CAAC,GAAG,CAAC,GAAG,EAAE,IAAI,CAAC,QAAQ,GAAG,CAAC,CAAC,CAAC;YAC1D,IAAI,CAAC,aAAa,GAAG,CAAC,CAAC;QACzB,CAAC;QACD,OAAO,IAAI,CAAC,QAAQ,CAAC;IACvB,CAAC;CACF;AAED,8EAA8E;AAC9E,wEAAwE;AACxE,mEAAmE;AACnE,8EAA8E;AAE9E,IAAI,aAAa,GAAgC,IAAI,CAAC;AACtD,IAAI,YAAY,GAA+B,IAAI,CAAC;AAEpD,SAAS,gBAAgB,CAAC,GAAG,IAA+B;IAC1D,KAAK,MAAM,GAAG,IAAI,IAAI,EAAE,CAAC;QACvB,IAAI,CAAC,GAAG;YAAE,SAAS;QACnB,MAAM,CAAC,GAAG,QAAQ,CAAC,GAAG,EAAE,EAAE,CAAC,CAAC;QAC5B,IAAI,MAAM,CAAC,QAAQ,CAAC,CAAC,CAAC,IAAI,CAAC,GAAG,CAAC;YAAE,OAAO,CAAC,CAAC;IAC5C,CAAC;IACD,OAAO,IAAI,CAAC;AACd,CAAC;AAED,SAAS,MAAM,CAAC,IAAY;IAC1B,MAAM,CAAC,GAAG,OAAO,CAAC,GAAG,CAAC,IAAI,CAAC,CAAC;IAC5B,IAAI,CAAC,CAAC;QAAE,OAAO,SAAS,CAAC;IACzB,MAAM,CAAC,GAAG,QAAQ,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC;IAC1B,OAAO,MAAM,CAAC,QAAQ,CAAC,CAAC,CAAC,IAAI,CAAC,GAAG,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,SAAS,CAAC;AACrD,CAAC;AAED,4DAA4D;AAC5D,MAAM,UAAU,yBAAyB;IACvC,IAAI,aAAa;QAAE,OAAO,aAAa,CAAC;IACxC,MAAM,GAAG,GAAkC,EAAE,CAAC;IAC9C,MAAM,KAAK,GAAG,MAAM,CAAC,yBAAyB,CAAC,CAAC;IAChD,MAAM,GAAG,GAAG,MAAM,CAAC,uBAAuB,CAAC,CAAC;IAC5C,MAAM,GAAG,GAAG,MAAM,CAAC,uBAAuB,CAAC,CAAC;IAC5C,IAAI,KAAK,KAAK,SAAS;QAAE,GAAG,CAAC,KAAK,GAAG,KAAK,CAAC;IAC3C,IAAI,GAAG,KAAK,SAAS;QAAE,GAAG,CAAC,GAAG,GAAG,GAAG,CAAC;IACrC,IAAI,GAAG,KAAK,SAAS;QAAE,GAAG,CAAC,GAAG,GAAG,GAAG,CAAC;IACrC,aAAa,GAAG,IAAI,oBAAoB,CACtC,GAAG,EACH,MAAM,CAAC,iCAAiC,CAAC,IAAI,OAAO,CACrD,CAAC;IACF,OAAO,aAAa,CAAC;AACvB,CAAC;AAED,2DAA2D;AAC3D,MAAM,UAAU,wBAAwB;IACtC,IAAI,YAAY;QAAE,OAAO,YAAY,CAAC;IACtC,MAAM,YAAY,GAAG,gBAAgB,CACnC,OAAO,CAAC,GAAG,CAAC,0BAA0B,EACtC,OAAO,CAAC,GAAG,CAAC,uBAAuB,CACpC,CAAC;IACF,YAAY,GAAG,IAAI,mBAAmB,CAAC;QACrC,GAAG,CAAC,YAAY,KAAK,IAAI,CAAC,CAAC,CAAC,EAAE,KAAK,EAAE,YAAY,EAAE,CAAC,CAAC,CAAC,EAAE,CAAC;QACzD,GAAG,CAAC,MAAM,CAAC,6BAA6B,CAAC,KAAK,SAAS;YACrD,CAAC,CAAC,EAAE,GAAG,EAAE,MAAM,CAAC,6BAA6B,CAAE,EAAE;YACjD,CAAC,CAAC,EAAE,CAAC;QACP,GAAG,CAAC,MAAM,CAAC,6BAA6B,CAAC,KAAK,SAAS;YACrD,CAAC,CAAC,EAAE,GAAG,EAAE,MAAM,CAAC,6BAA6B,CAAE,EAAE;YACjD,CAAC,CAAC,EAAE,CAAC;KACR,CAAC,CAAC;IACH,OAAO,YAAY,CAAC;AACtB,CAAC;AAED,qEAAqE;AACrE,MAAM,UAAU,6BAA6B;IAC3C,OAAO,yBAAyB,EAAE,CAAC,OAAO,CAAC;AAC7C,CAAC;AAED,4EAA4E;AAC5E,MAAM,UAAU,0BAA0B;IACxC,OAAO,wBAAwB,EAAE,CAAC,OAAO,CAAC;AAC5C,CAAC;AAED,kEAAkE;AAClE,MAAM,UAAU,mBAAmB;IACjC,aAAa,GAAG,IAAI,CAAC;IACrB,YAAY,GAAG,IAAI,CAAC;AACtB,CAAC"}
|
|
@@ -1 +1 @@
|
|
|
1
|
-
{"version":3,"file":"ax-client.d.ts","sourceRoot":"","sources":["../../src/llm/ax-client.ts"],"names":[],"mappings":"AAAA;;;;;GAKG;AAEH,OAAO,EACL,UAAU,EAEV,WAAW,EAEZ,MAAM,YAAY,CAAC;AAQpB,OAAO,KAAK,EAAE,SAAS,EAAE,MAAM,aAAa,CAAC;AAc7C,OAAO,EAAa,KAAK,oBAAoB,EAAE,MAAM,oBAAoB,CAAC;AAC1E,OAAO,EAAiB,KAAK,gBAAgB,EAAE,MAAM,kBAAkB,CAAC;AAGxE,OAAO,EAKL,KAAK,oBAAoB,EACzB,KAAK,kBAAkB,EACxB,MAAM,6BAA6B,CAAC;AAMrC;;GAEG;AACH,eAAO,MAAM,mBAAmB,uDAG9B,CAAC;AAEH;;GAEG;AACH,eAAO,MAAM,2BAA2B,uDAGtC,CAAC;AAEH;;GAEG;AACH,eAAO,MAAM,wBAAwB,uDAGnC,CAAC;AAEH;;GAEG;AACH,eAAO,MAAM,sBAAsB,uDAGjC,CAAC;AAEH;;GAEG;AACH,eAAO,MAAM,8BAA8B,uDAGzC,CAAC;AAEH;;GAEG;AACH,eAAO,MAAM,4BAA4B,uDAGvC,CAAC;AAEH;;GAEG;AACH,eAAO,MAAM,qBAAqB,uDAOhC,CAAC;AAEH;;;GAGG;AACH,eAAO,MAAM,kBAAkB,uDAK7B,CAAC;AAEH;;;GAGG;AACH,eAAO,MAAM,4BAA4B,uDAIvC,CAAC;AAEH;;;GAGG;AACH,eAAO,MAAM,uBAAuB,uDAMlC,CAAC;AAMH,MAAM,MAAM,OAAO,GAAG,YAAY,GAAG,cAAc,GAAG,UAAU,CAAC;AA4CjE;;;;;GAKG;AACH,wBAAgB,sBAAsB,CACpC,aAAa,EAAE,MAAM,EACrB,SAAS,EAAE,MAAM,GAChB,MAAM,CAIR;AAsBD;;;;;;GAMG;AACH,wBAAgB,sBAAsB,IAAI,IAAI,CAO7C;AAED;;;;;GAKG;AACH,wBAAgB,sBAAsB,IAAI,IAAI,CAI7C;AAED;4EAC4E;AAC5E,wBAAgB,iBAAiB,IAAI,OAAO,CAE3C;AAED,8EAA8E;AAC9E,wBAAgB,kBAAkB,IAAI;IACpC,mBAAmB,EAAE,MAAM,CAAC;IAC5B,WAAW,EAAE,OAAO,CAAC;IACrB,gBAAgB,EAAE,MAAM,CAAC;IACzB,cAAc,EAAE,OAAO,CAAC;CACzB,CAOA;AAgCD,eAAO,MAAM,uBAAuB,QAIxB,CAAC;AAiFb;;;;;GAKG;AACH,wBAAgB,iBAAiB,CAC/B,MAAM,EAAE,MAAM,GAAG,IAAI,EACrB,OAAO,EAAE,MAAM,EACf,GAAG,GAAE,MAAmB,GACvB,MAAM,CAmBR;AAgCD;;;;;;;;;;;;;GAaG;AACH,wBAAgB,cAAc,CAAC,IAAI,EAAE,MAAM,GAAG,SAAS,GAAG,IAAI,GAAG,OAAO,CA2BvE;AAED;;;;;;;;;;;;;;;;;GAiBG;AACH,wBAAgB,gBAAgB,CAAC,CAAC,EAAE,MAAM,GAAG,MAAM,CAKlD;AAgBD,4DAA4D;AAC5D,wBAAgB,kBAAkB,IAAI,MAAM,CAE3C;AAED,+EAA+E;AAC/E,wBAAgB,oBAAoB,IAAI,IAAI,CAE3C;AAED;;;;;;GAMG;AACH,wBAAgB,uBAAuB,IAAI,MAAM,CAEhD;AAED;;;;;;;;GAQG;AACH,wBAAgB,YAAY,CAAC,IAAI,EAAE,MAAM,EAAE,SAAS,GAAE,MAAgC,GAAG,MAAM,CAa9F;AAED;;GAEG;AACH,qBAAa,WAAW;IACtB,OAAO,CAAC,MAAM,CAAY;IAC1B,OAAO,CAAC,EAAE,CAAa;IACvB,OAAO,CAAC,UAAU,CAA2C;IAI7D;;;;;;;;;;;;OAYG;IACH,OAAO,CAAC,iBAAiB,CAA2C;IAEpE;;;;;OAKG;IACH,OAAO,CAAC,SAAS,CAA0E;IAE3F;;;;;;;;;;;OAWG;IACH,OAAO,CAAC,gBAAgB,CAAiC;IAEzD;;;;;;;;;;;;;OAaG;IACH,oBAAoB,IAAI,gBAAgB,GAAG,SAAS;gBAIxC,MAAM,CAAC,EAAE,OAAO,CAAC,SAAS,CAAC;IAiCvC;;OAEG;IACH,WAAW,IAAI,OAAO;IAItB;;;;OAIG;IACH,mBAAmB,IAAI,IAAI;IAI3B;;;;;;OAMG;IACH,gBAAgB,IAAI,OAAO;IAI3B;;;;;OAKG;IACH,OAAO,CAAC,aAAa;IAIrB;;OAEG;IACH,OAAO,CAAC,YAAY;IAQpB;;;;;;OAMG;IACH,OAAO,CAAC,aAAa;IAkBrB;;;;OAIG;IACH,OAAO,CAAC,iBAAiB;IAiBzB;;;;;;;OAOG;IACH,OAAO,CAAC,8BAA8B;IAYtC;;;;;OAKG;IACH,OAAO,CAAC,YAAY;IA4CpB;;OAEG;IACH,OAAO,CAAC,mBAAmB;IAyP3B;;;;;OAKG;IACU,QAAQ,CAAC,CAAC,EAAE,YAAY,EAAE,MAAM,EAAE,UAAU,EAAE,MAAM,EAAE,KAAK,GAAE,YAAY,GAAG,cAAc,GAAG,qBAAoC,EAAE,UAAU,GAAE,MAAU,GAAG,OAAO,CAAC,CAAC,GAAG,IAAI,CAAC;IA2G1L;;;;;;;OAOG;YACW,aAAa;IA+b3B;;;OAGG;IACH,OAAO,CAAC,uBAAuB;IA2D/B;;OAEG;IACH,OAAO,CAAC,qBAAqB;IA8C7B;;;OAGG;IACH,OAAO,CAAC,0BAA0B;IA8ClC;;OAEG;IACG,YAAY,CAAC,KAAK,EAAE;QACxB,SAAS,EAAE,MAAM,CAAC;QAClB,WAAW,EAAE,MAAM,CAAC;QACpB,WAAW,EAAE,MAAM,CAAC;QACpB,OAAO,EAAE,MAAM,CAAC;KACjB,GAAG,OAAO,CAAC;QACV,IAAI,EAAE,YAAY,GAAG,SAAS,GAAG,YAAY,GAAG,SAAS,GAAG,QAAQ,GAAG,SAAS,CAAC;QACjF,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;QAClB,UAAU,EAAE,MAAM,EAAE,CAAC;KACtB,CAAC;IAqCF;;OAEG;IACG,eAAe,CAAC,KAAK,EAAE;QAC3B,UAAU,EAAE,MAAM,CAAC;QACnB,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;QAClB,eAAe,EAAE,MAAM,CAAC;KACzB,GAAG,OAAO,CAAC,KAAK,CAAC;QAChB,IAAI,EAAE,MAAM,CAAC;QACb,QAAQ,EAAE,MAAM,CAAC;QACjB,IAAI,EAAE,MAAM,CAAC;QACb,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;KACnB,CAAC,CAAC;IA6CH;;OAEG;IACG,aAAa,CAAC,KAAK,EAAE;QACzB,UAAU,EAAE,MAAM,CAAC;QACnB,UAAU,EAAE,MAAM,CAAC;QACnB,WAAW,EAAE,MAAM,CAAC;QACpB,aAAa,EAAE,MAAM,CAAC;KACvB,GAAG,OAAO,CAAC,KAAK,CAAC;QAChB,IAAI,EAAE,MAAM,CAAC;QACb,MAAM,EAAE,MAAM,CAAC;QACf,IAAI,EAAE,MAAM,CAAC;QACb,GAAG,EAAE,MAAM,CAAC;QACZ,YAAY,EAAE,MAAM,EAAE,CAAC;QACvB,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;KACnB,CAAC,CAAC;IAiDH;;OAEG;IACG,sBAAsB,CAC1B,cAAc,EAAE,MAAM,EACtB,KAAK,EAAE;QACL,SAAS,EAAE,MAAM,CAAC;QAClB,WAAW,EAAE,MAAM,CAAC;QACpB,WAAW,EAAE,MAAM,CAAC;QACpB,OAAO,EAAE,MAAM,CAAC;KACjB,GACA,OAAO,CAAC;QACT,IAAI,EAAE,YAAY,GAAG,SAAS,GAAG,YAAY,GAAG,SAAS,GAAG,QAAQ,GAAG,SAAS,CAAC;QACjF,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;QAClB,UAAU,EAAE,MAAM,EAAE,CAAC;KACtB,CAAC;IA8CF;;OAEG;IACG,yBAAyB,CAC7B,cAAc,EAAE,MAAM,EACtB,KAAK,EAAE;QACL,UAAU,EAAE,MAAM,CAAC;QACnB,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;QAClB,eAAe,EAAE,MAAM,CAAC;KACzB,GACA,OAAO,CAAC,KAAK,CAAC;QACf,IAAI,EAAE,MAAM,CAAC;QACb,QAAQ,EAAE,MAAM,CAAC;QACjB,IAAI,EAAE,MAAM,CAAC;QACb,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;KACnB,CAAC,CAAC;IA4CH;;OAEG;IACG,uBAAuB,CAC3B,cAAc,EAAE,MAAM,EACtB,KAAK,EAAE;QACL,UAAU,EAAE,MAAM,CAAC;QACnB,UAAU,EAAE,MAAM,CAAC;QACnB,WAAW,EAAE,MAAM,CAAC;QACpB,aAAa,EAAE,MAAM,CAAC;KACvB,GACA,OAAO,CAAC,KAAK,CAAC;QACf,IAAI,EAAE,MAAM,CAAC;QACb,MAAM,EAAE,MAAM,CAAC;QACf,IAAI,EAAE,MAAM,CAAC;QACb,GAAG,EAAE,MAAM,CAAC;QACZ,YAAY,EAAE,MAAM,EAAE,CAAC;QACvB,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;KACnB,CAAC,CAAC;IAgDH;;OAEG;IACG,kBAAkB,CAAC,KAAK,EAAE;QAC9B,cAAc,EAAE,MAAM,CAAC;QACvB,aAAa,EAAE,MAAM,CAAC;QACtB,wBAAwB,EAAE,MAAM,CAAC;QACjC,OAAO,EAAE,MAAM,CAAC;KACjB,GAAG,OAAO,CAAC;QACV,sBAAsB,EAAE,MAAM,CAAC;QAC/B,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;KACnB,CAAC;IA2CF;;OAEG;IACG,cAAc,CAAC,KAAK,EAAE;QAC1B,QAAQ,EAAE,MAAM,CAAC;QACjB,WAAW,EAAE,MAAM,CAAC;KACrB,GAAG,OAAO,CAAC;QACV,aAAa,EAAE,KAAK,CAAC;YACnB,MAAM,EAAE,MAAM,CAAC;YACf,KAAK,EAAE,MAAM,CAAC;YACd,OAAO,EAAE,OAAO,CAAC;YACjB,UAAU,EAAE,MAAM,CAAC;YACnB,SAAS,EAAE,MAAM,CAAC;YAClB,aAAa,CAAC,EAAE,MAAM,CAAC;YACvB,YAAY,CAAC,EAAE,MAAM,CAAC;SACvB,CAAC,CAAC;KACJ,CAAC;IAoDF;;OAEG;IACG,MAAM,CAAC,KAAK,EAAE;QAClB,IAAI,EAAE,MAAM,CAAC;QACb,SAAS,EAAE,MAAM,CAAC;QAClB,UAAU,EAAE,MAAM,CAAC;QACnB,eAAe,EAAE,MAAM,EAAE,CAAC;QAC1B,aAAa,EAAE,MAAM,EAAE,CAAC;KACzB,GAAG,OAAO,CAAC;QACV,iBAAiB,EAAE,KAAK,CAAC;YACvB,IAAI,EAAE,MAAM,CAAC;YACb,IAAI,EAAE,MAAM,CAAC;YACb,QAAQ,CAAC,EAAE,MAAM,CAAC;YAClB,UAAU,EAAE,MAAM,CAAC;SACpB,CAAC,CAAC;QACH,eAAe,EAAE,KAAK,CAAC;YACrB,IAAI,EAAE,MAAM,CAAC;YACb,IAAI,EAAE,MAAM,CAAC;YACb,MAAM,CAAC,EAAE,MAAM,CAAC;YAChB,GAAG,EAAE,MAAM,CAAC;YACZ,UAAU,EAAE,MAAM,CAAC;SACpB,CAAC,CAAC;QACH,IAAI,EAAE,MAAM,CAAC;QACb,SAAS,EAAE,MAAM,CAAC;KACnB,CAAC;IAoDF;;;OAGG;IACH,OAAO,CAAC,oBAAoB;IA2G5B;;OAEG;IACG,MAAM,CAAC,KAAK,EAAE;QAClB,UAAU,EAAE,MAAM,CAAC;QACnB,UAAU,EAAE,MAAM,CAAC;QACnB,UAAU,EAAE,MAAM,CAAC;QACnB,QAAQ,EAAE,MAAM,CAAC;QACjB,QAAQ,EAAE,MAAM,CAAC;QACjB,QAAQ,EAAE,MAAM,CAAC;QACjB,GAAG,EAAE,MAAM,CAAC;QACZ,UAAU,EAAE,MAAM,CAAC;QACnB,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;QAClB,gBAAgB,EAAE,MAAM,EAAE,CAAC;KAC5B,GAAG,OAAO,CAAC;QACV,OAAO,EAAE,eAAe,GAAG,gBAAgB,GAAG,WAAW,CAAC;QAC1D,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;QAClB,cAAc,EAAE,MAAM,GAAG,QAAQ,GAAG,KAAK,GAAG,MAAM,CAAC;QACnD,eAAe,EAAE,MAAM,EAAE,CAAC;QAC1B,YAAY,EAAE,MAAM,CAAC;KACtB,CAAC;IAoGF;;OAEG;IACG,kBAAkB,CAAC,KAAK,EAAE;QAC9B,IAAI,EAAE,MAAM,CAAC;QACb,YAAY,EAAE,MAAM,CAAC;QACrB,UAAU,EAAE,MAAM,EAAE,CAAC;KACtB,GAAG,OAAO,CAAC;QACV,iBAAiB,EAAE,MAAM,CAAC,MAAM,EAAE;YAAE,KAAK,EAAE,MAAM,CAAC;YAAC,OAAO,EAAE,OAAO,CAAA;SAAE,CAAC,CAAC;QACvE,cAAc,EAAE,MAAM,EAAE,CAAC;QACzB,SAAS,EAAE,MAAM,CAAC;KACnB,CAAC;IAwDF;;OAEG;IACG,2BAA2B,CAAC,KAAK,EAAE;QACvC,IAAI,EAAE,MAAM,CAAC;QACb,kBAAkB,EAAE,KAAK,CAAC;YAAE,IAAI,EAAE,MAAM,CAAC;YAAC,SAAS,EAAE,MAAM,CAAA;SAAE,CAAC,CAAC;KAChE,GAAG,OAAO,CAAC;QACV,gBAAgB,EAAE,KAAK,CAAC;YACtB,UAAU,EAAE,MAAM,EAAE,CAAC;YACrB,WAAW,EAAE,eAAe,GAAG,UAAU,GAAG,SAAS,GAAG,aAAa,CAAC;YACtE,UAAU,EAAE,MAAM,CAAC;SACpB,CAAC,CAAC;QACH,SAAS,EAAE,MAAM,CAAC;KACnB,CAAC;IAgCF;;;OAGG;IACG,qBAAqB,CAAC,KAAK,EAAE;QACjC,UAAU,EAAE,MAAM,CAAC;QACnB,UAAU,EAAE,MAAM,CAAC;QACnB,UAAU,EAAE,MAAM,CAAC;QACnB,UAAU,EAAE,MAAM,CAAC;QACnB,aAAa,EAAE,KAAK,CAAC;YAAE,MAAM,EAAE,MAAM,CAAC;YAAC,IAAI,EAAE,MAAM,CAAC;YAAC,IAAI,EAAE,MAAM,CAAA;SAAE,CAAC,CAAC;QACrE,eAAe,EAAE,MAAM,EAAE,CAAC;QAC1B,gBAAgB,CAAC,EAAE,MAAM,CAAC;KAC3B,GAAG,OAAO,CAAC;QACV,UAAU,EAAE,KAAK,CAAC;YAChB,YAAY,EAAE,MAAM,CAAC;YACrB,YAAY,EAAE,MAAM,CAAC;YACrB,QAAQ,EAAE,QAAQ,GAAG,YAAY,GAAG,aAAa,CAAC;YAClD,UAAU,EAAE,MAAM,CAAC;SACpB,CAAC,CAAC;QACH,SAAS,EAAE,MAAM,CAAC;KACnB,CAAC;IAiIF;;OAEG;IACG,cAAc,IAAI,OAAO,CAAC,OAAO,CAAC;IA8BxC;;OAEG;IACH,SAAS,IAAI,SAAS;IAItB;;OAEG;IACH,KAAK,IAAI,UAAU;IAInB;;OAEG;IACH,mBAAmB,IAAI,SAAS,CAAC,YAAY,CAAC;IAI9C;;OAEG;IACH,qBAAqB,IAAI,SAAS,CAAC,cAAc,CAAC;IAIlD;;OAEG;IACH,cAAc,CAAC,KAAK,EAAE,YAAY,GAAG,cAAc,GAAG,SAAS,CAAC,QAAQ,CAAC,CAAC,YAAY,CAAC;IAQvF;;OAEG;IACG,uBAAuB,CAC3B,QAAQ,EAAE,oBAAoB,EAC9B,KAAK,EAAE;QACL,UAAU,EAAE,MAAM,CAAC;QACnB,aAAa,EAAE,MAAM,CAAC;QACtB,UAAU,EAAE,MAAM,CAAC;QACnB,IAAI,EAAE,MAAM,CAAC;KACd,GACA,OAAO,CAAC;QACT,IAAI,EAAE,YAAY,GAAG,SAAS,GAAG,SAAS,GAAG,YAAY,GAAG,SAAS,GAAG,KAAK,GAAG,QAAQ,GAAG,SAAS,CAAC;QACrG,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;QAClB,UAAU,EAAE,MAAM,EAAE,CAAC;KACtB,CAAC;IA2BF;;OAEG;IACG,0BAA0B,CAC9B,QAAQ,EAAE,oBAAoB,EAC9B,KAAK,EAAE;QACL,IAAI,EAAE,MAAM,CAAC;QACb,YAAY,EAAE,MAAM,CAAC;QACrB,UAAU,EAAE,MAAM,CAAC;QACnB,eAAe,EAAE,MAAM,CAAC;KACzB,GACA,OAAO,CAAC,oBAAoB,EAAE,CAAC;IAoDlC;;OAEG;IACG,wBAAwB,CAC5B,QAAQ,EAAE,oBAAoB,EAC9B,KAAK,EAAE;QACL,IAAI,EAAE,MAAM,CAAC;QACb,YAAY,EAAE,MAAM,CAAC;QACrB,WAAW,EAAE,MAAM,CAAC;QACpB,aAAa,EAAE,MAAM,CAAC;KACvB,GACA,OAAO,CAAC,kBAAkB,EAAE,CAAC;IA+ChC;;OAEG;IACG,iBAAiB,CACrB,QAAQ,EAAE,oBAAoB,EAC9B,KAAK,EAAE;QACL,UAAU,EAAE,MAAM,CAAC;QACnB,UAAU,EAAE,MAAM,CAAC;QACnB,QAAQ,EAAE,MAAM,CAAC;QACjB,QAAQ,EAAE,MAAM,CAAC;QACjB,YAAY,EAAE,MAAM,CAAC;QACrB,YAAY,EAAE,MAAM,CAAC;QACrB,UAAU,EAAE,MAAM,CAAC;QACnB,GAAG,EAAE,MAAM,CAAC;QACZ,UAAU,EAAE,MAAM,EAAE,CAAC;KACtB,GACA,OAAO,CAAC;QACT,OAAO,EAAE,eAAe,GAAG,gBAAgB,GAAG,WAAW,CAAC;QAC1D,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;QAClB,cAAc,EAAE,MAAM,GAAG,QAAQ,GAAG,KAAK,GAAG,MAAM,CAAC;QACnD,eAAe,EAAE,MAAM,EAAE,CAAC;QAC1B,YAAY,EAAE,MAAM,CAAC;KACtB,CAAC;IAwCF;;OAEG;IACG,qBAAqB,CAAC,KAAK,EAAE;QACjC,KAAK,EAAE,MAAM,CAAC;QACd,QAAQ,EAAE,MAAM,CAAC;QACjB,QAAQ,EAAE,MAAM,CAAC;QACjB,SAAS,CAAC,EAAE,MAAM,CAAC;QACnB,WAAW,EAAE,MAAM,CAAC;QACpB,YAAY,EAAE,KAAK,CAAC;YAAE,MAAM,EAAE,MAAM,CAAC;YAAC,IAAI,EAAE,MAAM,CAAC;YAAC,OAAO,EAAE,MAAM,CAAA;SAAE,CAAC,CAAC;QACvE,OAAO,EAAE,KAAK,CAAC;YAAE,IAAI,EAAE,MAAM,CAAC;YAAC,SAAS,EAAE,MAAM,CAAA;SAAE,CAAC,CAAC;QACpD,eAAe,EAAE,KAAK,CAAC;YAAE,GAAG,EAAE,MAAM,CAAC;YAAC,QAAQ,EAAE,MAAM,CAAC;YAAC,WAAW,EAAE,MAAM,CAAA;SAAE,CAAC,CAAC;KAChF,GAAG,OAAO,CAAC;QACV,KAAK,EAAE,MAAM,CAAC;QACd,OAAO,EAAE,MAAM,CAAC;QAChB,YAAY,EAAE,KAAK,CAAC;YAClB,EAAE,EAAE,MAAM,CAAC;YACX,WAAW,EAAE,MAAM,CAAC;YACpB,QAAQ,EAAE,YAAY,GAAG,UAAU,GAAG,aAAa,GAAG,WAAW,CAAC;YAClE,QAAQ,EAAE,MAAM,GAAG,QAAQ,GAAG,OAAO,CAAC;YACtC,MAAM,EAAE,OAAO,CAAC;SACjB,CAAC,CAAC;QACH,SAAS,EAAE,MAAM,EAAE,CAAC;QACpB,cAAc,EAAE,MAAM,EAAE,CAAC;KAC1B,GAAG,IAAI,CAAC;CAoGV;AAED;;;GAGG;AACH,wBAAgB,cAAc,CAAC,MAAM,CAAC,EAAE,OAAO,CAAC,SAAS,CAAC,GAAG,WAAW,CAEvE"}
|
|
1
|
+
{"version":3,"file":"ax-client.d.ts","sourceRoot":"","sources":["../../src/llm/ax-client.ts"],"names":[],"mappings":"AAAA;;;;;GAKG;AAEH,OAAO,EACL,UAAU,EAEV,WAAW,EAEZ,MAAM,YAAY,CAAC;AAQpB,OAAO,KAAK,EAAE,SAAS,EAAE,MAAM,aAAa,CAAC;AAc7C,OAAO,EAAa,KAAK,oBAAoB,EAAE,MAAM,oBAAoB,CAAC;AAC1E,OAAO,EAAiB,KAAK,gBAAgB,EAAE,MAAM,kBAAkB,CAAC;AAGxE,OAAO,EAKL,KAAK,oBAAoB,EACzB,KAAK,kBAAkB,EACxB,MAAM,6BAA6B,CAAC;AAMrC;;GAEG;AACH,eAAO,MAAM,mBAAmB,uDAG9B,CAAC;AAEH;;GAEG;AACH,eAAO,MAAM,2BAA2B,uDAGtC,CAAC;AAEH;;GAEG;AACH,eAAO,MAAM,wBAAwB,uDAGnC,CAAC;AAEH;;GAEG;AACH,eAAO,MAAM,sBAAsB,uDAGjC,CAAC;AAEH;;GAEG;AACH,eAAO,MAAM,8BAA8B,uDAGzC,CAAC;AAEH;;GAEG;AACH,eAAO,MAAM,4BAA4B,uDAGvC,CAAC;AAEH;;GAEG;AACH,eAAO,MAAM,qBAAqB,uDAOhC,CAAC;AAEH;;;GAGG;AACH,eAAO,MAAM,kBAAkB,uDAK7B,CAAC;AAEH;;;GAGG;AACH,eAAO,MAAM,4BAA4B,uDAIvC,CAAC;AAEH;;;GAGG;AACH,eAAO,MAAM,uBAAuB,uDAMlC,CAAC;AAMH,MAAM,MAAM,OAAO,GAAG,YAAY,GAAG,cAAc,GAAG,UAAU,CAAC;AA4CjE;;;;;GAKG;AACH,wBAAgB,sBAAsB,CACpC,aAAa,EAAE,MAAM,EACrB,SAAS,EAAE,MAAM,GAChB,MAAM,CAIR;AAsBD;;;;;;GAMG;AACH,wBAAgB,sBAAsB,IAAI,IAAI,CAO7C;AAED;;;;;GAKG;AACH,wBAAgB,sBAAsB,IAAI,IAAI,CAI7C;AAED;4EAC4E;AAC5E,wBAAgB,iBAAiB,IAAI,OAAO,CAE3C;AAED,8EAA8E;AAC9E,wBAAgB,kBAAkB,IAAI;IACpC,mBAAmB,EAAE,MAAM,CAAC;IAC5B,WAAW,EAAE,OAAO,CAAC;IACrB,gBAAgB,EAAE,MAAM,CAAC;IACzB,cAAc,EAAE,OAAO,CAAC;CACzB,CAOA;AAgCD,eAAO,MAAM,uBAAuB,QAIxB,CAAC;AAiFb;;;;;GAKG;AACH,wBAAgB,iBAAiB,CAC/B,MAAM,EAAE,MAAM,GAAG,IAAI,EACrB,OAAO,EAAE,MAAM,EACf,GAAG,GAAE,MAAmB,GACvB,MAAM,CAmBR;AAgCD;;;;;;;;;;;;;GAaG;AACH,wBAAgB,cAAc,CAAC,IAAI,EAAE,MAAM,GAAG,SAAS,GAAG,IAAI,GAAG,OAAO,CA2BvE;AAED;;;;;;;;;;;;;;;;;GAiBG;AACH,wBAAgB,gBAAgB,CAAC,CAAC,EAAE,MAAM,GAAG,MAAM,CAKlD;AAgBD,4DAA4D;AAC5D,wBAAgB,kBAAkB,IAAI,MAAM,CAE3C;AAED,+EAA+E;AAC/E,wBAAgB,oBAAoB,IAAI,IAAI,CAE3C;AAED;;;;;;GAMG;AACH,wBAAgB,uBAAuB,IAAI,MAAM,CAEhD;AAED;;;;;;;;GAQG;AACH,wBAAgB,YAAY,CAAC,IAAI,EAAE,MAAM,EAAE,SAAS,GAAE,MAAgC,GAAG,MAAM,CAa9F;AAED;;GAEG;AACH,qBAAa,WAAW;IACtB,OAAO,CAAC,MAAM,CAAY;IAC1B,OAAO,CAAC,EAAE,CAAa;IACvB,OAAO,CAAC,UAAU,CAA2C;IAI7D;;;;;;;;;;;;OAYG;IACH,OAAO,CAAC,iBAAiB,CAA2C;IAEpE;;;;;OAKG;IACH,OAAO,CAAC,SAAS,CAA0E;IAE3F;;;;;;;;;;;OAWG;IACH,OAAO,CAAC,gBAAgB,CAAiC;IAEzD;;;;;;;;;;;;;OAaG;IACH,oBAAoB,IAAI,gBAAgB,GAAG,SAAS;gBAIxC,MAAM,CAAC,EAAE,OAAO,CAAC,SAAS,CAAC;IAiCvC;;OAEG;IACH,WAAW,IAAI,OAAO;IAItB;;;;OAIG;IACH,mBAAmB,IAAI,IAAI;IAI3B;;;;;;OAMG;IACH,gBAAgB,IAAI,OAAO;IAI3B;;;;;OAKG;IACH,OAAO,CAAC,aAAa;IAIrB;;OAEG;IACH,OAAO,CAAC,YAAY;IAQpB;;;;;;OAMG;IACH,OAAO,CAAC,aAAa;IAkBrB;;;;OAIG;IACH,OAAO,CAAC,iBAAiB;IAiBzB;;;;;;;OAOG;IACH,OAAO,CAAC,8BAA8B;IAYtC;;;;;OAKG;IACH,OAAO,CAAC,YAAY;IA4CpB;;OAEG;IACH,OAAO,CAAC,mBAAmB;IAyP3B;;;;;OAKG;IACU,QAAQ,CAAC,CAAC,EAAE,YAAY,EAAE,MAAM,EAAE,UAAU,EAAE,MAAM,EAAE,KAAK,GAAE,YAAY,GAAG,cAAc,GAAG,qBAAoC,EAAE,UAAU,GAAE,MAAU,GAAG,OAAO,CAAC,CAAC,GAAG,IAAI,CAAC;IA2G1L;;;;;;;OAOG;YACW,aAAa;IAyc3B;;;OAGG;IACH,OAAO,CAAC,uBAAuB;IA2D/B;;OAEG;IACH,OAAO,CAAC,qBAAqB;IA8C7B;;;OAGG;IACH,OAAO,CAAC,0BAA0B;IA8ClC;;OAEG;IACG,YAAY,CAAC,KAAK,EAAE;QACxB,SAAS,EAAE,MAAM,CAAC;QAClB,WAAW,EAAE,MAAM,CAAC;QACpB,WAAW,EAAE,MAAM,CAAC;QACpB,OAAO,EAAE,MAAM,CAAC;KACjB,GAAG,OAAO,CAAC;QACV,IAAI,EAAE,YAAY,GAAG,SAAS,GAAG,YAAY,GAAG,SAAS,GAAG,QAAQ,GAAG,SAAS,CAAC;QACjF,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;QAClB,UAAU,EAAE,MAAM,EAAE,CAAC;KACtB,CAAC;IAqCF;;OAEG;IACG,eAAe,CAAC,KAAK,EAAE;QAC3B,UAAU,EAAE,MAAM,CAAC;QACnB,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;QAClB,eAAe,EAAE,MAAM,CAAC;KACzB,GAAG,OAAO,CAAC,KAAK,CAAC;QAChB,IAAI,EAAE,MAAM,CAAC;QACb,QAAQ,EAAE,MAAM,CAAC;QACjB,IAAI,EAAE,MAAM,CAAC;QACb,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;KACnB,CAAC,CAAC;IA6CH;;OAEG;IACG,aAAa,CAAC,KAAK,EAAE;QACzB,UAAU,EAAE,MAAM,CAAC;QACnB,UAAU,EAAE,MAAM,CAAC;QACnB,WAAW,EAAE,MAAM,CAAC;QACpB,aAAa,EAAE,MAAM,CAAC;KACvB,GAAG,OAAO,CAAC,KAAK,CAAC;QAChB,IAAI,EAAE,MAAM,CAAC;QACb,MAAM,EAAE,MAAM,CAAC;QACf,IAAI,EAAE,MAAM,CAAC;QACb,GAAG,EAAE,MAAM,CAAC;QACZ,YAAY,EAAE,MAAM,EAAE,CAAC;QACvB,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;KACnB,CAAC,CAAC;IAiDH;;OAEG;IACG,sBAAsB,CAC1B,cAAc,EAAE,MAAM,EACtB,KAAK,EAAE;QACL,SAAS,EAAE,MAAM,CAAC;QAClB,WAAW,EAAE,MAAM,CAAC;QACpB,WAAW,EAAE,MAAM,CAAC;QACpB,OAAO,EAAE,MAAM,CAAC;KACjB,GACA,OAAO,CAAC;QACT,IAAI,EAAE,YAAY,GAAG,SAAS,GAAG,YAAY,GAAG,SAAS,GAAG,QAAQ,GAAG,SAAS,CAAC;QACjF,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;QAClB,UAAU,EAAE,MAAM,EAAE,CAAC;KACtB,CAAC;IA8CF;;OAEG;IACG,yBAAyB,CAC7B,cAAc,EAAE,MAAM,EACtB,KAAK,EAAE;QACL,UAAU,EAAE,MAAM,CAAC;QACnB,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;QAClB,eAAe,EAAE,MAAM,CAAC;KACzB,GACA,OAAO,CAAC,KAAK,CAAC;QACf,IAAI,EAAE,MAAM,CAAC;QACb,QAAQ,EAAE,MAAM,CAAC;QACjB,IAAI,EAAE,MAAM,CAAC;QACb,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;KACnB,CAAC,CAAC;IA4CH;;OAEG;IACG,uBAAuB,CAC3B,cAAc,EAAE,MAAM,EACtB,KAAK,EAAE;QACL,UAAU,EAAE,MAAM,CAAC;QACnB,UAAU,EAAE,MAAM,CAAC;QACnB,WAAW,EAAE,MAAM,CAAC;QACpB,aAAa,EAAE,MAAM,CAAC;KACvB,GACA,OAAO,CAAC,KAAK,CAAC;QACf,IAAI,EAAE,MAAM,CAAC;QACb,MAAM,EAAE,MAAM,CAAC;QACf,IAAI,EAAE,MAAM,CAAC;QACb,GAAG,EAAE,MAAM,CAAC;QACZ,YAAY,EAAE,MAAM,EAAE,CAAC;QACvB,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;KACnB,CAAC,CAAC;IAgDH;;OAEG;IACG,kBAAkB,CAAC,KAAK,EAAE;QAC9B,cAAc,EAAE,MAAM,CAAC;QACvB,aAAa,EAAE,MAAM,CAAC;QACtB,wBAAwB,EAAE,MAAM,CAAC;QACjC,OAAO,EAAE,MAAM,CAAC;KACjB,GAAG,OAAO,CAAC;QACV,sBAAsB,EAAE,MAAM,CAAC;QAC/B,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;KACnB,CAAC;IA2CF;;OAEG;IACG,cAAc,CAAC,KAAK,EAAE;QAC1B,QAAQ,EAAE,MAAM,CAAC;QACjB,WAAW,EAAE,MAAM,CAAC;KACrB,GAAG,OAAO,CAAC;QACV,aAAa,EAAE,KAAK,CAAC;YACnB,MAAM,EAAE,MAAM,CAAC;YACf,KAAK,EAAE,MAAM,CAAC;YACd,OAAO,EAAE,OAAO,CAAC;YACjB,UAAU,EAAE,MAAM,CAAC;YACnB,SAAS,EAAE,MAAM,CAAC;YAClB,aAAa,CAAC,EAAE,MAAM,CAAC;YACvB,YAAY,CAAC,EAAE,MAAM,CAAC;SACvB,CAAC,CAAC;KACJ,CAAC;IAoDF;;OAEG;IACG,MAAM,CAAC,KAAK,EAAE;QAClB,IAAI,EAAE,MAAM,CAAC;QACb,SAAS,EAAE,MAAM,CAAC;QAClB,UAAU,EAAE,MAAM,CAAC;QACnB,eAAe,EAAE,MAAM,EAAE,CAAC;QAC1B,aAAa,EAAE,MAAM,EAAE,CAAC;KACzB,GAAG,OAAO,CAAC;QACV,iBAAiB,EAAE,KAAK,CAAC;YACvB,IAAI,EAAE,MAAM,CAAC;YACb,IAAI,EAAE,MAAM,CAAC;YACb,QAAQ,CAAC,EAAE,MAAM,CAAC;YAClB,UAAU,EAAE,MAAM,CAAC;SACpB,CAAC,CAAC;QACH,eAAe,EAAE,KAAK,CAAC;YACrB,IAAI,EAAE,MAAM,CAAC;YACb,IAAI,EAAE,MAAM,CAAC;YACb,MAAM,CAAC,EAAE,MAAM,CAAC;YAChB,GAAG,EAAE,MAAM,CAAC;YACZ,UAAU,EAAE,MAAM,CAAC;SACpB,CAAC,CAAC;QACH,IAAI,EAAE,MAAM,CAAC;QACb,SAAS,EAAE,MAAM,CAAC;KACnB,CAAC;IAoDF;;;OAGG;IACH,OAAO,CAAC,oBAAoB;IA2G5B;;OAEG;IACG,MAAM,CAAC,KAAK,EAAE;QAClB,UAAU,EAAE,MAAM,CAAC;QACnB,UAAU,EAAE,MAAM,CAAC;QACnB,UAAU,EAAE,MAAM,CAAC;QACnB,QAAQ,EAAE,MAAM,CAAC;QACjB,QAAQ,EAAE,MAAM,CAAC;QACjB,QAAQ,EAAE,MAAM,CAAC;QACjB,GAAG,EAAE,MAAM,CAAC;QACZ,UAAU,EAAE,MAAM,CAAC;QACnB,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;QAClB,gBAAgB,EAAE,MAAM,EAAE,CAAC;KAC5B,GAAG,OAAO,CAAC;QACV,OAAO,EAAE,eAAe,GAAG,gBAAgB,GAAG,WAAW,CAAC;QAC1D,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;QAClB,cAAc,EAAE,MAAM,GAAG,QAAQ,GAAG,KAAK,GAAG,MAAM,CAAC;QACnD,eAAe,EAAE,MAAM,EAAE,CAAC;QAC1B,YAAY,EAAE,MAAM,CAAC;KACtB,CAAC;IAoGF;;OAEG;IACG,kBAAkB,CAAC,KAAK,EAAE;QAC9B,IAAI,EAAE,MAAM,CAAC;QACb,YAAY,EAAE,MAAM,CAAC;QACrB,UAAU,EAAE,MAAM,EAAE,CAAC;KACtB,GAAG,OAAO,CAAC;QACV,iBAAiB,EAAE,MAAM,CAAC,MAAM,EAAE;YAAE,KAAK,EAAE,MAAM,CAAC;YAAC,OAAO,EAAE,OAAO,CAAA;SAAE,CAAC,CAAC;QACvE,cAAc,EAAE,MAAM,EAAE,CAAC;QACzB,SAAS,EAAE,MAAM,CAAC;KACnB,CAAC;IAwDF;;OAEG;IACG,2BAA2B,CAAC,KAAK,EAAE;QACvC,IAAI,EAAE,MAAM,CAAC;QACb,kBAAkB,EAAE,KAAK,CAAC;YAAE,IAAI,EAAE,MAAM,CAAC;YAAC,SAAS,EAAE,MAAM,CAAA;SAAE,CAAC,CAAC;KAChE,GAAG,OAAO,CAAC;QACV,gBAAgB,EAAE,KAAK,CAAC;YACtB,UAAU,EAAE,MAAM,EAAE,CAAC;YACrB,WAAW,EAAE,eAAe,GAAG,UAAU,GAAG,SAAS,GAAG,aAAa,CAAC;YACtE,UAAU,EAAE,MAAM,CAAC;SACpB,CAAC,CAAC;QACH,SAAS,EAAE,MAAM,CAAC;KACnB,CAAC;IAgCF;;;OAGG;IACG,qBAAqB,CAAC,KAAK,EAAE;QACjC,UAAU,EAAE,MAAM,CAAC;QACnB,UAAU,EAAE,MAAM,CAAC;QACnB,UAAU,EAAE,MAAM,CAAC;QACnB,UAAU,EAAE,MAAM,CAAC;QACnB,aAAa,EAAE,KAAK,CAAC;YAAE,MAAM,EAAE,MAAM,CAAC;YAAC,IAAI,EAAE,MAAM,CAAC;YAAC,IAAI,EAAE,MAAM,CAAA;SAAE,CAAC,CAAC;QACrE,eAAe,EAAE,MAAM,EAAE,CAAC;QAC1B,gBAAgB,CAAC,EAAE,MAAM,CAAC;KAC3B,GAAG,OAAO,CAAC;QACV,UAAU,EAAE,KAAK,CAAC;YAChB,YAAY,EAAE,MAAM,CAAC;YACrB,YAAY,EAAE,MAAM,CAAC;YACrB,QAAQ,EAAE,QAAQ,GAAG,YAAY,GAAG,aAAa,CAAC;YAClD,UAAU,EAAE,MAAM,CAAC;SACpB,CAAC,CAAC;QACH,SAAS,EAAE,MAAM,CAAC;KACnB,CAAC;IAiIF;;OAEG;IACG,cAAc,IAAI,OAAO,CAAC,OAAO,CAAC;IA8BxC;;OAEG;IACH,SAAS,IAAI,SAAS;IAItB;;OAEG;IACH,KAAK,IAAI,UAAU;IAInB;;OAEG;IACH,mBAAmB,IAAI,SAAS,CAAC,YAAY,CAAC;IAI9C;;OAEG;IACH,qBAAqB,IAAI,SAAS,CAAC,cAAc,CAAC;IAIlD;;OAEG;IACH,cAAc,CAAC,KAAK,EAAE,YAAY,GAAG,cAAc,GAAG,SAAS,CAAC,QAAQ,CAAC,CAAC,YAAY,CAAC;IAQvF;;OAEG;IACG,uBAAuB,CAC3B,QAAQ,EAAE,oBAAoB,EAC9B,KAAK,EAAE;QACL,UAAU,EAAE,MAAM,CAAC;QACnB,aAAa,EAAE,MAAM,CAAC;QACtB,UAAU,EAAE,MAAM,CAAC;QACnB,IAAI,EAAE,MAAM,CAAC;KACd,GACA,OAAO,CAAC;QACT,IAAI,EAAE,YAAY,GAAG,SAAS,GAAG,SAAS,GAAG,YAAY,GAAG,SAAS,GAAG,KAAK,GAAG,QAAQ,GAAG,SAAS,CAAC;QACrG,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;QAClB,UAAU,EAAE,MAAM,EAAE,CAAC;KACtB,CAAC;IA2BF;;OAEG;IACG,0BAA0B,CAC9B,QAAQ,EAAE,oBAAoB,EAC9B,KAAK,EAAE;QACL,IAAI,EAAE,MAAM,CAAC;QACb,YAAY,EAAE,MAAM,CAAC;QACrB,UAAU,EAAE,MAAM,CAAC;QACnB,eAAe,EAAE,MAAM,CAAC;KACzB,GACA,OAAO,CAAC,oBAAoB,EAAE,CAAC;IAoDlC;;OAEG;IACG,wBAAwB,CAC5B,QAAQ,EAAE,oBAAoB,EAC9B,KAAK,EAAE;QACL,IAAI,EAAE,MAAM,CAAC;QACb,YAAY,EAAE,MAAM,CAAC;QACrB,WAAW,EAAE,MAAM,CAAC;QACpB,aAAa,EAAE,MAAM,CAAC;KACvB,GACA,OAAO,CAAC,kBAAkB,EAAE,CAAC;IA+ChC;;OAEG;IACG,iBAAiB,CACrB,QAAQ,EAAE,oBAAoB,EAC9B,KAAK,EAAE;QACL,UAAU,EAAE,MAAM,CAAC;QACnB,UAAU,EAAE,MAAM,CAAC;QACnB,QAAQ,EAAE,MAAM,CAAC;QACjB,QAAQ,EAAE,MAAM,CAAC;QACjB,YAAY,EAAE,MAAM,CAAC;QACrB,YAAY,EAAE,MAAM,CAAC;QACrB,UAAU,EAAE,MAAM,CAAC;QACnB,GAAG,EAAE,MAAM,CAAC;QACZ,UAAU,EAAE,MAAM,EAAE,CAAC;KACtB,GACA,OAAO,CAAC;QACT,OAAO,EAAE,eAAe,GAAG,gBAAgB,GAAG,WAAW,CAAC;QAC1D,UAAU,EAAE,MAAM,CAAC;QACnB,SAAS,EAAE,MAAM,CAAC;QAClB,cAAc,EAAE,MAAM,GAAG,QAAQ,GAAG,KAAK,GAAG,MAAM,CAAC;QACnD,eAAe,EAAE,MAAM,EAAE,CAAC;QAC1B,YAAY,EAAE,MAAM,CAAC;KACtB,CAAC;IAwCF;;OAEG;IACG,qBAAqB,CAAC,KAAK,EAAE;QACjC,KAAK,EAAE,MAAM,CAAC;QACd,QAAQ,EAAE,MAAM,CAAC;QACjB,QAAQ,EAAE,MAAM,CAAC;QACjB,SAAS,CAAC,EAAE,MAAM,CAAC;QACnB,WAAW,EAAE,MAAM,CAAC;QACpB,YAAY,EAAE,KAAK,CAAC;YAAE,MAAM,EAAE,MAAM,CAAC;YAAC,IAAI,EAAE,MAAM,CAAC;YAAC,OAAO,EAAE,MAAM,CAAA;SAAE,CAAC,CAAC;QACvE,OAAO,EAAE,KAAK,CAAC;YAAE,IAAI,EAAE,MAAM,CAAC;YAAC,SAAS,EAAE,MAAM,CAAA;SAAE,CAAC,CAAC;QACpD,eAAe,EAAE,KAAK,CAAC;YAAE,GAAG,EAAE,MAAM,CAAC;YAAC,QAAQ,EAAE,MAAM,CAAC;YAAC,WAAW,EAAE,MAAM,CAAA;SAAE,CAAC,CAAC;KAChF,GAAG,OAAO,CAAC;QACV,KAAK,EAAE,MAAM,CAAC;QACd,OAAO,EAAE,MAAM,CAAC;QAChB,YAAY,EAAE,KAAK,CAAC;YAClB,EAAE,EAAE,MAAM,CAAC;YACX,WAAW,EAAE,MAAM,CAAC;YACpB,QAAQ,EAAE,YAAY,GAAG,UAAU,GAAG,aAAa,GAAG,WAAW,CAAC;YAClE,QAAQ,EAAE,MAAM,GAAG,QAAQ,GAAG,OAAO,CAAC;YACtC,MAAM,EAAE,OAAO,CAAC;SACjB,CAAC,CAAC;QACH,SAAS,EAAE,MAAM,EAAE,CAAC;QACpB,cAAc,EAAE,MAAM,EAAE,CAAC;KAC1B,GAAG,IAAI,CAAC;CAoGV;AAED;;;GAGG;AACH,wBAAgB,cAAc,CAAC,MAAM,CAAC,EAAE,OAAO,CAAC,SAAS,CAAC,GAAG,WAAW,CAEvE"}
|
package/dist/llm/ax-client.js
CHANGED
|
@@ -1227,6 +1227,16 @@ INFORMATION EXPOSURE (CWE-200/209) SPECIFIC:
|
|
|
1227
1227
|
}
|
|
1228
1228
|
emitAttempt('timeout', attemptStart);
|
|
1229
1229
|
this.lastErrorCategory = 'timeout';
|
|
1230
|
+
// cognium-ai#244 — AIMD back-off on client-side timeout.
|
|
1231
|
+
// Symmetric to the 429 back-off below: a timeout after
|
|
1232
|
+
// retry-exhaustion on a healthy endpoint (not tripped by
|
|
1233
|
+
// the connection-failure breaker at line 1366) signals
|
|
1234
|
+
// queue depth > server capacity. Halve concurrency; the
|
|
1235
|
+
// cooldown in onClientTimeout collapses bursts so we don't
|
|
1236
|
+
// over-decrease on a run of slow verifyBatch calls.
|
|
1237
|
+
if (adaptiveConcurrency) {
|
|
1238
|
+
applyAdaptiveConcurrency(adaptiveConcurrency.onClientTimeout());
|
|
1239
|
+
}
|
|
1230
1240
|
}
|
|
1231
1241
|
else {
|
|
1232
1242
|
console.error('LLM fetch failed:', fetchError);
|