@skydiveai/pi-extensions 0.1.0-beta.1968 → 0.1.0-beta.1973
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/dist/index.mjs +6 -6
- package/package.json +1 -1
package/dist/index.mjs
CHANGED
|
@@ -1107,13 +1107,13 @@ const env = process.env;
|
|
|
1107
1107
|
/**
|
|
1108
1108
|
* Fraction of the model's context window we're willing to spend on MCP tool
|
|
1109
1109
|
* schemas. Tool definitions are sent on every prompt, so they permanently eat
|
|
1110
|
-
* into the window available for the conversation
|
|
1111
|
-
*
|
|
1112
|
-
* 200K window is ~
|
|
1113
|
-
* MCP setup; of a 32K window it's ~
|
|
1114
|
-
* before a small model chokes.
|
|
1110
|
+
* into the window available for the conversation, but a generous tool budget is
|
|
1111
|
+
* worth more than a marginally larger conversation window given how the harness
|
|
1112
|
+
* is used. 0.35 of a 200K window is ~70K tokens of tool schema, comfortably
|
|
1113
|
+
* more than any sane MCP setup; of a 32K window it's ~11.2K, which still forces
|
|
1114
|
+
* truncation before a small model chokes.
|
|
1115
1115
|
*/
|
|
1116
|
-
const DEFAULT_MCP_TOOL_TOKEN_BUDGET_FRACTION = .
|
|
1116
|
+
const DEFAULT_MCP_TOOL_TOKEN_BUDGET_FRACTION = .35;
|
|
1117
1117
|
/**
|
|
1118
1118
|
* Floor for the token budget when the model's context window is unknown at
|
|
1119
1119
|
* reconcile time (e.g. the model hasn't been resolved yet). Generous enough not
|