pi-coralbricks-provider 1.0.9 → 1.0.10
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +6 -2
- package/package.json +1 -1
package/README.md
CHANGED
|
@@ -130,10 +130,11 @@ Verified against the live gateway:
|
|
|
130
130
|
| Model | Format | off | low | medium | high | max |
|
|
131
131
|
|-------|--------|-----|-----|--------|------|-----|
|
|
132
132
|
| GLM 5.3 FP4 | `thinking: {type}` + `reasoning_effort` | ✅ | ✅ | — | ✅ | ✅ |
|
|
133
|
+
| GLM 5.3 Flash | `thinking: {type}` + `reasoning_effort` | ✅ | ✅ | — | ✅ | ✅ |
|
|
133
134
|
| Kimi K3 | `reasoning_effort` | — | ✅ | — | ✅ | ✅ |
|
|
134
135
|
| GPT-OSS 120B | `reasoning_effort` | — | ✅ | ✅ | ✅ | — |
|
|
135
136
|
|
|
136
|
-
- **GLM** accepts zai-style `thinking: {type: "disabled"}` on Coral — pi's *off* level
|
|
137
|
+
- **GLM** accepts zai-style `thinking: {type: "disabled"}` on Coral — pi's *off* level turns thinking off, though a short preamble of a few dozen tokens can still appear (the upstream Z.ai API has no off at all, so this differs from the canonical Z.ai map).
|
|
137
138
|
- **Kimi K3** always thinks: `reasoning_effort: "none"` is accepted but doesn't disable reasoning, so *off* is intentionally not offered. Assistant replays include `reasoning_content`.
|
|
138
139
|
- **GPT-OSS** exposes the standard low/medium/high reasoning efforts; reasoning arrives in `reasoning_content`.
|
|
139
140
|
- Coral streams a duplicate `reasoning` field alongside `reasoning_content`; pi dedupes these automatically.
|
|
@@ -158,17 +159,20 @@ Merge order: `[live|cache|embedded] → patch.json → custom-models.json`
|
|
|
158
159
|
|
|
159
160
|
## Inference-Quality Testing
|
|
160
161
|
|
|
161
|
-
Validated with [synbad](https://github.com/synthetic-lab/synbad) — Synthetic's tool-calling and reasoning-parsing eval suite for LLM inference providers (`--count 1`, `--reasoning-effort high`; the GLM/Kimi runs used the 15-eval suite, the GPT-OSS
|
|
162
|
+
Validated with [synbad](https://github.com/synthetic-lab/synbad) — Synthetic's tool-calling and reasoning-parsing eval suite for LLM inference providers (`--count 1`, `--reasoning-effort high`; the GLM 5.3/Kimi runs used the 15-eval suite, the GPT-OSS and GLM 5.3 Flash runs on 2026-09-15 the current 13-eval suite):
|
|
162
163
|
|
|
163
164
|
| Model | Unary | Stream | Notes |
|
|
164
165
|
|-------|-------|--------|-------|
|
|
165
166
|
| GLM 5.3 FP4 | 15/15 ✅ | 15/15 ✅ | |
|
|
167
|
+
| GLM 5.3 Flash | 13/13 ✅ | 12/13 ⚠️ | re-run 2026-09-15; see below |
|
|
166
168
|
| Kimi K3 | 15/15 ✅ | 15/15 ✅ | |
|
|
167
169
|
| GPT-OSS 120B | 11/13 ⚠️ | 12/13 ⚠️ | re-run 2026-09-15; see below |
|
|
168
170
|
| GLM 5.2 FP4 (retired) | 15/15 ✅ | 15/15 ✅ | evaluated before Coral retired the model |
|
|
169
171
|
|
|
170
172
|
The gpt-oss misses are model-side, not transport: `tools/parallel-tool` fails in both modes because it answers "Paris and London" with one call after another instead of two parallel calls even when `parallel_tool_calls: true`; `reasoning/reasoning-claude-tool-call` (a prompt that asks the model to "put the tool call inside your thinking") occasionally gets exactly that in unary mode — the model narrates the call in its reasoning and answers in text — while streaming passed it every time.
|
|
171
173
|
|
|
174
|
+
GLM 5.3 Flash's streaming miss is `reasoning/reasoning-parsing`: on the trivial prompt it uses, Flash occasionally answers without a think block (about 1 in 5 streams and 1 in 8 unary responses in our sampling); the answer itself is unaffected, and a second full unary pass was 13/13.
|
|
175
|
+
|
|
172
176
|
Reproduce:
|
|
173
177
|
|
|
174
178
|
```bash
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "pi-coralbricks-provider",
|
|
3
|
-
"version": "1.0.
|
|
3
|
+
"version": "1.0.10",
|
|
4
4
|
"description": "CoralBricks provider extension for pi - Access GLM 5.3, GLM 5.3 Flash, Kimi K3, and GPT-OSS 120B through the Coral Inference API",
|
|
5
5
|
"author": "monotykamary",
|
|
6
6
|
"homepage": "https://github.com/monotykamary/pi-coralbricks-provider#readme",
|