@tryhamster/gerbil 1.0.11 → 1.1.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +13 -0
- package/dist/architectures-C1I5V3Dt.mjs.map +1 -1
- package/dist/cli.mjs +7 -7
- package/dist/cli.mjs.map +1 -1
- package/dist/frameworks/express.mjs +1 -1
- package/dist/frameworks/fastify.mjs +1 -1
- package/dist/frameworks/hono.mjs +1 -1
- package/dist/frameworks/next.d.mts +2 -2
- package/dist/frameworks/next.mjs +1 -1
- package/dist/frameworks/trpc.mjs +1 -1
- package/dist/gerbil-BlacEbZh.mjs +4 -0
- package/dist/{gerbil-2_wciMRP.d.mts → gerbil-DZbWbIm2.d.mts} +2 -2
- package/dist/{gerbil-2_wciMRP.d.mts.map → gerbil-DZbWbIm2.d.mts.map} +1 -1
- package/dist/{gerbil-Ef5IbSQu.mjs → gerbil-DpiwMe0y.mjs} +2 -2
- package/dist/{gerbil-Ef5IbSQu.mjs.map → gerbil-DpiwMe0y.mjs.map} +1 -1
- package/dist/gpu/hooks.d.mts +1 -1
- package/dist/gpu/index.d.mts +1 -1
- package/dist/gpu/index.mjs +2 -2
- package/dist/{gpu-BaSjl8vT.mjs → gpu-CUOj5CaA.mjs} +7 -5
- package/dist/gpu-CUOj5CaA.mjs.map +1 -0
- package/dist/{index-CGYIAChm.d.mts → index-CKszv3lt.d.mts} +30 -1
- package/dist/index-CKszv3lt.d.mts.map +1 -0
- package/dist/index.d.mts +2 -2
- package/dist/index.mjs +4 -4
- package/dist/integrations/ai-sdk.mjs +1 -1
- package/dist/integrations/langchain.mjs +1 -1
- package/dist/integrations/llamaindex.mjs +1 -1
- package/dist/integrations/mcp.d.mts +2 -2
- package/dist/integrations/mcp.mjs +4 -4
- package/dist/{mcp-Df5e-Ca7.mjs → mcp-Cb-4xYP6.mjs} +3 -3
- package/dist/{mcp-Df5e-Ca7.mjs.map → mcp-Cb-4xYP6.mjs.map} +1 -1
- package/dist/{moonshine-stt-BUZfQUFa.mjs → moonshine-stt-aSSceh2Y.mjs} +174 -9
- package/dist/moonshine-stt-aSSceh2Y.mjs.map +1 -0
- package/dist/moonshine-stt-qS4hohbf.mjs +4 -0
- package/dist/{one-liner-BX0_po5f.mjs → one-liner-DYAlbxBF.mjs} +2 -2
- package/dist/{one-liner-BX0_po5f.mjs.map → one-liner-DYAlbxBF.mjs.map} +1 -1
- package/dist/{repl-BD0XXdOn.mjs → repl-BtDu0j1n.mjs} +3 -3
- package/dist/skills/index.d.mts +2 -2
- package/dist/skills/index.mjs +3 -3
- package/dist/{skills-C1jGVp7L.mjs → skills-DVttBRMZ.mjs} +2 -2
- package/dist/{skills-C1jGVp7L.mjs.map → skills-DVttBRMZ.mjs.map} +1 -1
- package/package.json +1 -1
- package/dist/gerbil-BjfUymxY.mjs +0 -4
- package/dist/gpu-BaSjl8vT.mjs.map +0 -1
- package/dist/index-CGYIAChm.d.mts.map +0 -1
- package/dist/moonshine-stt-BJWv2IQM.mjs +0 -4
- package/dist/moonshine-stt-BUZfQUFa.mjs.map +0 -1
package/README.md
CHANGED
|
@@ -108,6 +108,19 @@ engine.destroy();
|
|
|
108
108
|
engine with `generate`, `stream`, `describeImage`, `embed`, and `speak`. See the
|
|
109
109
|
[native engine docs](#supported-models) below for the model lineup.
|
|
110
110
|
|
|
111
|
+
### Benchmark it
|
|
112
|
+
|
|
113
|
+
The same engine runs server-side on Node (via Dawn), so you can watch local decode
|
|
114
|
+
rip on your own GPU — no API key, no cloud:
|
|
115
|
+
|
|
116
|
+
```bash
|
|
117
|
+
npx @tryhamster/gerbil bench # tok/s + first-token latency on your machine
|
|
118
|
+
```
|
|
119
|
+
|
|
120
|
+
Reports steady-state decode tok/s, time-to-first-token, and the device it ran on.
|
|
121
|
+
For a copy-pasteable version see [`examples/benchmark.ts`](./examples/benchmark.ts)
|
|
122
|
+
(and the rest of [`examples/`](./examples/)).
|
|
123
|
+
|
|
111
124
|
## React Quickstart
|
|
112
125
|
|
|
113
126
|
`useEngine` (from `@tryhamster/gerbil/gpu/hooks`) owns the full engine lifecycle —
|