@kreuzberg/liter-llm-node 1.5.0 → 1.6.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/README.md
CHANGED
|
@@ -72,7 +72,7 @@
|
|
|
72
72
|
</a>
|
|
73
73
|
</div>
|
|
74
74
|
|
|
75
|
-
Universal LLM API client for TypeScript and Node.js. Access 143
|
|
75
|
+
Universal LLM API client for TypeScript and Node.js. Access 143 LLM providers through a single interface with native NAPI-RS bindings, async/await, streaming, tool calling, and full TypeScript type definitions.
|
|
76
76
|
|
|
77
77
|
## What This Package Provides
|
|
78
78
|
|
|
@@ -151,7 +151,7 @@ const chunks = await client.chatStream({
|
|
|
151
151
|
messages: [{ role: "user", content: "Tell me a story" }],
|
|
152
152
|
});
|
|
153
153
|
|
|
154
|
-
for (const chunk of chunks) {
|
|
154
|
+
for await (const chunk of chunks) {
|
|
155
155
|
process.stdout.write(chunk.choices?.[0]?.delta?.content ?? "");
|
|
156
156
|
}
|
|
157
157
|
console.log();
|
|
@@ -220,7 +220,7 @@ This binding uses NAPI-RS to provide native Node.js bindings with:
|
|
|
220
220
|
|
|
221
221
|
## Features
|
|
222
222
|
|
|
223
|
-
### Supported Providers (143
|
|
223
|
+
### Supported Providers (143)
|
|
224
224
|
|
|
225
225
|
Route to any provider using the `provider/model` prefix convention:
|
|
226
226
|
|
|
@@ -240,7 +240,7 @@ Route to any provider using the `provider/model` prefix convention:
|
|
|
240
240
|
|
|
241
241
|
### Key Capabilities
|
|
242
242
|
|
|
243
|
-
- **Provider Routing** -- Single client for 143
|
|
243
|
+
- **Provider Routing** -- Single client for 143 LLM providers via `provider/model` prefix
|
|
244
244
|
- **Local LLMs** — Connect to locally-hosted models via Ollama, LM Studio, vLLM, llama.cpp, and other local inference servers
|
|
245
245
|
- **Unified API** -- Consistent `chat`, `chat_stream`, `embeddings`, `list_models` interface
|
|
246
246
|
- **Streaming** -- Real-time token streaming via `chat_stream`
|
|
@@ -261,7 +261,7 @@ Built on a compiled Rust core for speed and safety:
|
|
|
261
261
|
|
|
262
262
|
## Provider Routing
|
|
263
263
|
|
|
264
|
-
Route to 143
|
|
264
|
+
Route to 143 providers using the `provider/model` prefix convention:
|
|
265
265
|
|
|
266
266
|
```text
|
|
267
267
|
openai/gpt-4o
|
|
@@ -290,12 +290,13 @@ See the [proxy server documentation](https://docs.liter-llm.kreuzberg.dev/server
|
|
|
290
290
|
|
|
291
291
|
## Part of Kreuzberg.dev
|
|
292
292
|
|
|
293
|
-
- [Kreuzberg](https://github.com/kreuzberg-dev/kreuzberg) — document intelligence: text, tables, metadata from
|
|
293
|
+
- [Kreuzberg](https://github.com/kreuzberg-dev/kreuzberg) — document intelligence: text, tables, metadata from 91+ formats with optional OCR.
|
|
294
294
|
- [Kreuzberg Cloud](https://github.com/kreuzberg-dev/kreuzberg-cloud) — managed extraction API with SDKs, dashboards, and observability.
|
|
295
295
|
- [kreuzcrawl](https://github.com/kreuzberg-dev/kreuzcrawl) — web crawling and scraping with HTML→Markdown and headless-Chrome fallback.
|
|
296
296
|
- [html-to-markdown](https://github.com/kreuzberg-dev/html-to-markdown) — fast, lossless HTML→Markdown engine.
|
|
297
|
+
- [liter-llm](https://github.com/kreuzberg-dev/liter-llm) — universal LLM API client with native bindings for 14 languages and 143 providers.
|
|
297
298
|
- [tree-sitter-language-pack](https://github.com/kreuzberg-dev/tree-sitter-language-pack) — tree-sitter grammars and code-intelligence primitives.
|
|
298
|
-
- [alef](https://github.com/kreuzberg-dev/alef) — the polyglot binding generator that produces
|
|
299
|
+
- [alef](https://github.com/kreuzberg-dev/alef) — the polyglot binding generator that produces every per-language binding across the 5 polyglot repos.
|
|
299
300
|
- [Discord](https://discord.gg/xt9WY3GnKR) — community, roadmap, announcements.
|
|
300
301
|
|
|
301
302
|
## Contributing
|