llmtrim 0.1.8-aarch64-linux → 0.1.9-aarch64-linux
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- checksums.yaml +4 -4
- data/README.md +2 -2
- data/lib/llmtrim/libllmtrim_ffi.so +0 -0
- metadata +1 -1
checksums.yaml
CHANGED
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
---
|
|
2
2
|
SHA256:
|
|
3
|
-
metadata.gz:
|
|
4
|
-
data.tar.gz:
|
|
3
|
+
metadata.gz: 6d1113b44d84957e5fc47130ce7db007a2b0a9aa8ca122a4f98ee88be237c1ac
|
|
4
|
+
data.tar.gz: 2ddfacac2ffb2ce72e3ecc53efc8b04b2fe9ef4adcfdf0773cc0c77ab2a48a49
|
|
5
5
|
SHA512:
|
|
6
|
-
metadata.gz:
|
|
7
|
-
data.tar.gz:
|
|
6
|
+
metadata.gz: 5410f62dffaad4feb379e338731d81f026ce956eae14196e7e453b9552f50d0212e60ed4e6d7dde36ade759c7e96412ade57d303a588f88d3b417bf141a74dad
|
|
7
|
+
data.tar.gz: fc0906f953e8b1344ff234ed15e5005fd2a4223cd92be996e7f56bd43d56d82053623589ad8e358375d7b7669049ea55ea476f7cb5372c55e4574449e518e3c0
|
data/README.md
CHANGED
|
@@ -1,7 +1,7 @@
|
|
|
1
1
|
# llmtrim (Ruby)
|
|
2
2
|
|
|
3
3
|
Native, in-process bindings to the [llmtrim](https://github.com/fkiene/llmtrim)
|
|
4
|
-
compression engine
|
|
4
|
+
compression engine, cutting LLM input tokens 30–90% with zero extra model calls, no network,
|
|
5
5
|
no server. The compiled engine is bundled in the gem, so no Rust toolchain is needed.
|
|
6
6
|
|
|
7
7
|
```ruby
|
|
@@ -15,7 +15,7 @@ puts "#{out.input_tokens_before} -> #{out.input_tokens_after}"
|
|
|
15
15
|
# send out.request_json to the provider
|
|
16
16
|
```
|
|
17
17
|
|
|
18
|
-
`compress(input, provider, preset)
|
|
18
|
+
`compress(input, provider, preset)`: `provider` is `Llmtrim::Provider::OPEN_AI` /
|
|
19
19
|
`ANTHROPIC` / `GOOGLE` or `nil` to auto-detect; `preset` is a workload name
|
|
20
20
|
(`"aggressive"`, `"agent"`, `"code"`, `"rag"`, `"safe"`, …) or `nil` for the environment
|
|
21
21
|
config. Raises `Llmtrim::LlmtrimError::Compress` / `UnknownPreset` on error.
|
|
Binary file
|