kalavai-client 0.5.30__py3-none-any.whl → 0.6.0__py3-none-any.whl
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- kalavai_client/__init__.py +1 -1
- kalavai_client/assets/apps.yaml +9 -7
- kalavai_client/assets/apps_values.yaml +0 -2
- kalavai_client/assets/docker-compose-gui.yaml +3 -0
- kalavai_client/assets/docker-compose-template.yaml +1 -1
- kalavai_client/auth.py +92 -50
- kalavai_client/bridge_api.py +39 -26
- kalavai_client/cli.py +112 -103
- kalavai_client/core.py +108 -113
- kalavai_client/env.py +1 -1
- kalavai_client/utils.py +66 -133
- {kalavai_client-0.5.30.dist-info → kalavai_client-0.6.0.dist-info}/METADATA +6 -27
- kalavai_client-0.6.0.dist-info/RECORD +25 -0
- {kalavai_client-0.5.30.dist-info → kalavai_client-0.6.0.dist-info}/WHEEL +1 -1
- kalavai_client-0.5.30.dist-info/RECORD +0 -25
- {kalavai_client-0.5.30.dist-info → kalavai_client-0.6.0.dist-info}/LICENSE +0 -0
- {kalavai_client-0.5.30.dist-info → kalavai_client-0.6.0.dist-info}/entry_points.txt +0 -0
@@ -1,6 +1,6 @@
|
|
1
1
|
Metadata-Version: 2.3
|
2
2
|
Name: kalavai-client
|
3
|
-
Version: 0.
|
3
|
+
Version: 0.6.0
|
4
4
|
Summary: Client app for kalavai platform
|
5
5
|
License: Apache-2.0
|
6
6
|
Keywords: LLM,platform
|
@@ -23,7 +23,6 @@ Classifier: Programming Language :: Python :: 3.12
|
|
23
23
|
Classifier: Programming Language :: Python :: 3.13
|
24
24
|
Provides-Extra: dev
|
25
25
|
Requires-Dist: Pillow (==10.3.0)
|
26
|
-
Requires-Dist: anvil-uplink (==0.5.1)
|
27
26
|
Requires-Dist: arguably (>=1.2.5)
|
28
27
|
Requires-Dist: build ; extra == "dev"
|
29
28
|
Requires-Dist: fastapi (==0.115.8)
|
@@ -53,10 +52,10 @@ Description-Content-Type: text/markdown
|
|
53
52
|
|
54
53
|
</div>
|
55
54
|
|
56
|
-
⭐⭐⭐ **Kalavai and our
|
55
|
+
⭐⭐⭐ **Kalavai and our AI pools are open source, and free to use in both commercial and non-commercial purposes. If you find it useful, consider supporting us by [giving a star to our GitHub project](https://github.com/kalavai-net/kalavai-client), joining our [discord channel](https://discord.gg/YN6ThTJKbM), follow our [Substack](https://kalavainet.substack.com/) and give us a [review on Product Hunt](https://www.producthunt.com/products/kalavai/reviews/new).**
|
57
56
|
|
58
57
|
|
59
|
-
# Kalavai: turn your devices into a scalable
|
58
|
+
# Kalavai: turn your devices into a scalable AI platform
|
60
59
|
|
61
60
|
### Taming the adoption of Large Language Models
|
62
61
|
|
@@ -71,7 +70,7 @@ Description-Content-Type: text/markdown
|
|
71
70
|
|
72
71
|
## What can Kalavai do?
|
73
72
|
|
74
|
-
Kalavai's goal is to make using LLMs in real applications accessible and affordable to all. It's a _magic box_ that **integrates all the components required to make
|
73
|
+
Kalavai's goal is to make using AI (LLMs, AI agents) in real applications accessible and affordable to all. It's a _magic box_ that **integrates all the components required to make AI useful in the age of massive computing**, from model deployment and orchestration to Agentic AI.
|
75
74
|
|
76
75
|
### Core features
|
77
76
|
|
@@ -86,18 +85,6 @@ Kalavai's goal is to make using LLMs in real applications accessible and afforda
|
|
86
85
|
|
87
86
|
**<summary>Video tutorials</summary>**
|
88
87
|
|
89
|
-
### Aggregate multiple devices in an LLM pool
|
90
|
-
|
91
|
-
https://github.com/user-attachments/assets/4be59886-1b76-4400-ab5c-c803e3e414ec
|
92
|
-
|
93
|
-
### Deploy LLMs across the pool
|
94
|
-
|
95
|
-
https://github.com/user-attachments/assets/ea57a2ab-3924-4097-be2a-504e0988fbb1
|
96
|
-
|
97
|
-
### Single point of entry for all models (GUI + API)
|
98
|
-
|
99
|
-
https://github.com/user-attachments/assets/7df73bbc-d129-46aa-8ce5-0735177dedeb
|
100
|
-
|
101
88
|
### Self-hosted LLM pools
|
102
89
|
|
103
90
|
https://github.com/user-attachments/assets/0d2316f3-79ea-46ac-b41e-8ef720f52672
|
@@ -211,7 +198,7 @@ pip install kalavai-client
|
|
211
198
|
```
|
212
199
|
|
213
200
|
|
214
|
-
## Create a a local, private
|
201
|
+
## Create a a local, private AI pool
|
215
202
|
|
216
203
|
> Kalavai is **free to use, no caps, for both commercial and non-commercial purposes**. All you need to get started is one or more computers that can see each other (i.e. within the same network), and you are good to go. If you are interested in join computers in different locations / networks, [contact us](mailto:info@kalavai.net) or [book a demo](https://app.onecal.io/b/kalavai/book-a-demo) with the founders.
|
217
204
|
|
@@ -228,13 +215,6 @@ This will expose the GUI and the backend services in localhost. By default, the
|
|
228
215
|
Check out our [getting started guide](https://kalavai-net.github.io/kalavai-client/getting_started/) for next steps.
|
229
216
|
|
230
217
|
|
231
|
-
## Public LLM pools: crowdsource community resources
|
232
|
-
|
233
|
-
This is the **easiest and most powerful** way to experience Kalavai. It affords users the full resource capabilities of the community and access to all its deployed LLMs, via an [OpenAI-compatible endpoint](https://kalavai-net.github.io/kalavai-client/public_llm_pool/#single-api-endpoint) as well as a [UI-based playground](https://kalavai-net.github.io/kalavai-client/public_llm_pool/#ui-playground).
|
234
|
-
|
235
|
-
Check out [our guide](https://kalavai-net.github.io/kalavai-client/public_llm_pool/) on how to join and start deploying LLMs.
|
236
|
-
|
237
|
-
|
238
218
|
## Enough already, let's run stuff!
|
239
219
|
|
240
220
|
Check our [examples](examples/) to put your new AI pool to good use! For an end to end tour, check our [self-hosted](https://kalavai-net.github.io/kalavai-client/self_hosted_llm_pool/) and [public LLM pools](https://kalavai-net.github.io/kalavai-client/public_llm_pool/) guides.
|
@@ -268,7 +248,6 @@ The kalavai client, which controls and access pools, can be installed on any mac
|
|
268
248
|
- [x] Kalavai client on Linux
|
269
249
|
- [x] [TEMPLATE] Distributed LLM deployment
|
270
250
|
- [x] Kalavai client on Windows (with WSL2)
|
271
|
-
- [x] Public LLM pools
|
272
251
|
- [x] Self-hosted LLM pools
|
273
252
|
- [x] Collaborative LLM deployment
|
274
253
|
- [x] Ray cluster support
|
@@ -308,7 +287,7 @@ Python version >= 3.6.
|
|
308
287
|
```bash
|
309
288
|
sudo add-apt-repository ppa:deadsnakes/ppa
|
310
289
|
sudo apt update
|
311
|
-
sudo apt install python3.10 python3.10-dev python3-virtualenv
|
290
|
+
sudo apt install python3.10 python3.10-dev python3-virtualenv python3-venv
|
312
291
|
virtualenv -p python3.10 env
|
313
292
|
source env/bin/activate
|
314
293
|
sudo apt install python3.10-venv python3.10-dev -y
|
@@ -0,0 +1,25 @@
|
|
1
|
+
kalavai_client/__init__.py,sha256=kdEPlDp6IaQ7VW5poiOUuYIU9_F2zMlsQ58FC7Mp1Bw,22
|
2
|
+
kalavai_client/__main__.py,sha256=WQUfxvRsBJH5gsCJg8pLz95QnZIj7Ol8psTO77m0QE0,73
|
3
|
+
kalavai_client/assets/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
|
4
|
+
kalavai_client/assets/apps.yaml,sha256=H2HZQ_oqdNz2qPDs5_NtHvJo4rblH1DRPugzQYq_t5Q,6366
|
5
|
+
kalavai_client/assets/apps_values.yaml,sha256=WRew3bS1MztjzcJfphuJcKn0n2T1ICRupPpr_Csjt_s,1644
|
6
|
+
kalavai_client/assets/docker-compose-gui.yaml,sha256=IHClIltiu8C4nHbgDgAscf3Ls6UFngbeQP07kj31kjM,776
|
7
|
+
kalavai_client/assets/docker-compose-template.yaml,sha256=0ckkXC2OJTWnjyyjtwCIckUc22xhY_84aCQjz1WSlBk,2831
|
8
|
+
kalavai_client/assets/nginx.conf,sha256=drVVCg8GHucz7hmt_BI6giAhK92OV71257NTs3LthwM,225
|
9
|
+
kalavai_client/assets/pool_config_template.yaml,sha256=fFz4w2-fMKD5KvyzFdfcWD_jSneRlmnjLc8hCctweX0,576
|
10
|
+
kalavai_client/assets/pool_config_values.yaml,sha256=VrM3XHQfQo6QLZ68qvagooUptaYgl1pszniY_JUtemk,233
|
11
|
+
kalavai_client/assets/user_workspace.yaml,sha256=wDvlMYknOPABAEo0dsQwU7bac8iubjAG9tdkFbJZ5Go,476
|
12
|
+
kalavai_client/assets/user_workspace_values.yaml,sha256=G0HOzQUxrDMCwuW9kbWUZaKMzDDPVwDwzBHCL2Xi2ZM,542
|
13
|
+
kalavai_client/auth.py,sha256=EB3PMvKUn5_KAQkezkEHEt-OMZXyfkZguIQlUFkEHcA,3243
|
14
|
+
kalavai_client/bridge_api.py,sha256=IkKq_CODA4p4UJkk6UqXKHkz5m2ESq2mL3tKqkQk6T0,6910
|
15
|
+
kalavai_client/bridge_models.py,sha256=k4ILxa8jfAcfgIIBJqK1DunDzHh_oNUpuiEpmhAfTP0,977
|
16
|
+
kalavai_client/cli.py,sha256=Cq0aC7L8kV1Ag2Olm3NGY51BMLBAjcsDH3mhmyfz6cA,47089
|
17
|
+
kalavai_client/cluster.py,sha256=gwjmdsd--YrffT0BmZDOEpbrdm3lPskUuN5jdgcrOR0,12947
|
18
|
+
kalavai_client/core.py,sha256=CWJQ38BZ2mLavfOCyR7wsDdy4fRTpjnYmggoXcR9Ji8,32531
|
19
|
+
kalavai_client/env.py,sha256=_T3D0Hns5yAbFS3Hp1Vt73FZWLMtKSUJz2XXR9kJvEY,2605
|
20
|
+
kalavai_client/utils.py,sha256=k2Bpvl16zDpWBXMIMsd_LbkinZtctPO6bygfB7DyiZ8,12018
|
21
|
+
kalavai_client-0.6.0.dist-info/LICENSE,sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ,11357
|
22
|
+
kalavai_client-0.6.0.dist-info/METADATA,sha256=NufPp5kOZHUqWASe0nHrecbPZPGMOUOPE91PYTA_Fpg,13353
|
23
|
+
kalavai_client-0.6.0.dist-info/WHEEL,sha256=fGIA9gx4Qxk2KDKeNJCbOEwSrmLtjWCwzBz351GyrPQ,88
|
24
|
+
kalavai_client-0.6.0.dist-info/entry_points.txt,sha256=9T6D45gxwzfVbglMm1r6XPdXuuZdHfy_7fCeu2jUphc,50
|
25
|
+
kalavai_client-0.6.0.dist-info/RECORD,,
|
@@ -1,25 +0,0 @@
|
|
1
|
-
kalavai_client/__init__.py,sha256=ROmnKI7L1DQjR4ddCvAjjSIbyHpDByVfi5X4UwPtjws,23
|
2
|
-
kalavai_client/__main__.py,sha256=WQUfxvRsBJH5gsCJg8pLz95QnZIj7Ol8psTO77m0QE0,73
|
3
|
-
kalavai_client/assets/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
|
4
|
-
kalavai_client/assets/apps.yaml,sha256=XahTRpFiaUG3jJGAzokWnNkaVnoogjxHVXBw2kSrwq8,6304
|
5
|
-
kalavai_client/assets/apps_values.yaml,sha256=CjKVelPQHd-hm-DTMEuya92feKiphU9mh3HrosLYYPE,1676
|
6
|
-
kalavai_client/assets/docker-compose-gui.yaml,sha256=6OHZIDDTl_PwXSYo1d05JasWfT0iiUDhrja0nQDjrlw,692
|
7
|
-
kalavai_client/assets/docker-compose-template.yaml,sha256=ii24Nn-dM5cZk9lxFgrzxnmK7yv_6kIIw7KUlWhvYeI,2831
|
8
|
-
kalavai_client/assets/nginx.conf,sha256=drVVCg8GHucz7hmt_BI6giAhK92OV71257NTs3LthwM,225
|
9
|
-
kalavai_client/assets/pool_config_template.yaml,sha256=fFz4w2-fMKD5KvyzFdfcWD_jSneRlmnjLc8hCctweX0,576
|
10
|
-
kalavai_client/assets/pool_config_values.yaml,sha256=VrM3XHQfQo6QLZ68qvagooUptaYgl1pszniY_JUtemk,233
|
11
|
-
kalavai_client/assets/user_workspace.yaml,sha256=wDvlMYknOPABAEo0dsQwU7bac8iubjAG9tdkFbJZ5Go,476
|
12
|
-
kalavai_client/assets/user_workspace_values.yaml,sha256=G0HOzQUxrDMCwuW9kbWUZaKMzDDPVwDwzBHCL2Xi2ZM,542
|
13
|
-
kalavai_client/auth.py,sha256=QsBh28L2LwjBBK6pTUE4Xu36lLDTyetyU1YfS1Hbb6g,1717
|
14
|
-
kalavai_client/bridge_api.py,sha256=xBd3KGoDcruuo53uNWOwA30CIPYgQLX8IkJWJgNHq9s,5546
|
15
|
-
kalavai_client/bridge_models.py,sha256=k4ILxa8jfAcfgIIBJqK1DunDzHh_oNUpuiEpmhAfTP0,977
|
16
|
-
kalavai_client/cli.py,sha256=MNmn8DgnEuyaCV8cMqr17JvfjalHcrP5Udpjn2jVXp8,46713
|
17
|
-
kalavai_client/cluster.py,sha256=gwjmdsd--YrffT0BmZDOEpbrdm3lPskUuN5jdgcrOR0,12947
|
18
|
-
kalavai_client/core.py,sha256=m5FOPzix8oNBlLqgllgJ0PwLXxo-s438fjJ0FPRVIZs,33266
|
19
|
-
kalavai_client/env.py,sha256=Zg2pP-xGJpQumo56KMBxBLgIsBmcNN0S9R-ZP2-s630,2604
|
20
|
-
kalavai_client/utils.py,sha256=OPmrsycNyrs2ZpTsjAzBuPN8hQNJtsYDLPKU13tnf-U,13862
|
21
|
-
kalavai_client-0.5.30.dist-info/LICENSE,sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ,11357
|
22
|
-
kalavai_client-0.5.30.dist-info/METADATA,sha256=Fi8DEzalDmDoASySWKmqIMx4A1DPLrWE8AO_lBtRml0,14443
|
23
|
-
kalavai_client-0.5.30.dist-info/WHEEL,sha256=XbeZDeTWKc1w7CSIyre5aMDU_-PohRwTQceYnisIYYY,88
|
24
|
-
kalavai_client-0.5.30.dist-info/entry_points.txt,sha256=9T6D45gxwzfVbglMm1r6XPdXuuZdHfy_7fCeu2jUphc,50
|
25
|
-
kalavai_client-0.5.30.dist-info/RECORD,,
|
File without changes
|
File without changes
|