kalavai-client 0.5.30__py3-none-any.whl → 0.6.0__py3-none-any.whl

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
@@ -1,6 +1,6 @@
1
1
  Metadata-Version: 2.3
2
2
  Name: kalavai-client
3
- Version: 0.5.30
3
+ Version: 0.6.0
4
4
  Summary: Client app for kalavai platform
5
5
  License: Apache-2.0
6
6
  Keywords: LLM,platform
@@ -23,7 +23,6 @@ Classifier: Programming Language :: Python :: 3.12
23
23
  Classifier: Programming Language :: Python :: 3.13
24
24
  Provides-Extra: dev
25
25
  Requires-Dist: Pillow (==10.3.0)
26
- Requires-Dist: anvil-uplink (==0.5.1)
27
26
  Requires-Dist: arguably (>=1.2.5)
28
27
  Requires-Dist: build ; extra == "dev"
29
28
  Requires-Dist: fastapi (==0.115.8)
@@ -53,10 +52,10 @@ Description-Content-Type: text/markdown
53
52
 
54
53
  </div>
55
54
 
56
- ⭐⭐⭐ **Kalavai and our LLM pools are open source, and free to use in both commercial and non-commercial purposes. If you find it useful, consider supporting us by [giving a star to our GitHub project](https://github.com/kalavai-net/kalavai-client), joining our [discord channel](https://discord.gg/YN6ThTJKbM), follow our [Substack](https://kalavainet.substack.com/) and give us a [review on Product Hunt](https://www.producthunt.com/products/kalavai/reviews/new).**
55
+ ⭐⭐⭐ **Kalavai and our AI pools are open source, and free to use in both commercial and non-commercial purposes. If you find it useful, consider supporting us by [giving a star to our GitHub project](https://github.com/kalavai-net/kalavai-client), joining our [discord channel](https://discord.gg/YN6ThTJKbM), follow our [Substack](https://kalavainet.substack.com/) and give us a [review on Product Hunt](https://www.producthunt.com/products/kalavai/reviews/new).**
57
56
 
58
57
 
59
- # Kalavai: turn your devices into a scalable LLM platform
58
+ # Kalavai: turn your devices into a scalable AI platform
60
59
 
61
60
  ### Taming the adoption of Large Language Models
62
61
 
@@ -71,7 +70,7 @@ Description-Content-Type: text/markdown
71
70
 
72
71
  ## What can Kalavai do?
73
72
 
74
- Kalavai's goal is to make using LLMs in real applications accessible and affordable to all. It's a _magic box_ that **integrates all the components required to make LLM useful in the age of massive computing**, from sourcing computing power, managing distributed infrastructure and storage, using industry-standard model engines and orchestration of LLMs.
73
+ Kalavai's goal is to make using AI (LLMs, AI agents) in real applications accessible and affordable to all. It's a _magic box_ that **integrates all the components required to make AI useful in the age of massive computing**, from model deployment and orchestration to Agentic AI.
75
74
 
76
75
  ### Core features
77
76
 
@@ -86,18 +85,6 @@ Kalavai's goal is to make using LLMs in real applications accessible and afforda
86
85
 
87
86
  **<summary>Video tutorials</summary>**
88
87
 
89
- ### Aggregate multiple devices in an LLM pool
90
-
91
- https://github.com/user-attachments/assets/4be59886-1b76-4400-ab5c-c803e3e414ec
92
-
93
- ### Deploy LLMs across the pool
94
-
95
- https://github.com/user-attachments/assets/ea57a2ab-3924-4097-be2a-504e0988fbb1
96
-
97
- ### Single point of entry for all models (GUI + API)
98
-
99
- https://github.com/user-attachments/assets/7df73bbc-d129-46aa-8ce5-0735177dedeb
100
-
101
88
  ### Self-hosted LLM pools
102
89
 
103
90
  https://github.com/user-attachments/assets/0d2316f3-79ea-46ac-b41e-8ef720f52672
@@ -211,7 +198,7 @@ pip install kalavai-client
211
198
  ```
212
199
 
213
200
 
214
- ## Create a a local, private LLM pool
201
+ ## Create a a local, private AI pool
215
202
 
216
203
  > Kalavai is **free to use, no caps, for both commercial and non-commercial purposes**. All you need to get started is one or more computers that can see each other (i.e. within the same network), and you are good to go. If you are interested in join computers in different locations / networks, [contact us](mailto:info@kalavai.net) or [book a demo](https://app.onecal.io/b/kalavai/book-a-demo) with the founders.
217
204
 
@@ -228,13 +215,6 @@ This will expose the GUI and the backend services in localhost. By default, the
228
215
  Check out our [getting started guide](https://kalavai-net.github.io/kalavai-client/getting_started/) for next steps.
229
216
 
230
217
 
231
- ## Public LLM pools: crowdsource community resources
232
-
233
- This is the **easiest and most powerful** way to experience Kalavai. It affords users the full resource capabilities of the community and access to all its deployed LLMs, via an [OpenAI-compatible endpoint](https://kalavai-net.github.io/kalavai-client/public_llm_pool/#single-api-endpoint) as well as a [UI-based playground](https://kalavai-net.github.io/kalavai-client/public_llm_pool/#ui-playground).
234
-
235
- Check out [our guide](https://kalavai-net.github.io/kalavai-client/public_llm_pool/) on how to join and start deploying LLMs.
236
-
237
-
238
218
  ## Enough already, let's run stuff!
239
219
 
240
220
  Check our [examples](examples/) to put your new AI pool to good use! For an end to end tour, check our [self-hosted](https://kalavai-net.github.io/kalavai-client/self_hosted_llm_pool/) and [public LLM pools](https://kalavai-net.github.io/kalavai-client/public_llm_pool/) guides.
@@ -268,7 +248,6 @@ The kalavai client, which controls and access pools, can be installed on any mac
268
248
  - [x] Kalavai client on Linux
269
249
  - [x] [TEMPLATE] Distributed LLM deployment
270
250
  - [x] Kalavai client on Windows (with WSL2)
271
- - [x] Public LLM pools
272
251
  - [x] Self-hosted LLM pools
273
252
  - [x] Collaborative LLM deployment
274
253
  - [x] Ray cluster support
@@ -308,7 +287,7 @@ Python version >= 3.6.
308
287
  ```bash
309
288
  sudo add-apt-repository ppa:deadsnakes/ppa
310
289
  sudo apt update
311
- sudo apt install python3.10 python3.10-dev python3-virtualenv
290
+ sudo apt install python3.10 python3.10-dev python3-virtualenv python3-venv
312
291
  virtualenv -p python3.10 env
313
292
  source env/bin/activate
314
293
  sudo apt install python3.10-venv python3.10-dev -y
@@ -0,0 +1,25 @@
1
+ kalavai_client/__init__.py,sha256=kdEPlDp6IaQ7VW5poiOUuYIU9_F2zMlsQ58FC7Mp1Bw,22
2
+ kalavai_client/__main__.py,sha256=WQUfxvRsBJH5gsCJg8pLz95QnZIj7Ol8psTO77m0QE0,73
3
+ kalavai_client/assets/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
4
+ kalavai_client/assets/apps.yaml,sha256=H2HZQ_oqdNz2qPDs5_NtHvJo4rblH1DRPugzQYq_t5Q,6366
5
+ kalavai_client/assets/apps_values.yaml,sha256=WRew3bS1MztjzcJfphuJcKn0n2T1ICRupPpr_Csjt_s,1644
6
+ kalavai_client/assets/docker-compose-gui.yaml,sha256=IHClIltiu8C4nHbgDgAscf3Ls6UFngbeQP07kj31kjM,776
7
+ kalavai_client/assets/docker-compose-template.yaml,sha256=0ckkXC2OJTWnjyyjtwCIckUc22xhY_84aCQjz1WSlBk,2831
8
+ kalavai_client/assets/nginx.conf,sha256=drVVCg8GHucz7hmt_BI6giAhK92OV71257NTs3LthwM,225
9
+ kalavai_client/assets/pool_config_template.yaml,sha256=fFz4w2-fMKD5KvyzFdfcWD_jSneRlmnjLc8hCctweX0,576
10
+ kalavai_client/assets/pool_config_values.yaml,sha256=VrM3XHQfQo6QLZ68qvagooUptaYgl1pszniY_JUtemk,233
11
+ kalavai_client/assets/user_workspace.yaml,sha256=wDvlMYknOPABAEo0dsQwU7bac8iubjAG9tdkFbJZ5Go,476
12
+ kalavai_client/assets/user_workspace_values.yaml,sha256=G0HOzQUxrDMCwuW9kbWUZaKMzDDPVwDwzBHCL2Xi2ZM,542
13
+ kalavai_client/auth.py,sha256=EB3PMvKUn5_KAQkezkEHEt-OMZXyfkZguIQlUFkEHcA,3243
14
+ kalavai_client/bridge_api.py,sha256=IkKq_CODA4p4UJkk6UqXKHkz5m2ESq2mL3tKqkQk6T0,6910
15
+ kalavai_client/bridge_models.py,sha256=k4ILxa8jfAcfgIIBJqK1DunDzHh_oNUpuiEpmhAfTP0,977
16
+ kalavai_client/cli.py,sha256=Cq0aC7L8kV1Ag2Olm3NGY51BMLBAjcsDH3mhmyfz6cA,47089
17
+ kalavai_client/cluster.py,sha256=gwjmdsd--YrffT0BmZDOEpbrdm3lPskUuN5jdgcrOR0,12947
18
+ kalavai_client/core.py,sha256=CWJQ38BZ2mLavfOCyR7wsDdy4fRTpjnYmggoXcR9Ji8,32531
19
+ kalavai_client/env.py,sha256=_T3D0Hns5yAbFS3Hp1Vt73FZWLMtKSUJz2XXR9kJvEY,2605
20
+ kalavai_client/utils.py,sha256=k2Bpvl16zDpWBXMIMsd_LbkinZtctPO6bygfB7DyiZ8,12018
21
+ kalavai_client-0.6.0.dist-info/LICENSE,sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ,11357
22
+ kalavai_client-0.6.0.dist-info/METADATA,sha256=NufPp5kOZHUqWASe0nHrecbPZPGMOUOPE91PYTA_Fpg,13353
23
+ kalavai_client-0.6.0.dist-info/WHEEL,sha256=fGIA9gx4Qxk2KDKeNJCbOEwSrmLtjWCwzBz351GyrPQ,88
24
+ kalavai_client-0.6.0.dist-info/entry_points.txt,sha256=9T6D45gxwzfVbglMm1r6XPdXuuZdHfy_7fCeu2jUphc,50
25
+ kalavai_client-0.6.0.dist-info/RECORD,,
@@ -1,4 +1,4 @@
1
1
  Wheel-Version: 1.0
2
- Generator: poetry-core 2.1.1
2
+ Generator: poetry-core 2.1.2
3
3
  Root-Is-Purelib: true
4
4
  Tag: py3-none-any
@@ -1,25 +0,0 @@
1
- kalavai_client/__init__.py,sha256=ROmnKI7L1DQjR4ddCvAjjSIbyHpDByVfi5X4UwPtjws,23
2
- kalavai_client/__main__.py,sha256=WQUfxvRsBJH5gsCJg8pLz95QnZIj7Ol8psTO77m0QE0,73
3
- kalavai_client/assets/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
4
- kalavai_client/assets/apps.yaml,sha256=XahTRpFiaUG3jJGAzokWnNkaVnoogjxHVXBw2kSrwq8,6304
5
- kalavai_client/assets/apps_values.yaml,sha256=CjKVelPQHd-hm-DTMEuya92feKiphU9mh3HrosLYYPE,1676
6
- kalavai_client/assets/docker-compose-gui.yaml,sha256=6OHZIDDTl_PwXSYo1d05JasWfT0iiUDhrja0nQDjrlw,692
7
- kalavai_client/assets/docker-compose-template.yaml,sha256=ii24Nn-dM5cZk9lxFgrzxnmK7yv_6kIIw7KUlWhvYeI,2831
8
- kalavai_client/assets/nginx.conf,sha256=drVVCg8GHucz7hmt_BI6giAhK92OV71257NTs3LthwM,225
9
- kalavai_client/assets/pool_config_template.yaml,sha256=fFz4w2-fMKD5KvyzFdfcWD_jSneRlmnjLc8hCctweX0,576
10
- kalavai_client/assets/pool_config_values.yaml,sha256=VrM3XHQfQo6QLZ68qvagooUptaYgl1pszniY_JUtemk,233
11
- kalavai_client/assets/user_workspace.yaml,sha256=wDvlMYknOPABAEo0dsQwU7bac8iubjAG9tdkFbJZ5Go,476
12
- kalavai_client/assets/user_workspace_values.yaml,sha256=G0HOzQUxrDMCwuW9kbWUZaKMzDDPVwDwzBHCL2Xi2ZM,542
13
- kalavai_client/auth.py,sha256=QsBh28L2LwjBBK6pTUE4Xu36lLDTyetyU1YfS1Hbb6g,1717
14
- kalavai_client/bridge_api.py,sha256=xBd3KGoDcruuo53uNWOwA30CIPYgQLX8IkJWJgNHq9s,5546
15
- kalavai_client/bridge_models.py,sha256=k4ILxa8jfAcfgIIBJqK1DunDzHh_oNUpuiEpmhAfTP0,977
16
- kalavai_client/cli.py,sha256=MNmn8DgnEuyaCV8cMqr17JvfjalHcrP5Udpjn2jVXp8,46713
17
- kalavai_client/cluster.py,sha256=gwjmdsd--YrffT0BmZDOEpbrdm3lPskUuN5jdgcrOR0,12947
18
- kalavai_client/core.py,sha256=m5FOPzix8oNBlLqgllgJ0PwLXxo-s438fjJ0FPRVIZs,33266
19
- kalavai_client/env.py,sha256=Zg2pP-xGJpQumo56KMBxBLgIsBmcNN0S9R-ZP2-s630,2604
20
- kalavai_client/utils.py,sha256=OPmrsycNyrs2ZpTsjAzBuPN8hQNJtsYDLPKU13tnf-U,13862
21
- kalavai_client-0.5.30.dist-info/LICENSE,sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ,11357
22
- kalavai_client-0.5.30.dist-info/METADATA,sha256=Fi8DEzalDmDoASySWKmqIMx4A1DPLrWE8AO_lBtRml0,14443
23
- kalavai_client-0.5.30.dist-info/WHEEL,sha256=XbeZDeTWKc1w7CSIyre5aMDU_-PohRwTQceYnisIYYY,88
24
- kalavai_client-0.5.30.dist-info/entry_points.txt,sha256=9T6D45gxwzfVbglMm1r6XPdXuuZdHfy_7fCeu2jUphc,50
25
- kalavai_client-0.5.30.dist-info/RECORD,,