kalavai-client 0.5.15__tar.gz → 0.5.16__tar.gz
Sign up to get free protection for your applications and to get access to all the features.
- {kalavai_client-0.5.15 → kalavai_client-0.5.16}/PKG-INFO +5 -4
- {kalavai_client-0.5.15 → kalavai_client-0.5.16}/README.md +4 -4
- kalavai_client-0.5.16/kalavai_client/__init__.py +2 -0
- {kalavai_client-0.5.15 → kalavai_client-0.5.16}/kalavai_client/assets/apps.yaml +1 -1
- kalavai_client-0.5.16/kalavai_client/assets/docker-compose-gui.yaml +10 -0
- {kalavai_client-0.5.15 → kalavai_client-0.5.16}/kalavai_client/assets/docker-compose-template.yaml +5 -3
- {kalavai_client-0.5.15 → kalavai_client-0.5.16}/kalavai_client/cli.py +143 -584
- {kalavai_client-0.5.15 → kalavai_client-0.5.16}/kalavai_client/cluster.py +25 -2
- kalavai_client-0.5.16/kalavai_client/core.py +878 -0
- kalavai_client-0.5.16/kalavai_client/env.py +58 -0
- {kalavai_client-0.5.15 → kalavai_client-0.5.16}/kalavai_client/utils.py +55 -19
- {kalavai_client-0.5.15 → kalavai_client-0.5.16}/pyproject.toml +1 -1
- kalavai_client-0.5.15/kalavai_client/__init__.py +0 -2
- kalavai_client-0.5.15/kalavai_client/core.py +0 -227
- kalavai_client-0.5.15/kalavai_client/env.py +0 -19
- {kalavai_client-0.5.15 → kalavai_client-0.5.16}/LICENSE +0 -0
- {kalavai_client-0.5.15 → kalavai_client-0.5.16}/kalavai_client/__main__.py +0 -0
- {kalavai_client-0.5.15 → kalavai_client-0.5.16}/kalavai_client/assets/__init__.py +0 -0
- {kalavai_client-0.5.15 → kalavai_client-0.5.16}/kalavai_client/assets/apps_values.yaml +0 -0
- {kalavai_client-0.5.15 → kalavai_client-0.5.16}/kalavai_client/assets/nginx.conf +0 -0
- {kalavai_client-0.5.15 → kalavai_client-0.5.16}/kalavai_client/assets/pool_config_template.yaml +0 -0
- {kalavai_client-0.5.15 → kalavai_client-0.5.16}/kalavai_client/assets/pool_config_values.yaml +0 -0
- {kalavai_client-0.5.15 → kalavai_client-0.5.16}/kalavai_client/assets/user_workspace.yaml +0 -0
- {kalavai_client-0.5.15 → kalavai_client-0.5.16}/kalavai_client/assets/user_workspace_values.yaml +0 -0
- {kalavai_client-0.5.15 → kalavai_client-0.5.16}/kalavai_client/auth.py +0 -0
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
Metadata-Version: 2.3
|
|
2
2
|
Name: kalavai-client
|
|
3
|
-
Version: 0.5.
|
|
3
|
+
Version: 0.5.16
|
|
4
4
|
Summary: Client app for kalavai platform
|
|
5
5
|
License: Apache-2.0
|
|
6
6
|
Keywords: LLM,platform
|
|
@@ -47,11 +47,11 @@ Description-Content-Type: text/markdown
|
|
|
47
47
|
<div align="center">
|
|
48
48
|
|
|
49
49
|
 
|
|
50
|
-
   [   [](https://discordapp.com/channels/1295009828623880313) [](https://platform.kalavai.net)
|
|
51
51
|
|
|
52
52
|
</div>
|
|
53
53
|
|
|
54
|
-
⭐⭐⭐ **Kalavai and our LLM pools are open source, and free to use in both commercial and non-commercial purposes. If you find it useful, consider supporting us by [giving a star to our GitHub project](https://github.com/kalavai-net/kalavai-client), joining our [discord channel](https://discord.gg/
|
|
54
|
+
⭐⭐⭐ **Kalavai and our LLM pools are open source, and free to use in both commercial and non-commercial purposes. If you find it useful, consider supporting us by [giving a star to our GitHub project](https://github.com/kalavai-net/kalavai-client), joining our [discord channel](https://discord.gg/YN6ThTJKbM), follow our [Substack](https://kalavainet.substack.com/) and give us a [review on Product Hunt](https://www.producthunt.com/products/kalavai/reviews/new).**
|
|
55
55
|
|
|
56
56
|
|
|
57
57
|
# Kalavai: turn your devices into a scalable LLM platform
|
|
@@ -129,7 +129,7 @@ Not what you were looking for? [Tell us](https://github.com/kalavai-net/kalavai-
|
|
|
129
129
|
- Get a free [Kalavai account](https://platform.kalavai.net) and access unlimited AI.
|
|
130
130
|
- Full [documentation](https://kalavai-net.github.io/kalavai-client/) for the project.
|
|
131
131
|
- [Join our Substack](https://kalavainet.substack.com/) for updates and be part of our community
|
|
132
|
-
- [Join our discord community](https://discord.gg/
|
|
132
|
+
- [Join our discord community](https://discord.gg/YN6ThTJKbM)
|
|
133
133
|
|
|
134
134
|
|
|
135
135
|
## Getting started
|
|
@@ -323,3 +323,4 @@ python -m unittest
|
|
|
323
323
|
```
|
|
324
324
|
|
|
325
325
|
docker run --rm --net=host -v /root/.cache/kalavai/:/root/.cache/kalavai/ ghcr.io/helmfile/helmfile:v0.169.2 helmfile sync --file /root/.cache/kalavai/apps.yaml --kubeconfig /root/.cache/kalavai/kubeconfig
|
|
326
|
+
|
|
@@ -3,11 +3,11 @@
|
|
|
3
3
|
<div align="center">
|
|
4
4
|
|
|
5
5
|
 
|
|
6
|
-
   [   [](https://discordapp.com/channels/1295009828623880313) [](https://platform.kalavai.net)
|
|
7
7
|
|
|
8
8
|
</div>
|
|
9
9
|
|
|
10
|
-
⭐⭐⭐ **Kalavai and our LLM pools are open source, and free to use in both commercial and non-commercial purposes. If you find it useful, consider supporting us by [giving a star to our GitHub project](https://github.com/kalavai-net/kalavai-client), joining our [discord channel](https://discord.gg/
|
|
10
|
+
⭐⭐⭐ **Kalavai and our LLM pools are open source, and free to use in both commercial and non-commercial purposes. If you find it useful, consider supporting us by [giving a star to our GitHub project](https://github.com/kalavai-net/kalavai-client), joining our [discord channel](https://discord.gg/YN6ThTJKbM), follow our [Substack](https://kalavainet.substack.com/) and give us a [review on Product Hunt](https://www.producthunt.com/products/kalavai/reviews/new).**
|
|
11
11
|
|
|
12
12
|
|
|
13
13
|
# Kalavai: turn your devices into a scalable LLM platform
|
|
@@ -85,7 +85,7 @@ Not what you were looking for? [Tell us](https://github.com/kalavai-net/kalavai-
|
|
|
85
85
|
- Get a free [Kalavai account](https://platform.kalavai.net) and access unlimited AI.
|
|
86
86
|
- Full [documentation](https://kalavai-net.github.io/kalavai-client/) for the project.
|
|
87
87
|
- [Join our Substack](https://kalavainet.substack.com/) for updates and be part of our community
|
|
88
|
-
- [Join our discord community](https://discord.gg/
|
|
88
|
+
- [Join our discord community](https://discord.gg/YN6ThTJKbM)
|
|
89
89
|
|
|
90
90
|
|
|
91
91
|
## Getting started
|
|
@@ -278,4 +278,4 @@ To run the unit tests, use:
|
|
|
278
278
|
python -m unittest
|
|
279
279
|
```
|
|
280
280
|
|
|
281
|
-
docker run --rm --net=host -v /root/.cache/kalavai/:/root/.cache/kalavai/ ghcr.io/helmfile/helmfile:v0.169.2 helmfile sync --file /root/.cache/kalavai/apps.yaml --kubeconfig /root/.cache/kalavai/kubeconfig
|
|
281
|
+
docker run --rm --net=host -v /root/.cache/kalavai/:/root/.cache/kalavai/ ghcr.io/helmfile/helmfile:v0.169.2 helmfile sync --file /root/.cache/kalavai/apps.yaml --kubeconfig /root/.cache/kalavai/kubeconfig
|
{kalavai_client-0.5.15 → kalavai_client-0.5.16}/kalavai_client/assets/docker-compose-template.yaml
RENAMED
|
@@ -68,6 +68,8 @@ services:
|
|
|
68
68
|
restart: unless-stopped
|
|
69
69
|
command: >
|
|
70
70
|
--command={{command}}
|
|
71
|
+
--node_name="{{node_name}}"
|
|
72
|
+
--node_ip="{{node_ip_address}}"
|
|
71
73
|
{% if command == "server" %}
|
|
72
74
|
--port_range="30000-32767"
|
|
73
75
|
{% else %}
|
|
@@ -86,9 +88,9 @@ services:
|
|
|
86
88
|
--extra="{{node_labels}}"
|
|
87
89
|
{% endif %}
|
|
88
90
|
|
|
89
|
-
volumes:
|
|
90
|
-
- {{k3s_path}}:/var/lib/rancher/k3s # Persist data
|
|
91
|
-
- {{etc_path}}:/etc/rancher/k3s # Config files
|
|
91
|
+
# volumes:
|
|
92
|
+
# - {{k3s_path}}:/var/lib/rancher/k3s # Persist data
|
|
93
|
+
# - {{etc_path}}:/etc/rancher/k3s # Config files
|
|
92
94
|
|
|
93
95
|
{% if num_gpus and num_gpus > 0 %}
|
|
94
96
|
deploy:
|