kalavai-client 0.5.29__tar.gz → 0.6.0__tar.gz

{kalavai_client-0.5.29 → kalavai_client-0.6.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.3
 Name: kalavai-client
-Version: 0.5.29
+Version: 0.6.0
 Summary: Client app for kalavai platform
 License: Apache-2.0
 Keywords: LLM,platform
@@ -23,7 +23,6 @@ Classifier: Programming Language :: Python :: 3.12
 Classifier: Programming Language :: Python :: 3.13
 Provides-Extra: dev
 Requires-Dist: Pillow (==10.3.0)
-Requires-Dist: anvil-uplink (==0.5.1)
 Requires-Dist: arguably (>=1.2.5)
 Requires-Dist: build ; extra == "dev"
 Requires-Dist: fastapi (==0.115.8)
@@ -53,10 +52,10 @@ Description-Content-Type: text/markdown
 
 </div>
 
-⭐⭐⭐ **Kalavai and our LLM pools are open source, and free to use in both commercial and non-commercial purposes. If you find it useful, consider supporting us by [giving a star to our GitHub project](https://github.com/kalavai-net/kalavai-client), joining our [discord channel](https://discord.gg/YN6ThTJKbM), follow our [Substack](https://kalavainet.substack.com/) and give us a [review on Product Hunt](https://www.producthunt.com/products/kalavai/reviews/new).**
+⭐⭐⭐ **Kalavai and our AI pools are open source, and free to use in both commercial and non-commercial purposes. If you find it useful, consider supporting us by [giving a star to our GitHub project](https://github.com/kalavai-net/kalavai-client), joining our [discord channel](https://discord.gg/YN6ThTJKbM), follow our [Substack](https://kalavainet.substack.com/) and give us a [review on Product Hunt](https://www.producthunt.com/products/kalavai/reviews/new).**
 
 
-# Kalavai: turn your devices into a scalable LLM platform
+# Kalavai: turn your devices into a scalable AI platform
 
 ### Taming the adoption of Large Language Models
 
@@ -71,7 +70,7 @@ Description-Content-Type: text/markdown
 
 ## What can Kalavai do?
 
-Kalavai's goal is to make using LLMs in real applications accessible and affordable to all. It's a _magic box_ that **integrates all the components required to make LLM useful in the age of massive computing**, from sourcing computing power, managing distributed infrastructure and storage, using industry-standard model engines and orchestration of LLMs. 
+Kalavai's goal is to make using AI (LLMs, AI agents) in real applications accessible and affordable to all. It's a _magic box_ that **integrates all the components required to make AI useful in the age of massive computing**, from model deployment and orchestration to Agentic AI. 
 
 ### Core features
 
@@ -86,18 +85,6 @@ Kalavai's goal is to make using LLMs in real applications accessible and afforda
 
 **<summary>Video tutorials</summary>**
 
-### Aggregate multiple devices in an LLM pool
-
-https://github.com/user-attachments/assets/4be59886-1b76-4400-ab5c-c803e3e414ec
-
-### Deploy LLMs across the pool
-
-https://github.com/user-attachments/assets/ea57a2ab-3924-4097-be2a-504e0988fbb1
-
-### Single point of entry for all models (GUI + API)
-
-https://github.com/user-attachments/assets/7df73bbc-d129-46aa-8ce5-0735177dedeb
-
 ### Self-hosted LLM pools
 
 https://github.com/user-attachments/assets/0d2316f3-79ea-46ac-b41e-8ef720f52672
@@ -211,7 +198,7 @@ pip install kalavai-client
 ```
 
 
-## Create a a local, private LLM pool
+## Create a a local, private AI pool
 
 > Kalavai is **free to use, no caps, for both commercial and non-commercial purposes**. All you need to get started is one or more computers that can see each other (i.e. within the same network), and you are good to go. If you are interested in join computers in different locations / networks, [contact us](mailto:info@kalavai.net) or [book a demo](https://app.onecal.io/b/kalavai/book-a-demo) with the founders.
 
@@ -228,13 +215,6 @@ This will expose the GUI and the backend services in localhost. By default, the
 Check out our [getting started guide](https://kalavai-net.github.io/kalavai-client/getting_started/) for next steps.
 
 
-## Public LLM pools: crowdsource community resources
-
-This is the **easiest and most powerful** way to experience Kalavai. It affords users the full resource capabilities of the community and access to all its deployed LLMs, via an [OpenAI-compatible endpoint](https://kalavai-net.github.io/kalavai-client/public_llm_pool/#single-api-endpoint) as well as a [UI-based playground](https://kalavai-net.github.io/kalavai-client/public_llm_pool/#ui-playground).
-
-Check out [our guide](https://kalavai-net.github.io/kalavai-client/public_llm_pool/) on how to join and start deploying LLMs.
-
-
 ## Enough already, let's run stuff!
 
 Check our [examples](examples/) to put your new AI pool to good use! For an end to end tour, check our [self-hosted](https://kalavai-net.github.io/kalavai-client/self_hosted_llm_pool/) and [public LLM pools](https://kalavai-net.github.io/kalavai-client/public_llm_pool/) guides.
@@ -268,7 +248,6 @@ The kalavai client, which controls and access pools, can be installed on any mac
 - [x] Kalavai client on Linux
 - [x] [TEMPLATE] Distributed LLM deployment
 - [x] Kalavai client on Windows (with WSL2)
-- [x] Public LLM pools
 - [x] Self-hosted LLM pools
 - [x] Collaborative LLM deployment
 - [x] Ray cluster support
@@ -308,7 +287,7 @@ Python version >= 3.6.
 ```bash
 sudo add-apt-repository ppa:deadsnakes/ppa
 sudo apt update
-sudo apt install python3.10 python3.10-dev python3-virtualenv
+sudo apt install python3.10 python3.10-dev python3-virtualenv python3-venv
 virtualenv -p python3.10 env
 source env/bin/activate
 sudo apt install  python3.10-venv python3.10-dev -y

{kalavai_client-0.5.29 → kalavai_client-0.6.0}/README.md

@@ -7,10 +7,10 @@
 
 </div>
 
-⭐⭐⭐ **Kalavai and our LLM pools are open source, and free to use in both commercial and non-commercial purposes. If you find it useful, consider supporting us by [giving a star to our GitHub project](https://github.com/kalavai-net/kalavai-client), joining our [discord channel](https://discord.gg/YN6ThTJKbM), follow our [Substack](https://kalavainet.substack.com/) and give us a [review on Product Hunt](https://www.producthunt.com/products/kalavai/reviews/new).**
+⭐⭐⭐ **Kalavai and our AI pools are open source, and free to use in both commercial and non-commercial purposes. If you find it useful, consider supporting us by [giving a star to our GitHub project](https://github.com/kalavai-net/kalavai-client), joining our [discord channel](https://discord.gg/YN6ThTJKbM), follow our [Substack](https://kalavainet.substack.com/) and give us a [review on Product Hunt](https://www.producthunt.com/products/kalavai/reviews/new).**
 
 
-# Kalavai: turn your devices into a scalable LLM platform
+# Kalavai: turn your devices into a scalable AI platform
 
 ### Taming the adoption of Large Language Models
 
@@ -25,7 +25,7 @@
 
 ## What can Kalavai do?
 
-Kalavai's goal is to make using LLMs in real applications accessible and affordable to all. It's a _magic box_ that **integrates all the components required to make LLM useful in the age of massive computing**, from sourcing computing power, managing distributed infrastructure and storage, using industry-standard model engines and orchestration of LLMs. 
+Kalavai's goal is to make using AI (LLMs, AI agents) in real applications accessible and affordable to all. It's a _magic box_ that **integrates all the components required to make AI useful in the age of massive computing**, from model deployment and orchestration to Agentic AI. 
 
 ### Core features
 
@@ -40,18 +40,6 @@ Kalavai's goal is to make using LLMs in real applications accessible and afforda
 
 **<summary>Video tutorials</summary>**
 
-### Aggregate multiple devices in an LLM pool
-
-https://github.com/user-attachments/assets/4be59886-1b76-4400-ab5c-c803e3e414ec
-
-### Deploy LLMs across the pool
-
-https://github.com/user-attachments/assets/ea57a2ab-3924-4097-be2a-504e0988fbb1
-
-### Single point of entry for all models (GUI + API)
-
-https://github.com/user-attachments/assets/7df73bbc-d129-46aa-8ce5-0735177dedeb
-
 ### Self-hosted LLM pools
 
 https://github.com/user-attachments/assets/0d2316f3-79ea-46ac-b41e-8ef720f52672
@@ -165,7 +153,7 @@ pip install kalavai-client
 ```
 
 
-## Create a a local, private LLM pool
+## Create a a local, private AI pool
 
 > Kalavai is **free to use, no caps, for both commercial and non-commercial purposes**. All you need to get started is one or more computers that can see each other (i.e. within the same network), and you are good to go. If you are interested in join computers in different locations / networks, [contact us](mailto:info@kalavai.net) or [book a demo](https://app.onecal.io/b/kalavai/book-a-demo) with the founders.
 
@@ -182,13 +170,6 @@ This will expose the GUI and the backend services in localhost. By default, the
 Check out our [getting started guide](https://kalavai-net.github.io/kalavai-client/getting_started/) for next steps.
 
 
-## Public LLM pools: crowdsource community resources
-
-This is the **easiest and most powerful** way to experience Kalavai. It affords users the full resource capabilities of the community and access to all its deployed LLMs, via an [OpenAI-compatible endpoint](https://kalavai-net.github.io/kalavai-client/public_llm_pool/#single-api-endpoint) as well as a [UI-based playground](https://kalavai-net.github.io/kalavai-client/public_llm_pool/#ui-playground).
-
-Check out [our guide](https://kalavai-net.github.io/kalavai-client/public_llm_pool/) on how to join and start deploying LLMs.
-
-
 ## Enough already, let's run stuff!
 
 Check our [examples](examples/) to put your new AI pool to good use! For an end to end tour, check our [self-hosted](https://kalavai-net.github.io/kalavai-client/self_hosted_llm_pool/) and [public LLM pools](https://kalavai-net.github.io/kalavai-client/public_llm_pool/) guides.
@@ -222,7 +203,6 @@ The kalavai client, which controls and access pools, can be installed on any mac
 - [x] Kalavai client on Linux
 - [x] [TEMPLATE] Distributed LLM deployment
 - [x] Kalavai client on Windows (with WSL2)
-- [x] Public LLM pools
 - [x] Self-hosted LLM pools
 - [x] Collaborative LLM deployment
 - [x] Ray cluster support
@@ -262,7 +242,7 @@ Python version >= 3.6.
 ```bash
 sudo add-apt-repository ppa:deadsnakes/ppa
 sudo apt update
-sudo apt install python3.10 python3.10-dev python3-virtualenv
+sudo apt install python3.10 python3.10-dev python3-virtualenv python3-venv
 virtualenv -p python3.10 env
 source env/bin/activate
 sudo apt install  python3.10-venv python3.10-dev -y

kalavai_client-0.6.0/kalavai_client/__init__.py

@@ -0,0 +1,2 @@
+
+__version__ = "0.6.0"

{kalavai_client-0.5.29 → kalavai_client-0.6.0}/kalavai_client/assets/apps.yaml

@@ -28,7 +28,7 @@ releases:
   - name: lago
     namespace: kalavai
     chart: kalavai/lago
-    installed: true
+    installed: {{deploy_llm_sidecars}}
     set:
     - name: external.api.nodePort
       value: 32000
@@ -79,7 +79,7 @@ releases:
     namespace: kalavai
     chart: kalavai/kalavai-helios
     version: "0.1.11"
-    installed: {{not watcher_allow_unregistered_user}}
+    installed: false #{{deploy_llm_sidecars}}
     set:
     - name: deployment.watcher_endpoint
       value: "http://{{watcher_service}}"
@@ -94,11 +94,11 @@ releases:
   - name: opencost
     namespace: opencost
     chart: opencost-charts/opencost
-    installed: {{not watcher_allow_unregistered_user}}
+    installed: {{deploy_llm_sidecars}}
   - name: prometheus
     namespace: prometheus-system
     chart: prometheus/prometheus
-    installed: {{not watcher_allow_unregistered_user}}
+    installed: {{deploy_llm_sidecars}}
     set:
     - name: prometheus-pushgateway.enabled
       value: false
@@ -144,17 +144,19 @@ releases:
   - name: kalavai-watcher
     namespace: kalavai
     chart: kalavai/kalavai-watcher
-    version: "0.3.6"
+    version: "0.3.8"
     installed: true
     set:
     - name: namespace
       value: kalavai
     - name: replicas
-      value: 2
+      value: 1
     - name: image_tag
-      value: "v2025.03.11"
+      value: "v2025.03.18"
     - name: deployment.in_cluster
       value: "True"
+    - name: deployment.kalavai_username_key
+      value: "{{kalavai_username_key}}"
     - name: deployment.use_auth_key
       value: "True"
     - name: deployment.admin_key

{kalavai_client-0.5.29 → kalavai_client-0.6.0}/kalavai_client/assets/apps_values.yaml

@@ -1,5 +1,3 @@
-# TODO: add helm versions here
-
 - name: kalavai_api_endpoint
   default: https://platform.kalavai.net/_/api
   description: ""

{kalavai_client-0.5.29 → kalavai_client-0.6.0}/kalavai_client/assets/docker-compose-gui.yaml

@@ -10,6 +10,9 @@ services:
     environment:
     - KALAVAI_BRIDGE_URL=http://host.docker.internal
     - KALAVAI_BRIDGE_PORT={{bridge_port}}
+    {% if protected_access %}
+    - ACCESS_KEY={{protected_access}}
+    {% endif %}
     entrypoint: ["reflex"]
     command: >
       run

{kalavai_client-0.5.29 → kalavai_client-0.6.0}/kalavai_client/assets/docker-compose-template.yaml

@@ -1,7 +1,7 @@
 services:
 {% if vpn %}
   {{vpn_name}}:
-    image: gravitl/netclient:v0.24.3
+    image: gravitl/netclient:v0.90.0
     container_name: {{vpn_name}}
     #privileged: true
     cap_add:

kalavai_client-0.6.0/kalavai_client/auth.py

@@ -0,0 +1,110 @@
+from collections import defaultdict
+import os
+import json
+from typing import Optional, Any
+
+_USER_KEY = "id"
+
+
+class KalavaiAuth():
+    """Client for authenticating with the Kalavai watcher service."""
+    
+    def __init__(
+        self,
+        auth_service_url: str,
+        auth_service_key: str,
+        user_cookie_file: str
+    ):
+        """Initialize the Kalavai auth client.
+        
+        Args:
+            user_cookie_file: Path to store user session data
+        """
+        self.user_cookie = user_cookie_file
+        self.auth_service_url = auth_service_url
+        self.auth_service_key = auth_service_key
+        self.user_session = defaultdict(None)
+        self.load_user_session()
+
+    def save_auth(self, user_key: str) -> Optional[Any]:
+        """Login with user key.
+        
+        Args:
+            user_key: User's key (actual authentication key)
+            
+        Returns:
+            User data if successful, None otherwise
+        """
+        # Store the user key as the session
+        self.user_session[_USER_KEY] = user_key
+        with open(self.user_cookie, "w") as f:
+            json.dump(self.user_session, f)
+            print(f"User key securely saved to {self.user_cookie}")
+
+    def clear_auth(self) -> bool:
+        """Clear the current user and local session.
+        
+        Returns:
+            bool: True if successful, False otherwise
+        """
+        self.user_session = defaultdict(None)
+        try:
+            if os.path.exists(self.user_cookie):
+                os.remove(self.user_cookie)
+        except Exception as e:
+            print(f"Failed to clear user session: {str(e)}")
+
+    def is_authenticated(self) -> bool:
+        """Check if user is currently authenticated.
+        
+        Returns:
+            bool: True if logged in, False otherwise
+        """
+        return self.user_session[_USER_KEY] is not None
+
+    def load_user_session(self) -> Optional[Any]:
+        """Load user session from local storage.
+        
+        Returns:
+            User data if session exists, None otherwise
+        """
+        try:
+            if not os.path.exists(self.user_cookie):
+                return None
+                
+            with open(self.user_cookie, "r") as f:
+                for key, value in json.load(f).items():
+                    self.user_session[key] = value
+            return self.user_session
+            
+        except Exception as e:
+            print(f"Failed to load user session: {str(e)}")
+            self.clear_auth()
+            return None
+    
+    def get_user_id(self) -> Optional[Any]:
+        """Get the user key from the user session.
+        
+        Returns:
+            User key if session exists, None otherwise
+        """
+        try:
+            return self.user_session[_USER_KEY]
+        except:
+            return None
+
+
+# Example usage
+if __name__ == "__main__":
+    # Initialize client
+    auth = KalavaiAuth(
+        auth_service_url="http://localhost:8000",
+        auth_service_key="example_auth_service_key",
+        user_cookie_file="user_cookie.json"
+    )
+    
+    # Example of logging in with a user key
+    user_id = "example_user_id"
+    auth.save_auth(user_id)
+    
+    print(f"User id: {auth.get_user_id()}")

{kalavai_client-0.5.29 → kalavai_client-0.6.0}/kalavai_client/bridge_api.py

@@ -2,7 +2,8 @@
 Core kalavai service.
 Used as a bridge between the kalavai-client app and the reflex frontend
 """
-from fastapi import FastAPI
+from fastapi import FastAPI, HTTPException, Depends
+from starlette.requests import Request
 import uvicorn
 
 from kalavai_client.bridge_models import (
@@ -47,11 +48,24 @@ from kalavai_client.core import (
     uncordon_nodes,
     TokenType
 )
+from kalavai_client.utils import load_user_id
 
 app = FastAPI()
 
+################################
+## API Key Validation methods ##
+################################
+async def verify_api_key(request: Request):
+    user_id = load_user_id()
+    if user_id is None:
+        return None
+    api_key = request.headers.get("X-API-KEY")
+    if api_key != user_id:
+        raise HTTPException(status_code=401, detail="Request requires API Key")
+    return api_key
+
 @app.post("/create_pool")
-def pool_create(request: CreatePoolRequest):
+def pool_create(request: CreatePoolRequest, api_key: str = Depends(verify_api_key)):
     result = create_pool(
         cluster_name=request.cluster_name,
         ip_address=request.ip_address,
@@ -66,7 +80,7 @@ def pool_create(request: CreatePoolRequest):
     return result
 
 @app.post("/join_pool")
-def pool_join(request: JoinPoolRequest):
+def pool_join(request: JoinPoolRequest, api_key: str = Depends(verify_api_key)):
     result = join_pool(
         token=request.token,
         num_gpus=request.num_gpus,
@@ -76,7 +90,7 @@ def pool_join(request: JoinPoolRequest):
     return result
 
 @app.post("/attach_to_pool")
-def pool_attach(request: JoinPoolRequest):
+def pool_attach(request: JoinPoolRequest, api_key: str = Depends(verify_api_key)):
     result = attach_to_pool(
         token=request.token,
         node_name=request.node_name
@@ -84,64 +98,64 @@ def pool_attach(request: JoinPoolRequest):
     return result
 
 @app.post("/stop_pool")
-def pool_stop(request: StopPoolRequest):
+def pool_stop(request: StopPoolRequest, api_key: str = Depends(verify_api_key)):
     result = stop_pool(
         skip_node_deletion=request.skip_node_deletion
     )
     return result
 
 @app.post("/delete_nodes")
-def device_delete(request: NodesActionRequest):
+def device_delete(request: NodesActionRequest, api_key: str = Depends(verify_api_key)):
     result = delete_nodes(
         nodes=request.nodes
     )
     return result
 
 @app.post("/cordon_nodes")
-def device_cordon(request: NodesActionRequest):
+def device_cordon(request: NodesActionRequest, api_key: str = Depends(verify_api_key)):
     result = cordon_nodes(
         nodes=request.nodes
     )
     return result
 
 @app.post("/uncordon_nodes")
-def device_uncordon(request: NodesActionRequest):
+def device_uncordon(request: NodesActionRequest, api_key: str = Depends(verify_api_key)):
     result = uncordon_nodes(
         nodes=request.nodes
     )
     return result
 
 @app.get("/get_pool_token")
-def get_token(mode: int):
+def get_token(mode: int, api_key: str = Depends(verify_api_key)):
 
     return get_pool_token(mode=TokenType(mode))
 
 @app.get("/fetch_devices")
-def get_devices():
+def get_devices(api_key: str = Depends(verify_api_key)):
     return fetch_devices()
 
 @app.post("/send_pool_invites")
-def send_pool_invites(request: InvitesRequest):
+def send_pool_invites(request: InvitesRequest, api_key: str = Depends(verify_api_key)):
     return send_invites(invitees=request.invitees)
 
 @app.get("/fetch_resources")
-def resources():
+def resources(api_key: str = Depends(verify_api_key)):
     return fetch_resources()
 
 @app.get("/fetch_job_names")
-def job_names():
+def job_names(api_key: str = Depends(verify_api_key)):
     return fetch_job_names()
 
 @app.get("/fetch_gpus")
-def gpus(available: bool = False):
+def gpus(available: bool = False, api_key: str = Depends(verify_api_key)):
     return fetch_gpus(available=available)
 
 @app.post("/fetch_job_details")
-def job_details(request: JobDetailsRequest):
+def job_details(request: JobDetailsRequest, api_key: str = Depends(verify_api_key)):
     return fetch_job_details(jobs=request.jobs)
 
 @app.get("/fetch_job_logs")
-def job_logs(job_name: str, force_namespace: str=None, pod_name: str=None, tail: int=100):
+def job_logs(job_name: str, force_namespace: str=None, pod_name: str=None, tail: int=100, api_key: str = Depends(verify_api_key)):
     return fetch_job_logs(
         job_name=job_name,
         force_namespace=force_namespace,
@@ -150,15 +164,15 @@ def job_logs(job_name: str, force_namespace: str=None, pod_name: str=None, tail:
     )
 
 @app.get("/fetch_job_templates")
-def job_templates():
+def job_templates(api_key: str = Depends(verify_api_key)):
     return fetch_job_templates()
 
 @app.get("/fetch_job_defaults")
-def job_templates(name: str):
+def job_templates(name: str, api_key: str = Depends(verify_api_key)):
     return fetch_job_defaults(name=name)
 
 @app.post("/deploy_job")
-def job_deploy(request: DeployJobRequest):
+def job_deploy(request: DeployJobRequest, api_key: str = Depends(verify_api_key)):
     result = deploy_job(
         template_name=request.template_name,
         values_dict=request.values,
@@ -168,7 +182,7 @@ def job_deploy(request: DeployJobRequest):
     return result
 
 @app.post("/delete_job")
-def job_delete(request: DeleteJobRequest):
+def job_delete(request: DeleteJobRequest, api_key: str = Depends(verify_api_key)):
     result = delete_job(
         name=request.name,
         force_namespace=request.force_namespace
@@ -176,15 +190,14 @@ def job_delete(request: DeleteJobRequest):
     return result
 
 @app.get("/authenticate_user")
-def user_authenticate(username: str, password: str):
+def user_authenticate(user_id: str, api_key: str = Depends(verify_api_key)):
     result = authenticate_user(
-        username=username,
-        password=password
+        user_id=user_id
     )
     return result
 
 @app.get("/load_user_session")
-def user_session():
+def user_session(api_key: str = Depends(verify_api_key)):
     result = load_user_session()
     return result
 
@@ -219,12 +232,12 @@ def agent_resume():
     return result
 
 @app.get("/get_ip_addresses")
-def ip_addresses(subnet: str=None):
+def ip_addresses(subnet: str=None, api_key: str = Depends(verify_api_key)):
     result = get_ip_addresses(subnet=subnet)
     return result
 
 @app.get("/list_available_pools")
-def pool_connected(user_only: bool=False):
+def pool_connected(user_only: bool=False, api_key: str = Depends(verify_api_key)):
     result = list_available_pools(user_only=user_only)
     return result