llms-py 2.0.10__tar.gz → 2.0.12__tar.gz

{llms_py-2.0.10/llms_py.egg-info → llms_py-2.0.12}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: llms-py
-Version: 2.0.10
+Version: 2.0.12
 Summary: A lightweight CLI tool and OpenAI-compatible server for querying multiple Large Language Model (LLM) providers
 Home-page: https://github.com/ServiceStack/llms
 Author: ServiceStack
@@ -97,34 +97,31 @@ pip install aiohttp
 
 ## Quick Start
 
-### 1. Initialize Configuration
-
-Create a default configuration file:
-
-```bash
-llms --init
-```
-
-This saves the latest [llms.json](llms.json) configuration to `~/.llms/llms.json`.
-
-Modify `~/.llms/llms.json` to enable providers, add required API keys, additional models or any custom
-OpenAI-compatible providers.
-
-### 2. Set API Keys
+### 1. Set API Keys
 
 Set environment variables for the providers you want to use:
 
 ```bash
-export OPENROUTER_API_KEY="..."
-export GROQ_API_KEY="..."
-export GOOGLE_API_KEY="..."
-export ANTHROPIC_API_KEY="..."
-export GROK_API_KEY="..."
-export DASHSCOPE_API_KEY="..."
-# ... etc
+export OPENROUTER_FREE_API_KEY="..."
 ```
 
-### 3. Enable Providers
+| Provider        | Variable                  | Description         | Example |
+|-----------------|---------------------------|---------------------|---------|
+| openrouter_free | `OPENROUTER_FREE_API_KEY` | OpenRouter FREE models API key | `sk-or-...` |
+| groq            | `GROQ_API_KEY`            | Groq API key        | `gsk_...` |
+| google_free     | `GOOGLE_FREE_API_KEY`     | Google FREE API key | `AIza...` |
+| codestral       | `CODESTRAL_API_KEY`       | Codestral API key   | `...` |
+| ollama          | N/A                       | No API key required | |
+| openrouter      | `OPENROUTER_API_KEY`      | OpenRouter API key  | `sk-or-...` |
+| google          | `GOOGLE_API_KEY`          | Google API key      | `AIza...` |
+| anthropic       | `ANTHROPIC_API_KEY`       | Anthropic API key   | `sk-ant-...` |
+| openai          | `OPENAI_API_KEY`          | OpenAI API key      | `sk-...` |
+| grok            | `GROK_API_KEY`            | Grok (X.AI) API key | `xai-...` |
+| qwen            | `DASHSCOPE_API_KEY`       | Qwen (Alibaba) API key | `sk-...` |
+| z.ai            | `ZAI_API_KEY`             | Z.ai API key        | `sk-...` |
+| mistral         | `MISTRAL_API_KEY`         | Mistral API key     | `...` |
+
+### 2. Enable Providers
 
 Enable the providers you want to use:
 
@@ -136,7 +133,17 @@ llms --enable openrouter_free google_free groq
 llms --enable openrouter anthropic google openai mistral grok qwen
 ```
 
-### 4. Start Chatting
+### 3. Run UI
+
+Start the UI and an OpenAI compatible API on port **8000**:
+
+```bash
+llms --serve 8000
+```
+
+Launches the UI at `http://localhost:8000` and an OpenAI Endpoint at `http://localhost:8000/v1/chat/completions`.
+
+### 4. Use llms.py CLI
 
 ```bash
 llms "What is the capital of France?"
@@ -144,7 +151,7 @@ llms "What is the capital of France?"
 
 ## Configuration
 
-The configuration file (`llms.json`) defines available providers, models, and default settings. Key sections:
+The configuration file [llms.json](llms.json) is saved to `~/.llms/llms.json` and defines available providers, models, and default settings. Key sections:
 
 ### Defaults
 - `headers`: Common HTTP headers for all requests
@@ -159,6 +166,7 @@ Each provider configuration includes:
 - `base_url`: API endpoint URL
 - `models`: Model name mappings (local name → provider name)
 
+
 ## Command Line Usage
 
 ### Basic Chat

{llms_py-2.0.10 → llms_py-2.0.12}/README.md

@@ -57,34 +57,31 @@ pip install aiohttp
 
 ## Quick Start
 
-### 1. Initialize Configuration
-
-Create a default configuration file:
-
-```bash
-llms --init
-```
-
-This saves the latest [llms.json](llms.json) configuration to `~/.llms/llms.json`.
-
-Modify `~/.llms/llms.json` to enable providers, add required API keys, additional models or any custom
-OpenAI-compatible providers.
-
-### 2. Set API Keys
+### 1. Set API Keys
 
 Set environment variables for the providers you want to use:
 
 ```bash
-export OPENROUTER_API_KEY="..."
-export GROQ_API_KEY="..."
-export GOOGLE_API_KEY="..."
-export ANTHROPIC_API_KEY="..."
-export GROK_API_KEY="..."
-export DASHSCOPE_API_KEY="..."
-# ... etc
+export OPENROUTER_FREE_API_KEY="..."
 ```
 
-### 3. Enable Providers
+| Provider        | Variable                  | Description         | Example |
+|-----------------|---------------------------|---------------------|---------|
+| openrouter_free | `OPENROUTER_FREE_API_KEY` | OpenRouter FREE models API key | `sk-or-...` |
+| groq            | `GROQ_API_KEY`            | Groq API key        | `gsk_...` |
+| google_free     | `GOOGLE_FREE_API_KEY`     | Google FREE API key | `AIza...` |
+| codestral       | `CODESTRAL_API_KEY`       | Codestral API key   | `...` |
+| ollama          | N/A                       | No API key required | |
+| openrouter      | `OPENROUTER_API_KEY`      | OpenRouter API key  | `sk-or-...` |
+| google          | `GOOGLE_API_KEY`          | Google API key      | `AIza...` |
+| anthropic       | `ANTHROPIC_API_KEY`       | Anthropic API key   | `sk-ant-...` |
+| openai          | `OPENAI_API_KEY`          | OpenAI API key      | `sk-...` |
+| grok            | `GROK_API_KEY`            | Grok (X.AI) API key | `xai-...` |
+| qwen            | `DASHSCOPE_API_KEY`       | Qwen (Alibaba) API key | `sk-...` |
+| z.ai            | `ZAI_API_KEY`             | Z.ai API key        | `sk-...` |
+| mistral         | `MISTRAL_API_KEY`         | Mistral API key     | `...` |
+
+### 2. Enable Providers
 
 Enable the providers you want to use:
 
@@ -96,7 +93,17 @@ llms --enable openrouter_free google_free groq
 llms --enable openrouter anthropic google openai mistral grok qwen
 ```
 
-### 4. Start Chatting
+### 3. Run UI
+
+Start the UI and an OpenAI compatible API on port **8000**:
+
+```bash
+llms --serve 8000
+```
+
+Launches the UI at `http://localhost:8000` and an OpenAI Endpoint at `http://localhost:8000/v1/chat/completions`.
+
+### 4. Use llms.py CLI
 
 ```bash
 llms "What is the capital of France?"
@@ -104,7 +111,7 @@ llms "What is the capital of France?"
 
 ## Configuration
 
-The configuration file (`llms.json`) defines available providers, models, and default settings. Key sections:
+The configuration file [llms.json](llms.json) is saved to `~/.llms/llms.json` and defines available providers, models, and default settings. Key sections:
 
 ### Defaults
 - `headers`: Common HTTP headers for all requests
@@ -119,6 +126,7 @@ Each provider configuration includes:
 - `base_url`: API endpoint URL
 - `models`: Model name mappings (local name → provider name)
 
+
 ## Command Line Usage
 
 ### Basic Chat

{llms_py-2.0.10 → llms_py-2.0.12}/llms.json

@@ -86,7 +86,7 @@
             "enabled": true,
             "type": "OpenAiProvider",
             "base_url": "https://openrouter.ai/api",
-            "api_key": "$OPENROUTER_FREE_API_KEY",
+            "api_key": "$OPENROUTER_API_KEY",
             "models": {
                 "qwen2.5vl": "qwen/qwen2.5-vl-32b-instruct:free",
                 "llama4:109b": "meta-llama/llama-4-scout:free",
@@ -236,6 +236,7 @@
                 "qwen3-max": "qwen/qwen3-max",
                 "qwen3-vl:235b": "qwen/qwen3-vl-235b-a22b-instruct",
                 "qwen3-vl-thinking:235b": "qwen/qwen3-vl-235b-a22b-thinking",
+                "ling-1t": "inclusionai/ling-1t",
                 "llama4:109b": "meta-llama/llama-4-scout",
                 "llama4:400b": "meta-llama/llama-4-maverick"
             }
@@ -283,6 +284,7 @@
             "base_url": "https://api.openai.com",
             "api_key": "$OPENAI_API_KEY",
             "models": {
+                "gpt-5-pro": "openai/gpt-5-pro",
                 "gpt-5-codex": "gpt-5-codex",
                 "gpt-audio": "gpt-audio",
                 "gpt-realtime": "gpt-realtime",
@@ -386,6 +388,7 @@
                 "qwen3-coder:30b": "qwen3-coder-30b-a3b-instruct",
                 "qwen3-vl-thinking:235b": "qwen3-vl-235b-a22b-thinking",
                 "qwen3-vl:235b": "qwen3-vl-235b-a22b-instruct",
+                "qwen3-vl:30b": "qwen3-vl-30b-a3b-instruct",
                 "qwen2.5-vl:72b": "qwen2.5-vl-72b-instruct",
                 "qwen2.5-vl:32b": "qwen2.5-vl-32b-instruct",
                 "qwen2.5-vl:7b": "qwen2.5-vl-7b-instruct",

{llms_py-2.0.10 → llms_py-2.0.12}/llms.py

@@ -22,7 +22,7 @@ from aiohttp import web
 from pathlib import Path
 from importlib import resources   # Py≥3.9  (pip install importlib_resources for 3.7/3.8)
 
-VERSION = "2.0.10"
+VERSION = "2.0.12"
 _ROOT = None
 g_config_path = None
 g_ui_path = None

{llms_py-2.0.10 → llms_py-2.0.12/llms_py.egg-info}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: llms-py
-Version: 2.0.10
+Version: 2.0.12
 Summary: A lightweight CLI tool and OpenAI-compatible server for querying multiple Large Language Model (LLM) providers
 Home-page: https://github.com/ServiceStack/llms
 Author: ServiceStack
@@ -97,34 +97,31 @@ pip install aiohttp
 
 ## Quick Start
 
-### 1. Initialize Configuration
-
-Create a default configuration file:
-
-```bash
-llms --init
-```
-
-This saves the latest [llms.json](llms.json) configuration to `~/.llms/llms.json`.
-
-Modify `~/.llms/llms.json` to enable providers, add required API keys, additional models or any custom
-OpenAI-compatible providers.
-
-### 2. Set API Keys
+### 1. Set API Keys
 
 Set environment variables for the providers you want to use:
 
 ```bash
-export OPENROUTER_API_KEY="..."
-export GROQ_API_KEY="..."
-export GOOGLE_API_KEY="..."
-export ANTHROPIC_API_KEY="..."
-export GROK_API_KEY="..."
-export DASHSCOPE_API_KEY="..."
-# ... etc
+export OPENROUTER_FREE_API_KEY="..."
 ```
 
-### 3. Enable Providers
+| Provider        | Variable                  | Description         | Example |
+|-----------------|---------------------------|---------------------|---------|
+| openrouter_free | `OPENROUTER_FREE_API_KEY` | OpenRouter FREE models API key | `sk-or-...` |
+| groq            | `GROQ_API_KEY`            | Groq API key        | `gsk_...` |
+| google_free     | `GOOGLE_FREE_API_KEY`     | Google FREE API key | `AIza...` |
+| codestral       | `CODESTRAL_API_KEY`       | Codestral API key   | `...` |
+| ollama          | N/A                       | No API key required | |
+| openrouter      | `OPENROUTER_API_KEY`      | OpenRouter API key  | `sk-or-...` |
+| google          | `GOOGLE_API_KEY`          | Google API key      | `AIza...` |
+| anthropic       | `ANTHROPIC_API_KEY`       | Anthropic API key   | `sk-ant-...` |
+| openai          | `OPENAI_API_KEY`          | OpenAI API key      | `sk-...` |
+| grok            | `GROK_API_KEY`            | Grok (X.AI) API key | `xai-...` |
+| qwen            | `DASHSCOPE_API_KEY`       | Qwen (Alibaba) API key | `sk-...` |
+| z.ai            | `ZAI_API_KEY`             | Z.ai API key        | `sk-...` |
+| mistral         | `MISTRAL_API_KEY`         | Mistral API key     | `...` |
+
+### 2. Enable Providers
 
 Enable the providers you want to use:
 
@@ -136,7 +133,17 @@ llms --enable openrouter_free google_free groq
 llms --enable openrouter anthropic google openai mistral grok qwen
 ```
 
-### 4. Start Chatting
+### 3. Run UI
+
+Start the UI and an OpenAI compatible API on port **8000**:
+
+```bash
+llms --serve 8000
+```
+
+Launches the UI at `http://localhost:8000` and an OpenAI Endpoint at `http://localhost:8000/v1/chat/completions`.
+
+### 4. Use llms.py CLI
 
 ```bash
 llms "What is the capital of France?"
@@ -144,7 +151,7 @@ llms "What is the capital of France?"
 
 ## Configuration
 
-The configuration file (`llms.json`) defines available providers, models, and default settings. Key sections:
+The configuration file [llms.json](llms.json) is saved to `~/.llms/llms.json` and defines available providers, models, and default settings. Key sections:
 
 ### Defaults
 - `headers`: Common HTTP headers for all requests
@@ -159,6 +166,7 @@ Each provider configuration includes:
 - `base_url`: API endpoint URL
 - `models`: Model name mappings (local name → provider name)
 
+
 ## Command Line Usage
 
 ### Basic Chat

{llms_py-2.0.10 → llms_py-2.0.12}/pyproject.toml

@@ -4,7 +4,7 @@ build-backend = "setuptools.build_meta"
 
 [project]
 name = "llms-py"
-version = "2.0.10"
+version = "2.0.12"
 description = "A lightweight CLI tool and OpenAI-compatible server for querying multiple Large Language Model (LLM) providers"
 readme = "README.md"
 license = "BSD-3-Clause"

{llms_py-2.0.10 → llms_py-2.0.12}/setup.py

@@ -16,7 +16,7 @@ with open(os.path.join(this_directory, "requirements.txt"), encoding="utf-8") as
 
 setup(
     name="llms-py",
-    version="2.0.10",
+    version="2.0.12",
     author="ServiceStack",
     author_email="team@servicestack.net",
     description="A lightweight CLI tool and OpenAI-compatible server for querying multiple Large Language Model (LLM) providers",

{llms_py-2.0.10 → llms_py-2.0.12}/ui/ai.mjs

@@ -6,6 +6,7 @@ const headers = { 'Accept': 'application/json' }
 const prefsKey = 'llms.prefs'
 
 export const o = {
+    version: '2.0.12',
     base,
     prefsKey,
     welcome: 'Welcome to llms.py',