zerollm-kit 0.1.0__tar.gz

zerollm_kit-0.1.0/.gitignore

@@ -0,0 +1,14 @@
+__pycache__/
+*.py[cod]
+*$py.class
+*.egg-info/
+dist/
+build/
+.eggs/
+*.egg
+.venv/
+venv/
+.env
+.DS_Store
+*.gguf
+*.db

zerollm_kit-0.1.0/.python-version

@@ -0,0 +1 @@
+3.11

zerollm_kit-0.1.0/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 Nilesh Verma
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

zerollm_kit-0.1.0/PKG-INFO

@@ -0,0 +1,211 @@
+Metadata-Version: 2.4
+Name: zerollm-kit
+Version: 0.1.0
+Summary: Zero setup, zero config — the easiest Python API for local LLMs on any hardware
+Project-URL: Homepage, https://github.com/TechyNilesh/ZeroLLM
+Project-URL: Repository, https://github.com/TechyNilesh/ZeroLLM
+Author: Nilesh Verma
+License-Expression: MIT
+License-File: LICENSE
+Keywords: agents,fine-tuning,inference,llm,local,rag
+Classifier: Development Status :: 3 - Alpha
+Classifier: Intended Audience :: Developers
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
+Requires-Python: >=3.10
+Requires-Dist: accelerate
+Requires-Dist: datasets
+Requires-Dist: fastapi
+Requires-Dist: huggingface-hub
+Requires-Dist: llama-cpp-python
+Requires-Dist: peft
+Requires-Dist: psutil
+Requires-Dist: pymupdf
+Requires-Dist: python-docx
+Requires-Dist: rich
+Requires-Dist: sentence-transformers
+Requires-Dist: sqlite-vec
+Requires-Dist: tokenizers
+Requires-Dist: torch
+Requires-Dist: transformers
+Requires-Dist: typer
+Requires-Dist: uvicorn
+Description-Content-Type: text/markdown
+
+<p align="center">
+  <img src="assets/zerollm-logo-main.png" alt="ZeroLLM" width="400">
+</p>
+
+<p align="center">
+  <strong>Zero setup. Zero config. Local LLMs on any hardware.</strong>
+</p>
+
+<p align="center">
+  <a href="https://github.com/TechyNilesh/ZeroLLM/actions"><img src="https://img.shields.io/github/actions/workflow/status/TechyNilesh/ZeroLLM/ci.yml?branch=main&style=for-the-badge" alt="CI"></a>
+  <a href="https://pypi.org/project/zerollm/"><img src="https://img.shields.io/pypi/v/zerollm?style=for-the-badge" alt="PyPI"></a>
+  <a href="LICENSE"><img src="https://img.shields.io/badge/License-MIT-blue.svg?style=for-the-badge" alt="MIT License"></a>
+  <a href="https://www.python.org/"><img src="https://img.shields.io/badge/python-3.10+-blue?style=for-the-badge&logo=python&logoColor=white" alt="Python 3.10+"></a>
+  <a href="https://pepy.tech/project/zerollm"><img src="https://img.shields.io/pepy/dt/zerollm?style=for-the-badge&label=Downloads" alt="Downloads"></a>
+</p>
+
+---
+
+## What is ZeroLLM?
+
+One `pip install`. Auto-detects your hardware. Downloads the right model. You're chatting in 3 lines of Python.
+
+```python
+from zerollm import Chat
+
+bot = Chat("Qwen/Qwen3-0.6B")
+print(bot.ask("What is the capital of France?"))
+```
+
+That's it. No config files, no model format headaches, no GPU drivers to manage.
+
+## Install
+
+```bash
+pip install zerollm
+```
+
+## Quick Start
+
+### Chat
+
+```python
+from zerollm import Chat
+
+bot = Chat("Qwen/Qwen3-0.6B")
+
+# Ask
+print(bot.ask("Explain quantum computing in one sentence"))
+
+# Stream
+for token in bot.stream("Write a haiku about code"):
+    print(token, end="", flush=True)
+
+# Interactive REPL
+bot.chat()
+```
+
+### Agent with Tools
+
+```python
+from zerollm import Agent
+
+agent = Agent("Qwen/Qwen3-0.6B")
+
+@agent.tool
+def get_weather(city: str) -> str:
+    """Get weather for a city."""
+    return f"22°C and sunny in {city}"
+
+print(agent.ask("What's the weather in Auckland?"))
+```
+
+### Sub-Agents
+
+```python
+researcher = Agent("Qwen/Qwen3-1.7B", name="researcher")
+
+@researcher.tool
+def search(query: str) -> str:
+    return f"Results for: {query}"
+
+main = Agent("Qwen/Qwen3-0.6B")
+main.add_agent("researcher", researcher, "Research any topic")
+
+main.ask("Research the latest AI trends")
+```
+
+### Serve as API
+
+```python
+from zerollm import Server
+
+Server("Qwen/Qwen3-0.6B", port=8080).serve()
+```
+
+OpenAI-compatible. Works with any client that speaks the OpenAI API.
+
+### Fine-Tune
+
+```python
+from zerollm import FineTuner
+
+tuner = FineTuner("Qwen/Qwen3-0.6B")
+tuner.train("my_data.csv", epochs=3)
+tuner.save("my-bot")
+```
+
+Then serve your fine-tuned model:
+
+```python
+from zerollm import Chat, Server
+
+Chat("my-bot").ask("Hello!")        # chat with it
+Server("my-bot", port=8080).serve() # or serve it
+```
+
+### RAG
+
+```python
+from zerollm import RAG
+
+rag = RAG("Qwen/Qwen3-0.6B")
+rag.add("docs.pdf")
+print(rag.ask("What is the refund policy?"))
+```
+
+Powered by SQLite + sqlite-vec. No external database needed.
+
+## CLI
+
+```bash
+zerollm recommend                                          # best model for your hardware
+zerollm chat Qwen/Qwen3-0.6B          # interactive chat
+zerollm serve Qwen/Qwen3-0.6B         # start API server
+zerollm list                                               # all available models
+zerollm doctor                                             # diagnose setup
+```
+
+## Supported Hardware
+
+| Platform | Acceleration | Auto-detected |
+|----------|-------------|---------------|
+| Any CPU | llama.cpp | Yes |
+| NVIDIA GPU | CUDA | Yes |
+| Apple Silicon | Metal | Yes |
+| AMD GPU | ROCm | Yes |
+| Raspberry Pi | CPU | Yes |
+
+## Models
+
+Works with any GGUF model from Hugging Face. Pass the full HF model name or a local `.gguf` file:
+
+```python
+Chat("Qwen/Qwen3-0.6B")  # from registry
+Chat("/path/to/any-model.gguf")                # local file
+Chat("my-finetuned-bot")                       # your fine-tuned model
+```
+
+Run `zerollm list` to see curated models, or `zerollm recommend` to find the best one for your hardware.
+
+## Architecture
+
+<p align="center">
+  <img src="assets/zerollm-architecture.png" alt="ZeroLLM Architecture" width="700">
+</p>
+
+## License
+
+[MIT](LICENSE)
+
+## Core Contributor
+
+[Nilesh Verma](https://nileshverma.com/)