hf2ollama-python-cli-tool 1.0.0__py3-none-any.whl

hf2ollama_python_cli_tool-1.0.0.dist-info/METADATA

@@ -0,0 +1,200 @@
+Metadata-Version: 2.5
+Name: hf2ollama-python-cli-tool
+Version: 1.0.0
+Summary: Search, download, and import HuggingFace GGUF models into Ollama
+Project-URL: Repository, https://github.com/rs2pydev/hf2ollama-python-cli-tool
+Author: Tanmoy Dutta
+License-Expression: MIT
+License-File: LICENSE
+Keywords: gguf,huggingface,llm,model-management,ollama
+Classifier: Development Status :: 3 - Alpha
+Classifier: Intended Audience :: Developers
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
+Requires-Python: >=3.10
+Requires-Dist: certifi
+Requires-Dist: click>=8.0
+Requires-Dist: httpx>=0.27
+Requires-Dist: rich>=13.0
+Requires-Dist: truststore>=0.9
+Provides-Extra: dev
+Requires-Dist: pytest>=7.0; extra == 'dev'
+Requires-Dist: respx>=0.21; extra == 'dev'
+Requires-Dist: ruff>=0.4; extra == 'dev'
+Description-Content-Type: text/markdown
+
+# hf2ollama
+
+A Python CLI tool that searches, downloads, and imports HuggingFace GGUF models into Ollama. Handles model discovery, quantization selection, automatic Modelfile generation, and resumable downloads.
+
+## What it does
+
+`ollama pull` only works with models hosted on the Ollama registry. Most open-weight GGUF models live on HuggingFace. This tool bridges that gap: search HuggingFace for GGUF repos, pick a quantization, download the file, auto-generate the correct Modelfile with chat template and stop tokens, and import into Ollama - all in one command.
+
+It also handles a common Python SSL issue where `certifi` (the default CA bundle) doesn't include certificates from the operating system's trust store. The `--ssl-fix` flag exports the OS certificate store and configures Python to use it.
+
+## Installation
+
+Works on Windows, macOS, and Linux. Requires Python 3.10+.
+
+```shell
+pip install hf2ollama
+```
+
+From source:
+
+```shell
+git clone https://github.com/rs2pydev/hf2ollama-python-cli-tool.git
+cd hf2ollama-python-cli-tool
+pip install -e ".[dev]"
+```
+
+## Quick start
+
+```shell
+# Search for models
+hf2ollama search "qwen 7b gguf"
+
+# See available quantizations and file sizes
+hf2ollama list-files bartowski/Qwen2.5-Coder-7B-Instruct-GGUF
+
+# Download and import into Ollama
+hf2ollama pull bartowski/Qwen2.5-Coder-7B-Instruct-GGUF --quant Q4_K_M
+
+# Fix Python SSL certificate issues if downloads fail
+hf2ollama pull bartowski/Qwen2.5-Coder-7B-Instruct-GGUF --ssl-fix
+
+# Use alternative download method (Windows, PowerShell 7 required)
+hf2ollama pull bartowski/Qwen2.5-Coder-7B-Instruct-GGUF --alt-download
+```
+
+## Commands
+
+### pull
+
+Download a GGUF model from HuggingFace and import into Ollama.
+
+```shell
+hf2ollama pull <repo> [--quant Q4_K_M] [--name my-model] [--keep-gguf] [--ssl-fix] [--alt-download]
+```
+
+Options:
+
+- `--quant` / `-q` - Quantization level (Q2_K, Q3_K_M, Q4_K_M, Q5_K_M, Q6_K, Q8_0). Default: Q4_K_M.
+- `--name` / `-n` - Ollama model name. Auto-generated from filename if not specified.
+- `--keep-gguf` - Keep the GGUF file after importing into Ollama.
+- `--ssl-fix` - Use OS certificate store instead of Python's default CA bundle.
+- `--alt-download` - Use alternative PowerShell-based download method (Windows only, requires PowerShell 7).
+
+The tool auto-detects the model family from the filename and generates the correct Modelfile with chat template and stop tokens.
+
+### search
+
+Search HuggingFace for GGUF model repositories.
+
+```shell
+hf2ollama search "llama 70b" --limit 20 --sort downloads
+```
+
+### list-files
+
+Show available GGUF files in a repository with their sizes.
+
+```shell
+hf2ollama list-files bartowski/Qwen2.5-Coder-7B-Instruct-GGUF
+```
+
+### list
+
+List locally installed Ollama models.
+
+```shell
+hf2ollama list
+```
+
+### remove
+
+Delete an Ollama model.
+
+```shell
+hf2ollama remove my-model:q4_k_m
+```
+
+### info
+
+Show details about an installed Ollama model.
+
+```shell
+hf2ollama info my-model:q4_k_m
+```
+
+### recommend
+
+Recommend quantization based on your GPU VRAM and model size.
+
+```shell
+# Auto-detect GPU VRAM
+hf2ollama recommend --params 7
+
+# Specify VRAM manually
+hf2ollama recommend --params 70 --vram 24
+```
+
+### network-check
+
+Check whether HuggingFace is reachable and whether SSL certificates are configured correctly.
+
+```shell
+hf2ollama network-check
+```
+
+## Supported model families
+
+The tool auto-detects model families from GGUF filenames and generates the correct Ollama Modelfile:
+
+- Llama 3 / 3.1 / 3.2 / 3.3 / 4
+- Gemma (2, 3, 4)
+- Qwen (2, 2.5, 3)
+- Mistral / Mixtral
+- Phi (3, 4)
+- DeepSeek (R1, V3)
+- Granite
+- Command-R
+- ChatML (fallback for unrecognized models)
+
+## Supported quantizations
+
+Q2_K, Q3_K_M, Q4_K_M (default), Q5_K_M, Q6_K, Q8_0
+
+## Configuration
+
+Persistent config is stored in `~/.hf2ollama/config.toml`:
+
+```toml
+download_dir = "C:/Users/you/.hf2ollama/downloads"
+default_quant = "Q4_K_M"
+hf_token = "hf_xxxxx"
+```
+
+## Requirements
+
+- Python 3.10+
+- Ollama installed locally
+- For `--alt-download`: Windows + PowerShell 7
+
+## Dependencies
+
+- click - CLI framework
+- httpx - HTTP client with resumable downloads
+- rich - Terminal tables and progress bars
+- truststore - OS certificate store access
+- certifi - Public CA bundle
+
+## License
+
+MIT

hf2ollama_python_cli_tool-1.0.0.dist-info/RECORD

@@ -0,0 +1,24 @@
+hf2ollama/__init__.py,sha256=u4aaDMltD1BbvSdlfZQewQsaFoVbafEf3wdHccpHQUo,107
+hf2ollama/cli.py,sha256=0JDujTIUDJV9Rk8OPou74s89jGRFdWeJYa2cx2rilf4,10879
+hf2ollama/core/__init__.py,sha256=qzmey-_8Gn3vLix4pBLQq5h-eQNiVcyJiB7NN2l8ILc,77
+hf2ollama/core/config.py,sha256=JbKg1C7bbVE8HQsD6-r01fqyXEAzcNPgqaPwd9ucrYk,2140
+hf2ollama/core/ollama.py,sha256=4ghLiK9DQFPb-YoPJGBx2fvv2pZyODQCwU07rLRxyl8,3451
+hf2ollama/hf/__init__.py,sha256=6eD_Q6fcUdM5glDIzAtw3pj_B76Q9Ww8_jioxbTvGvI,63
+hf2ollama/hf/alt_download.py,sha256=jYnx89CGjvVwB1YWFnRy-fgSqnDucVccC22eU3O7Chg,1877
+hf2ollama/hf/api.py,sha256=TV_Tp_utnND_xqOShLf7nD5wng6QGBQuYe_0GfeVk2g,4856
+hf2ollama/hf/download.py,sha256=JOSmAwOgb9BfFz6iPKd_SMiuIavFnJH5f74XG9Mr4gw,3356
+hf2ollama/modelfile/__init__.py,sha256=X-_-Cv5sAxqg_5m4IC8V2T01oVM7y3ZlisXkgilJGXA,72
+hf2ollama/modelfile/generator.py,sha256=qfzbNhEe-to-WgwYBGpo26lKaTtGBdzcc5poBpJ2uIY,2299
+hf2ollama/modelfile/templates.py,sha256=2-P2ve3Hw2qF_TSs4fo5_m_DZqIw9FA-WyoyAxTJ-L8,4537
+hf2ollama/network/__init__.py,sha256=1_d4a9VusKoERwpvuNJiT4A62Uu3Wz6AH6MsDAAc0jo,76
+hf2ollama/network/detect.py,sha256=XIH3MSPm2xXHBUgsMhah2n1jCnjvS4ptMygA8_tshDQ,1715
+hf2ollama/network/ssl_fix.py,sha256=zhMXhirHtWRhJIFU9_smzY6h7P7ifY0UumnzKv1gNBw,2125
+hf2ollama/scripts/HfDownload.ps1,sha256=MFvU4DTjapW05eB8x4gsCg9jN0ERLFXD7xAjWUHjeoo,8955
+hf2ollama/utils/__init__.py,sha256=Q3PTIhsN4KTYUqjuOVNVDa0sPjeHiBN6CwVgvyXZ6wg,63
+hf2ollama/utils/vram.py,sha256=zZhFtbFHg1ai8ABPmbKTlA4q_t2daB6rIQW873IFlsA,1743
+hf2ollama_python_cli_tool-1.0.0.data/data/hf2ollama/scripts/HfDownload.ps1,sha256=MFvU4DTjapW05eB8x4gsCg9jN0ERLFXD7xAjWUHjeoo,8955
+hf2ollama_python_cli_tool-1.0.0.dist-info/METADATA,sha256=ZSFChGCGDU8ODGzw4RnY1v6t3PJQCph4OG5s4Dfg0yo,5392
+hf2ollama_python_cli_tool-1.0.0.dist-info/WHEEL,sha256=zOwg4jB6zX2kU910N-cMawjivD6tO8NEWvE12je1bVk,87
+hf2ollama_python_cli_tool-1.0.0.dist-info/entry_points.txt,sha256=d2JsyhZ5wcOXU09BqB5UHQ2nZYEdQ5ZpC0mLHPcymoM,49
+hf2ollama_python_cli_tool-1.0.0.dist-info/licenses/LICENSE,sha256=0LXwWLVpnURdwP9QZYvThNWHlwXNgeHGdrJlyYFtMD4,1069
+hf2ollama_python_cli_tool-1.0.0.dist-info/RECORD,,

hf2ollama_python_cli_tool-1.0.0.dist-info/WHEEL

@@ -0,0 +1,4 @@
+Wheel-Version: 1.0
+Generator: hatchling 1.32.0
+Root-Is-Purelib: true
+Tag: py3-none-any

hf2ollama_python_cli_tool-1.0.0.dist-info/entry_points.txt

@@ -0,0 +1,2 @@
+[console_scripts]
+hf2ollama = hf2ollama.cli:main

hf2ollama_python_cli_tool-1.0.0.dist-info/licenses/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2024 Tanmoy Dutta
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.