nexaai 0.0.8.5__tar.gz → 0.0.8.6.1__tar.gz

{nexaai-0.0.8.5 → nexaai-0.0.8.6.1}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: nexaai
-Version: 0.0.8.5
+Version: 0.0.8.6.1
 Summary: Nexa AI SDK
 Author-Email: Nexa AI <octopus@nexa4ai.com>
 License: MIT
@@ -72,6 +72,21 @@ Description-Content-Type: text/markdown
 
 Nexa SDK is a comprehensive toolkit for supporting **ONNX** and **GGML** models. It supports text generation, image generation, vision-language models (VLM), and text-to-speech (TTS) capabilities. Additionally, it offers an OpenAI-compatible API server with JSON schema mode for function calling and streaming support, and a user-friendly Streamlit UI. Users can run Nexa SDK in any device with Python environment, and GPU acceleration is supported.
 
+## Latest News 🔥
+* [2024/09] Nexa now has executables for easy installation: [Install Nexa SDK](https://nexaai.com/download-sdk)
+* [2024/09] Added support for Llama 3.2 models: `nexa run llama3.2`
+* [2024/09] Added support for Qwen2.5, Qwen2.5-coder and Qwen2.5-Math models: `nexa run qwen2.5`
+* [2024/09] Now supporting pulling and running GGUF models from Hugging Face: `nexa run -hf <hf model id>`
+* [2024/09] Added support for ROCm
+* [2024/09] Added support for Phi-3.5 models: `nexa run phi3.5`
+* [2024/09] Added support for OpenELM models: `nexa run openelm`
+* [2024/09] Introduced logits API support for more advanced model interactions
+* [2024/09] Added support for Flux models: `nexa run flux`
+* [2024/09] Added support for Stable Diffusion 3 model: `nexa run sd3`
+* [2024/09] Added support for Stable Diffusion 2.1 model: `nexa run sd2-1`
+
+Welcome to submit your requests through [issues](https://github.com/NexaAI/nexa-sdk/issues/new/choose), we ship weekly.
+
 ## Features
 
 - **Model Support:**
@@ -107,6 +122,18 @@ Below is our differentiation from other similar tools:
 
 ## Installation
 
+### macOS
+[Download](https://public-storage.nexa4ai.com/nexa-sdk-executable-installer/nexa-macos-installer.pkg)
+
+### Linux
+```bash
+curl -fsSL https://public-storage.nexa4ai.com/install.sh | sh 
+```
+### Windows
+Coming soon. Install with Python package below 👇
+
+## Python Package
+
 We have released pre-built wheels for various Python versions, platforms, and backends for convenient installation on our [index page](https://nexaai.github.io/nexa-sdk/whl/).
 
 > [!NOTE]
@@ -189,7 +216,7 @@ CMAKE_ARGS="-DCMAKE_CXX_FLAGS=-fopenmp" pip install nexaai
 For **Linux**:
 
 ```bash
-CMAKE_ARGS="-DGGML_HIPBLAS=on" pip install nexaai --prefer-binary --index-url https://nexaai.github.io/nexa-sdk/whl/rocm602 --extra-index-url https://pypi.org/simple --no-cache-dir
+CMAKE_ARGS="-DGGML_HIPBLAS=on" pip install nexaai --prefer-binary --index-url https://nexaai.github.io/nexa-sdk/whl/rocm621 --extra-index-url https://pypi.org/simple --no-cache-dir
 ```
 
 ### Local Build
@@ -218,27 +245,31 @@ pip install -e .
 | ------------------------------------------------------------------------------------------------------- | --------------- | --------- | ---------------------------------- |
 | [octopus-v2](https://www.nexaai.com/NexaAI/Octopus-v2/gguf-q4_0/readme)                                 | NLP             | GGUF      | `nexa run octopus-v2`              |
 | [octopus-v4](https://www.nexaai.com/NexaAI/Octopus-v4/gguf-q4_0/readme)                                 | NLP             | GGUF      | `nexa run octopus-v4`              |
+| [gpt2](https://nexaai.com/openai/gpt2/gguf-q4_0/readme)                                                 | NLP             | GGUF      | `nexa run gpt2`                    |
 | [tinyllama](https://www.nexaai.com/TinyLlama/TinyLlama-1.1B-Chat-v1.0/gguf-fp16/readme)                 | NLP             | GGUF      | `nexa run tinyllama`               |
 | [llama2](https://www.nexaai.com/meta/Llama2-7b-chat/gguf-q4_0/readme)                                   | NLP             | GGUF/ONNX | `nexa run llama2`                  |
+| [llama2-uncensored](https://www.nexaai.com/georgesung/Llama2-7b-chat-uncensored/gguf-q4_0/readme)       | NLP             | GGUF      | `nexa run llama2-uncensored`       |
+| [llama2-function-calling](https://www.nexaai.com/Trelis/Llama2-7b-function-calling/gguf-q4_K_M/readme)  | NLP             | GGUF      | `nexa run llama2-function-calling` |
 | [llama3](https://www.nexaai.com/meta/Llama3-8B-Instruct/gguf-q4_0/readme)                               | NLP             | GGUF/ONNX | `nexa run llama3`                  |
 | [llama3.1](https://www.nexaai.com/meta/Llama3.1-8B-Instruct/gguf-q4_0/readme)                           | NLP             | GGUF/ONNX | `nexa run llama3.1`                |
+| [llama3.2](https://nexaai.com/meta/Llama3.2-3B-Instruct/gguf-q4_0/readme)                               | NLP             | GGUF      | `nexa run llama3.2`                |
+| [llama3-uncensored](https://www.nexaai.com/Orenguteng/Llama3-8B-Lexi-Uncensored/gguf-q4_K_M/readme)     | NLP             | GGUF      | `nexa run llama3-uncensored`       |
 | [gemma](https://www.nexaai.com/google/gemma-1.1-2b-instruct/gguf-q4_0/readme)                           | NLP             | GGUF/ONNX | `nexa run gemma`                   |
 | [gemma2](https://www.nexaai.com/google/gemma-2-2b-instruct/gguf-q4_0/readme)                            | NLP             | GGUF      | `nexa run gemma2`                  |
 | [qwen1.5](https://www.nexaai.com/Qwen/Qwen1.5-7B-Instruct/gguf-q4_0/readme)                             | NLP             | GGUF      | `nexa run qwen1.5`                 |
 | [qwen2](https://www.nexaai.com/Qwen/Qwen2-1.5B-Instruct/gguf-q4_0/readme)                               | NLP             | GGUF/ONNX | `nexa run qwen2`                   |
 | [qwen2.5](https://www.nexaai.com/Qwen/Qwen2.5-1.5B-Instruct/gguf-q4_0/readme)                           | NLP             | GGUF      | `nexa run qwen2.5`                 |
 | [mathqwen](https://nexaai.com/Qwen/Qwen2.5-Math-1.5B-Instruct/gguf-q4_0/readme)                         | NLP             | GGUF      | `nexa run mathqwen`                |
+| [codeqwen](https://www.nexaai.com/Qwen/CodeQwen1.5-7B-Instruct/gguf-q4_0/readme)                        | NLP             | GGUF      | `nexa run codeqwen`                |
 | [mistral](https://www.nexaai.com/mistralai/Mistral-7B-Instruct-v0.3/gguf-q4_0/readme)                   | NLP             | GGUF/ONNX | `nexa run mistral`                 |
+| [dolphin-mistral](https://www.nexaai.com/CognitiveComputations/dolphin-2.8-mistral-7b/gguf-q4_0/readme) | NLP             | GGUF      | `nexa run dolphin-mistral`         |
 | [codegemma](https://www.nexaai.com/google/codegemma-2b/gguf-q4_0/readme)                                | NLP             | GGUF      | `nexa run codegemma`               |
 | [codellama](https://www.nexaai.com/meta/CodeLlama-7b-Instruct/gguf-q2_K/readme)                         | NLP             | GGUF      | `nexa run codellama`               |
-| [codeqwen](https://www.nexaai.com/Qwen/CodeQwen1.5-7B-Instruct/gguf-q4_0/readme)                        | NLP             | GGUF      | `nexa run codeqwen`                |
 | [deepseek-coder](https://www.nexaai.com/DeepSeek/deepseek-coder-1.3b-instruct/gguf-q4_0/readme)         | NLP             | GGUF      | `nexa run deepseek-coder`          |
-| [dolphin-mistral](https://www.nexaai.com/CognitiveComputations/dolphin-2.8-mistral-7b/gguf-q4_0/readme) | NLP             | GGUF      | `nexa run dolphin-mistral`         |
 | [phi2](https://www.nexaai.com/microsoft/Phi-2/gguf-q4_0/readme)                                         | NLP             | GGUF      | `nexa run phi2`                    |
 | [phi3](https://www.nexaai.com/microsoft/Phi-3-mini-128k-instruct/gguf-q4_0/readme)                      | NLP             | GGUF/ONNX | `nexa run phi3`                    |
-| [llama2-uncensored](https://www.nexaai.com/georgesung/Llama2-7b-chat-uncensored/gguf-q4_0/readme)       | NLP             | GGUF      | `nexa run llama2-uncensored`       |
-| [llama3-uncensored](https://www.nexaai.com/Orenguteng/Llama3-8B-Lexi-Uncensored/gguf-q4_K_M/readme)     | NLP             | GGUF      | `nexa run llama3-uncensored`       |
-| [llama2-function-calling](https://www.nexaai.com/Trelis/Llama2-7b-function-calling/gguf-q4_K_M/readme)  | NLP             | GGUF      | `nexa run llama2-function-calling` |
+| [phi3.5](https://nexaai.com/microsoft/Phi-3.5-mini-instruct/gguf-q4_0/readme)                           | NLP             | GGUF      | `nexa run phi3.5`                  |
+| [openelm](https://nexaai.com/apple/OpenELM-3B/gguf-q4_K_M/readme)                                       | NLP             | GGUF      | `nexa run openelm`                 |
 | [nanollava](https://www.nexaai.com/qnguyen3/nanoLLaVA/gguf-fp16/readme)                                 | Multimodal      | GGUF      | `nexa run nanollava`               |
 | [llava-phi3](https://www.nexaai.com/xtuner/llava-phi-3-mini/gguf-q4_0/readme)                           | Multimodal      | GGUF      | `nexa run llava-phi3`              |
 | [llava-llama3](https://www.nexaai.com/xtuner/llava-llama-3-8b-v1.1/gguf-q4_0/readme)                    | Multimodal      | GGUF      | `nexa run llava-llama3`            |
@@ -246,6 +277,9 @@ pip install -e .
 | [llava1.6-vicuna](https://www.nexaai.com/liuhaotian/llava-v1.6-vicuna-7b/gguf-q4_0/readme)              | Multimodal      | GGUF      | `nexa run llava1.6-vicuna`         |
 | [stable-diffusion-v1-4](https://www.nexaai.com/runwayml/stable-diffusion-v1-4/gguf-q4_0/readme)         | Computer Vision | GGUF      | `nexa run sd1-4`                   |
 | [stable-diffusion-v1-5](https://www.nexaai.com/runwayml/stable-diffusion-v1-5/gguf-q4_0/readme)         | Computer Vision | GGUF/ONNX | `nexa run sd1-5`                   |
+| [stable-diffusion-v2-1](https://nexaai.com/StabilityAI/stable-diffusion-v2-1/gguf-q4_0/readme)          | Computer Vision | GGUF      | `nexa run sd2-1`                   |
+| [stable-diffusion-3-medium](https://nexaai.com/StabilityAI/stable-diffusion-3-medium/gguf-q4_0/readme)  | Computer Vision | GGUF      | `nexa run sd3`                     |
+| [FLUX.1-schnell](https://nexaai.com/BlackForestLabs/FLUX.1-schnell/gguf-q4_0/readme)                    | Computer Vision | GGUF      | `nexa run flux`                    |
 | [lcm-dreamshaper](https://www.nexaai.com/SimianLuo/lcm-dreamshaper-v7/gguf-fp16/readme)                 | Computer Vision | GGUF/ONNX | `nexa run lcm-dreamshaper`         |
 | [hassaku-lcm](https://nexaai.com/stablediffusionapi/hassaku-hentai-model-v13-LCM/gguf-fp16/readme)      | Computer Vision | GGUF      | `nexa run hassaku-lcm`             |
 | [anything-lcm](https://www.nexaai.com/Linaqruf/anything-v30-LCM/gguf-fp16/readme)                       | Computer Vision | GGUF      | `nexa run anything-lcm`            |
@@ -254,6 +288,12 @@ pip install -e .
 | [faster-whisper-medium](https://www.nexaai.com/Systran/faster-whisper-medium/bin-cpu-fp16/readme)       | Audio           | BIN       | `nexa run faster-whisper-medium`   |
 | [faster-whisper-base](https://www.nexaai.com/Systran/faster-whisper-base/bin-cpu-fp16/readme)           | Audio           | BIN       | `nexa run faster-whisper-base`     |
 | [faster-whisper-large](https://www.nexaai.com/Systran/faster-whisper-large-v3/bin-cpu-fp16/readme)      | Audio           | BIN       | `nexa run faster-whisper-large`    |
+| [whisper-tiny.en](https://nexaai.com/openai/whisper-tiny.en/onnx-cpu-fp32/readme)                       | Audio           | ONNX      | `nexa run whisper-tiny.en`         |
+| [whisper-tiny](https://nexaai.com/openai/whisper-tiny/onnx-cpu-fp32/readme)                             | Audio           | ONNX      | `nexa run whisper-tiny`            |
+| [whisper-small.en](https://nexaai.com/openai/whisper-small.en/onnx-cpu-fp32/readme)                     | Audio           | ONNX      | `nexa run whisper-small.en`        |
+| [whisper-small](https://nexaai.com/openai/whisper-small/onnx-cpu-fp32/readme)                           | Audio           | ONNX      | `nexa run whisper-small`           |
+| [whisper-base.en](https://nexaai.com/openai/whisper-base.en/onnx-cpu-fp32/readme)                       | Audio           | ONNX      | `nexa run whisper-base.en`         |
+| [whisper-base](https://nexaai.com/openai/whisper-base/onnx-cpu-fp32/readme)                             | Audio           | ONNX      | `nexa run whisper-base`            |
 
 ## CLI Reference
 

{nexaai-0.0.8.5 → nexaai-0.0.8.6.1}/README.md

@@ -23,6 +23,21 @@
 
 Nexa SDK is a comprehensive toolkit for supporting **ONNX** and **GGML** models. It supports text generation, image generation, vision-language models (VLM), and text-to-speech (TTS) capabilities. Additionally, it offers an OpenAI-compatible API server with JSON schema mode for function calling and streaming support, and a user-friendly Streamlit UI. Users can run Nexa SDK in any device with Python environment, and GPU acceleration is supported.
 
+## Latest News 🔥
+* [2024/09] Nexa now has executables for easy installation: [Install Nexa SDK](https://nexaai.com/download-sdk)
+* [2024/09] Added support for Llama 3.2 models: `nexa run llama3.2`
+* [2024/09] Added support for Qwen2.5, Qwen2.5-coder and Qwen2.5-Math models: `nexa run qwen2.5`
+* [2024/09] Now supporting pulling and running GGUF models from Hugging Face: `nexa run -hf <hf model id>`
+* [2024/09] Added support for ROCm
+* [2024/09] Added support for Phi-3.5 models: `nexa run phi3.5`
+* [2024/09] Added support for OpenELM models: `nexa run openelm`
+* [2024/09] Introduced logits API support for more advanced model interactions
+* [2024/09] Added support for Flux models: `nexa run flux`
+* [2024/09] Added support for Stable Diffusion 3 model: `nexa run sd3`
+* [2024/09] Added support for Stable Diffusion 2.1 model: `nexa run sd2-1`
+
+Welcome to submit your requests through [issues](https://github.com/NexaAI/nexa-sdk/issues/new/choose), we ship weekly.
+
 ## Features
 
 - **Model Support:**
@@ -58,6 +73,18 @@ Below is our differentiation from other similar tools:
 
 ## Installation
 
+### macOS
+[Download](https://public-storage.nexa4ai.com/nexa-sdk-executable-installer/nexa-macos-installer.pkg)
+
+### Linux
+```bash
+curl -fsSL https://public-storage.nexa4ai.com/install.sh | sh 
+```
+### Windows
+Coming soon. Install with Python package below 👇
+
+## Python Package
+
 We have released pre-built wheels for various Python versions, platforms, and backends for convenient installation on our [index page](https://nexaai.github.io/nexa-sdk/whl/).
 
 > [!NOTE]
@@ -140,7 +167,7 @@ CMAKE_ARGS="-DCMAKE_CXX_FLAGS=-fopenmp" pip install nexaai
 For **Linux**:
 
 ```bash
-CMAKE_ARGS="-DGGML_HIPBLAS=on" pip install nexaai --prefer-binary --index-url https://nexaai.github.io/nexa-sdk/whl/rocm602 --extra-index-url https://pypi.org/simple --no-cache-dir
+CMAKE_ARGS="-DGGML_HIPBLAS=on" pip install nexaai --prefer-binary --index-url https://nexaai.github.io/nexa-sdk/whl/rocm621 --extra-index-url https://pypi.org/simple --no-cache-dir
 ```
 
 ### Local Build
@@ -169,27 +196,31 @@ pip install -e .
 | ------------------------------------------------------------------------------------------------------- | --------------- | --------- | ---------------------------------- |
 | [octopus-v2](https://www.nexaai.com/NexaAI/Octopus-v2/gguf-q4_0/readme)                                 | NLP             | GGUF      | `nexa run octopus-v2`              |
 | [octopus-v4](https://www.nexaai.com/NexaAI/Octopus-v4/gguf-q4_0/readme)                                 | NLP             | GGUF      | `nexa run octopus-v4`              |
+| [gpt2](https://nexaai.com/openai/gpt2/gguf-q4_0/readme)                                                 | NLP             | GGUF      | `nexa run gpt2`                    |
 | [tinyllama](https://www.nexaai.com/TinyLlama/TinyLlama-1.1B-Chat-v1.0/gguf-fp16/readme)                 | NLP             | GGUF      | `nexa run tinyllama`               |
 | [llama2](https://www.nexaai.com/meta/Llama2-7b-chat/gguf-q4_0/readme)                                   | NLP             | GGUF/ONNX | `nexa run llama2`                  |
+| [llama2-uncensored](https://www.nexaai.com/georgesung/Llama2-7b-chat-uncensored/gguf-q4_0/readme)       | NLP             | GGUF      | `nexa run llama2-uncensored`       |
+| [llama2-function-calling](https://www.nexaai.com/Trelis/Llama2-7b-function-calling/gguf-q4_K_M/readme)  | NLP             | GGUF      | `nexa run llama2-function-calling` |
 | [llama3](https://www.nexaai.com/meta/Llama3-8B-Instruct/gguf-q4_0/readme)                               | NLP             | GGUF/ONNX | `nexa run llama3`                  |
 | [llama3.1](https://www.nexaai.com/meta/Llama3.1-8B-Instruct/gguf-q4_0/readme)                           | NLP             | GGUF/ONNX | `nexa run llama3.1`                |
+| [llama3.2](https://nexaai.com/meta/Llama3.2-3B-Instruct/gguf-q4_0/readme)                               | NLP             | GGUF      | `nexa run llama3.2`                |
+| [llama3-uncensored](https://www.nexaai.com/Orenguteng/Llama3-8B-Lexi-Uncensored/gguf-q4_K_M/readme)     | NLP             | GGUF      | `nexa run llama3-uncensored`       |
 | [gemma](https://www.nexaai.com/google/gemma-1.1-2b-instruct/gguf-q4_0/readme)                           | NLP             | GGUF/ONNX | `nexa run gemma`                   |
 | [gemma2](https://www.nexaai.com/google/gemma-2-2b-instruct/gguf-q4_0/readme)                            | NLP             | GGUF      | `nexa run gemma2`                  |
 | [qwen1.5](https://www.nexaai.com/Qwen/Qwen1.5-7B-Instruct/gguf-q4_0/readme)                             | NLP             | GGUF      | `nexa run qwen1.5`                 |
 | [qwen2](https://www.nexaai.com/Qwen/Qwen2-1.5B-Instruct/gguf-q4_0/readme)                               | NLP             | GGUF/ONNX | `nexa run qwen2`                   |
 | [qwen2.5](https://www.nexaai.com/Qwen/Qwen2.5-1.5B-Instruct/gguf-q4_0/readme)                           | NLP             | GGUF      | `nexa run qwen2.5`                 |
 | [mathqwen](https://nexaai.com/Qwen/Qwen2.5-Math-1.5B-Instruct/gguf-q4_0/readme)                         | NLP             | GGUF      | `nexa run mathqwen`                |
+| [codeqwen](https://www.nexaai.com/Qwen/CodeQwen1.5-7B-Instruct/gguf-q4_0/readme)                        | NLP             | GGUF      | `nexa run codeqwen`                |
 | [mistral](https://www.nexaai.com/mistralai/Mistral-7B-Instruct-v0.3/gguf-q4_0/readme)                   | NLP             | GGUF/ONNX | `nexa run mistral`                 |
+| [dolphin-mistral](https://www.nexaai.com/CognitiveComputations/dolphin-2.8-mistral-7b/gguf-q4_0/readme) | NLP             | GGUF      | `nexa run dolphin-mistral`         |
 | [codegemma](https://www.nexaai.com/google/codegemma-2b/gguf-q4_0/readme)                                | NLP             | GGUF      | `nexa run codegemma`               |
 | [codellama](https://www.nexaai.com/meta/CodeLlama-7b-Instruct/gguf-q2_K/readme)                         | NLP             | GGUF      | `nexa run codellama`               |
-| [codeqwen](https://www.nexaai.com/Qwen/CodeQwen1.5-7B-Instruct/gguf-q4_0/readme)                        | NLP             | GGUF      | `nexa run codeqwen`                |
 | [deepseek-coder](https://www.nexaai.com/DeepSeek/deepseek-coder-1.3b-instruct/gguf-q4_0/readme)         | NLP             | GGUF      | `nexa run deepseek-coder`          |
-| [dolphin-mistral](https://www.nexaai.com/CognitiveComputations/dolphin-2.8-mistral-7b/gguf-q4_0/readme) | NLP             | GGUF      | `nexa run dolphin-mistral`         |
 | [phi2](https://www.nexaai.com/microsoft/Phi-2/gguf-q4_0/readme)                                         | NLP             | GGUF      | `nexa run phi2`                    |
 | [phi3](https://www.nexaai.com/microsoft/Phi-3-mini-128k-instruct/gguf-q4_0/readme)                      | NLP             | GGUF/ONNX | `nexa run phi3`                    |
-| [llama2-uncensored](https://www.nexaai.com/georgesung/Llama2-7b-chat-uncensored/gguf-q4_0/readme)       | NLP             | GGUF      | `nexa run llama2-uncensored`       |
-| [llama3-uncensored](https://www.nexaai.com/Orenguteng/Llama3-8B-Lexi-Uncensored/gguf-q4_K_M/readme)     | NLP             | GGUF      | `nexa run llama3-uncensored`       |
-| [llama2-function-calling](https://www.nexaai.com/Trelis/Llama2-7b-function-calling/gguf-q4_K_M/readme)  | NLP             | GGUF      | `nexa run llama2-function-calling` |
+| [phi3.5](https://nexaai.com/microsoft/Phi-3.5-mini-instruct/gguf-q4_0/readme)                           | NLP             | GGUF      | `nexa run phi3.5`                  |
+| [openelm](https://nexaai.com/apple/OpenELM-3B/gguf-q4_K_M/readme)                                       | NLP             | GGUF      | `nexa run openelm`                 |
 | [nanollava](https://www.nexaai.com/qnguyen3/nanoLLaVA/gguf-fp16/readme)                                 | Multimodal      | GGUF      | `nexa run nanollava`               |
 | [llava-phi3](https://www.nexaai.com/xtuner/llava-phi-3-mini/gguf-q4_0/readme)                           | Multimodal      | GGUF      | `nexa run llava-phi3`              |
 | [llava-llama3](https://www.nexaai.com/xtuner/llava-llama-3-8b-v1.1/gguf-q4_0/readme)                    | Multimodal      | GGUF      | `nexa run llava-llama3`            |
@@ -197,6 +228,9 @@ pip install -e .
 | [llava1.6-vicuna](https://www.nexaai.com/liuhaotian/llava-v1.6-vicuna-7b/gguf-q4_0/readme)              | Multimodal      | GGUF      | `nexa run llava1.6-vicuna`         |
 | [stable-diffusion-v1-4](https://www.nexaai.com/runwayml/stable-diffusion-v1-4/gguf-q4_0/readme)         | Computer Vision | GGUF      | `nexa run sd1-4`                   |
 | [stable-diffusion-v1-5](https://www.nexaai.com/runwayml/stable-diffusion-v1-5/gguf-q4_0/readme)         | Computer Vision | GGUF/ONNX | `nexa run sd1-5`                   |
+| [stable-diffusion-v2-1](https://nexaai.com/StabilityAI/stable-diffusion-v2-1/gguf-q4_0/readme)          | Computer Vision | GGUF      | `nexa run sd2-1`                   |
+| [stable-diffusion-3-medium](https://nexaai.com/StabilityAI/stable-diffusion-3-medium/gguf-q4_0/readme)  | Computer Vision | GGUF      | `nexa run sd3`                     |
+| [FLUX.1-schnell](https://nexaai.com/BlackForestLabs/FLUX.1-schnell/gguf-q4_0/readme)                    | Computer Vision | GGUF      | `nexa run flux`                    |
 | [lcm-dreamshaper](https://www.nexaai.com/SimianLuo/lcm-dreamshaper-v7/gguf-fp16/readme)                 | Computer Vision | GGUF/ONNX | `nexa run lcm-dreamshaper`         |
 | [hassaku-lcm](https://nexaai.com/stablediffusionapi/hassaku-hentai-model-v13-LCM/gguf-fp16/readme)      | Computer Vision | GGUF      | `nexa run hassaku-lcm`             |
 | [anything-lcm](https://www.nexaai.com/Linaqruf/anything-v30-LCM/gguf-fp16/readme)                       | Computer Vision | GGUF      | `nexa run anything-lcm`            |
@@ -205,6 +239,12 @@ pip install -e .
 | [faster-whisper-medium](https://www.nexaai.com/Systran/faster-whisper-medium/bin-cpu-fp16/readme)       | Audio           | BIN       | `nexa run faster-whisper-medium`   |
 | [faster-whisper-base](https://www.nexaai.com/Systran/faster-whisper-base/bin-cpu-fp16/readme)           | Audio           | BIN       | `nexa run faster-whisper-base`     |
 | [faster-whisper-large](https://www.nexaai.com/Systran/faster-whisper-large-v3/bin-cpu-fp16/readme)      | Audio           | BIN       | `nexa run faster-whisper-large`    |
+| [whisper-tiny.en](https://nexaai.com/openai/whisper-tiny.en/onnx-cpu-fp32/readme)                       | Audio           | ONNX      | `nexa run whisper-tiny.en`         |
+| [whisper-tiny](https://nexaai.com/openai/whisper-tiny/onnx-cpu-fp32/readme)                             | Audio           | ONNX      | `nexa run whisper-tiny`            |
+| [whisper-small.en](https://nexaai.com/openai/whisper-small.en/onnx-cpu-fp32/readme)                     | Audio           | ONNX      | `nexa run whisper-small.en`        |
+| [whisper-small](https://nexaai.com/openai/whisper-small/onnx-cpu-fp32/readme)                           | Audio           | ONNX      | `nexa run whisper-small`           |
+| [whisper-base.en](https://nexaai.com/openai/whisper-base.en/onnx-cpu-fp32/readme)                       | Audio           | ONNX      | `nexa run whisper-base.en`         |
+| [whisper-base](https://nexaai.com/openai/whisper-base/onnx-cpu-fp32/readme)                             | Audio           | ONNX      | `nexa run whisper-base`            |
 
 ## CLI Reference
 

{nexaai-0.0.8.5 → nexaai-0.0.8.6.1}/dependency/llama.cpp/common/build-info.cpp

@@ -1,4 +1,4 @@
 int LLAMA_BUILD_NUMBER = 3644;
 char const *LLAMA_COMMIT = "3a355263";
-char const *LLAMA_COMPILER = "gcc (Ubuntu 9.4.0-1ubuntu1~20.04.2) 9.4.0";
+char const *LLAMA_COMPILER = "gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0";
 char const *LLAMA_BUILD_TARGET = "x86_64-linux-gnu";

nexaai-0.0.8.6.1/examples/local_file_organization/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2024 Yanhao Qiu
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

nexaai-0.0.8.6.1/examples/local_file_organization/README.md

@@ -0,0 +1,214 @@
+# Local File Organizer: AI File Management Run Entirely on Your Device, Privacy Assured
+
+Tired of digital clutter? Overwhelmed by disorganized files scattered across your computer? Let AI do the heavy lifting! The Local File Organizer is your personal organizing assistant, using cutting-edge AI to bring order to your file chaos - all while respecting your privacy.
+
+## How It Works 💡
+
+Before:
+
+```
+/home/user/messy_documents/
+├── IMG_20230515_140322.jpg
+├── IMG_20230516_083045.jpg
+├── IMG_20230517_192130.jpg
+├── budget_2023.xlsx
+├── meeting_notes_05152023.txt
+├── project_proposal_draft.docx
+├── random_thoughts.txt
+├── recipe_chocolate_cake.pdf
+├── scan0001.pdf
+├── vacation_itinerary.docx
+└── work_presentation.pptx
+
+0 directories, 11 files
+```
+
+After:
+
+```
+/home/user/organized_documents/
+├── Financial
+│   └── 2023_Budget_Spreadsheet.xlsx
+├── Food_and_Recipes
+│   └── Chocolate_Cake_Recipe.pdf
+├── Meetings_and_Notes
+│   └── Team_Meeting_Notes_May_15_2023.txt
+├── Personal
+│   └── Random_Thoughts_and_Ideas.txt
+├── Photos
+│   ├── Cityscape_Sunset_May_17_2023.jpg
+│   ├── Morning_Coffee_Shop_May_16_2023.jpg
+│   └── Office_Team_Lunch_May_15_2023.jpg
+├── Travel
+│   └── Summer_Vacation_Itinerary_2023.docx
+└── Work
+    ├── Project_X_Proposal_Draft.docx
+    ├── Quarterly_Sales_Report.pdf
+    └── Marketing_Strategy_Presentation.pptx
+
+7 directories, 11 files
+```
+
+## Updates 🚀
+
+**[2024/09] v0.0.2**:
+* Featured by [Nexa Gallery](https://nexaai.com/gallery) and [Nexa SDK Cookbook](https://github.com/NexaAI/nexa-sdk/tree/main/examples)!
+* Dry Run Mode: check sorting results before committing changes
+* Silent Mode: save all logs to a txt file for quieter operation
+* Added file support:  `.md`, .`excel`, `.ppt`, and `.csv` 
+* Three sorting options: by content, by date, and by type
+* The default text model is now [Llama3.2 3B](https://nexaai.com/meta/Llama3.2-3B-Instruct/gguf-q3_K_M/file)
+* Improved CLI interaction experience
+* Added real-time progress bar for file analysis
+
+Please update the project by deleting the original project folder and reinstalling the requirements. Refer to the installation guide from Step 4.
+
+
+## Roadmap 📅
+
+- [ ] Copilot Mode: chat with AI to tell AI how you want to sort the file (ie. read and rename all the PDFs)
+- [ ] Change models with CLI 
+- [ ] ebook format support
+- [ ] audio file support
+- [ ] video file support
+- [ ] Implement best practices like Johnny Decimal
+- [ ] Check file duplication
+- [ ] Dockerfile for easier installation
+- [ ] People from [Nexa](https://github.com/NexaAI/nexa-sdk) is helping me to make executables for macOS, Linux and Windows
+
+## What It Does 🔍
+
+This intelligent file organizer harnesses the power of advanced AI models, including language models (LMs) and vision-language models (VLMs), to automate the process of organizing files by:
+
+
+* Scanning a specified input directory for files.
+* Content Understanding: 
+  - **Textual Analysis**: Uses the [Llama3.2 3B](https://nexaai.com/meta/Llama3.2-3B-Instruct/gguf-q3_K_M/file) to analyze and summarize text-based content, generating relevant descriptions and filenames.
+  - **Visual Content Analysis**: Uses the [LLaVA-v1.6](https://nexaai.com/liuhaotian/llava-v1.6-vicuna-7b/gguf-q4_0/file) , based on Vicuna-7B, to interpret visual files such as images, providing context-aware categorization and descriptions.
+
+* Understanding the content of your files (text, images, and more) to generate relevant descriptions, folder names, and filenames.
+* Organizing the files into a new directory structure based on the generated metadata.
+
+The best part? All AI processing happens 100% on your local device using the [Nexa SDK](https://github.com/NexaAI/nexa-sdk). No internet connection required, no data leaves your computer, and no AI API is needed - keeping your files completely private and secure.
+
+
+## Supported File Types 📁
+
+- **Images:** `.png`, `.jpg`, `.jpeg`, `.gif`, `.bmp`
+- **Text Files:** `.txt`, `.docx`, `.md`
+- **Spreadsheets:** `.xlsx`, `.csv`
+- **Presentations:** `.ppt`, `.pptx`
+- **PDFs:** `.pdf`
+
+## Prerequisites 💻
+
+- **Operating System:** Compatible with Windows, macOS, and Linux.
+- **Python Version:** Python 3.12
+- **Conda:** Anaconda or Miniconda installed.
+- **Git:** For cloning the repository (or you can download the code as a ZIP file).
+
+## Installation 🛠
+
+> For SDK installation and model-related issues, please post on [here](https://github.com/NexaAI/nexa-sdk/issues).
+
+### 1. Install Python
+
+Before installing the Local File Organizer, make sure you have Python installed on your system. We recommend using Python 3.12 or later.
+
+You can download Python from [the official website]((https://www.python.org/downloads/)).
+
+Follow the installation instructions for your operating system.
+
+### 2. Clone the Repository
+
+Clone this repository to your local machine using Git:
+
+```zsh
+git clone https://github.com/QiuYannnn/Local-File-Organizer.git
+```
+
+Or download the repository as a ZIP file and extract it to your desired location.
+
+### 3. Set Up the Python Environment
+
+Create a new Conda environment named `local_file_organizer` with Python 3.12:
+
+```zsh
+conda create --name local_file_organizer python=3.12
+```
+
+Activate the environment:
+
+```zsh
+conda activate local_file_organizer
+```
+
+### 4. Install Nexa SDK ️
+
+#### CPU Installation
+To install the CPU version of Nexa SDK, run:
+```bash
+pip install nexaai --prefer-binary --index-url https://nexaai.github.io/nexa-sdk/whl/cpu --extra-index-url https://pypi.org/simple --no-cache-dir
+```
+
+#### GPU Installation (Metal - macOS)
+For the GPU version supporting Metal (macOS), run:
+```bash
+CMAKE_ARGS="-DGGML_METAL=ON -DSD_METAL=ON" pip install nexaai --prefer-binary --index-url https://nexaai.github.io/nexa-sdk/whl/metal --extra-index-url https://pypi.org/simple --no-cache-dir
+```
+For detailed installation instructions of Nexa SDK for **CUDA** and **AMD GPU** support, please refer to the [Installation section](https://github.com/NexaAI/nexa-sdk?tab=readme-ov-file#installation) in the main README.
+
+
+### 5. Install Dependencies 
+
+1. Ensure you are in the project directory:
+   ```zsh
+   cd path/to/Local-File-Organizer
+   ```
+   Replace `path/to/Local-File-Organizer` with the actual path where you cloned or extracted the project.
+
+2. Install the required dependencies:
+   ```zsh
+   pip install -r requirements.txt
+   ```
+
+**Note:** If you encounter issues with any packages, install them individually:
+
+```zsh
+pip install nexa Pillow pytesseract PyMuPDF python-docx
+```
+
+With the environment activated and dependencies installed, run the script using:
+
+### 6. Running the Script🎉
+```zsh
+python main.py
+```
+
+## Notes
+
+- **SDK Models:**
+  - The script uses `NexaVLMInference` and `NexaTextInference` models [usage](https://docs.nexaai.com/sdk/python-interface/gguf).
+  - Ensure you have access to these models and they are correctly set up.
+  - You may need to download model files or configure paths.
+
+
+- **Dependencies:**
+  - **pytesseract:** Requires Tesseract OCR installed on your system.
+    - **macOS:** `brew install tesseract`
+    - **Ubuntu/Linux:** `sudo apt-get install tesseract-ocr`
+    - **Windows:** Download from [Tesseract OCR Windows Installer](https://github.com/UB-Mannheim/tesseract/wiki)
+  - **PyMuPDF (fitz):** Used for reading PDFs.
+
+- **Processing Time:**
+  - Processing may take time depending on the number and size of files.
+  - The script uses multiprocessing to improve performance.
+
+- **Customizing Prompts:**
+  - You can adjust prompts in `data_processing.py` to change how metadata is generated.
+
+## License
+
+This project is dual-licensed under the MIT License and Apache 2.0 License. You may choose which license you prefer to use for this project.
+
+- See the [MIT License](LICENSE-MIT) for more details.