nexaai 0.0.8.4__tar.gz → 0.0.8.5__tar.gz

{nexaai-0.0.8.4 → nexaai-0.0.8.5}/CLI.md

@@ -149,9 +149,9 @@ Image generation options:
   --lora_dir LORA_DIR   Path to directory containing LoRA files
   --wtype WTYPE         Weight type (f32, f16, q4_0, q4_1, q5_0, q5_1, q8_0)
   --control_net_path CONTROL_NET_PATH
-                        Path to control net model
+                        Path to the control net model
   --control_image_path CONTROL_IMAGE_PATH
-                        Path to image condition for Control Net
+                        Path to the image condition for Control Net
   --control_strength CONTROL_STRENGTH
                         Strength to apply Control Net
 ```

{nexaai-0.0.8.4 → nexaai-0.0.8.5}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: nexaai
-Version: 0.0.8.4
+Version: 0.0.8.5
 Summary: Nexa AI SDK
 Author-Email: Nexa AI <octopus@nexa4ai.com>
 License: MIT
@@ -25,6 +25,7 @@ Requires-Dist: fastapi
 Requires-Dist: uvicorn
 Requires-Dist: pydantic
 Requires-Dist: pillow
+Requires-Dist: huggingface_hub
 Requires-Dist: prompt_toolkit
 Requires-Dist: tqdm
 Requires-Dist: tabulate
@@ -94,23 +95,22 @@ Detailed API documentation is available [here](https://docs.nexaai.com/).
 Below is our differentiation from other similar tools:
 
 | **Feature**                | **[Nexa SDK](https://github.com/NexaAI/nexa-sdk)** | **[ollama](https://github.com/ollama/ollama)** | **[Optimum](https://github.com/huggingface/optimum)** | **[LM Studio](https://github.com/lmstudio-ai)** |
-|----------------------------|:-------------------------------------------------:|:----------------------------------------------:|:-----------------------------------------------:|:-----------------------------------------------:|
-| **GGML Support**            | ✅                                                | ✅                                               | ❌                                               | ✅                                               |
-| **ONNX Support**            | ✅                                                | ❌                                               | ✅                                               | ❌                                               |
-| **Text Generation**         | ✅                                                | ✅                                               | ✅                                               | ✅                                               |
-| **Image Generation**        | ✅                                                | ❌                                               | ❌                                               | ❌                                               |
-| **Vision-Language Models**  | ✅                                                | ✅                                               | ✅                                               | ✅                                               |
-| **Text-to-Speech**          | ✅                                                | ❌                                               | ✅                                               | ❌                                               |
-| **Server Capability**       | ✅                                                | ✅                                               | ✅                                               | ✅                                               |
-| **User Interface**          | ✅                                                | ❌                                               | ❌                                               | ✅                                               |
-
-
+| -------------------------- | :------------------------------------------------: | :--------------------------------------------: | :---------------------------------------------------: | :---------------------------------------------: |
+| **GGML Support**           |                         ✅                         |                       ✅                       |                          ❌                           |                       ✅                        |
+| **ONNX Support**           |                         ✅                         |                       ❌                       |                          ✅                           |                       ❌                        |
+| **Text Generation**        |                         ✅                         |                       ✅                       |                          ✅                           |                       ✅                        |
+| **Image Generation**       |                         ✅                         |                       ❌                       |                          ❌                           |                       ❌                        |
+| **Vision-Language Models** |                         ✅                         |                       ✅                       |                          ✅                           |                       ✅                        |
+| **Text-to-Speech**         |                         ✅                         |                       ❌                       |                          ✅                           |                       ❌                        |
+| **Server Capability**      |                         ✅                         |                       ✅                       |                          ✅                           |                       ✅                        |
+| **User Interface**         |                         ✅                         |                       ❌                       |                          ❌                           |                       ✅                        |
 
 ## Installation
 
 We have released pre-built wheels for various Python versions, platforms, and backends for convenient installation on our [index page](https://nexaai.github.io/nexa-sdk/whl/).
 
 > [!NOTE]
+>
 > 1. If you want to use <strong>ONNX model</strong>, just replace `pip install nexaai` with `pip install "nexaai[onnx]"` in provided commands.
 > 2. For Chinese developers, we recommend you to use <strong>Tsinghua Open Source Mirror</strong> as extra index url, just replace `--extra-index-url https://pypi.org/simple` with `--extra-index-url https://pypi.tuna.tsinghua.edu.cn/simple` in provided commands.
 
@@ -193,41 +193,25 @@ CMAKE_ARGS="-DGGML_HIPBLAS=on" pip install nexaai --prefer-binary --index-url ht
 ```
 
 ### Local Build
-How to clone this repo
-```bash
-git clone --recursive https://github.com/NexaAI/nexa-sdk
-```
-If you forget to use `--recursive`, you can use below command to add submodule
-```bash
-git submodule update --init --recursive
-```
-Then you can build and install the package
-```bash
-pip install -e .
-```
-
-### Docker Usage
 
-Note: Docker doesn't support GPU acceleration
+How to clone this repo
 
 ```bash
-docker pull nexa4ai/sdk:latest
+git clone --recursive https://github.com/NexaAI/nexa-sdk
 ```
 
-replace following placeholder with your path and command
+If you forget to use `--recursive`, you can use below command to add submodule
 
 ```bash
-docker run -v <your_model_dir>:/model -it nexa4ai/sdk:latest [nexa_command] [your_model_relative_path]
+git submodule update --init --recursive
 ```
 
-Example:
+Then you can build and install the package
 
 ```bash
-docker run -v /home/ubuntu/.cache/nexa/hub/official:/model -it nexa4ai/sdk:latest nexa gen-text /model/Phi-3-mini-128k-instruct/q4_0.gguf
+pip install -e .
 ```
 
-will create an interactive session with text generation
-
 ## Supported Models
 
 | Model                                                                                                   | Type            | Format    | Command                            |
@@ -242,6 +226,8 @@ will create an interactive session with text generation
 | [gemma2](https://www.nexaai.com/google/gemma-2-2b-instruct/gguf-q4_0/readme)                            | NLP             | GGUF      | `nexa run gemma2`                  |
 | [qwen1.5](https://www.nexaai.com/Qwen/Qwen1.5-7B-Instruct/gguf-q4_0/readme)                             | NLP             | GGUF      | `nexa run qwen1.5`                 |
 | [qwen2](https://www.nexaai.com/Qwen/Qwen2-1.5B-Instruct/gguf-q4_0/readme)                               | NLP             | GGUF/ONNX | `nexa run qwen2`                   |
+| [qwen2.5](https://www.nexaai.com/Qwen/Qwen2.5-1.5B-Instruct/gguf-q4_0/readme)                           | NLP             | GGUF      | `nexa run qwen2.5`                 |
+| [mathqwen](https://nexaai.com/Qwen/Qwen2.5-Math-1.5B-Instruct/gguf-q4_0/readme)                         | NLP             | GGUF      | `nexa run mathqwen`                |
 | [mistral](https://www.nexaai.com/mistralai/Mistral-7B-Instruct-v0.3/gguf-q4_0/readme)                   | NLP             | GGUF/ONNX | `nexa run mistral`                 |
 | [codegemma](https://www.nexaai.com/google/codegemma-2b/gguf-q4_0/readme)                                | NLP             | GGUF      | `nexa run codegemma`               |
 | [codellama](https://www.nexaai.com/meta/CodeLlama-7b-Instruct/gguf-q2_K/readme)                         | NLP             | GGUF      | `nexa run codellama`               |
@@ -286,15 +272,15 @@ Here's a brief overview of the main CLI commands:
 
 For detailed information on CLI commands and usage, please refer to the [CLI Reference](CLI.md) document.
 
-
 ## Start Local Server
 
-To start a local server using models on your local computer, you can use the `nexa server` command. 
+To start a local server using models on your local computer, you can use the `nexa server` command.
 For detailed information on server setup, API endpoints, and usage examples, please refer to the [Server Reference](SERVER.md) document.
 
-
 ## Acknowledgements
+
 We would like to thank the following projects:
+
 - [llama.cpp](https://github.com/ggerganov/llama.cpp)
 - [stable-diffusion.cpp](https://github.com/leejet/stable-diffusion.cpp)
 - [optimum](https://github.com/huggingface/optimum)

{nexaai-0.0.8.4 → nexaai-0.0.8.5}/README.md

@@ -46,23 +46,22 @@ Detailed API documentation is available [here](https://docs.nexaai.com/).
 Below is our differentiation from other similar tools:
 
 | **Feature**                | **[Nexa SDK](https://github.com/NexaAI/nexa-sdk)** | **[ollama](https://github.com/ollama/ollama)** | **[Optimum](https://github.com/huggingface/optimum)** | **[LM Studio](https://github.com/lmstudio-ai)** |
-|----------------------------|:-------------------------------------------------:|:----------------------------------------------:|:-----------------------------------------------:|:-----------------------------------------------:|
-| **GGML Support**            | ✅                                                | ✅                                               | ❌                                               | ✅                                               |
-| **ONNX Support**            | ✅                                                | ❌                                               | ✅                                               | ❌                                               |
-| **Text Generation**         | ✅                                                | ✅                                               | ✅                                               | ✅                                               |
-| **Image Generation**        | ✅                                                | ❌                                               | ❌                                               | ❌                                               |
-| **Vision-Language Models**  | ✅                                                | ✅                                               | ✅                                               | ✅                                               |
-| **Text-to-Speech**          | ✅                                                | ❌                                               | ✅                                               | ❌                                               |
-| **Server Capability**       | ✅                                                | ✅                                               | ✅                                               | ✅                                               |
-| **User Interface**          | ✅                                                | ❌                                               | ❌                                               | ✅                                               |
-
-
+| -------------------------- | :------------------------------------------------: | :--------------------------------------------: | :---------------------------------------------------: | :---------------------------------------------: |
+| **GGML Support**           |                         ✅                         |                       ✅                       |                          ❌                           |                       ✅                        |
+| **ONNX Support**           |                         ✅                         |                       ❌                       |                          ✅                           |                       ❌                        |
+| **Text Generation**        |                         ✅                         |                       ✅                       |                          ✅                           |                       ✅                        |
+| **Image Generation**       |                         ✅                         |                       ❌                       |                          ❌                           |                       ❌                        |
+| **Vision-Language Models** |                         ✅                         |                       ✅                       |                          ✅                           |                       ✅                        |
+| **Text-to-Speech**         |                         ✅                         |                       ❌                       |                          ✅                           |                       ❌                        |
+| **Server Capability**      |                         ✅                         |                       ✅                       |                          ✅                           |                       ✅                        |
+| **User Interface**         |                         ✅                         |                       ❌                       |                          ❌                           |                       ✅                        |
 
 ## Installation
 
 We have released pre-built wheels for various Python versions, platforms, and backends for convenient installation on our [index page](https://nexaai.github.io/nexa-sdk/whl/).
 
 > [!NOTE]
+>
 > 1. If you want to use <strong>ONNX model</strong>, just replace `pip install nexaai` with `pip install "nexaai[onnx]"` in provided commands.
 > 2. For Chinese developers, we recommend you to use <strong>Tsinghua Open Source Mirror</strong> as extra index url, just replace `--extra-index-url https://pypi.org/simple` with `--extra-index-url https://pypi.tuna.tsinghua.edu.cn/simple` in provided commands.
 
@@ -145,41 +144,25 @@ CMAKE_ARGS="-DGGML_HIPBLAS=on" pip install nexaai --prefer-binary --index-url ht
 ```
 
 ### Local Build
-How to clone this repo
-```bash
-git clone --recursive https://github.com/NexaAI/nexa-sdk
-```
-If you forget to use `--recursive`, you can use below command to add submodule
-```bash
-git submodule update --init --recursive
-```
-Then you can build and install the package
-```bash
-pip install -e .
-```
-
-### Docker Usage
 
-Note: Docker doesn't support GPU acceleration
+How to clone this repo
 
 ```bash
-docker pull nexa4ai/sdk:latest
+git clone --recursive https://github.com/NexaAI/nexa-sdk
 ```
 
-replace following placeholder with your path and command
+If you forget to use `--recursive`, you can use below command to add submodule
 
 ```bash
-docker run -v <your_model_dir>:/model -it nexa4ai/sdk:latest [nexa_command] [your_model_relative_path]
+git submodule update --init --recursive
 ```
 
-Example:
+Then you can build and install the package
 
 ```bash
-docker run -v /home/ubuntu/.cache/nexa/hub/official:/model -it nexa4ai/sdk:latest nexa gen-text /model/Phi-3-mini-128k-instruct/q4_0.gguf
+pip install -e .
 ```
 
-will create an interactive session with text generation
-
 ## Supported Models
 
 | Model                                                                                                   | Type            | Format    | Command                            |
@@ -194,6 +177,8 @@ will create an interactive session with text generation
 | [gemma2](https://www.nexaai.com/google/gemma-2-2b-instruct/gguf-q4_0/readme)                            | NLP             | GGUF      | `nexa run gemma2`                  |
 | [qwen1.5](https://www.nexaai.com/Qwen/Qwen1.5-7B-Instruct/gguf-q4_0/readme)                             | NLP             | GGUF      | `nexa run qwen1.5`                 |
 | [qwen2](https://www.nexaai.com/Qwen/Qwen2-1.5B-Instruct/gguf-q4_0/readme)                               | NLP             | GGUF/ONNX | `nexa run qwen2`                   |
+| [qwen2.5](https://www.nexaai.com/Qwen/Qwen2.5-1.5B-Instruct/gguf-q4_0/readme)                           | NLP             | GGUF      | `nexa run qwen2.5`                 |
+| [mathqwen](https://nexaai.com/Qwen/Qwen2.5-Math-1.5B-Instruct/gguf-q4_0/readme)                         | NLP             | GGUF      | `nexa run mathqwen`                |
 | [mistral](https://www.nexaai.com/mistralai/Mistral-7B-Instruct-v0.3/gguf-q4_0/readme)                   | NLP             | GGUF/ONNX | `nexa run mistral`                 |
 | [codegemma](https://www.nexaai.com/google/codegemma-2b/gguf-q4_0/readme)                                | NLP             | GGUF      | `nexa run codegemma`               |
 | [codellama](https://www.nexaai.com/meta/CodeLlama-7b-Instruct/gguf-q2_K/readme)                         | NLP             | GGUF      | `nexa run codellama`               |
@@ -238,15 +223,15 @@ Here's a brief overview of the main CLI commands:
 
 For detailed information on CLI commands and usage, please refer to the [CLI Reference](CLI.md) document.
 
-
 ## Start Local Server
 
-To start a local server using models on your local computer, you can use the `nexa server` command. 
+To start a local server using models on your local computer, you can use the `nexa server` command.
 For detailed information on server setup, API endpoints, and usage examples, please refer to the [Server Reference](SERVER.md) document.
 
-
 ## Acknowledgements
+
 We would like to thank the following projects:
+
 - [llama.cpp](https://github.com/ggerganov/llama.cpp)
 - [stable-diffusion.cpp](https://github.com/leejet/stable-diffusion.cpp)
 - [optimum](https://github.com/huggingface/optimum)

nexaai-0.0.8.5/dependency/llama.cpp/common/build-info.cpp

@@ -0,0 +1,4 @@
+int LLAMA_BUILD_NUMBER = 3644;
+char const *LLAMA_COMMIT = "3a355263";
+char const *LLAMA_COMPILER = "gcc (Ubuntu 9.4.0-1ubuntu1~20.04.2) 9.4.0";
+char const *LLAMA_BUILD_TARGET = "x86_64-linux-gnu";

nexaai-0.0.8.5/examples/disaster_assistant/Readme.md

@@ -0,0 +1,53 @@
+
+<h2>🌟 Overview</h2>
+
+<p><b>SafeGuardianAI</b> is an innovative emergency response platform that harnesses the power of artificial intelligence to provide critical support during catastrophic events. 
+By seamlessly integrating real-time data analysis, offline capabilities, and community-driven support, SafeGuardianAI bridges the gap between individuals, communities, and emergency services, ensuring a more coordinated and effective response to disasters.</p>
+
+<h3>NexaAI-SDK</h3>
+<li><b> Conversational Bot: </b> Llama3-8B-Lexi-Uncensored</li>
+<li><b> Data-Parsing Bot : </b> llama-3.1-8b-instant</li>
+<li><b> Automatic Speech recognition</b> : Faster-Whisper-Tiny</li>
+<li><b> Text-To-Speech</b> : OpenAI </li>
+
+
+
+<h2>🛠️ Key Features</h2><ul>
+  
+  <li>💬 <strong>AI-Powered Chat Interface</strong>: Interact with GuardianAI for personalized emergency assistance and real-time guidance.</li>
+  <li>🎙️ <strong>Multi-Modal Activation</strong>: Trigger emergency mode via text, voice commands, or automatic motion detection for hands-free operation.</li>
+  <li>👤 <strong>Smart User Profiles</strong>: Store vital information securely for quick access during emergencies, including medical history and emergency contacts.</li>
+  <li>📱 <strong>Offline Functionality</strong>: Access critical guides and emergency procedures without an internet connection, ensuring help is always available.</li>
+  <li>🧠 <strong>Real-time Situation Assessment</strong>: Receive tailored responses and advice based on AI analysis of current conditions and user input.</li>
+
+
+<h2>🚀 Quick Start</h2>
+
+<h3>
+
+[Live Demo]([https://safeguardian-llm.streamlit.app/](https://github.com/Ashoka74/SafeGuardian-LLM.git))
+  
+</h3>
+
+  <li>Install dependencies:
+    <pre><code>pip install -r requirements.txt</code></pre>
+  </li>
+  <li>Set up environment variables:
+    Create a <code>.env</code> file in the project root with the following content:
+    <pre><code>
+     OPENAI_API = 'XXX'
+     GROQ_API = 'XXX'
+     HELICONE_API = 'XXX'
+</code></pre>
+  </li>
+  
+ 
+  <li>- Generate a .json access-key from FireBase</li>
+
+   ![generate_key_firebase](https://github.com/user-attachments/assets/528aa756-6215-4ccc-b4e0-f716dd152f68)
+  
+  <li>- rename the file disasterrescueai-firebase-adminsdk.json</li>
+  <li>Run the application:
+    <pre><code>streamlit run app.py</code></pre>
+  </li>
+</ol>

nexaai-0.0.8.5/examples/disaster_assistant/app.py

@@ -0,0 +1,207 @@
+import streamlit as st
+import base64
+from utils.transcribe import record_and_transcribe
+from utils.gen_response import generate_chat_response, generate_and_play_response
+import datetime
+from utils.state_manager import StateManager
+from utils.initialize import initialize_chat, load_model, display_victim_info
+from utils.validate_json import process_and_upload_victim_info, update_victim_json
+from utils.json_cleaner import upload_victim_info, process_json_response
+import logging
+import json
+
+# Function to process JSON response
+def process_json_response(response: str) -> None:
+    try:
+        process_and_upload_victim_info(update_victim_json(response), schema=st.session_state['json_template'])
+    except Exception as e:
+        logger.error(f"Error processing JSON response: {e}")
+        st.warning("Error processing the response.")
+
+logger = logging.getLogger(__name__)
+
+
+state_manager = StateManager()
+
+
+ai_avatar = "utils/avatar.jpg"
+#default_model = "gemma-1.1-2b-instruct:q4_0"
+#default_model = "Octopus-v2:fp16"
+default_model = "llama3-uncensored"
+def main():
+
+ # create 3 columns
+    left, middle, right = st.columns([.5, .1, .4])
+    # Chat input and display
+    with left:
+        st.title("Natural Disaster Rescue Assistant")
+    
+        st.caption("NexaAI x SafeGuardianAI")
+
+        st.sidebar.header("Model Configuration")
+        model_path = st.sidebar.text_input("Model path", default_model)
+
+        if not model_path:
+            st.warning(
+                "Please enter a valid path or identifier for the model in Nexa Model Hub to proceed."
+            )
+            st.stop()
+
+        if (
+            "current_model_path" not in st.session_state
+            or st.session_state.current_model_path != model_path
+        ):
+            st.session_state.current_model_path = model_path
+            st.session_state.nexa_model = load_model(model_path)
+            if st.session_state.nexa_model is None:
+                st.stop()
+
+        st.sidebar.header("Generation Parameters")
+        temperature = st.sidebar.slider(
+            "Temperature", 0.0, 1.0, st.session_state.nexa_model.params["temperature"]
+        )
+        max_new_tokens = st.sidebar.slider(
+            "Max New Tokens", 1, 1000, st.session_state.nexa_model.params["max_new_tokens"]
+        )
+        top_k = st.sidebar.slider("Top K", 1, 100, st.session_state.nexa_model.params["top_k"])
+        top_p = st.sidebar.slider(
+            "Top P", 0.0, 1.0, st.session_state.nexa_model.params["top_p"]
+        )
+
+        st.session_state.nexa_model.params.update(
+            {
+                "temperature": temperature,
+                "max_new_tokens": max_new_tokens,
+                "top_k": top_k,
+                "top_p": top_p,
+                "stop": ["<end_of_turn>"]
+            }
+        )
+
+        initialize_chat()
+        for message in st.session_state.messages:
+            if message["role"] != "system":
+                if message["role"] == "user":
+                    with st.chat_message(message["role"]):
+                        st.markdown(message["content"])
+                else:
+                    with st.chat_message(message["role"], avatar=ai_avatar):
+                        st.markdown(message["content"])
+
+        if st.button("🎙️ Start Voice Chat"):
+            transcribed_text = record_and_transcribe()
+            if transcribed_text:
+                # First AI run for JSON extraction
+                json_prompt = transcribed_text + 'You are a disaster assistant. Your task is to return a JSON of the provided information. Only return JSON based on provided elements, don\'t return unknown key-value pairs. Return only the JSON, no additional comments or text:'
+                st.session_state.messages.append({"role": "user", "content": json_prompt})
+                
+                json_response = ""
+                history = []
+                for chunk in generate_chat_response(st.session_state.nexa_model):
+                    choice = chunk["choices"][0]
+                    content = choice.get("delta", {}).get("content") or choice.get("text", "")
+                    json_response += content
+                    # Check if the end token is in the content
+
+                st.session_state['json_response'] = json_response
+
+                st.session_state.messages.append({"role": "assistant", "content": json_response})
+
+                # Process the JSON response
+                try:
+                    process_json_response(json_response)
+                    # history.append(json_response)
+                except Exception as e:
+                    st.warning(f"Error processing JSON: {e}")
+
+                history.append(json_response)
+                history_str = json.dumps(history)
+
+                # Second AI run for the actual response
+                response_prompt = f"Given the history {history_str} and the most recent response: {json_response}\n\nAssist the user's with the adequate response as a disaster rescue assistant: {transcribed_text}"
+                st.session_state.messages.append({"role": "user", "content": response_prompt})
+
+                with st.chat_message("user"):
+                    st.markdown(transcribed_text)
+
+                with st.chat_message("assistant", avatar=ai_avatar):
+                    response_placeholder = st.empty()
+                    full_response = ""
+                    for chunk in generate_chat_response(st.session_state.nexa_model):
+                        choice = chunk["choices"][0]
+                        content = choice.get("delta", {}).get("content") or choice.get("text", "")
+                        full_response += content
+                        response_placeholder.markdown(full_response, unsafe_allow_html=True)
+                    response_placeholder.markdown(full_response)
+
+                st.session_state.messages.append({"role": "assistant", "content": full_response})
+
+                # Generate and play audio response
+                audio_path = generate_and_play_response(full_response)
+                
+                with open(audio_path, "rb") as audio_file:
+                    audio_bytes = audio_file.read()
+                    audio_base64 = base64.b64encode(audio_bytes).decode("utf-8")
+                st.markdown(f"""
+                    <audio autoplay>
+                        <source src="data:audio/mp3;base64,{audio_base64}" type="audio/mp3">
+                    </audio>
+                """, unsafe_allow_html=True)
+
+                st.session_state.messages.append({"role": "assistant", "content": full_response})
+
+        if prompt := st.chat_input("Say something..."):
+            st.session_state.messages.append({"role": "user", "content": prompt})
+            with st.chat_message("user"):
+                st.markdown(prompt)
+
+            with st.chat_message("assistant", avatar=ai_avatar):
+                response_placeholder = st.empty()
+                full_response = ""
+                for chunk in generate_chat_response(st.session_state.nexa_model):
+                    choice = chunk["choices"][0]
+                    if "delta" in choice:
+                        delta = choice["delta"]
+                        content = delta.get("content", "")
+                    elif "text" in choice:
+                        delta = choice["text"]
+                        content = delta
+
+                    full_response += content
+                    response_placeholder.markdown(full_response, unsafe_allow_html=True)
+                response_placeholder.markdown(full_response)
+
+            try:
+                audio_path = generate_and_play_response(full_response)
+            except Exception as e:
+                st.warning(f"Error generating audio: {e}")
+            with open(audio_path, "rb") as audio_file:
+                audio_bytes = audio_file.read()
+                audio_base64 = base64.b64encode(audio_bytes).decode("utf-8")
+            st.markdown(f"""
+                <audio autoplay>
+                    <source src="data:audio/mp3;base64,{audio_base64}" type="audio/mp3">
+                </audio>
+            """, unsafe_allow_html=True)
+            st.session_state.messages.append({"role": "assistant", "content": full_response})
+
+            try:
+                process_json_response(full_response)
+            except Exception as e:
+                st.warning(f"Error processing JSON: {e}")
+
+    with right:
+        # with st.container(height=300):
+        #     st.subheader("Parsed JSON")
+        #     st.markdown(st.session_state['json_response'])
+
+        with st.container(height=800):
+            st.subheader("Full JSON")
+            display_victim_info()
+
+          
+
+
+
+if __name__ == "__main__":
+    main()