PraisonAI 0.0.72__tar.gz → 0.0.74__tar.gz

{praisonai-0.0.72 → praisonai-0.0.74}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: PraisonAI
-Version: 0.0.72
+Version: 0.0.74
 Summary: PraisonAI application combines AutoGen and CrewAI or similar frameworks into a low-code solution for building and managing multi-agent LLM systems, focusing on simplicity, customization, and efficient human-agent collaboration.
 Author: Mervin Praison
 Requires-Python: >=3.10,<3.13
@@ -17,27 +17,30 @@ Provides-Extra: cohere
 Provides-Extra: google
 Provides-Extra: gradio
 Provides-Extra: openai
+Provides-Extra: realtime
 Provides-Extra: train
 Provides-Extra: ui
 Requires-Dist: agentops (>=0.3.12) ; extra == "agentops"
-Requires-Dist: aiosqlite (>=0.20.0) ; extra == "chat" or extra == "code"
-Requires-Dist: chainlit (==1.2.0) ; extra == "ui" or extra == "chat" or extra == "code"
-Requires-Dist: crawl4ai (==0.3.4) ; extra == "chat" or extra == "code"
+Requires-Dist: aiosqlite (>=0.20.0) ; extra == "chat" or extra == "code" or extra == "realtime"
+Requires-Dist: chainlit (==1.3.0rc1) ; extra == "ui" or extra == "chat" or extra == "code" or extra == "realtime"
+Requires-Dist: crawl4ai (==0.3.4) ; extra == "chat" or extra == "code" or extra == "realtime"
 Requires-Dist: crewai (>=0.32.0)
 Requires-Dist: flask (>=3.0.0) ; extra == "api"
 Requires-Dist: gradio (>=4.26.0) ; extra == "gradio"
-Requires-Dist: greenlet (>=3.0.3) ; extra == "chat" or extra == "code"
+Requires-Dist: greenlet (>=3.0.3) ; extra == "chat" or extra == "code" or extra == "realtime"
 Requires-Dist: langchain-anthropic (>=0.1.13) ; extra == "anthropic"
 Requires-Dist: langchain-cohere (>=0.1.4) ; extra == "cohere"
 Requires-Dist: langchain-google-genai (>=1.0.4) ; extra == "google"
 Requires-Dist: langchain-openai (>=0.1.7) ; extra == "openai"
-Requires-Dist: litellm (>=1.41.8) ; extra == "chat" or extra == "code"
+Requires-Dist: litellm (>=1.41.8) ; extra == "chat" or extra == "code" or extra == "realtime"
 Requires-Dist: markdown (>=3.5)
+Requires-Dist: plotly (>=5.24.0) ; extra == "realtime"
 Requires-Dist: praisonai-tools (>=0.0.7)
 Requires-Dist: pyautogen (>=0.2.19)
 Requires-Dist: pyparsing (>=3.0.0)
 Requires-Dist: rich (>=13.7)
-Requires-Dist: tavily-python (==0.5.0) ; extra == "chat" or extra == "code"
+Requires-Dist: tavily-python (==0.5.0) ; extra == "chat" or extra == "code" or extra == "realtime"
+Requires-Dist: websockets (>=12.0) ; extra == "realtime"
 Project-URL: Homepage, https://docs.praison.ai
 Project-URL: Repository, https://github.com/mervinpraison/PraisonAI
 Description-Content-Type: text/markdown
@@ -79,6 +82,7 @@ Praison AI, leveraging both AutoGen and CrewAI or any other agent framework, rep
 | **UI** | Multi Agents such as CrewAI or AutoGen | [https://docs.praison.ai/ui/ui](https://docs.praison.ai/ui/ui) |
 | **Chat** | Chat with 100+ LLMs, single AI Agent | [https://docs.praison.ai/ui/chat](https://docs.praison.ai/ui/chat) |
 | **Code** | Chat with entire Codebase, single AI Agent | [https://docs.praison.ai/ui/code](https://docs.praison.ai/ui/code) |
+| **Realtime** | Real-time voice interaction with AI | [https://docs.praison.ai/ui/realtime](https://docs.praison.ai/ui/realtime) |
 
 | Other Features | Description | Docs |
 |---|---|---|
@@ -100,6 +104,7 @@ Praison AI, leveraging both AutoGen and CrewAI or any other agent framework, rep
 | **PraisonAI Code** | `pip install "praisonai[code]"` |
 | **PraisonAI Chat** | `pip install "praisonai[chat]"` |
 | **PraisonAI Train** | `pip install "praisonai[train]"` |
+| **PraisonAI Realtime** | `pip install "praisonai[realtime]"` |
 
 ## Key Features
 
@@ -110,6 +115,9 @@ Praison AI, leveraging both AutoGen and CrewAI or any other agent framework, rep
 - Interactive UIs
 - YAML-based Configuration
 - Custom Tool Integration
+- Internet Search Capability (using Crawl4AI and Tavily)
+- Vision Language Model (VLM) Support
+- Real-time Voice Interaction
 
 ## TL;DR Multi Agents
 
@@ -222,6 +230,14 @@ export OPENAI_API_KEY="Enter your API key"
 praisonai chat
 ```
 
+### Internet Search
+
+Praison AI Chat and Praison AI Code now includes internet search capabilities using Crawl4AI and Tavily, allowing you to retrieve up-to-date information during your conversations.
+
+### Vision Language Model Support
+
+You can now upload images and ask questions based on them using Vision Language Models. This feature enables visual understanding and analysis within your chat sessions.
+
 ## Praison AI Code
 
 ```bash
@@ -230,6 +246,10 @@ export OPENAI_API_KEY="Enter your API key"
 praisonai code
 ```
 
+### Internet Search
+
+Praison AI Code also includes internet search functionality, enabling you to find relevant code snippets and programming information online.
+
 ## Create Custom Tools
 
 - https://docs.praison.ai/tools/custom/

{praisonai-0.0.72 → praisonai-0.0.74}/README.md

@@ -35,6 +35,7 @@ Praison AI, leveraging both AutoGen and CrewAI or any other agent framework, rep
 | **UI** | Multi Agents such as CrewAI or AutoGen | [https://docs.praison.ai/ui/ui](https://docs.praison.ai/ui/ui) |
 | **Chat** | Chat with 100+ LLMs, single AI Agent | [https://docs.praison.ai/ui/chat](https://docs.praison.ai/ui/chat) |
 | **Code** | Chat with entire Codebase, single AI Agent | [https://docs.praison.ai/ui/code](https://docs.praison.ai/ui/code) |
+| **Realtime** | Real-time voice interaction with AI | [https://docs.praison.ai/ui/realtime](https://docs.praison.ai/ui/realtime) |
 
 | Other Features | Description | Docs |
 |---|---|---|
@@ -56,6 +57,7 @@ Praison AI, leveraging both AutoGen and CrewAI or any other agent framework, rep
 | **PraisonAI Code** | `pip install "praisonai[code]"` |
 | **PraisonAI Chat** | `pip install "praisonai[chat]"` |
 | **PraisonAI Train** | `pip install "praisonai[train]"` |
+| **PraisonAI Realtime** | `pip install "praisonai[realtime]"` |
 
 ## Key Features
 
@@ -66,6 +68,9 @@ Praison AI, leveraging both AutoGen and CrewAI or any other agent framework, rep
 - Interactive UIs
 - YAML-based Configuration
 - Custom Tool Integration
+- Internet Search Capability (using Crawl4AI and Tavily)
+- Vision Language Model (VLM) Support
+- Real-time Voice Interaction
 
 ## TL;DR Multi Agents
 
@@ -178,6 +183,14 @@ export OPENAI_API_KEY="Enter your API key"
 praisonai chat
 ```
 
+### Internet Search
+
+Praison AI Chat and Praison AI Code now includes internet search capabilities using Crawl4AI and Tavily, allowing you to retrieve up-to-date information during your conversations.
+
+### Vision Language Model Support
+
+You can now upload images and ask questions based on them using Vision Language Models. This feature enables visual understanding and analysis within your chat sessions.
+
 ## Praison AI Code
 
 ```bash
@@ -186,6 +199,10 @@ export OPENAI_API_KEY="Enter your API key"
 praisonai code
 ```
 
+### Internet Search
+
+Praison AI Code also includes internet search functionality, enabling you to find relevant code snippets and programming information online.
+
 ## Create Custom Tools
 
 - https://docs.praison.ai/tools/custom/

{praisonai-0.0.72 → praisonai-0.0.74}/praisonai/cli.py

@@ -130,6 +130,10 @@ class PraisonAI:
             self.create_code_interface()
             return
         
+        if getattr(args, 'realtime', False):
+            self.create_realtime_interface()
+            return
+        
         if args.agent_file == 'train':
             package_root = os.path.dirname(os.path.abspath(__file__))
             config_yaml_destination = os.path.join(os.getcwd(), 'config.yaml')
@@ -256,6 +260,7 @@ class PraisonAI:
         parser.add_argument("--hf", type=str, help="Hugging Face model name")
         parser.add_argument("--ollama", type=str, help="Ollama model name")
         parser.add_argument("--dataset", type=str, help="Dataset name for training", default="yahma/alpaca-cleaned")
+        parser.add_argument("--realtime", action="store_true", help="Start the realtime voice interaction interface")
         args, unknown_args = parser.parse_known_args()
 
         if unknown_args and unknown_args[0] == '-b' and unknown_args[1] == 'api:app':
@@ -270,6 +275,8 @@ class PraisonAI:
         if args.agent_file == 'code':
             args.ui = 'chainlit'
             args.code = True
+        if args.agent_file == 'realtime':
+            args.realtime = True
 
         return args
     
@@ -416,6 +423,29 @@ class PraisonAI:
         else:
             print("ERROR: Chainlit is not installed. Please install it with 'pip install \"praisonai\[ui]\"' to use the UI.")        
 
+    def create_realtime_interface(self):
+        """
+        Create a Chainlit interface for the realtime voice interaction application.
+        """
+        if CHAINLIT_AVAILABLE:
+            import praisonai
+            os.environ["CHAINLIT_PORT"] = "8088"  # Ensure this port is not in use by another service
+            root_path = os.path.join(os.path.expanduser("~"), ".praison")
+            os.environ["CHAINLIT_APP_ROOT"] = root_path
+            public_folder = os.path.join(os.path.dirname(praisonai.__file__), 'public')
+            if not os.path.exists(os.path.join(root_path, "public")):
+                if os.path.exists(public_folder):
+                    shutil.copytree(public_folder, os.path.join(root_path, "public"), dirs_exist_ok=True)
+                    logging.info("Public folder copied successfully!")
+                else:
+                    logging.info("Public folder not found in the package.")
+            else:
+                logging.info("Public folder already exists.")
+            realtime_ui_path = os.path.join(os.path.dirname(praisonai.__file__), 'ui', 'realtime.py')
+            chainlit_run([realtime_ui_path])
+        else:
+            print("ERROR: Realtime UI is not installed. Please install it with 'pip install \"praisonai[realtime]\"' to use the realtime UI.")
+
 if __name__ == "__main__":
     praison_ai = PraisonAI()
     praison_ai.main()

{praisonai-0.0.72 → praisonai-0.0.74}/praisonai/deploy.py

@@ -56,7 +56,7 @@ class CloudDeployer:
             file.write("FROM python:3.11-slim\n")
             file.write("WORKDIR /app\n")
             file.write("COPY . .\n")
-            file.write("RUN pip install flask praisonai==0.0.72 gunicorn markdown\n")
+            file.write("RUN pip install flask praisonai==0.0.74 gunicorn markdown\n")
             file.write("EXPOSE 8080\n")
             file.write('CMD ["gunicorn", "-b", "0.0.0.0:8080", "api:app"]\n')
             

{praisonai-0.0.72 → praisonai-0.0.74}/praisonai/ui/chat.py

@@ -17,6 +17,9 @@ from sql_alchemy import SQLAlchemyDataLayer
 from tavily import TavilyClient
 from crawl4ai import WebCrawler
 import asyncio
+from PIL import Image
+import io
+import base64
 
 # Set up logging
 logger = logging.getLogger(__name__)
@@ -292,11 +295,32 @@ async def main(message: cl.Message):
     message_history = cl.user_session.get("message_history", [])
     now = datetime.now().strftime("%Y-%m-%d %H:%M:%S")
     
-    # Add the current date and time to the user's message
+    # Check if an image was uploaded with this message
+    image = None
+    if message.elements and isinstance(message.elements[0], cl.Image):
+        image_element = message.elements[0]
+        try:
+            # Open the image and keep it in memory
+            image = Image.open(image_element.path)
+            image.load()  # This ensures the file is fully loaded into memory
+            cl.user_session.set("image", image)
+        except Exception as e:
+            logger.error(f"Error processing image: {str(e)}")
+            await cl.Message(content="There was an error processing the uploaded image. Please try again.").send()
+            return
+
+    # Prepare user message
     user_message = f"""
-Answer the question and use tools if needed:\n{message.content}.\n\n
+Answer the question and use tools if needed:\n
+
 Current Date and Time: {now}
+
+User Question: {message.content}
 """
+
+    if image:
+        user_message = f"Image uploaded. {user_message}"
+
     message_history.append({"role": "user", "content": user_message})
 
     msg = cl.Message(content="")
@@ -309,6 +333,19 @@ Current Date and Time: {now}
         "stream": True,
     }
 
+    # If an image is uploaded, include it in the message
+    if image:
+        buffered = io.BytesIO()
+        image.save(buffered, format="PNG")
+        img_str = base64.b64encode(buffered.getvalue()).decode()
+        
+        completion_params["messages"][-1] = {
+            "role": "user",
+            "content": [
+                {"type": "text", "text": user_message},
+                {"type": "image_url", "image_url": {"url": f"data:image/png;base64,{img_str}"}}
+            ]
+        }
     # Only add tools and tool_choice if Tavily API key is available
     if tavily_api_key:
         completion_params["tools"] = tools
@@ -359,6 +396,7 @@ Current Date and Time: {now}
     cl.user_session.set("message_history", message_history)
     await msg.update()
 
+    # Handle tool calls if any
     if tavily_api_key and tool_calls:
         available_functions = {
             "tavily_web_search": tavily_web_search,
@@ -411,7 +449,7 @@ Current Date and Time: {now}
         msg.content = full_response
         await msg.update()
     else:
-        # If no tool calls or Tavily API key is not set, the full_response is already set
+        # If no tool calls, the full_response is already set
         msg.content = full_response
         await msg.update()
 
@@ -433,7 +471,7 @@ async def send_count():
     ).send()
 
 @cl.on_chat_resume
-async def on_chat_resume(thread: ThreadDict):  # Change the type hint here
+async def on_chat_resume(thread: ThreadDict):
     logger.info(f"Resuming chat: {thread['id']}")
     model_name = load_setting("model_name") or os.getenv("MODEL_NAME") or "gpt-4o-mini"
     logger.debug(f"Model name: {model_name}")
@@ -481,3 +519,10 @@ async def on_chat_resume(thread: ThreadDict):  # Change the type hint here
             logger.warning(f"Message without recognized type: {message}")
 
     cl.user_session.set("message_history", message_history)
+
+    # Check if there's an image in the thread metadata
+    image_data = metadata.get("image")
+    if image_data:
+        image = Image.open(io.BytesIO(base64.b64decode(image_data)))
+        cl.user_session.set("image", image)
+        await cl.Message(content="Previous image loaded. You can continue asking questions about it or upload a new image.").send()

{praisonai-0.0.72 → praisonai-0.0.74}/praisonai/ui/code.py

@@ -18,6 +18,9 @@ from context import ContextGatherer
 from tavily import TavilyClient
 from datetime import datetime
 from crawl4ai import WebCrawler
+from PIL import Image
+import io
+import base64
 
 # Set up logging
 logger = logging.getLogger(__name__)
@@ -303,16 +306,37 @@ tools = [{
 async def main(message: cl.Message):
     model_name = load_setting("model_name") or os.getenv("MODEL_NAME") or "gpt-4o-mini"
     message_history = cl.user_session.get("message_history", [])
-    message_history.append({"role": "user", "content": message.content})
     gatherer = ContextGatherer()
     context, token_count, context_tree = gatherer.run()
     now = datetime.now().strftime("%Y-%m-%d %H:%M:%S")
-    prompt_history = message_history
-    prompt_history.append({"role": "user", "content": """
-                           Answer the question and use tools if needed:\n{question}.\n\n
-                           Current Date and Time: {now}
-                           Below is the Context:\n{context}\n\n"""
-                           .format(context=context, question=message.content, now=now)})
+
+    # Check if an image was uploaded with this message
+    image = None
+    if message.elements and isinstance(message.elements[0], cl.Image):
+        image_element = message.elements[0]
+        try:
+            # Open the image and keep it in memory
+            image = Image.open(image_element.path)
+            image.load()  # This ensures the file is fully loaded into memory
+            cl.user_session.set("image", image)
+        except Exception as e:
+            logger.error(f"Error processing image: {str(e)}")
+            await cl.Message(content="There was an error processing the uploaded image. Please try again.").send()
+            return
+
+    # Prepare user message
+    user_message = f"""
+Answer the question and use tools if needed:\n{message.content}.\n\n
+Current Date and Time: {now}
+
+Context:
+{context}
+"""
+
+    if image:
+        user_message = f"Image uploaded. {user_message}"
+
+    message_history.append({"role": "user", "content": user_message})
 
     msg = cl.Message(content="")
     await msg.send()
@@ -320,11 +344,27 @@ async def main(message: cl.Message):
     # Prepare the completion parameters
     completion_params = {
         "model": model_name,
-        "messages": prompt_history,
+        "messages": message_history,
         "stream": True,
     }
 
-    # Only add tools and tool_choice if Tavily API key is available
+    # If an image is uploaded, include it in the message
+    if image:
+        buffered = io.BytesIO()
+        image.save(buffered, format="PNG")
+        img_str = base64.b64encode(buffered.getvalue()).decode()
+        
+        completion_params["messages"][-1] = {
+            "role": "user",
+            "content": [
+                {"type": "text", "text": user_message},
+                {"type": "image_url", "image_url": {"url": f"data:image/png;base64,{img_str}"}}
+            ]
+        }
+        # Use a vision-capable model when an image is present
+        completion_params["model"] = "gpt-4-vision-preview"  # Adjust this to your actual vision-capable model
+
+    # Only add tools and tool_choice if Tavily API key is available and no image is uploaded
     if tavily_api_key:
         completion_params["tools"] = tools
         completion_params["tool_choice"] = "auto"
@@ -380,7 +420,7 @@ async def main(message: cl.Message):
         available_functions = {
             "tavily_web_search": tavily_web_search,
         }
-        messages = prompt_history + [{"role": "assistant", "content": None, "function_call": {
+        messages = message_history + [{"role": "assistant", "content": None, "function_call": {
             "name": tool_calls[0]['function']['name'],
             "arguments": tool_calls[0]['function']['arguments']
         }}]
@@ -497,3 +537,10 @@ async def on_chat_resume(thread: ThreadDict):
             logger.warning(f"Message without recognized type: {message}")
 
     cl.user_session.set("message_history", message_history)
+
+    # Check if there's an image in the thread metadata
+    image_data = metadata.get("image")
+    if image_data:
+        image = Image.open(io.BytesIO(base64.b64decode(image_data)))
+        cl.user_session.set("image", image)
+        await cl.Message(content="Previous image loaded. You can continue asking questions about it, upload a new image, or just chat.").send()