webscout 6.8__tar.gz → 7.0__tar.gz

{webscout-6.8/webscout.egg-info → webscout-7.0}/PKG-INFO

@@ -1,6 +1,6 @@
-Metadata-Version: 2.1
+Metadata-Version: 2.2
 Name: webscout
-Version: 6.8
+Version: 7.0
 Summary: Search for anything using Google, DuckDuckGo, phind.com, Contains AI models, can transcribe yt videos, temporary email and phone number generation, has TTS support, webai (terminal gpt and open interpreter) and offline LLMs and more
 Author: OEvortex
 Author-email: helpingai5@gmail.com
@@ -46,6 +46,8 @@ Requires-Dist: ollama
 Requires-Dist: pillow
 Requires-Dist: bson
 Requires-Dist: cloudscraper
+Requires-Dist: html5lib
+Requires-Dist: aiofiles
 Requires-Dist: emoji
 Requires-Dist: openai
 Requires-Dist: prompt-toolkit
@@ -54,6 +56,7 @@ Requires-Dist: pyreqwest_impersonate
 Requires-Dist: gradio_client
 Requires-Dist: psutil
 Requires-Dist: yaspin
+Requires-Dist: pygetwindow
 Provides-Extra: dev
 Requires-Dist: ruff>=0.1.6; extra == "dev"
 Requires-Dist: pytest>=7.4.2; extra == "dev"
@@ -63,6 +66,17 @@ Requires-Dist: colorama; extra == "local"
 Requires-Dist: numpy; extra == "local"
 Requires-Dist: huggingface_hub[cli]; extra == "local"
 Requires-Dist: unicorn; extra == "local"
+Dynamic: author
+Dynamic: author-email
+Dynamic: classifier
+Dynamic: description
+Dynamic: description-content-type
+Dynamic: license
+Dynamic: project-url
+Dynamic: provides-extra
+Dynamic: requires-dist
+Dynamic: requires-python
+Dynamic: summary
 
 <div align="center">
   <!-- Replace `#` with your actual links -->
@@ -107,9 +121,8 @@ Requires-Dist: unicorn; extra == "local"
 * **Tempmail & Temp Number:** Generate temporary email addresses and phone numbers for enhanced privacy.
 * **[Text-to-Speech (TTS)](webscout/Provider/TTS/README.md):** Convert text into natural-sounding speech using multiple AI-powered providers like ElevenLabs, StreamElements, and Voicepods.
 * **Offline LLMs:** Utilize powerful language models offline with GGUF support.
-* **Extensive Provider Ecosystem:** Explore a vast collection of providers, including BasedGPT, DeepSeek, and many others.
+* **Extensive Provider Ecosystem:** Explore a vast collection of AI providers
 * **Local LLM Execution:** Run GGUF models locally with minimal configuration.
-* **Rawdog Scripting:** Execute Python scripts directly within your terminal using the `rawdog` feature.
 * **GGUF Conversion & Quantization:** Convert and quantize Hugging Face models to GGUF format.
 * **Autollama:** Download Hugging Face models and automatically convert them for Ollama compatibility.
 * **[SwiftCLI](webscout/swiftcli/Readme.md):** A powerful and elegant CLI framework that makes it easy to create beautiful command-line interfaces.
@@ -117,7 +130,6 @@ Requires-Dist: unicorn; extra == "local"
 * **[LitLogger](webscout/litlogger/Readme.md):** Simplifies logging with customizable formats and color schemes
 * **[LitAgent](webscout/litagent/Readme.md):** Powerful and modern user agent generator that keeps your requests fresh and undetectable
 * **[Text-to-Image](webscout/Provider/TTI/README.md):** Generate high-quality images using a wide range of AI art providers
-* **[MarkdownLite](webscout/Extra/markdownlite/README.md):** Powerful HTML to Markdown conversion library with advanced parsing and structured output
 * **[Scout](webscout/scout/README.md):** Advanced web parsing and crawling library with intelligent HTML/XML parsing, web crawling, and Markdown conversion
 
 ## ⚙️ Installation
@@ -967,34 +979,6 @@ response_str = a.chat(prompt)
 print(response_str)
 ```
 
-###  `DeepSeek` - Chat with DeepSeek
-
-```python
-from webscout import DeepSeek
-from rich import print
-
-ai = DeepSeek(
-    is_conversation=True,
-    api_key='cookie',
-    max_tokens=800,
-    timeout=30,
-    intro=None,
-    filepath=None,
-    update_file=True,
-    proxies={},
-    history_offset=10250,
-    act=None,
-    model="deepseek_chat"
-)
-
-
-# Define a prompt to send to the AI
-prompt = "Tell me about india"
-# Use the 'chat' method to send the prompt and receive a response
-r = ai.chat(prompt)
-print(r)
-```
-
 ###  `Deepinfra`
 
 ```python
@@ -1131,7 +1115,7 @@ print(a.chat("HelpingAI-9B"))
 ```
 
 
-###  LLAMA3, pizzagpt, RUBIKSAI, Koala, Darkai, AI4Chat, Farfalle, PIAI, Felo, Julius, YouChat, YEPCHAT, Cloudflare, TurboSeek, Editee, AI21, Chatify, Cerebras, X0GPT, Lepton, GEMINIAPI, Cleeai, Elmo, Free2GPT, Bing, DiscordRocks, GPTWeb, LlamaTutor, PromptRefine, TutorAI, ChatGPTES, Bagoodex, ChatHub, AmigoChat, AIMathGPT, GaurishCerebras, NinjaChat, GeminiPro, Talkai, LLMChat, AskMyAI, Llama3Mitril, Marcus, TypeGPT, Mhystical, Netwrck, MultiChatAI, JadveOpenAI, OOAi
+###  LLAMA3, pizzagpt, RUBIKSAI, Koala, Darkai, AI4Chat, Farfalle, PIAI, Felo, Julius, YouChat, YEPCHAT, Cloudflare, TurboSeek, Editee, AI21, Chatify, Cerebras, X0GPT, Lepton, GEMINIAPI, Cleeai, Elmo, Free2GPT, Bing, DiscordRocks, GPTWeb, LlamaTutor, PromptRefine, TutorAI, ChatGPTES, Bagoodex, ChatHub, AmigoChat, AIMathGPT, GaurishCerebras, NinjaChat, GeminiPro, Talkai, LLMChat, AskMyAI, Llama3Mitril, Marcus, TypeGPT, Mhystical, Netwrck, MultiChatAI, JadveOpenAI, ChatGLM, Deepfind, NousHermes, TextPollinationsAI, GliderAI, DGAFAI
 
 Code is similar to other providers.
 

{webscout-6.8 → webscout-7.0}/README.md

@@ -41,9 +41,8 @@
 * **Tempmail & Temp Number:** Generate temporary email addresses and phone numbers for enhanced privacy.
 * **[Text-to-Speech (TTS)](webscout/Provider/TTS/README.md):** Convert text into natural-sounding speech using multiple AI-powered providers like ElevenLabs, StreamElements, and Voicepods.
 * **Offline LLMs:** Utilize powerful language models offline with GGUF support.
-* **Extensive Provider Ecosystem:** Explore a vast collection of providers, including BasedGPT, DeepSeek, and many others.
+* **Extensive Provider Ecosystem:** Explore a vast collection of AI providers
 * **Local LLM Execution:** Run GGUF models locally with minimal configuration.
-* **Rawdog Scripting:** Execute Python scripts directly within your terminal using the `rawdog` feature.
 * **GGUF Conversion & Quantization:** Convert and quantize Hugging Face models to GGUF format.
 * **Autollama:** Download Hugging Face models and automatically convert them for Ollama compatibility.
 * **[SwiftCLI](webscout/swiftcli/Readme.md):** A powerful and elegant CLI framework that makes it easy to create beautiful command-line interfaces.
@@ -51,7 +50,6 @@
 * **[LitLogger](webscout/litlogger/Readme.md):** Simplifies logging with customizable formats and color schemes
 * **[LitAgent](webscout/litagent/Readme.md):** Powerful and modern user agent generator that keeps your requests fresh and undetectable
 * **[Text-to-Image](webscout/Provider/TTI/README.md):** Generate high-quality images using a wide range of AI art providers
-* **[MarkdownLite](webscout/Extra/markdownlite/README.md):** Powerful HTML to Markdown conversion library with advanced parsing and structured output
 * **[Scout](webscout/scout/README.md):** Advanced web parsing and crawling library with intelligent HTML/XML parsing, web crawling, and Markdown conversion
 
 ## ⚙️ Installation
@@ -901,34 +899,6 @@ response_str = a.chat(prompt)
 print(response_str)
 ```
 
-###  `DeepSeek` - Chat with DeepSeek
-
-```python
-from webscout import DeepSeek
-from rich import print
-
-ai = DeepSeek(
-    is_conversation=True,
-    api_key='cookie',
-    max_tokens=800,
-    timeout=30,
-    intro=None,
-    filepath=None,
-    update_file=True,
-    proxies={},
-    history_offset=10250,
-    act=None,
-    model="deepseek_chat"
-)
-
-
-# Define a prompt to send to the AI
-prompt = "Tell me about india"
-# Use the 'chat' method to send the prompt and receive a response
-r = ai.chat(prompt)
-print(r)
-```
-
 ###  `Deepinfra`
 
 ```python
@@ -1065,7 +1035,7 @@ print(a.chat("HelpingAI-9B"))
 ```
 
 
-###  LLAMA3, pizzagpt, RUBIKSAI, Koala, Darkai, AI4Chat, Farfalle, PIAI, Felo, Julius, YouChat, YEPCHAT, Cloudflare, TurboSeek, Editee, AI21, Chatify, Cerebras, X0GPT, Lepton, GEMINIAPI, Cleeai, Elmo, Free2GPT, Bing, DiscordRocks, GPTWeb, LlamaTutor, PromptRefine, TutorAI, ChatGPTES, Bagoodex, ChatHub, AmigoChat, AIMathGPT, GaurishCerebras, NinjaChat, GeminiPro, Talkai, LLMChat, AskMyAI, Llama3Mitril, Marcus, TypeGPT, Mhystical, Netwrck, MultiChatAI, JadveOpenAI, OOAi
+###  LLAMA3, pizzagpt, RUBIKSAI, Koala, Darkai, AI4Chat, Farfalle, PIAI, Felo, Julius, YouChat, YEPCHAT, Cloudflare, TurboSeek, Editee, AI21, Chatify, Cerebras, X0GPT, Lepton, GEMINIAPI, Cleeai, Elmo, Free2GPT, Bing, DiscordRocks, GPTWeb, LlamaTutor, PromptRefine, TutorAI, ChatGPTES, Bagoodex, ChatHub, AmigoChat, AIMathGPT, GaurishCerebras, NinjaChat, GeminiPro, Talkai, LLMChat, AskMyAI, Llama3Mitril, Marcus, TypeGPT, Mhystical, Netwrck, MultiChatAI, JadveOpenAI, ChatGLM, Deepfind, NousHermes, TextPollinationsAI, GliderAI, DGAFAI
 
 Code is similar to other providers.
 

{webscout-6.8 → webscout-7.0}/setup.py

@@ -52,6 +52,8 @@ setup(
             "pillow",
             "bson",
             "cloudscraper",
+            "html5lib",
+            "aiofiles",
             "emoji",
             "openai",
             "prompt-toolkit",
@@ -60,7 +62,7 @@ setup(
             "gradio_client",
             "psutil",
             "yaspin",
-            # "cerebras_cloud_sdk",
+            "pygetwindow",
         ],
 
     entry_points={

{webscout-6.8 → webscout-7.0}/webscout/AIbase.py

@@ -1,5 +1,4 @@
-from abc import ABC
-from abc import abstractmethod
+from abc import ABC, abstractmethod
 from pathlib import Path
 from typing import AsyncGenerator, List, Union, Generator, Optional
 from typing_extensions import TypeAlias
@@ -110,4 +109,15 @@ class AsyncImageProvider(ABC):
         name: Optional[str] = None,
         dir: Optional[Union[str, Path]] = None
     ) -> List[str]:
+        raise NotImplementedError("Method needs to be implemented in subclass")
+
+class AISearch(ABC):
+
+    @abstractmethod
+    def search(
+        self,
+        prompt: str,
+        stream: bool = False,
+        raw: bool = False,
+    ) -> Response:
         raise NotImplementedError("Method needs to be implemented in subclass")

{webscout-6.8 → webscout-7.0}/webscout/DWEBS.py

@@ -109,7 +109,7 @@ class GoogleS:
         timeout: Optional[int] = 10,
         max_workers: int = 20,
         cache_dir: Optional[str] = None,
-        rate_limit: float = 0.01,
+        rate_limit: float = 2.0,
         use_litlogger: bool = False
     ):
         """
@@ -152,7 +152,10 @@ class GoogleS:
         current_time = time.time()
         time_since_last = current_time - self.last_request_time
         if time_since_last < self.rate_limit:
-            time.sleep(self.rate_limit - time_since_last)
+            sleep_time = self.rate_limit - time_since_last
+            if self.use_litlogger:
+                self.logger.debug(f"Rate limiting: Waiting {sleep_time:.2f} seconds")
+            time.sleep(sleep_time)
         self.last_request_time = time.time()
 
     def _get_url(self, method: str, url: str, params: Optional[Dict[str, str]] = None,
@@ -170,31 +173,44 @@ class GoogleS:
         Returns:
             bytes: Response content
         """
-        self._respect_rate_limit()
+        retry_count = 0
+        base_delay = 5  # Base delay in seconds
         
-        for attempt in range(max_retries):
+        while retry_count < max_retries:
             try:
-                if self.use_litlogger:
-                    self.logger.debug(f"Making {method} request to {url} (Attempt {attempt + 1})")
+                self._respect_rate_limit()
+                response = self.client.request(
+                    method=method,
+                    url=url,
+                    params=params,
+                    data=data,
+                    timeout=self.timeout
+                )
                 
-                resp = self.client.request(method, url, params=params, data=data, timeout=self.timeout)
-                resp.raise_for_status()
+                if response.status_code == 429:
+                    retry_delay = base_delay * (2 ** retry_count)  # Exponential backoff
+                    if self.use_litlogger:
+                        self.logger.warning(f"Rate limited by Google. Waiting {retry_delay} seconds before retry...")
+                    time.sleep(retry_delay)
+                    retry_count += 1
+                    continue
+                    
+                response.raise_for_status()
+                return response.content
                 
-                if self.use_litlogger:
-                    self.logger.success(f"Request successful: {resp.status_code}")
+            except requests.exceptions.RequestException as e:
+                if retry_count == max_retries - 1:
+                    if self.use_litlogger:
+                        self.logger.error(f"Max retries reached. Last error: {str(e)}")
+                    raise
                 
-                return resp.content
-            
-            except requests.exceptions.RequestException as ex:
+                retry_delay = base_delay * (2 ** retry_count)
                 if self.use_litlogger:
-                    self.logger.error(f"Request failed: {url} - {str(ex)}")
+                    self.logger.warning(f"Request failed. Retrying in {retry_delay} seconds... Error: {str(e)}")
+                time.sleep(retry_delay)
+                retry_count += 1
                 
-                # Exponential backoff
-                if attempt < max_retries - 1:
-                    wait_time = (2 ** attempt) + random.random()
-                    time.sleep(wait_time)
-                else:
-                    raise
+        raise Exception("Max retries reached")
 
     @lru_cache(maxsize=100)
     def _cache_key(self, query: str, **kwargs) -> str:
@@ -471,7 +487,7 @@ class GoogleS:
 
 if __name__ == "__main__":
     from rich import print
-    searcher = GoogleS()
-    results = searcher.search("HelpingAI-9B", max_results=200, extract_text=False, max_text_length=200)
+    searcher = GoogleS(rate_limit=3.0, use_litlogger=True)
+    results = searcher.search("HelpingAI-9B", max_results=5, extract_text=False, max_text_length=200)
     for result in results:
         print(result)

{webscout-6.8 → webscout-7.0}/webscout/Extra/YTToolkit/YTdownloader.py

@@ -12,10 +12,15 @@ from sys import stdout
 import os
 import subprocess
 import sys
+import tempfile
 from webscout.version import __prog__, __version__
-from webscout.zerodir import user_cache_dir
 from webscout.swiftcli import CLI, option, argument, group
 
+# Define cache directory using tempfile
+user_cache_dir = os.path.join(tempfile.gettempdir(), 'webscout')
+if not os.path.exists(user_cache_dir):
+    os.makedirs(user_cache_dir)
+
 logging = LitLogger(name="YTDownloader")
 
 session = requests.session()
@@ -32,7 +37,7 @@ session.headers.update(headers)
 
 get_excep = lambda e: e.args[1] if len(e.args) > 1 else e
 
-appdir = user_cache_dir(__prog__, __prog__)
+appdir = user_cache_dir
 
 if not path.isdir(appdir):
     try:

{webscout-6.8 → webscout-7.0}/webscout/Extra/YTToolkit/ytapi/channel.py

@@ -304,4 +304,4 @@ class Channel:
         List[str] | None
             The ids of all playlists or None
         """
-        return dup_filter(Patterns.playlists.findall(channel_playlists(self._target_url)))
+        return dup_filter(Patterns.playlists.findall(channel_playlists(self._target_url)))

{webscout-6.8 → webscout-7.0}/webscout/Extra/YTToolkit/ytapi/query.py

@@ -35,3 +35,6 @@ class Search:
     @staticmethod
     def playlists(keywords: str, limit: int = 20) -> Optional[List[str]]:
         return dup_filter(Patterns.playlist_id.findall(find_playlists(keywords)), limit)
+
+if __name__ == "__main__":
+    print(Search.videos("java"))

{webscout-6.8 → webscout-7.0}/webscout/Extra/YTToolkit/ytapi/stream.py

@@ -58,3 +58,6 @@ class Video:
             'tags': data[7].split(',') if data[7] else None,
             'description': data[8].replace('\\n', '\n') if data[8] else None
         }
+
+if __name__ == '__main__':
+    print(Video('https://www.youtube.com/watch?v=9bZkp7q19f0').metadata)

{webscout-6.8 → webscout-7.0}/webscout/Extra/YTToolkit/ytapi/video.py

@@ -99,4 +99,6 @@ class Video:
             data['genre'] = genre_pattern.search(self._video_data).group(1)
         except AttributeError:
             data['genre'] = None
-        return data
+        return data
+if __name__ == '__main__':
+    print(Video('https://www.youtube.com/watch?v=9bZkp7q19f0').metadata)

{webscout-6.8 → webscout-7.0}/webscout/Extra/autocoder/autocoder_utiles.py

@@ -8,14 +8,71 @@ import sys
 from typing import List, Optional
 
 from webscout.optimizers import Optimizers
-
+import os
+import platform
+import subprocess
 
 def get_current_app() -> str:
-    """Get the current active application name."""
-    try:
-        active_window: Optional[gw.Window] = gw.getActiveWindow()
-        return f"{active_window.title if active_window else 'Unknown'}"
-    except Exception as e:
+    """
+    Get the current active application or window title in a cross-platform manner.
+
+    On Windows, uses the win32gui module from pywin32.
+    On macOS, uses AppKit to access the active application info.
+    On Linux, uses xprop to get the active window details.
+
+    Returns:
+        A string containing the title of the active application/window, or "Unknown" if it cannot be determined.
+    """
+    system_name = platform.system()
+
+    if system_name == "Windows":
+        try:
+            import win32gui  # pywin32 must be installed
+            window_handle = win32gui.GetForegroundWindow()
+            title = win32gui.GetWindowText(window_handle)
+            return title if title else "Unknown"
+        except Exception:
+            return "Unknown"
+
+    elif system_name == "Darwin":  # macOS
+        try:
+            from AppKit import NSWorkspace # type: ignore
+            active_app = NSWorkspace.sharedWorkspace().activeApplication()
+            title = active_app.get('NSApplicationName')
+            return title if title else "Unknown"
+        except Exception:
+            return "Unknown"
+
+    elif system_name == "Linux":
+        try:
+            # Get the active window id using xprop
+            result = subprocess.run(
+                ["xprop", "-root", "_NET_ACTIVE_WINDOW"],
+                stdout=subprocess.PIPE,
+                stderr=subprocess.PIPE,
+                text=True
+            )
+            if result.returncode == 0 and result.stdout:
+                # Expected format: _NET_ACTIVE_WINDOW(WINDOW): window id # 0x1400007
+                parts = result.stdout.strip().split()
+                window_id = parts[-1]
+                if window_id != "0x0":
+                    title_result = subprocess.run(
+                        ["xprop", "-id", window_id, "WM_NAME"],
+                        stdout=subprocess.PIPE,
+                        stderr=subprocess.PIPE,
+                        text=True
+                    )
+                    if title_result.returncode == 0 and title_result.stdout:
+                        # Expected format: WM_NAME(STRING) = "Terminal"
+                        title_parts = title_result.stdout.split(" = ", 1)
+                        if len(title_parts) == 2:
+                            title = title_parts[1].strip().strip('"')
+                            return title if title else "Unknown"
+        except Exception:
+            pass
+        return "Unknown"
+    else:
         return "Unknown"
 
 
@@ -136,4 +193,8 @@ EXAMPLES: str = """
         </rawdog_response>
     </example>
 </examples>
-"""
+"""
+
+if __name__ == "__main__":
+    # Simple test harness to print the current active window title.
+    print("Current Active Window/Application: ", get_current_app())

{webscout-6.8 → webscout-7.0}/webscout/Extra/autollama.py

@@ -1,21 +1,5 @@
 """
-Yo fam! 🔥 Welcome to AutoLlama - your go-to tool for downloading and setting up HelpingAI models! 💪
-
-Created by the legendary Abhay Koul, this script's got your back when it comes to:
-- Downloading models straight from HuggingFace Hub 🚀
-- Setting up Ollama with zero hassle 💯
-- Getting your AI assistant ready to vibe with you! ⚡
-
-Usage:
 >>> python -m webscout.Extra.autollama download -m "OEvortex/HelpingAI-Lite-1.5T" -g "HelpingAI-Lite-1.5T.q4_k_m.gguf"
-
-Features:
-- Smart model management 🧠
-- Automatic dependency installation 📦
-- Progress tracking that keeps it real 📈
-- Error handling that's got your back 💪
-
-Join the squad on Discord and level up your AI game! 🎮
 """
 
 import warnings

{webscout-6.8 → webscout-7.0}/webscout/Extra/gguf.py

@@ -1,22 +1,9 @@
 """
-Yo fam! 🔥 Welcome to GGUF Converter - your ultimate tool for converting models to GGUF format! 💪
 
-- Converting HuggingFace models to GGUF format 🚀
-- Multiple quantization methods for different needs 🎯
-- Easy upload back to HuggingFace Hub 📤
-
-Usage:
 >>> python -m webscout.Extra.gguf convert -m "OEvortex/HelpingAI-Lite-1.5T" -q "q4_k_m,q5_k_m"
 >>> # With upload options:
 >>> python -m webscout.Extra.gguf convert -m "your-model" -u "username" -t "token" -q "q4_k_m"
 
-Features:
-- Smart dependency checking 🔍
-- CUDA support detection ⚡
-- Progress tracking that keeps it real 📈
-- Multiple quantization options 🎮
-
-Join the squad on Discord and level up your AI game! 🎮
 """
 
 import subprocess