webscout 3.0__tar.gz → 3.1__tar.gz

{webscout-3.0 → webscout-3.1}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: webscout
-Version: 3.0
+Version: 3.1
 Summary: Search for anything using Google, DuckDuckGo, phind.com, Contains AI models, can transcribe yt videos, temporary email and phone number generation, has TTS support, webai (terminal gpt and open interpreter) and offline LLMs
 Author: OEvortex
 Author-email: helpingai5@gmail.com
@@ -143,6 +143,7 @@ Search for anything using Google, DuckDuckGo, phind.com, Contains AI models, can
     - [`LLM`](#llm)
     - [`Local-LLM` webscout can now run GGUF models](#local-llm-webscout-can-now-run-gguf-models)
     - [`Function-calling-local-llm`](#function-calling-local-llm)
+    - [`Local-rawdog`](#local-rawdog)
     - [`LLM` with internet](#llm-with-internet)
     - [LLM with deepwebs](#llm-with-deepwebs)
   - [`Webai` - terminal gpt and a open interpeter](#webai---terminal-gpt-and-a-open-interpeter)
@@ -1245,6 +1246,7 @@ while True:
     print("AI: ", response)
 ```
 ### `Local-LLM` webscout can now run GGUF models
+Local LLM's some functions are taken from easy-llama
 ```python
 from webscout.Local.utils import download_model
 from webscout.Local.model import Model
@@ -1336,6 +1338,93 @@ while True:
     response = thread.send(user_input)
     print("Bot: ", response) 
 ```
+### `Local-rawdog`
+```python
+import webscout.Local as ws
+from webscout.Local.rawdog import RawDog
+from webscout.Local.samplers import DefaultSampling
+from webscout.Local.formats import chatml, AdvancedFormat
+from webscout.Local.utils import download_model
+import datetime
+import sys
+import os
+
+repo_id = "YorkieOH10/granite-8b-code-instruct-Q8_0-GGUF" 
+filename = "granite-8b-code-instruct.Q8_0.gguf"
+model_path = download_model(repo_id, filename, token='')
+
+# Load the model using the downloaded path
+model = ws.Model(model_path, n_gpu_layers=10)
+
+rawdog = RawDog()
+
+# Create an AdvancedFormat and modify the system content
+# Use a lambda to generate the prompt dynamically:
+chat_format = AdvancedFormat(chatml)
+#  **Pre-format the intro_prompt string:**
+system_content = f"""
+You are a command-line coding assistant called Rawdog that generates and auto-executes Python scripts.
+
+A typical interaction goes like this:
+1. The user gives you a natural language PROMPT.
+2. You:
+    i. Determine what needs to be done
+    ii. Write a short Python SCRIPT to do it
+    iii. Communicate back to the user by printing to the console in that SCRIPT
+3. The compiler extracts the script and then runs it using exec(). If there will be an exception raised,
+ it will be send back to you starting with "PREVIOUS SCRIPT EXCEPTION:".
+4. In case of exception, regenerate error free script.
+
+If you need to review script outputs before completing the task, you can print the word "CONTINUE" at the end of your SCRIPT.
+This can be useful for summarizing documents or technical readouts, reading instructions before
+deciding what to do, or other tasks that require multi-step reasoning.
+A typical 'CONTINUE' interaction looks like this:
+1. The user gives you a natural language PROMPT.
+2. You:
+    i. Determine what needs to be done
+    ii. Determine that you need to see the output of some subprocess call to complete the task
+    iii. Write a short Python SCRIPT to print that and then print the word "CONTINUE"
+3. The compiler
+    i. Checks and runs your SCRIPT
+    ii. Captures the output and appends it to the conversation as "LAST SCRIPT OUTPUT:"
+    iii. Finds the word "CONTINUE" and sends control back to you
+4. You again:
+    i. Look at the original PROMPT + the "LAST SCRIPT OUTPUT:" to determine what needs to be done
+    ii. Write a short Python SCRIPT to do it
+    iii. Communicate back to the user by printing to the console in that SCRIPT
+5. The compiler...
+
+Please follow these conventions carefully:
+- Decline any tasks that seem dangerous, irreversible, or that you don't understand.
+- Always review the full conversation prior to answering and maintain continuity.
+- If asked for information, just print the information clearly and concisely.
+- If asked to do something, print a concise summary of what you've done as confirmation.
+- If asked a question, respond in a friendly, conversational way. Use programmatically-generated and natural language responses as appropriate.
+- If you need clarification, return a SCRIPT that prints your question. In the next interaction, continue based on the user's response.
+- Assume the user would like something concise. For example rather than printing a massive table, filter or summarize it to what's likely of interest.
+- Actively clean up any temporary processes or files you use.
+- When looking through files, use git as available to skip files, and skip hidden files (.env, .git, etc) by default.
+- You can plot anything with matplotlib.
+- ALWAYS Return your SCRIPT inside of a single pair of ``` delimiters. Only the console output of the first such SCRIPT is visible to the user, so make sure that it's complete and don't bother returning anything else.
+"""
+chat_format.override('system_content', lambda: system_content)
+
+thread = ws.Thread(model, format=chat_format, sampler=DefaultSampling)
+
+while True:
+    prompt = input(">: ")
+    if prompt.lower() == "q":
+        break
+
+    response = thread.send(prompt)
+
+    # Process the response using RawDog
+    script_output = rawdog.main(response)
+
+    if script_output:
+        print(script_output)
+
+```
 ### `LLM` with internet
 ```python
 from __future__ import annotations

{webscout-3.0 → webscout-3.1}/README.md

@@ -78,6 +78,7 @@ Search for anything using Google, DuckDuckGo, phind.com, Contains AI models, can
     - [`LLM`](#llm)
     - [`Local-LLM` webscout can now run GGUF models](#local-llm-webscout-can-now-run-gguf-models)
     - [`Function-calling-local-llm`](#function-calling-local-llm)
+    - [`Local-rawdog`](#local-rawdog)
     - [`LLM` with internet](#llm-with-internet)
     - [LLM with deepwebs](#llm-with-deepwebs)
   - [`Webai` - terminal gpt and a open interpeter](#webai---terminal-gpt-and-a-open-interpeter)
@@ -1180,6 +1181,7 @@ while True:
     print("AI: ", response)
 ```
 ### `Local-LLM` webscout can now run GGUF models
+Local LLM's some functions are taken from easy-llama
 ```python
 from webscout.Local.utils import download_model
 from webscout.Local.model import Model
@@ -1271,6 +1273,93 @@ while True:
     response = thread.send(user_input)
     print("Bot: ", response) 
 ```
+### `Local-rawdog`
+```python
+import webscout.Local as ws
+from webscout.Local.rawdog import RawDog
+from webscout.Local.samplers import DefaultSampling
+from webscout.Local.formats import chatml, AdvancedFormat
+from webscout.Local.utils import download_model
+import datetime
+import sys
+import os
+
+repo_id = "YorkieOH10/granite-8b-code-instruct-Q8_0-GGUF" 
+filename = "granite-8b-code-instruct.Q8_0.gguf"
+model_path = download_model(repo_id, filename, token='')
+
+# Load the model using the downloaded path
+model = ws.Model(model_path, n_gpu_layers=10)
+
+rawdog = RawDog()
+
+# Create an AdvancedFormat and modify the system content
+# Use a lambda to generate the prompt dynamically:
+chat_format = AdvancedFormat(chatml)
+#  **Pre-format the intro_prompt string:**
+system_content = f"""
+You are a command-line coding assistant called Rawdog that generates and auto-executes Python scripts.
+
+A typical interaction goes like this:
+1. The user gives you a natural language PROMPT.
+2. You:
+    i. Determine what needs to be done
+    ii. Write a short Python SCRIPT to do it
+    iii. Communicate back to the user by printing to the console in that SCRIPT
+3. The compiler extracts the script and then runs it using exec(). If there will be an exception raised,
+ it will be send back to you starting with "PREVIOUS SCRIPT EXCEPTION:".
+4. In case of exception, regenerate error free script.
+
+If you need to review script outputs before completing the task, you can print the word "CONTINUE" at the end of your SCRIPT.
+This can be useful for summarizing documents or technical readouts, reading instructions before
+deciding what to do, or other tasks that require multi-step reasoning.
+A typical 'CONTINUE' interaction looks like this:
+1. The user gives you a natural language PROMPT.
+2. You:
+    i. Determine what needs to be done
+    ii. Determine that you need to see the output of some subprocess call to complete the task
+    iii. Write a short Python SCRIPT to print that and then print the word "CONTINUE"
+3. The compiler
+    i. Checks and runs your SCRIPT
+    ii. Captures the output and appends it to the conversation as "LAST SCRIPT OUTPUT:"
+    iii. Finds the word "CONTINUE" and sends control back to you
+4. You again:
+    i. Look at the original PROMPT + the "LAST SCRIPT OUTPUT:" to determine what needs to be done
+    ii. Write a short Python SCRIPT to do it
+    iii. Communicate back to the user by printing to the console in that SCRIPT
+5. The compiler...
+
+Please follow these conventions carefully:
+- Decline any tasks that seem dangerous, irreversible, or that you don't understand.
+- Always review the full conversation prior to answering and maintain continuity.
+- If asked for information, just print the information clearly and concisely.
+- If asked to do something, print a concise summary of what you've done as confirmation.
+- If asked a question, respond in a friendly, conversational way. Use programmatically-generated and natural language responses as appropriate.
+- If you need clarification, return a SCRIPT that prints your question. In the next interaction, continue based on the user's response.
+- Assume the user would like something concise. For example rather than printing a massive table, filter or summarize it to what's likely of interest.
+- Actively clean up any temporary processes or files you use.
+- When looking through files, use git as available to skip files, and skip hidden files (.env, .git, etc) by default.
+- You can plot anything with matplotlib.
+- ALWAYS Return your SCRIPT inside of a single pair of ``` delimiters. Only the console output of the first such SCRIPT is visible to the user, so make sure that it's complete and don't bother returning anything else.
+"""
+chat_format.override('system_content', lambda: system_content)
+
+thread = ws.Thread(model, format=chat_format, sampler=DefaultSampling)
+
+while True:
+    prompt = input(">: ")
+    if prompt.lower() == "q":
+        break
+
+    response = thread.send(prompt)
+
+    # Process the response using RawDog
+    script_output = rawdog.main(response)
+
+    if script_output:
+        print(script_output)
+
+```
 ### `LLM` with internet
 ```python
 from __future__ import annotations

{webscout-3.0 → webscout-3.1}/setup.py

@@ -5,7 +5,7 @@ with open("README.md", encoding="utf-8") as f:
 
 setup(
     name="webscout",
-    version="3.0",
+    version="3.1",
     description="Search for anything using Google, DuckDuckGo, phind.com, Contains AI models, can transcribe yt videos, temporary email and phone number generation, has TTS support, webai (terminal gpt and open interpreter) and offline LLMs",
     long_description=README,
     long_description_content_type="text/markdown",

{webscout-3.0 → webscout-3.1}/webscout/Local/__init__.py

@@ -8,3 +8,4 @@ from . import utils
 
 from .model  import Model
 from .thread import Thread
+from .rawdog import *

{webscout-3.0 → webscout-3.1}/webscout/Local/_version.py

@@ -1,3 +1,3 @@
 from llama_cpp import __version__ as __llama_cpp_version__
 
-__version__ = '2.9'
+__version__ = '3.1'