webscout 1.2.1__py3-none-any.whl → 1.2.3__py3-none-any.whl

{webscout-1.2.1.dist-info → webscout-1.2.3.dist-info}/METADATA

@@ -1,7 +1,7 @@
 Metadata-Version: 2.1
 Name: webscout
-Version: 1.2.1
-Summary: Search for words, documents, images, videos, news, maps and text translation using the DuckDuckGo.com, yep.com, phind.com, you.com, etc Also containes AI models
+Version: 1.2.3
+Summary: Search for words, documents, images, videos, news, maps and text translation using the Google, DuckDuckGo.com, yep.com, phind.com, you.com, etc Also containes AI models
 Author: OEvortex
 Author-email: helpingai5@gmail.com
 License: HelpingAI Simplified Universal License
@@ -37,6 +37,14 @@ Requires-Dist: g4f >=0.2.2.3
 Requires-Dist: rich
 Requires-Dist: python-dotenv
 Requires-Dist: Helpingai-T2
+Requires-Dist: beautifulsoup4
+Requires-Dist: markdownify
+Requires-Dist: pydantic
+Requires-Dist: requests
+Requires-Dist: sse-starlette
+Requires-Dist: termcolor
+Requires-Dist: tiktoken
+Requires-Dist: tldextract
 Provides-Extra: dev
 Requires-Dist: ruff >=0.1.6 ; extra == 'dev'
 Requires-Dist: pytest >=7.4.2 ; extra == 'dev'
@@ -47,33 +55,22 @@ Requires-Dist: pytest >=7.4.2 ; extra == 'dev'
 <a href="#"><img alt="Python version" src="https://img.shields.io/pypi/pyversions/webscout"/></a>
 <a href="https://pepy.tech/project/webscout"><img alt="Downloads" src="https://static.pepy.tech/badge/webscout"></a>
 
-Search for words, documents, images, videos, news, maps and text translation using the DuckDuckGo.com, yep.com, phind.com, you.com, etc also contains AI models
+Search for words, documents, images, videos, news, maps and text translation using the Google, DuckDuckGo.com, yep.com, phind.com, you.com, etc Also containes AI models
 Also containes AI models that you can use
-**⚠️ Warning: use AsyncWEBS in asynchronous code**
+
 
 ## Table of Contents
 - [webscout](#webscout)
   - [Table of Contents](#table-of-contents)
   - [Install](#install)
-- [Webscout API Server](#webscout-api-server)
-  - [Installation](#installation)
-  - [Usage](#usage)
-    - [Text Search](#text-search)
-    - [Image Search](#image-search)
-    - [Video Search](#video-search)
-    - [News Search](#news-search)
-    - [Map Search](#map-search)
-    - [Translation](#translation)
-    - [Suggestions](#suggestions)
-    - [Health Check](#health-check)
-  - [Response Format](#response-format)
-  - [Error Handling](#error-handling)
-  - [License](#license)
-- [IN python projects](#in-python-projects)
   - [CLI version](#cli-version)
   - [CLI version of webscout.AI](#cli-version-of-webscoutai)
   - [CLI to use LLM](#cli-to-use-llm)
   - [Regions](#regions)
+  - [DeepWEBS: Advanced Web Searches](#deepwebs-advanced-web-searches)
+    - [Activating DeepWEBS](#activating-deepwebs)
+    - [Point to remember before using `DeepWEBS`](#point-to-remember-before-using-deepwebs)
+    - [Usage Example](#usage-example)
   - [WEBS and AsyncWEBS classes](#webs-and-asyncwebs-classes)
   - [Exceptions](#exceptions)
   - [usage of webscout](#usage-of-webscout)
@@ -102,153 +99,6 @@ Also containes AI models that you can use
 ```python
 pip install -U webscout
 ```
-# Webscout API Server
-
-This is a Flask server that provides an API for performing various types of searches using the `webscout` Python package. The server supports text, answers, images, videos, news, maps, translation, and suggestions searches.
-
-## Installation
-
-1. Install the required dependencies:
-
-```bash
-pip install flask webscout
-```
-
-2. Clone or download the repository containing the server code.
-
-## Usage
-
-1. Run the server:
-
-```bash
-python server.py
-```
-
-This will start the Flask server at `http://localhost:5000`.
-
-2. Use the API endpoints to perform searches. Here are the available endpoints:
-
-### Text Search
-
-`GET /api/search`
-
-Parameters:
-- `q` (required): The search query string.
-- `max_results` (optional, default=10): The maximum number of results to return.
-- `timelimit` (optional): The time limit for the search (e.g., 'd' for day, 'w' for week, 'm' for month, 'y' for year).
-- `safesearch` (optional, default='moderate'): The safe search level ('on', 'moderate', or 'off').
-- `region` (optional, default='wt-wt'): The region for the search (e.g., 'us-en', 'uk-en', 'ru-ru').
-
-Example: `http://localhost:5000/api/search?q=python&max_results=20&timelimit=d&safesearch=off&region=us-en`
-
-
-### Image Search
-
-`GET /api/images`
-
-Parameters:
-- `q` (required): The search query string.
-- `max_results` (optional, default=10): The maximum number of results to return.
-- `safesearch` (optional, default='moderate'): The safe search level ('on', 'moderate', or 'off').
-- `region` (optional, default='wt-wt'): The region for the search (e.g., 'us-en', 'uk-en', 'ru-ru').
-
-Example: `http://localhost:5000/api/images?q=butterfly&max_results=15&safesearch=off&region=uk-en`
-
-### Video Search
-
-`GET /api/videos`
-
-Parameters:
-- `q` (required): The search query string.
-- `max_results` (optional, default=10): The maximum number of results to return.
-- `safesearch` (optional, default='moderate'): The safe search level ('on', 'moderate', or 'off').
-- `region` (optional, default='wt-wt'): The region for the search (e.g., 'us-en', 'uk-en', 'ru-ru').
-- `timelimit` (optional): The time limit for the search (e.g., 'd' for day, 'w' for week, 'm' for month).
-- `duration` (optional): The duration of the videos ('short', 'medium', 'long').
-
-Example: `http://localhost:5000/api/videos?q=tesla&max_results=20&safesearch=off&region=us-en&timelimit=m&duration=long`
-
-### News Search
-
-`GET /api/news`
-
-Parameters:
-- `q` (required): The search query string.
-- `max_results` (optional, default=10): The maximum number of results to return.
-- `safesearch` (optional, default='moderate'): The safe search level ('on', 'moderate', or 'off').
-- `region` (optional, default='wt-wt'): The region for the search (e.g., 'us-en', 'uk-en', 'ru-ru').
-- `timelimit` (optional): The time limit for the search (e.g., 'd' for day, 'w' for week, 'm' for month).
-
-Example: `http://localhost:5000/api/news?q=sports&max_results=20&safesearch=on&region=uk-en&timelimit=d`
-
-### Map Search
-
-`GET /api/maps`
-
-Parameters:
-- `q` (required): The search query string.
-- `place` (optional): The place for the search (e.g., 'New York City').
-- `max_results` (optional, default=10): The maximum number of results to return.
-
-Example: `http://localhost:5000/api/maps?q=restaurants&place=Anantnag&max_results=15`
-
-### Translation
-
-`GET /api/translate`
-
-Parameters:
-- `q` (required): The text to translate.
-- `to` (optional, default='en'): The language to translate to (e.g., 'es', 'fr', 'hi').
-
-Example: `http://localhost:5000/api/translate?q=hello&to=es`
-
-### Suggestions
-
-`GET /api/suggestions`
-
-Parameters:
-- `q` (required): The query string for suggestions.
-
-Example: `http://localhost:5000/api/suggestions?q=python`
-
-### Health Check
-
-`GET /api/health`
-
-This endpoint returns a simple JSON response indicating that the server is running and ready to accept requests.
-
-Example: `http://localhost:5000/api/health`
-
-## Response Format
-
-All endpoints return JSON responses with the following format:
-
-```json
-{
-    "results": [
-        {...},
-        {...},
-        ...
-    ]
-}
-```
-
-The `results` key contains a list of search results, where each result is a dictionary containing the relevant information for that search type.
-
-## Error Handling
-
-If an error occurs during the search, the server will return a JSON response with an appropriate error message.
-
-```json
-{
-    "error": "Error message"
-}
-```
-
-## License
-
-This project is licensed under the [HelpingAI Simplified Universal License](https://raw.githubusercontent.com/OE-LUCIFER/Webscout/main/LICENSE.md).
-# IN python projects
 ## CLI version
 
 ```python3
@@ -366,6 +216,71 @@ ___
 [Go To TOP](#TOP)
 
 
+
+## DeepWEBS: Advanced Web Searches
+
+`DeepWEBS` is a standalone feature designed to perform advanced web searches with enhanced capabilities. It is particularly powerful in extracting relevant information directly from webpages and Search engine, focusing exclusively on text (web) searches. Unlike the `WEBS` , which provides a broader range of search functionalities, `DeepWEBS` is specifically tailored for in-depth web searches.
+
+### Activating DeepWEBS
+
+To utilize the `DeepWEBS` feature, you must first create an instance of the `DeepWEBS` . This is designed to be used independently of the `WEBS` , offering a focused approach to web searches.
+
+### Point to remember before using `DeepWEBS`
+As `DeepWEBS` is designed to extract relevant information directly from webpages and Search engine, It extracts html from webpages and saves them to folder named files in `DeepWEBS` that can be found at `C:\Users\Username\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.11_qbz5n2kfra8p0\LocalCache\local-packages\Python311\site-packages\DeepWEBS`
+
+### Usage Example
+
+Here's a basic example of how to use the `DeepWEBS` :
+```python
+from webscout import DeepWEBS
+
+def perform_web_search(query):
+    # Initialize the DeepWEBS class
+    D = DeepWEBS()
+    
+    # Set up the search parameters
+    search_params = D.DeepSearch(
+        queries=[query], # Query to search
+        result_num=5, # Number of search results
+        safe=True, # Enable SafeSearch
+        types=["web"], # Search type: web
+        extract_webpage=True, # True for extracting webpages
+        overwrite_query_html=False,
+        overwrite_webpage_html=False,
+    )
+    
+    # Execute the search and retrieve results
+    results = D.queries_to_search_results(search_params)
+    
+    return results
+
+def print_search_results(results):
+    """
+    Print the search results.
+    
+    Args:
+    - search_results (list): List of search results to print.
+    """
+    if results:
+        for index, result in enumerate(results, start=1):
+            print(f"Result {index}: {result}")
+    else:
+        print("No search results found.")
+
+def main():
+    # Prompt the user for a search query
+    query = input("Enter your search query: ")
+    
+    # Perform the web search
+    results = perform_web_search(query)
+    
+    # Print the search results
+    print_search_results(results)
+
+if __name__ == "__main__":
+    main()
+
+```
 ## WEBS and AsyncWEBS classes
 
 The WEBS and AsyncWEBS classes are used to retrieve search results from DuckDuckGo.com and yep.com periodically.

webscout-1.2.3.dist-info/RECORD

@@ -0,0 +1,33 @@
+DeepWEBS/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+DeepWEBS/documents/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+DeepWEBS/documents/query_results_extractor.py,sha256=whd0NKLpcxW_6q3SkBOhMukr1K_c1PPYN92rf5EHRPM,4049
+DeepWEBS/documents/webpage_content_extractor.py,sha256=P4yHCkPTiBvMbORd8SKVt64rQFPJuj3iixcQoRU34Lw,5272
+DeepWEBS/networks/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+DeepWEBS/networks/filepath_converter.py,sha256=JKMBew1TYe4TVoGTqgTWerq2Pam49_9u9TVUFCTDQyk,3183
+DeepWEBS/networks/google_searcher.py,sha256=-AdIpVkRgemsARnOt8WPkF2Id1baVlqDHyqX2qz8Aew,1966
+DeepWEBS/networks/network_configs.py,sha256=-Hb78_7SBx32h219FnU14qcHTvBdDUf_QAU6-RTL_e0,726
+DeepWEBS/networks/webpage_fetcher.py,sha256=d5paDTB3wa_w6YWmLV7RkpAj8Lh8ztuUuyfe8RuTjQg,3846
+DeepWEBS/utilsdw/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+DeepWEBS/utilsdw/enver.py,sha256=vstxg_5P3Rwo1en6oPcuc2SBiATJqxi4C7meGmw5w0M,1754
+DeepWEBS/utilsdw/logger.py,sha256=Z0nFUcEGyU8r28yKiIyvEtO26xxpmJgbvNToTfwZecc,8174
+webscout/AI.py,sha256=CwUCeGnNRL9STd5bAZSyIiLysorBMu065HrkY8UCzAQ,49618
+webscout/AIbase.py,sha256=vQi2ougu5bG-QdmoYmxCQsOg7KTEgG7EF6nZh5qqUGw,2343
+webscout/AIutel.py,sha256=cvsuw57hq3GirAiT-PjqwhAiLPf1urOzDb2szJ4bwmo,24124
+webscout/DWEBS.py,sha256=f1mZntTvClJOn8q7jUdQZAkp4Op3zR7L7j4KRPNHlgY,7135
+webscout/HelpingAI.py,sha256=YeZw0zYVHMcBFFPNdd3_Ghpm9ebt_EScQjHO_IIs4lg,8103
+webscout/LLM.py,sha256=XByJPiATLA_57FBWKw18Xx_PGRCPOj-GJE96aQH1k2Y,3309
+webscout/__init__.py,sha256=wRx1a7Jo-Vs9VwCq1ib5VEf2OeKK4qbtK1DaWu7Oj_s,425
+webscout/__main__.py,sha256=ZtTRgsRjUi2JOvYFLF1ZCh55Sdoz94I-BS-TlJC7WDU,126
+webscout/cli.py,sha256=F888fdrFUQgczMBN4yMOSf6Nh-IbvkqpPhDsbnA2FtQ,17059
+webscout/exceptions.py,sha256=4AOO5wexeL96nvUS-badcckcwrPS7UpZyAgB9vknHZE,276
+webscout/models.py,sha256=5iQIdtedT18YuTZ3npoG7kLMwcrKwhQ7928dl_7qZW0,692
+webscout/utils.py,sha256=c_98M4oqpb54pUun3fpGGlCerFD6ZHUbghyp5b7Mwgo,2605
+webscout/version.py,sha256=IzQz-3tdiLwn4VJnIg8k0a-2MLPMIr0xmpR5acmHp4Q,25
+webscout/webscout_search.py,sha256=3_lli-hDb8_kCGwscK29xuUcOS833ROgpNhDzrxh0dk,3085
+webscout/webscout_search_async.py,sha256=Y5frH0k3hLqBCR-8dn7a_b7EvxdYxn6wHiKl3jWosE0,40670
+webscout-1.2.3.dist-info/LICENSE.md,sha256=mRVwJuT4SXC5O93BFdsfWBjlXjGn2Np90Zm5SocUzM0,3150
+webscout-1.2.3.dist-info/METADATA,sha256=8qdgb7E9qLjKkmgQ_dOouLcZ1_8WMR-_RgdXCb52mTQ,21774
+webscout-1.2.3.dist-info/WHEEL,sha256=oiQVh_5PnQM0E3gPdiz09WCNmwiHDMaGer_elqB3coM,92
+webscout-1.2.3.dist-info/entry_points.txt,sha256=8-93eRslYrzTHs5E-6yFRJrve00C9q-SkXJD113jzRY,197
+webscout-1.2.3.dist-info/top_level.txt,sha256=OD5YKy6Y3hldL7SmuxsiEDxAG4LgdSSWwzYk22MF9fk,18
+webscout-1.2.3.dist-info/RECORD,,

{webscout-1.2.1.dist-info → webscout-1.2.3.dist-info}/top_level.txt

@@ -1 +1,2 @@
+DeepWEBS
 webscout

webscout-1.2.1.dist-info/RECORD

@@ -1,20 +0,0 @@
-webscout/AI.py,sha256=CwUCeGnNRL9STd5bAZSyIiLysorBMu065HrkY8UCzAQ,49618
-webscout/AIbase.py,sha256=vQi2ougu5bG-QdmoYmxCQsOg7KTEgG7EF6nZh5qqUGw,2343
-webscout/AIutel.py,sha256=cvsuw57hq3GirAiT-PjqwhAiLPf1urOzDb2szJ4bwmo,24124
-webscout/HelpingAI.py,sha256=YeZw0zYVHMcBFFPNdd3_Ghpm9ebt_EScQjHO_IIs4lg,8103
-webscout/LLM.py,sha256=XByJPiATLA_57FBWKw18Xx_PGRCPOj-GJE96aQH1k2Y,3309
-webscout/__init__.py,sha256=RrvYG33maRS0U7J-M99FroQLzVkt_gxDJ6WZ0_BkmTk,398
-webscout/__main__.py,sha256=ZtTRgsRjUi2JOvYFLF1ZCh55Sdoz94I-BS-TlJC7WDU,126
-webscout/cli.py,sha256=F888fdrFUQgczMBN4yMOSf6Nh-IbvkqpPhDsbnA2FtQ,17059
-webscout/exceptions.py,sha256=4AOO5wexeL96nvUS-badcckcwrPS7UpZyAgB9vknHZE,276
-webscout/models.py,sha256=5iQIdtedT18YuTZ3npoG7kLMwcrKwhQ7928dl_7qZW0,692
-webscout/utils.py,sha256=c_98M4oqpb54pUun3fpGGlCerFD6ZHUbghyp5b7Mwgo,2605
-webscout/version.py,sha256=O7Fj-NiGjQvXFncfoqksmWe28FBjunBGo8HwmRXvalw,25
-webscout/webscout_search.py,sha256=3_lli-hDb8_kCGwscK29xuUcOS833ROgpNhDzrxh0dk,3085
-webscout/webscout_search_async.py,sha256=Y5frH0k3hLqBCR-8dn7a_b7EvxdYxn6wHiKl3jWosE0,40670
-webscout-1.2.1.dist-info/LICENSE.md,sha256=mRVwJuT4SXC5O93BFdsfWBjlXjGn2Np90Zm5SocUzM0,3150
-webscout-1.2.1.dist-info/METADATA,sha256=FY50l_qZzzwo9fGwK6WFBLAEaDS0Db0AFVfcODFuDOA,24121
-webscout-1.2.1.dist-info/WHEEL,sha256=oiQVh_5PnQM0E3gPdiz09WCNmwiHDMaGer_elqB3coM,92
-webscout-1.2.1.dist-info/entry_points.txt,sha256=8-93eRslYrzTHs5E-6yFRJrve00C9q-SkXJD113jzRY,197
-webscout-1.2.1.dist-info/top_level.txt,sha256=nYIw7OKBQDr_Z33IzZUKidRD3zQEo8jOJYkMVMeN334,9
-webscout-1.2.1.dist-info/RECORD,,