StreamingCommunity 3.0.6__tar.gz → 3.0.7__tar.gz

{streamingcommunity-3.0.6/StreamingCommunity.egg-info → streamingcommunity-3.0.7}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: StreamingCommunity
-Version: 3.0.6
+Version: 3.0.7
 Home-page: https://github.com/Lovi-0/StreamingCommunity
 Author: Lovi-0
 Project-URL: Bug Reports, https://github.com/Lovi-0/StreamingCommunity/issues
@@ -506,7 +506,11 @@ To enable qBittorrent integration, follow the setup guide [here](https://github.
     "REQUESTS": {
         "verify": false,
         "timeout": 20,
-        "max_retry": 8
+        "max_retry": 8,
+        "proxy": {
+            "http": "http://username:password@host:port",
+            "https": "https://username:password@host:port"
+        }
     }
 }
 ```
@@ -514,6 +518,22 @@ To enable qBittorrent integration, follow the setup guide [here](https://github.
 - `verify`: Verifies SSL certificates
 - `timeout`: Maximum timeout (in seconds) for each request
 - `max_retry`: Number of retry attempts per segment during M3U8 index download
+- `proxy`: Proxy configuration for HTTP/HTTPS requests
+  * Set to empty string `""` to disable proxies (default)
+  * Example with authentication:
+    ```json
+    "proxy": {
+        "http": "http://username:password@host:port",
+        "https": "https://username:password@host:port"
+    }
+    ```
+  * Example without authentication:
+    ```json
+    "proxy": {
+        "http": "http://host:port",
+        "https": "https://host:port"
+    }
+    ```
 </details>
 
 <details>
@@ -764,26 +784,24 @@ The `run-container` command mounts also the `config.json` file, so any change to
 The bot was created to replace terminal commands and allow interaction via Telegram. Each download runs within a screen session, enabling multiple downloads to run simultaneously.
 
 To run the bot in the background, simply start it inside a screen session and then press Ctrl + A, followed by D, to detach from the session without stopping the bot.
-</details>
-
-<details>
-<summary>🤖 Bot Commands</summary>
 
 Command Functions:
 
 🔹 /start – Starts a new search for a download. This command performs the same operations as manually running the script in the terminal with test_run.py.
 
 🔹 /list – Displays the status of active downloads, with options to:
-- Stop an incorrect download using /stop <ID>
-- View the real-time output of a download using /screen <ID>
+
+Stop an incorrect download using /stop <ID>.
+
+View the real-time output of a download using /screen <ID>.
 
 ⚠ Warning: If a download is interrupted, incomplete files may remain in the folder specified in config.json. These files must be deleted manually to avoid storage or management issues.
-</details>
 
-<details>
-<summary>🔧 Environment Setup</summary>
+🛠 Configuration: Currently, the bot's settings are stored in the config.json file, which is located in the same directory as the telegram_bot.py script.
+
+## .env Example:
 
-Create an `.env` file with:
+You need to create an .env file and enter your Telegram token and user ID to authorize only one user to use it
 
 ```
 TOKEN_TELEGRAM=IlTuo2131TOKEN$12D3Telegram

{streamingcommunity-3.0.6 → streamingcommunity-3.0.7}/README.md

@@ -470,7 +470,11 @@ To enable qBittorrent integration, follow the setup guide [here](https://github.
     "REQUESTS": {
         "verify": false,
         "timeout": 20,
-        "max_retry": 8
+        "max_retry": 8,
+        "proxy": {
+            "http": "http://username:password@host:port",
+            "https": "https://username:password@host:port"
+        }
     }
 }
 ```
@@ -478,6 +482,22 @@ To enable qBittorrent integration, follow the setup guide [here](https://github.
 - `verify`: Verifies SSL certificates
 - `timeout`: Maximum timeout (in seconds) for each request
 - `max_retry`: Number of retry attempts per segment during M3U8 index download
+- `proxy`: Proxy configuration for HTTP/HTTPS requests
+  * Set to empty string `""` to disable proxies (default)
+  * Example with authentication:
+    ```json
+    "proxy": {
+        "http": "http://username:password@host:port",
+        "https": "https://username:password@host:port"
+    }
+    ```
+  * Example without authentication:
+    ```json
+    "proxy": {
+        "http": "http://host:port",
+        "https": "https://host:port"
+    }
+    ```
 </details>
 
 <details>
@@ -728,26 +748,24 @@ The `run-container` command mounts also the `config.json` file, so any change to
 The bot was created to replace terminal commands and allow interaction via Telegram. Each download runs within a screen session, enabling multiple downloads to run simultaneously.
 
 To run the bot in the background, simply start it inside a screen session and then press Ctrl + A, followed by D, to detach from the session without stopping the bot.
-</details>
-
-<details>
-<summary>🤖 Bot Commands</summary>
 
 Command Functions:
 
 🔹 /start – Starts a new search for a download. This command performs the same operations as manually running the script in the terminal with test_run.py.
 
 🔹 /list – Displays the status of active downloads, with options to:
-- Stop an incorrect download using /stop <ID>
-- View the real-time output of a download using /screen <ID>
+
+Stop an incorrect download using /stop <ID>.
+
+View the real-time output of a download using /screen <ID>.
 
 ⚠ Warning: If a download is interrupted, incomplete files may remain in the folder specified in config.json. These files must be deleted manually to avoid storage or management issues.
-</details>
 
-<details>
-<summary>🔧 Environment Setup</summary>
+🛠 Configuration: Currently, the bot's settings are stored in the config.json file, which is located in the same directory as the telegram_bot.py script.
+
+## .env Example:
 
-Create an `.env` file with:
+You need to create an .env file and enter your Telegram token and user ID to authorize only one user to use it
 
 ```
 TOKEN_TELEGRAM=IlTuo2131TOKEN$12D3Telegram

streamingcommunity-3.0.7/StreamingCommunity/Api/Player/maxstream.py

@@ -0,0 +1,141 @@
+# 05.07.24
+# NOTE: NOT USED
+
+import re
+import logging
+
+
+# External libraries
+import httpx
+import jsbeautifier
+from bs4 import BeautifulSoup
+
+
+# Internal utilities
+from StreamingCommunity.Util.config_json import config_manager
+from StreamingCommunity.Util.headers import get_userAgent
+
+
+# Variable
+MAX_TIMEOUT = config_manager.get_int("REQUESTS", "timeout")
+
+
+class VideoSource:
+    def __init__(self, url: str):
+        """
+        Sets up the video source with the provided URL.
+
+        Parameters:
+            - url (str): The URL of the video.
+        """
+        self.url = url
+        self.redirect_url = None
+        self.maxstream_url = None
+        self.m3u8_url = None
+        self.headers = {'user-agent': get_userAgent()}
+
+    def get_redirect_url(self):
+        """
+        Sends a request to the initial URL and extracts the redirect URL.
+        """
+        try:
+            response = httpx.get(self.url, headers=self.headers, follow_redirects=True, timeout=MAX_TIMEOUT)
+            response.raise_for_status()
+
+            # Extract the redirect URL from the HTML
+            soup = BeautifulSoup(response.text, "html.parser")
+            self.redirect_url = soup.find("div", id="iframen1").get("data-src")
+            logging.info(f"Redirect URL: {self.redirect_url}")
+
+            return self.redirect_url
+        
+        except Exception as e:
+            logging.error(f"Error parsing HTML: {e}")
+            raise
+
+    def get_maxstream_url(self):
+        """
+        Sends a request to the redirect URL and extracts the Maxstream URL.
+        """
+        try:
+            response = httpx.get(self.redirect_url, headers=self.headers, follow_redirects=True, timeout=MAX_TIMEOUT)
+            response.raise_for_status()
+
+            # Extract the Maxstream URL from the HTML
+            soup = BeautifulSoup(response.text, "html.parser")
+            maxstream_url = soup.find("a")
+            
+            if maxstream_url is None:
+
+                # If no anchor tag is found, try the alternative method
+                logging.warning("Anchor tag not found. Trying the alternative method.")
+                headers = {
+                    'origin': 'https://stayonline.pro',
+                    'user-agent': get_userAgent(),
+                    'x-requested-with': 'XMLHttpRequest',
+                }
+
+                # Make request to stayonline api
+                data = {'id': self.redirect_url.split("/")[-2], 'ref': ''}
+                response = httpx.post('https://stayonline.pro/ajax/linkEmbedView.php', headers=headers, data=data)
+                response.raise_for_status()
+                uprot_url = response.json()['data']['value']
+
+                # Retry getting maxtstream url
+                response = httpx.get(uprot_url, headers=self.headers, follow_redirects=True, timeout=MAX_TIMEOUT)
+                response.raise_for_status()
+                soup = BeautifulSoup(response.text, "html.parser")
+                maxstream_url = soup.find("a").get("href")
+                
+            else:
+                maxstream_url = maxstream_url.get("href")
+
+            self.maxstream_url = maxstream_url
+            logging.info(f"Maxstream URL: {self.maxstream_url}")
+
+            return self.maxstream_url
+        
+        except Exception as e:
+            logging.error(f"Error during the request: {e}")
+            raise
+
+    def get_m3u8_url(self):
+        """
+        Sends a request to the Maxstream URL and extracts the .m3u8 file URL.
+        """
+        try:
+            response = httpx.get(self.maxstream_url, headers=self.headers, follow_redirects=True, timeout=MAX_TIMEOUT)
+            response.raise_for_status() 
+            soup = BeautifulSoup(response.text, "html.parser")
+
+            # Iterate over all script tags in the HTML
+            for script in soup.find_all("script"):
+                if "eval(function(p,a,c,k,e,d)" in script.text:
+
+                    # Execute the script using
+                    data_js = jsbeautifier.beautify(script.text)
+
+                    # Extract the .m3u8 URL from the script's output
+                    match = re.search(r'sources:\s*\[\{\s*src:\s*"([^"]+)"', data_js)
+
+                    if match:
+                        self.m3u8_url = match.group(1)
+                        logging.info(f"M3U8 URL: {self.m3u8_url}")
+                        break
+
+                    else:
+                        logging.error("Failed to find M3U8 URL: No match found")
+
+            return self.m3u8_url
+
+        except Exception as e:
+            logging.error(f"Error executing the Node.js script: {e}")
+            raise
+
+    def get_playlist(self):
+        """
+        Executes the entire flow to obtain the final .m3u8 file URL.
+        """
+        self.get_redirect_url()
+        self.get_maxstream_url()
+        return self.get_m3u8_url()

{streamingcommunity-3.0.6 → streamingcommunity-3.0.7}/StreamingCommunity/Api/Player/vixcloud.py

@@ -1,6 +1,6 @@
 # 01.03.24
 
-import sys
+import time
 import logging
 from urllib.parse import urlparse, parse_qs, urlencode, urlunparse
 
@@ -24,7 +24,7 @@ console = Console()
 
 
 class VideoSource:
-    def __init__(self, url: str, is_series: bool, media_id: int = None):
+    def __init__(self, url: str, is_series: bool, media_id: int = None, proxy: str = None):
         """
         Initialize video source for streaming site.
         
@@ -35,6 +35,7 @@ class VideoSource:
         """
         self.headers = {'user-agent': get_userAgent()}
         self.url = url
+        self.proxy = proxy
         self.is_series = is_series
         self.media_id = media_id
         self.iframe_src = None
@@ -55,7 +56,7 @@ class VideoSource:
             }
 
         try:
-            response = httpx.get(f"{self.url}/iframe/{self.media_id}", params=params, timeout=MAX_TIMEOUT)
+            response = httpx.get(f"{self.url}/iframe/{self.media_id}", headers=self.headers, params=params, timeout=MAX_TIMEOUT, proxy=self.proxy)
             response.raise_for_status()
 
             # Parse response with BeautifulSoup to get iframe source
@@ -81,6 +82,7 @@ class VideoSource:
             self.window_video = WindowVideo(converter.get('video'))
             self.window_streams = StreamsCollection(converter.get('streams'))
             self.window_parameter = WindowParameter(converter.get('masterPlaylist'))
+            time.sleep(0.5)
 
         except Exception as e:
             logging.error(f"Error parsing script: {e}")

{streamingcommunity-3.0.6 → streamingcommunity-3.0.7}/StreamingCommunity/Api/Site/1337xx/__init__.py

@@ -24,7 +24,7 @@ indice = 3
 _useFor = "Torrent"
 _priority = 0
 _engineDownload = "Torrent"
-_deprecate = False
+_deprecate = True
 
 console = Console()
 msg = Prompt()
@@ -62,7 +62,7 @@ def search(string_to_search: str = None, get_onlyDatabase: bool = False, direct_
         return media_search_manager
 
     if len_database > 0:
-        select_title = get_select_title(table_show_manager, media_search_manager)
+        select_title = get_select_title(table_show_manager, media_search_manager, len_database)
         download_title(select_title)
 
     else:

{streamingcommunity-3.0.6 → streamingcommunity-3.0.7}/StreamingCommunity/Api/Site/altadefinizione/__init__.py

@@ -27,7 +27,7 @@ indice = 2
 _useFor = "Film_&_Serie"
 _priority = 0
 _engineDownload = "hls"
-_deprecate = True
+_deprecate = False
 
 msg = Prompt()
 console = Console()
@@ -110,7 +110,7 @@ def search(string_to_search: str = None, get_onlyDatabase: bool = False, direct_
         bot = get_bot_instance()
         
     if len_database > 0:
-        select_title = get_select_title(table_show_manager, media_search_manager)
+        select_title = get_select_title(table_show_manager, media_search_manager, len_database)
         process_search_result(select_title, selections)
     
     else:

{streamingcommunity-3.0.6 → streamingcommunity-3.0.7}/StreamingCommunity/Api/Site/altadefinizione/film.py

@@ -1,6 +1,7 @@
 # 16.03.25
 
 import os
+import re
 
 
 # External library
@@ -56,51 +57,30 @@ def download_film(select_title: MediaItem) -> str:
 
     start_message()
     console.print(f"[bold yellow]Download:[/bold yellow] [red]{site_constant.SITE_NAME}[/red] → [cyan]{select_title.name}[/cyan] \n")
-
-    # Extract mostraguarda link
+    
+    # Extract mostraguarda URL
     try:
         response = httpx.get(select_title.url, headers=get_headers(), timeout=10)
-        response.raise_for_status()
-
-    except Exception as e:
-        console.print(f"[red]Error fetching the page: {e}")
-
-        if site_constant.TELEGRAM_BOT:
-            bot.send_message(f"ERRORE\n\nErrore durante il recupero della pagina.\n\n{e}", None)
-        return None
+        soup = BeautifulSoup(response.text, 'html.parser')
+        iframes = soup.find_all('iframe')
+        mostraguarda = iframes[0]['src']
     
-    # Create mostraguarda url
-    soup = BeautifulSoup(response.text, "html.parser")
-    iframe_tag = soup.find_all("iframe")
-    url_mostraGuarda = iframe_tag[0].get('data-src')
-    if not url_mostraGuarda:
-        console.print("Error: data-src attribute not found in iframe.")
-        if site_constant.TELEGRAM_BOT:
-            bot.send_message(f"ERRORE\n\nErrore: attributo data-src non trovato nell'iframe", None)
+    except Exception as e:
+        console.print(f"[red]Site: {site_constant.SITE_NAME}, request error: {e}, get mostraguarda")
 
     # Extract supervideo URL
     try:
-        response = httpx.get(url_mostraGuarda, headers=get_headers(), timeout=10)
-        response.raise_for_status()
+        response = httpx.get(mostraguarda, headers=get_headers(), timeout=10)
+        soup = BeautifulSoup(response.text, 'html.parser')
+        pattern = r'//supervideo\.[^/]+/[a-z]/[a-zA-Z0-9]+'
+        supervideo_match = re.search(pattern, response.text)
+        supervideo_url = 'https:' + supervideo_match.group(0)
 
     except Exception as e:
-        console.print(f"[red]Error fetching mostraguarda link: {e}")
-        console.print("[yellow]Missing access credentials. This part of the code is still under development.")
-        if site_constant.TELEGRAM_BOT:
-            bot.send_message(f"ERRORE\n\nErrore durante il recupero del link mostra/guarda.\n\n{e}", None)
-            bot.send_message(f"ERRORE\n\nCredenziali di accesso mancanti.\nQuesta parte del codice è ancora in fase di sviluppo.", None)
-        return None
-
-    # Create supervio URL
-    soup = BeautifulSoup(response.text, "html.parser")
-    player_links = soup.find("ul", class_="_player-mirrors")
-    player_items = player_links.find_all("li")
-    supervideo_url = "https:" + player_items[0].get("data-link")
-    if not supervideo_url:
-        return None
+        console.print(f"[red]Site: {site_constant.SITE_NAME}, request error: {e}, get supervideo URL")
 
     # Init class
-    video_source = VideoSource(url=supervideo_url)
+    video_source = VideoSource(supervideo_url)
     master_playlist = video_source.get_playlist()
 
     # Define the filename and path for the downloaded film

{streamingcommunity-3.0.6 → streamingcommunity-3.0.7}/StreamingCommunity/Api/Site/animeunity/__init__.py

@@ -109,7 +109,7 @@ def search(string_to_search: str = None, get_onlyDatabase: bool = False, direct_
         bot = get_bot_instance()
 
     if len_database > 0:
-        select_title = get_select_title(table_show_manager, media_search_manager)
+        select_title = get_select_title(table_show_manager, media_search_manager,len_database)
         process_search_result(select_title, selections)
     
     else:

{streamingcommunity-3.0.6 → streamingcommunity-3.0.7}/StreamingCommunity/Api/Site/animeunity/util/ScrapeSerie.py

@@ -43,40 +43,38 @@ class ScrapeSerieAnime:
     def get_count_episodes(self):
         """
         Retrieve total number of episodes for the selected media.
+        This includes partial episodes (like episode 6.5).
         
         Returns:
-            int: Total episode count
+            int: Total episode count including partial episodes
         """
-        try:
-
-            response = httpx.get(
-                url=f"{self.url}/info_api/{self.media_id}/", 
-                headers=self.headers, 
-                timeout=max_timeout
-            )
-            response.raise_for_status()
-
-            # Parse JSON response and return episode count
-            return response.json()["episodes_count"]
-        
-        except Exception as e:
-            logging.error(f"Error fetching episode count: {e}")
-            return None
+        if self.episodes_cache is None:
+            self._fetch_all_episodes()
+            
+        if self.episodes_cache:
+            return len(self.episodes_cache)
+        return None
     
     def _fetch_all_episodes(self):
         """
         Fetch all episodes data at once and cache it
         """
         try:
-            all_episodes = []
-            count = self.get_count_episodes()
-            if not count:
-                return
+            # Get initial episode count
+            response = httpx.get(
+                url=f"{self.url}/info_api/{self.media_id}/",
+                headers=self.headers,
+                timeout=max_timeout
+            )
+            response.raise_for_status()
+            initial_count = response.json()["episodes_count"]
             
-            # Fetch episodes
+            all_episodes = []
             start_range = 1
-            while start_range <= count:
-                end_range = min(start_range + 119, count)
+            
+            # Fetch episodes in chunks
+            while start_range <= initial_count:
+                end_range = min(start_range + 119, initial_count)
                 
                 response = httpx.get(
                     url=f"{self.url}/info_api/{self.media_id}/1",

{streamingcommunity-3.0.6 → streamingcommunity-3.0.7}/StreamingCommunity/Api/Site/animeworld/__init__.py

@@ -75,7 +75,7 @@ def search(string_to_search: str = None, get_onlyDatabase: bool = False, direct_
         return media_search_manager
 
     if len_database > 0:
-        select_title = get_select_title(table_show_manager, media_search_manager)
+        select_title = get_select_title(table_show_manager, media_search_manager,len_database)
         process_search_result(select_title, selections)
     
     else:

streamingcommunity-3.0.7/StreamingCommunity/Api/Site/cb01new/__init__.py

@@ -0,0 +1,72 @@
+# 09.06.24
+
+from urllib.parse import quote_plus
+
+
+# External library
+from rich.console import Console
+from rich.prompt import Prompt
+
+
+# Internal utilities
+from StreamingCommunity.Api.Template import get_select_title
+from StreamingCommunity.Api.Template.config_loader import site_constant
+from StreamingCommunity.Api.Template.Class.SearchType import MediaItem
+
+
+# Logic class
+from .site import title_search, media_search_manager, table_show_manager
+from .film import download_film
+
+
+# Variable
+indice = -1
+_useFor = "Film"
+_priority = 0
+_engineDownload = "mp4"
+_deprecate = True
+
+msg = Prompt()
+console = Console()
+
+
+def process_search_result(select_title):
+    """
+    Handles the search result and initiates the download for either a film or series.
+    """
+    # !!! ADD TYPE DONT WORK FOR SERIE
+    download_film(select_title)
+
+def search(string_to_search: str = None, get_onlyDatabase: bool = False, direct_item: dict = None):
+    """
+    Main function of the application for search.
+
+    Parameters:
+        string_to_search (str, optional): String to search for
+        get_onylDatabase (bool, optional): If True, return only the database object
+        direct_item (dict, optional): Direct item to process (bypass search)
+    """
+    if direct_item:
+        select_title = MediaItem(**direct_item)
+        process_search_result(select_title)
+        return
+
+    if string_to_search is None:
+        string_to_search = msg.ask(f"\n[purple]Insert word to search in [green]{site_constant.SITE_NAME}").strip()
+
+    # Search on database
+    len_database = title_search(quote_plus(string_to_search))
+
+    ## If only the database is needed, return the manager
+    if get_onlyDatabase:
+        return media_search_manager
+    
+    if len_database > 0:
+        select_title = get_select_title(table_show_manager, media_search_manager,len_database)
+        process_search_result(select_title)
+        
+    else:
+
+        # If no results are found, ask again
+        console.print(f"\n[red]Nothing matching was found for[white]: [purple]{string_to_search}")
+        search()

streamingcommunity-3.0.7/StreamingCommunity/Api/Site/cb01new/film.py

@@ -0,0 +1,62 @@
+# 03.07.24
+
+import os
+
+
+# External library
+from rich.console import Console
+
+
+# Internal utilities
+from StreamingCommunity.Util.os import os_manager
+from StreamingCommunity.Util.message import start_message
+from StreamingCommunity.Lib.Downloader import HLS_Downloader
+
+
+# Logic class
+from StreamingCommunity.Api.Template.config_loader import site_constant
+from StreamingCommunity.Api.Template.Class.SearchType import MediaItem
+
+
+# Player
+from StreamingCommunity.Api.Player.maxstream import VideoSource
+
+
+# Variable
+console = Console()
+
+
+def download_film(select_title: MediaItem) -> str:
+    """
+    Downloads a film using the provided obj.
+
+    Parameters:
+        - select_title (MediaItem): The media item to be downloaded. This should be an instance of the MediaItem class, containing attributes like `name` and `url`.
+
+    Return:
+        - str: output path
+    """
+    start_message()
+    console.print(f"[bold yellow]Download:[/bold yellow] [red]{site_constant.SITE_NAME}[/red] → [cyan]{select_title.name}[/cyan] \n")
+
+    # Setup api manger
+    video_source = VideoSource(select_title.url)
+
+    # Define output path
+    title_name = os_manager.get_sanitize_file(select_title.name) +".mp4"
+    mp4_path = os.path.join(site_constant.MOVIE_FOLDER, title_name.replace(".mp4", ""))
+
+    # Get m3u8 master playlist
+    master_playlist = video_source.get_playlist()
+
+    # Download the film using the m3u8 playlist, and output filename
+    r_proc = HLS_Downloader(
+        m3u8_url=master_playlist, 
+        output_path=os.path.join(mp4_path, title_name)
+    ).start()
+
+    if r_proc['error'] is not None:
+        try: os.remove(r_proc['path'])
+        except: pass
+
+    return r_proc['path']