pkscreener 0.46.20250219.725__tar.gz → 0.46.20250220.726__tar.gz

{pkscreener-0.46.20250219.725 → pkscreener-0.46.20250220.726}/PKG-INFO

@@ -1,9 +1,9 @@
 Metadata-Version: 2.2
 Name: pkscreener
-Version: 0.46.20250219.725
+Version: 0.46.20250220.726
 Summary: A Python-based stock screener for NSE, India with alerts to Telegram Channel (pkscreener)
 Home-page: https://github.com/pkjmesra/pkscreener
-Download-URL: https://github.com/pkjmesra/pkscreener/archive/v0.46.20250219.725.zip
+Download-URL: https://github.com/pkjmesra/pkscreener/archive/v0.46.20250220.726.zip
 Author: pkjmesra
 Author-email: pkjmesra@gmail.com
 License: OSI Approved (MIT)
@@ -48,7 +48,7 @@ Requires-Dist: tensorflow==2.16.1
 Requires-Dist: urllib3
 Requires-Dist: vectorbt
 Requires-Dist: xlsxwriter
-Requires-Dist: yfinance==0.2.28
+Requires-Dist: yfinance==0.2.54
 Requires-Dist: advanced_ta
 Dynamic: author
 Dynamic: author-email
@@ -392,15 +392,15 @@ After you have finished the run, go to that copied path, zip the contents of the
 [MADE-IN-INDIA-badge]: https://img.shields.io/badge/MADE%20WITH%20%E2%9D%A4%20IN-INDIA-orange
 [MADE-IN-INDIA]: https://en.wikipedia.org/wiki/India
 [Windows-badge]: https://img.shields.io/badge/Windows-0078D6?logo=windows&logoColor=white
-[Windows]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.724/pkscreenercli.exe
+[Windows]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.725/pkscreenercli.exe
 [Linux-badge_x64]: https://img.shields.io/badge/Linux(x64)-FCC624?logo=linux&logoColor=black
-[Linux_x64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.724/pkscreenercli_x64.bin
+[Linux_x64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.725/pkscreenercli_x64.bin
 [Linux-badge_arm64]: https://img.shields.io/badge/Linux(arm64)-FCC624?logo=linux&logoColor=black
-[Linux_arm64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.724/pkscreenercli_arm64.bin
+[Linux_arm64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.725/pkscreenercli_arm64.bin
 [Mac OS-badge_x64]: https://img.shields.io/badge/mac%20os(x64)-D3D3D3?logo=apple&logoColor=000000
-[Mac OS_x64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.724/pkscreenercli_x64.run
+[Mac OS_x64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.725/pkscreenercli_x64.run
 [Mac OS-badge_arm64]: https://img.shields.io/badge/mac%20os(arm64)-D3D3D3?logo=apple&logoColor=000000
-[Mac OS_arm64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.724/pkscreenercli_arm64.run
+[Mac OS_arm64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.725/pkscreenercli_arm64.run
 [GitHub release (latest by date)-badge]: https://img.shields.io/github/v/release/pkjmesra/PKScreener
 [GitHub release (latest by date)]: https://github.com/pkjmesra/PKScreener/releases/latest
 [pypi-badge]: https://img.shields.io/pypi/v/pkscreener.svg?style=flat-square

{pkscreener-0.46.20250219.725 → pkscreener-0.46.20250220.726}/README.md

@@ -328,15 +328,15 @@ After you have finished the run, go to that copied path, zip the contents of the
 [MADE-IN-INDIA-badge]: https://img.shields.io/badge/MADE%20WITH%20%E2%9D%A4%20IN-INDIA-orange
 [MADE-IN-INDIA]: https://en.wikipedia.org/wiki/India
 [Windows-badge]: https://img.shields.io/badge/Windows-0078D6?logo=windows&logoColor=white
-[Windows]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.724/pkscreenercli.exe
+[Windows]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.725/pkscreenercli.exe
 [Linux-badge_x64]: https://img.shields.io/badge/Linux(x64)-FCC624?logo=linux&logoColor=black
-[Linux_x64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.724/pkscreenercli_x64.bin
+[Linux_x64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.725/pkscreenercli_x64.bin
 [Linux-badge_arm64]: https://img.shields.io/badge/Linux(arm64)-FCC624?logo=linux&logoColor=black
-[Linux_arm64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.724/pkscreenercli_arm64.bin
+[Linux_arm64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.725/pkscreenercli_arm64.bin
 [Mac OS-badge_x64]: https://img.shields.io/badge/mac%20os(x64)-D3D3D3?logo=apple&logoColor=000000
-[Mac OS_x64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.724/pkscreenercli_x64.run
+[Mac OS_x64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.725/pkscreenercli_x64.run
 [Mac OS-badge_arm64]: https://img.shields.io/badge/mac%20os(arm64)-D3D3D3?logo=apple&logoColor=000000
-[Mac OS_arm64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.724/pkscreenercli_arm64.run
+[Mac OS_arm64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.725/pkscreenercli_arm64.run
 [GitHub release (latest by date)-badge]: https://img.shields.io/github/v/release/pkjmesra/PKScreener
 [GitHub release (latest by date)]: https://github.com/pkjmesra/PKScreener/releases/latest
 [pypi-badge]: https://img.shields.io/pypi/v/pkscreener.svg?style=flat-square

{pkscreener-0.46.20250219.725 → pkscreener-0.46.20250220.726}/pkscreener/README.txt

@@ -328,15 +328,15 @@ After you have finished the run, go to that copied path, zip the contents of the
 [MADE-IN-INDIA-badge]: https://img.shields.io/badge/MADE%20WITH%20%E2%9D%A4%20IN-INDIA-orange
 [MADE-IN-INDIA]: https://en.wikipedia.org/wiki/India
 [Windows-badge]: https://img.shields.io/badge/Windows-0078D6?logo=windows&logoColor=white
-[Windows]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.724/pkscreenercli.exe
+[Windows]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.725/pkscreenercli.exe
 [Linux-badge_x64]: https://img.shields.io/badge/Linux(x64)-FCC624?logo=linux&logoColor=black
-[Linux_x64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.724/pkscreenercli_x64.bin
+[Linux_x64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.725/pkscreenercli_x64.bin
 [Linux-badge_arm64]: https://img.shields.io/badge/Linux(arm64)-FCC624?logo=linux&logoColor=black
-[Linux_arm64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.724/pkscreenercli_arm64.bin
+[Linux_arm64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.725/pkscreenercli_arm64.bin
 [Mac OS-badge_x64]: https://img.shields.io/badge/mac%20os(x64)-D3D3D3?logo=apple&logoColor=000000
-[Mac OS_x64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.724/pkscreenercli_x64.run
+[Mac OS_x64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.725/pkscreenercli_x64.run
 [Mac OS-badge_arm64]: https://img.shields.io/badge/mac%20os(arm64)-D3D3D3?logo=apple&logoColor=000000
-[Mac OS_arm64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.724/pkscreenercli_arm64.run
+[Mac OS_arm64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.725/pkscreenercli_arm64.run
 [GitHub release (latest by date)-badge]: https://img.shields.io/github/v/release/pkjmesra/PKScreener
 [GitHub release (latest by date)]: https://github.com/pkjmesra/PKScreener/releases/latest
 [pypi-badge]: https://img.shields.io/pypi/v/pkscreener.svg?style=flat-square

{pkscreener-0.46.20250219.725 → pkscreener-0.46.20250220.726}/pkscreener/classes/AssetsManager.py

@@ -265,8 +265,10 @@ class PKAssetsManager:
         return cache_file
 
     @Halo(text='  [+] Downloading fresh data from Data Providers...', spinner='dots')
-    def downloadLatestData(stockDict,configManager,stockCodes=[],exchangeSuffix=".NS",downloadOnly=False):
-        numStocksPerIteration = (int(len(stockCodes)/int(len(stockCodes)/10)) if len(stockCodes) >= 10 else len(stockCodes)) + 1
+    def downloadLatestData(stockDict,configManager,stockCodes=[],exchangeSuffix=".NS",downloadOnly=False,numStocksPerIteration=0):
+        # if numStocksPerIteration == 0:
+        maxParallelProcesses = 17
+        numStocksPerIteration = (int(len(stockCodes)/int(len(stockCodes)/maxParallelProcesses)) if len(stockCodes) >= maxParallelProcesses else len(stockCodes)) + 1
         queueCounter = 0
         iterations = int(len(stockCodes)/numStocksPerIteration) + 1
         tasksList = []
@@ -293,10 +295,10 @@ class PKAssetsManager:
                                         minAcceptableCompletionPercentage=(100 if downloadOnly else 100),
                                         showProgressBars=configManager.logsEnabled)
             for task in tasksList:
-                if task.result is not None:
+                if task.result is not None and isinstance(task.result,pd.DataFrame) and not task.result.empty:
                     for stock in task.userData:
                         taskResult = task.result.get(f"{stock}{exchangeSuffix}")
-                        if taskResult is not None:
+                        if taskResult is not None and isinstance(taskResult,pd.DataFrame) and not taskResult.empty:
                             stockDict[stock] = taskResult.to_dict("split")
                             processedStocks.append(stock)
         leftOutStocks = list(set(stockCodes)-set(processedStocks))
@@ -332,10 +334,10 @@ class PKAssetsManager:
         # stockCodes is not None mandates that we start our work based on the downloaded data from yesterday
         if (stockCodes is not None and len(stockCodes) > 0) and (isTrading or downloadOnly):
             recentDownloadFromOriginAttempted = True
-            stockDict, leftOutStocks = PKAssetsManager.downloadLatestData(stockDict,configManager,stockCodes,exchangeSuffix=exchangeSuffix,downloadOnly=downloadOnly)
+            stockDict, leftOutStocks = PKAssetsManager.downloadLatestData(stockDict,configManager,stockCodes,exchangeSuffix=exchangeSuffix,downloadOnly=downloadOnly,numStocksPerIteration=len(stockCodes) if stockCodes is not None else 0)
             if len(leftOutStocks) > int(len(stockCodes)*0.05):
                 # More than 5 % of stocks are still remaining
-                stockDict, _ = PKAssetsManager.downloadLatestData(stockDict,configManager,leftOutStocks,exchangeSuffix=exchangeSuffix,downloadOnly=downloadOnly)
+                stockDict, _ = PKAssetsManager.downloadLatestData(stockDict,configManager,leftOutStocks,exchangeSuffix=exchangeSuffix,downloadOnly=downloadOnly,numStocksPerIteration=len(leftOutStocks) if leftOutStocks is not None else 0)
             # return stockDict
         if downloadOnly or isTrading:
             # We don't want to download from local stale pkl file or stale file at server
@@ -366,7 +368,7 @@ class PKAssetsManager:
                 + colorText.END
             )
         if not stockDataLoaded and not recentDownloadFromOriginAttempted:
-            stockDict, _ = PKAssetsManager.downloadLatestData(stockDict,configManager,stockCodes,exchangeSuffix=exchangeSuffix,downloadOnly=downloadOnly)
+            stockDict, _ = PKAssetsManager.downloadLatestData(stockDict,configManager,stockCodes,exchangeSuffix=exchangeSuffix,downloadOnly=downloadOnly,numStocksPerIteration=len(stockCodes) if stockCodes is not None else 0)
         # See if we need to save stock data
         stockDataLoaded = stockDataLoaded or (len(stockDict) > 0 and (len(stockDict) != initialLoadCount))
         if stockDataLoaded:

{pkscreener-0.46.20250219.725 → pkscreener-0.46.20250220.726}/pkscreener/classes/Fetcher.py

@@ -27,16 +27,21 @@ import os
 import sys
 import warnings
 
+from time import sleep
 warnings.simplefilter("ignore", DeprecationWarning)
 warnings.simplefilter("ignore", FutureWarning)
 import pandas as pd
 import yfinance as yf
 from yfinance import shared
-# from yfinance.exceptions import YFPricesMissingError, YFInvalidPeriodError
-class YFPricesMissingError(Exception):
-    pass
-class YFInvalidPeriodError(Exception):
-    pass
+# from yfinance.const import USER_AGENTS
+from PKDevTools.classes.Utils import USER_AGENTS
+from yfinance.data import YfData
+import random
+from yfinance.exceptions import YFPricesMissingError, YFInvalidPeriodError, YFRateLimitError
+# class YFPricesMissingError(Exception):
+#     pass
+# class YFInvalidPeriodError(Exception):
+#     pass
 from concurrent.futures import ThreadPoolExecutor
 from PKDevTools.classes.PKDateUtilities import PKDateUtilities
 from PKDevTools.classes.ColorText import colorText
@@ -94,7 +99,8 @@ class screenerStockDataFetcher(nseStockDataFetcher):
         printCounter=False,
         start=None, 
         end=None,
-        exchangeSuffix=".NS"
+        exchangeSuffix=".NS",
+        attempt = 0
     ):
         if isinstance(stockCode,list):
             if len(exchangeSuffix) > 0:
@@ -117,6 +123,8 @@ class screenerStockDataFetcher(nseStockDataFetcher):
         data = None
         with SuppressOutput(suppress_stdout=(not printCounter), suppress_stderr=(not printCounter)):
             try:
+                # YfData.user_agent_headers = {
+                #     'User-Agent': random.choice(USER_AGENTS)}
                 data = yf.download(
                     tickers=stockCode,
                     period=period,
@@ -127,7 +135,8 @@ class screenerStockDataFetcher(nseStockDataFetcher):
                     group_by='ticker',
                     timeout=self.configManager.generalTimeout/4,
                     start=start,
-                    end=end
+                    end=end,
+                    auto_adjust=True
                 )
                 if isinstance(stockCode,str):
                     if (data is None or data.empty):
@@ -142,8 +151,13 @@ class screenerStockDataFetcher(nseStockDataFetcher):
                                     recommendedPeriod = str(err).split("[")[1].split("]")[0].split(",")[-1].strip()
                                 recommendedPeriod = recommendedPeriod.replace("'","").replace("\"","")
                                 # default_logger().debug(f"Sending request again for {ticker} with period:{recommendedPeriod}")
-                                data = self.fetchStockData(stockCode=ticker,period=recommendedPeriod,duration=duration,printCounter=printCounter, start=start,end=end)
+                                data = self.fetchStockData(stockCode=ticker,period=period,duration=duration,printCounter=printCounter, start=start,end=end,proxyServer=proxyServer,)
                                 return data
+                            elif "YFRateLimitError" in err:
+                                if attempt <= 2:
+                                    default_logger().debug(f"YFRateLimitError Hit! Going for attempt : {attempt+1}")
+                                    # sleep(attempt*1) # Exponential backoff
+                                    # return self.fetchStockData(stockCode=stockCode,period=period,duration=duration,printCounter=printCounter, start=start,end=end,screenResultsCounter=screenResultsCounter,screenCounter=screenCounter,totalSymbols=totalSymbols,exchangeSuffix=exchangeSuffix,attempt=attempt+1)
                     else:
                         multiIndex = data.keys()
                         if isinstance(multiIndex, pd.MultiIndex):
@@ -151,9 +165,25 @@ class screenerStockDataFetcher(nseStockDataFetcher):
                             # we'd have received a multiindex dataframe
                             listStockCodes = multiIndex.get_level_values(0)
                             data = data.get(listStockCodes[0])
+                else:
+                    if (data is None or data.empty):
+                        if len(shared._ERRORS) > 0:
+                            default_logger().debug(shared._ERRORS)
+                        for ticker in shared._ERRORS:
+                            err = shared._ERRORS.get(ticker)
+                            if "YFRateLimitError" in err:
+                                if attempt <= 2:
+                                    default_logger().debug(f"YFRateLimitError Hit! Going for attempt : {attempt+1}")
+                                    # sleep(attempt*2) # Exponential backoff
+                                    # return self.fetchStockData(stockCode=stockCode,period=period,duration=duration,printCounter=printCounter, start=start,end=end,screenResultsCounter=screenResultsCounter,screenCounter=screenCounter,totalSymbols=totalSymbols,exchangeSuffix=exchangeSuffix,attempt=attempt+1)
             except (KeyError,YFPricesMissingError) as e: # pragma: no cover
                 default_logger().debug(e,exc_info=True)
                 pass
+            except YFRateLimitError as e:
+                if attempt <= 2:
+                    default_logger().debug(f"YFRateLimitError Hit! Going for attempt : {attempt+1}")
+                    # sleep(attempt*2) # Exponential backoff
+                    # return self.fetchStockData(stockCode=stockCode,period=period,duration=duration,printCounter=printCounter, start=start,end=end,screenResultsCounter=screenResultsCounter,screenCounter=screenCounter,totalSymbols=totalSymbols,exchangeSuffix=exchangeSuffix,attempt=attempt+1)
             except (YFInvalidPeriodError,Exception) as e: # pragma: no cover
                 default_logger().debug(e,exc_info=True)                    
         if printCounter and type(screenCounter) != int:

pkscreener-0.46.20250220.726/pkscreener/classes/__init__.py

@@ -0,0 +1 @@
+VERSION='0.46.20250220.726'

{pkscreener-0.46.20250219.725 → pkscreener-0.46.20250220.726}/pkscreener/requirements.txt

@@ -37,7 +37,7 @@ tensorflow==2.16.1 # https://github.com/tensorflow/tensorflow/issues/62075
 urllib3 #>=1.26.20
 vectorbt #>=0.26.2
 xlsxwriter #>=3.2.0
-yfinance==0.2.28 #>=0.2.44 #==0.1.87
+yfinance==0.2.54 #>=0.2.44 #==0.1.87
 # windows-curses; "windows" in sys.platform
 # https://github.com/pkjmesra/PKScreener/blob/main/.github/dependencies/TA_Lib-0.4.28-cp311-cp311-win_amd64.whl; "windows" in sys.platform
 

{pkscreener-0.46.20250219.725 → pkscreener-0.46.20250220.726}/pkscreener.egg-info/PKG-INFO

@@ -1,9 +1,9 @@
 Metadata-Version: 2.2
 Name: pkscreener
-Version: 0.46.20250219.725
+Version: 0.46.20250220.726
 Summary: A Python-based stock screener for NSE, India with alerts to Telegram Channel (pkscreener)
 Home-page: https://github.com/pkjmesra/pkscreener
-Download-URL: https://github.com/pkjmesra/pkscreener/archive/v0.46.20250219.725.zip
+Download-URL: https://github.com/pkjmesra/pkscreener/archive/v0.46.20250220.726.zip
 Author: pkjmesra
 Author-email: pkjmesra@gmail.com
 License: OSI Approved (MIT)
@@ -48,7 +48,7 @@ Requires-Dist: tensorflow==2.16.1
 Requires-Dist: urllib3
 Requires-Dist: vectorbt
 Requires-Dist: xlsxwriter
-Requires-Dist: yfinance==0.2.28
+Requires-Dist: yfinance==0.2.54
 Requires-Dist: advanced_ta
 Dynamic: author
 Dynamic: author-email
@@ -392,15 +392,15 @@ After you have finished the run, go to that copied path, zip the contents of the
 [MADE-IN-INDIA-badge]: https://img.shields.io/badge/MADE%20WITH%20%E2%9D%A4%20IN-INDIA-orange
 [MADE-IN-INDIA]: https://en.wikipedia.org/wiki/India
 [Windows-badge]: https://img.shields.io/badge/Windows-0078D6?logo=windows&logoColor=white
-[Windows]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.724/pkscreenercli.exe
+[Windows]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.725/pkscreenercli.exe
 [Linux-badge_x64]: https://img.shields.io/badge/Linux(x64)-FCC624?logo=linux&logoColor=black
-[Linux_x64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.724/pkscreenercli_x64.bin
+[Linux_x64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.725/pkscreenercli_x64.bin
 [Linux-badge_arm64]: https://img.shields.io/badge/Linux(arm64)-FCC624?logo=linux&logoColor=black
-[Linux_arm64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.724/pkscreenercli_arm64.bin
+[Linux_arm64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.725/pkscreenercli_arm64.bin
 [Mac OS-badge_x64]: https://img.shields.io/badge/mac%20os(x64)-D3D3D3?logo=apple&logoColor=000000
-[Mac OS_x64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.724/pkscreenercli_x64.run
+[Mac OS_x64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.725/pkscreenercli_x64.run
 [Mac OS-badge_arm64]: https://img.shields.io/badge/mac%20os(arm64)-D3D3D3?logo=apple&logoColor=000000
-[Mac OS_arm64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.724/pkscreenercli_arm64.run
+[Mac OS_arm64]: https://github.com/pkjmesra/PKScreener/releases/download/0.46.20250219.725/pkscreenercli_arm64.run
 [GitHub release (latest by date)-badge]: https://img.shields.io/github/v/release/pkjmesra/PKScreener
 [GitHub release (latest by date)]: https://github.com/pkjmesra/PKScreener/releases/latest
 [pypi-badge]: https://img.shields.io/pypi/v/pkscreener.svg?style=flat-square

{pkscreener-0.46.20250219.725 → pkscreener-0.46.20250220.726}/pkscreener.egg-info/requires.txt

@@ -30,5 +30,5 @@ tensorflow==2.16.1
 urllib3
 vectorbt
 xlsxwriter
-yfinance==0.2.28
+yfinance==0.2.54
 advanced_ta

pkscreener-0.46.20250219.725/pkscreener/classes/__init__.py

@@ -1 +0,0 @@
-VERSION='0.46.20250219.725'