endpointscanner 7.3.1__tar.gz → 7.3.4__tar.gz

{endpointscanner-7.3.1 → endpointscanner-7.3.4}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: endpointscanner
-Version: 7.3.1
+Version: 7.3.4
 Summary: Website endpoint reconnaissance tool and rate limit tester that can bypass simple captchas and WAFs.
 Project-URL: Homepage, https://github.com/SphericalFlower52811/endpointscanner
 Project-URL: Issues, https://github.com/SphericalFlower52811/endpointscanner/issues
@@ -17,7 +17,7 @@ Requires-Dist: httpx[http2]>=0.27.0
 Requires-Dist: colorama>=0.4.6
 Dynamic: license-file
 
-# EndpointScanner: Website Endpoint Scanner and Rate Limit Tester For Websites (Version 7.3.1)
+# EndpointScanner: Website Endpoint Scanner and Rate Limit Tester (Version 7.3.4)
 
 A fast automated website reconnaissance tool that extracts endpoints, files, and even external links from websites. Automates IDOR and broken access control vulnerability testing through replacing variables with 1 in endpoints. Has a built in rate limit tester that can test on any endpoint, and can bypass simple WAFs/captchas and client-side SPAs.
 
@@ -70,7 +70,7 @@ Passable arguments:
 
 ## Installation
 
-You can install EndpointScanner via PyPI(global, recommended for Windows), Homebrew(MacOS), and Apt(Linux).
+You can install EndpointScanner via PyPI(global, recommended for Windows and Linux) or Homebrew(MacOS).
 
 ### Installation via PyPI (or pip)
 
@@ -178,18 +178,6 @@ After that, you will need to install chromium on playwright for the headless bro
 python3 -m playwright install chromium
 ```
 
-### Apt
-
-To install EndpointScanner via Apt (Linux), run these commands:
-
-```bash
-wget https://github.com/SphericalFlower52811/endpointscanner/releases/download/v7.3.1/endpointscanner_7.3.1-1_all.deb
-
-sudo dpkg -i endpointscanner_7.3.1-1_all.deb
-
-python3 -m playwright install chromium
-```
-
 ## Example Commands
 
 Example command to run to scan a site (show inaccessible endpoints, show assets, show progress as it finds endpoints, and show files that it got endpoints from):
@@ -263,9 +251,14 @@ Version 7.3 added:
 Version 7.3.1 added:
 
 - EndpointScanner now installable on:
-  - Linux via sudo apt
   - Homebrew
 
+Version 7.3.2 fixed a glitch showing robots.txt when it was not scanned.
+
+Version 7.3.3 was another minor patch and included a llms.txt for LLMs to digest.
+
+Version 7.3.4 fixed header for the variable S_HEADER, as it contained an invalid User-Agent Header.
+
 ## Plans for next version and the future
 
 Version 7.4:

{endpointscanner-7.3.1 → endpointscanner-7.3.4}/README.md

@@ -1,4 +1,4 @@
-# EndpointScanner: Website Endpoint Scanner and Rate Limit Tester For Websites (Version 7.3.1)
+# EndpointScanner: Website Endpoint Scanner and Rate Limit Tester (Version 7.3.4)
 
 A fast automated website reconnaissance tool that extracts endpoints, files, and even external links from websites. Automates IDOR and broken access control vulnerability testing through replacing variables with 1 in endpoints. Has a built in rate limit tester that can test on any endpoint, and can bypass simple WAFs/captchas and client-side SPAs.
 
@@ -51,7 +51,7 @@ Passable arguments:
 
 ## Installation
 
-You can install EndpointScanner via PyPI(global, recommended for Windows), Homebrew(MacOS), and Apt(Linux).
+You can install EndpointScanner via PyPI(global, recommended for Windows and Linux) or Homebrew(MacOS).
 
 ### Installation via PyPI (or pip)
 
@@ -159,18 +159,6 @@ After that, you will need to install chromium on playwright for the headless bro
 python3 -m playwright install chromium
 ```
 
-### Apt
-
-To install EndpointScanner via Apt (Linux), run these commands:
-
-```bash
-wget https://github.com/SphericalFlower52811/endpointscanner/releases/download/v7.3.1/endpointscanner_7.3.1-1_all.deb
-
-sudo dpkg -i endpointscanner_7.3.1-1_all.deb
-
-python3 -m playwright install chromium
-```
-
 ## Example Commands
 
 Example command to run to scan a site (show inaccessible endpoints, show assets, show progress as it finds endpoints, and show files that it got endpoints from):
@@ -244,9 +232,14 @@ Version 7.3 added:
 Version 7.3.1 added:
 
 - EndpointScanner now installable on:
-  - Linux via sudo apt
   - Homebrew
 
+Version 7.3.2 fixed a glitch showing robots.txt when it was not scanned.
+
+Version 7.3.3 was another minor patch and included a llms.txt for LLMs to digest.
+
+Version 7.3.4 fixed header for the variable S_HEADER, as it contained an invalid User-Agent Header.
+
 ## Plans for next version and the future
 
 Version 7.4:

{endpointscanner-7.3.1 → endpointscanner-7.3.4}/endpointscanner.egg-info/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: endpointscanner
-Version: 7.3.1
+Version: 7.3.4
 Summary: Website endpoint reconnaissance tool and rate limit tester that can bypass simple captchas and WAFs.
 Project-URL: Homepage, https://github.com/SphericalFlower52811/endpointscanner
 Project-URL: Issues, https://github.com/SphericalFlower52811/endpointscanner/issues
@@ -17,7 +17,7 @@ Requires-Dist: httpx[http2]>=0.27.0
 Requires-Dist: colorama>=0.4.6
 Dynamic: license-file
 
-# EndpointScanner: Website Endpoint Scanner and Rate Limit Tester For Websites (Version 7.3.1)
+# EndpointScanner: Website Endpoint Scanner and Rate Limit Tester (Version 7.3.4)
 
 A fast automated website reconnaissance tool that extracts endpoints, files, and even external links from websites. Automates IDOR and broken access control vulnerability testing through replacing variables with 1 in endpoints. Has a built in rate limit tester that can test on any endpoint, and can bypass simple WAFs/captchas and client-side SPAs.
 
@@ -70,7 +70,7 @@ Passable arguments:
 
 ## Installation
 
-You can install EndpointScanner via PyPI(global, recommended for Windows), Homebrew(MacOS), and Apt(Linux).
+You can install EndpointScanner via PyPI(global, recommended for Windows and Linux) or Homebrew(MacOS).
 
 ### Installation via PyPI (or pip)
 
@@ -178,18 +178,6 @@ After that, you will need to install chromium on playwright for the headless bro
 python3 -m playwright install chromium
 ```
 
-### Apt
-
-To install EndpointScanner via Apt (Linux), run these commands:
-
-```bash
-wget https://github.com/SphericalFlower52811/endpointscanner/releases/download/v7.3.1/endpointscanner_7.3.1-1_all.deb
-
-sudo dpkg -i endpointscanner_7.3.1-1_all.deb
-
-python3 -m playwright install chromium
-```
-
 ## Example Commands
 
 Example command to run to scan a site (show inaccessible endpoints, show assets, show progress as it finds endpoints, and show files that it got endpoints from):
@@ -263,9 +251,14 @@ Version 7.3 added:
 Version 7.3.1 added:
 
 - EndpointScanner now installable on:
-  - Linux via sudo apt
   - Homebrew
 
+Version 7.3.2 fixed a glitch showing robots.txt when it was not scanned.
+
+Version 7.3.3 was another minor patch and included a llms.txt for LLMs to digest.
+
+Version 7.3.4 fixed header for the variable S_HEADER, as it contained an invalid User-Agent Header.
+
 ## Plans for next version and the future
 
 Version 7.4:

{endpointscanner-7.3.1 → endpointscanner-7.3.4}/enumerateendpoint.py

@@ -40,7 +40,7 @@ PYODIDE_VFS_PRECISION_PATTERNS = [
 ]
 
 S_HEADER = {
-    "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 ...",
+    "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36",
     "Cache-Control": "no-store",    
     "Pragma": "no-cache",
     "If-None-Match": "",    
@@ -359,7 +359,8 @@ async def async_rate_test(url, num_reqs=100, method="GET", rb=None, rv=None, coo
             for idx, (h, body_data, json_flag) in enumerate(processed_queue):
                 asyncio.create_task(worker(h, body_data, json_flag, idx))
                 
-            print("[+] Streaming requests into the background network pipeline...")
+            print("Finishing up rate limiting test...")
+            #wait for all responses to load properly
             await asyncio.sleep(45.0)
 
         #label every single request using enumerate() to find out exactly when the first request timed out, or hit a non-200.
@@ -432,9 +433,11 @@ def checktime(st, at):
         else:
             if choice in ['n', 'no']:
                 print('Scan stopped. Any data found in the time window will be printed.')
+                print('Sensitive endpoints like ".git/config" will be automatically skipped.')
             else:
                 print('Choice not recognised, and will be defaulted to no.')
                 print('Scan stopped. Any data found in the time window will be printed.')
+                print('Sensitive endpoints like ".git/config" will be automatically skipped.')
             return "STOP"
     return "CONTINUE"
 def main():
@@ -469,7 +472,7 @@ def main():
         init(autoreset=True)
         print()
         print("-" * 40)
-        print(f"{Style.BRIGHT}Endpointscanner {Fore.LIGHTMAGENTA_EX}v7.3.1")
+        print(f"{Style.BRIGHT}Endpointscanner {Fore.LIGHTMAGENTA_EX}v7.3.4")
         print("-" * 40)
         print()
     if args.no_duplicate_prog and not args.show_prog:
@@ -648,7 +651,7 @@ def main():
         try:
             r_res = requests.get(urljoin(target, "/robots.txt"), headers=E_HEADER, impersonate=impersonate_settings, timeout=4)
             if r_res.status_code == 200:
-                e_files.append('/robots.txt')
+                appendrobottoe = False
                 
                 for line in r_res.text.splitlines():
                     _local_robots_line = line.strip()
@@ -663,6 +666,9 @@ def main():
                         if _local_directive in ["disallow", "allow"]:
                             if _local_payload and _local_payload not in ["/", "/*"] and _local_payload not in found_paths:
                                 found_paths.add(_local_payload)
+                                if appendrobottoe == False:
+                                    e_files.append('/robots.txt')
+                                    appendrobottoe = True
                                 if not args.tidy: 
                                     results_fromotherfiles.append(f"{_local_payload} [Source: robots.txt]")
                                 else:
@@ -1084,7 +1090,7 @@ def main():
                                         if nested_netloc == target_netloc:
                                             nested_safe = True
                                         elif get_apex(nested_netloc) == get_apex(target_netloc):
-                                            if any(token in nested_netloc for token in ["assets.", "cdn.", "vendor."]):
+                                            if any(token in nested_netloc for token in ["assets.", "cdn."]):
                                                 nested_safe = True
                                                 
                                         if nested_safe and check_nested_url not in js_files:
@@ -1237,18 +1243,19 @@ def main():
                 if len(found_paths) >= 12500:
                     exaggerate = "REALLY REALLY "
                     
-                print(f"\n[!] Number of endpoints found is {exaggerate}large.")
-                print(f"[*] Estimated sorting time: {esttime}")
+                print(f"\n[WARNING] Number of endpoints found is {exaggerate}large.")
+                print(f"Estimated sorting time: {esttime}")
                 
                 try:
                     userawoutput = input("Would you like to use the raw output instead? (No sorting at all) [y/n]\n >>> ")
                     if userawoutput.lower() in ['y', 'yes']:
+                        print("Endpoints will not be sorted.")
                         args.raw_output = True
                     else:
                         print("Endpoints will still be sorted.")
                         args.raw_output = False
                 except (KeyboardInterrupt, SystemExit):
-                    print("\n[!] Scan cancelled by user.")
+                    print("\nScan cancelled by user.")
                     return
 
                 

{endpointscanner-7.3.1 → endpointscanner-7.3.4}/pyproject.toml

@@ -4,7 +4,7 @@ build-backend = "setuptools.build_meta"
 
 [project]
 name = "endpointscanner"
-version = "7.3.1"
+version = "7.3.4"
 readme = "README.md"
 description = "Website endpoint reconnaissance tool and rate limit tester that can bypass simple captchas and WAFs."
 requires-python = ">=3.9"