waymore 6.6__tar.gz → 7.0__tar.gz

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (17) hide show
  1. {waymore-6.6/waymore.egg-info → waymore-7.0}/PKG-INFO +8 -5
  2. {waymore-6.6 → waymore-7.0}/README.md +3 -3
  3. waymore-6.6/waymore.egg-info/requires.txt → waymore-7.0/requirements.txt +1 -0
  4. waymore-7.0/waymore/__init__.py +1 -0
  5. {waymore-6.6 → waymore-7.0}/waymore/waymore.py +830 -736
  6. {waymore-6.6 → waymore-7.0/waymore.egg-info}/PKG-INFO +8 -5
  7. waymore-6.6/requirements.txt → waymore-7.0/waymore.egg-info/requires.txt +2 -1
  8. waymore-6.6/waymore/__init__.py +0 -1
  9. {waymore-6.6 → waymore-7.0}/LICENSE +0 -0
  10. {waymore-6.6 → waymore-7.0}/pyproject.toml +0 -0
  11. {waymore-6.6 → waymore-7.0}/setup.cfg +0 -0
  12. {waymore-6.6 → waymore-7.0}/setup.py +0 -0
  13. {waymore-6.6 → waymore-7.0}/tests/test_import.py +0 -0
  14. {waymore-6.6 → waymore-7.0}/waymore.egg-info/SOURCES.txt +0 -0
  15. {waymore-6.6 → waymore-7.0}/waymore.egg-info/dependency_links.txt +0 -0
  16. {waymore-6.6 → waymore-7.0}/waymore.egg-info/entry_points.txt +0 -0
  17. {waymore-6.6 → waymore-7.0}/waymore.egg-info/top_level.txt +0 -0
{waymore-6.6/waymore.egg-info → waymore-7.0}/PKG-INFO RENAMED
@@ -1,6 +1,6 @@
1
- Metadata-Version: 2.1
1
+ Metadata-Version: 2.4
2
2
  Name: waymore
3
- Version: 6.6
3
+ Version: 7.0
4
4
  Summary: Find way more from the Wayback Machine, Common Crawl, Alien Vault OTX, URLScan, VirusTotal & Intelligence X!
5
5
  Home-page: https://github.com/xnl-h4ck3r/waymore
6
6
  Author: xnl-h4ck3r
@@ -15,10 +15,13 @@ Requires-Dist: termcolor
15
15
  Requires-Dist: psutil
16
16
  Requires-Dist: urlparse3
17
17
  Requires-Dist: tldextract
18
+ Requires-Dist: aiohttp
19
+ Dynamic: home-page
20
+ Dynamic: license-file
18
21
 
19
22
  <center><img src="https://github.com/xnl-h4ck3r/waymore/blob/main/waymore/images/title.png"></center>
20
23
 
21
- ## About - v6.6
24
+ ## About - v7.0
22
25
 
23
26
  The idea behind **waymore** is to find even more links from the Wayback Machine than other existing tools.
24
27
 
@@ -48,7 +51,7 @@ Now **waymore** gets URL's from ALL of those sources too (with ability to filter
48
51
 
49
52
  **NOTE: If you already have a `config.yml` file, it will not be overwritten. The file `config.yml.NEW` will be created in the same directory. If you need the new config, remove `config.yml` and rename `config.yml.NEW` back to `config.yml`.**
50
53
 
51
- `waymore` supports **Python 3**.
54
+ `waymore` supports **Python 3.7+** (Python 3.7 or higher required for async/await support).
52
55
 
53
56
  Install `waymore` in default (global) python environment.
54
57
 
@@ -104,7 +107,7 @@ pipx install git+https://github.com/xnl-h4ck3r/waymore.git
104
107
  | -xix | | Exclude checks for links from Intelligence X.com |
105
108
  | -lcc | | Limit the number of Common Crawl index collections searched, e.g. `-lcc 10` will just search the latest `10` collections (default: 1). As of November 2024 there are currently 106 collections. Setting to `0` will search **ALL** collections. If you don't want to search Common Crawl at all, use the `-xcc` option. |
106
109
  | -t | --timeout | This is for archived responses only! How many seconds to wait for the server to send data before giving up (default: 30) |
107
- | -p | --processes | Basic multithreading is done when getting requests for a file of URLs. This argument determines the number of processes (threads) used (default: 1) |
110
+ | -p | --processes | Basic multithreading is done when getting requests for a file of URLs. This argument determines the number of processes (threads) used (default: 2) |
108
111
  | -r | --retries | The number of retries for requests that get connection error or rate limited (default: 1). |
109
112
  | -m | --memory-threshold | The memory threshold percentage. If the machines memory goes above the threshold, the program will be stopped and ended gracefully before running out of memory (default: 95) |
110
113
  | -ko | --keywords-only | Only return links and responses that contain keywords that you are interested in. This can reduce the time it takes to get results. If you provide the flag with no value, Keywords are taken from the comma separated list in the `config.yml` file (typically in `~/.config/waymore/`) with the `FILTER_KEYWORDS` key, otherwise you can pass a specific Regex value to use, e.g. `-ko "admin"` to only get links containing the word `admin`, or `-ko "\.js(\?\|$)"` to only get JS files. The Regex check is NOT case sensitive. |
{waymore-6.6 → waymore-7.0}/README.md RENAMED
@@ -1,6 +1,6 @@
1
1
  <center><img src="https://github.com/xnl-h4ck3r/waymore/blob/main/waymore/images/title.png"></center>
2
2
 
3
- ## About - v6.6
3
+ ## About - v7.0
4
4
 
5
5
  The idea behind **waymore** is to find even more links from the Wayback Machine than other existing tools.
6
6
 
@@ -30,7 +30,7 @@ Now **waymore** gets URL's from ALL of those sources too (with ability to filter
30
30
 
31
31
  **NOTE: If you already have a `config.yml` file, it will not be overwritten. The file `config.yml.NEW` will be created in the same directory. If you need the new config, remove `config.yml` and rename `config.yml.NEW` back to `config.yml`.**
32
32
 
33
- `waymore` supports **Python 3**.
33
+ `waymore` supports **Python 3.7+** (Python 3.7 or higher required for async/await support).
34
34
 
35
35
  Install `waymore` in default (global) python environment.
36
36
 
@@ -86,7 +86,7 @@ pipx install git+https://github.com/xnl-h4ck3r/waymore.git
86
86
  | -xix | | Exclude checks for links from Intelligence X.com |
87
87
  | -lcc | | Limit the number of Common Crawl index collections searched, e.g. `-lcc 10` will just search the latest `10` collections (default: 1). As of November 2024 there are currently 106 collections. Setting to `0` will search **ALL** collections. If you don't want to search Common Crawl at all, use the `-xcc` option. |
88
88
  | -t | --timeout | This is for archived responses only! How many seconds to wait for the server to send data before giving up (default: 30) |
89
- | -p | --processes | Basic multithreading is done when getting requests for a file of URLs. This argument determines the number of processes (threads) used (default: 1) |
89
+ | -p | --processes | Basic multithreading is done when getting requests for a file of URLs. This argument determines the number of processes (threads) used (default: 2) |
90
90
  | -r | --retries | The number of retries for requests that get connection error or rate limited (default: 1). |
91
91
  | -m | --memory-threshold | The memory threshold percentage. If the machines memory goes above the threshold, the program will be stopped and ended gracefully before running out of memory (default: 95) |
92
92
  | -ko | --keywords-only | Only return links and responses that contain keywords that you are interested in. This can reduce the time it takes to get results. If you provide the flag with no value, Keywords are taken from the comma separated list in the `config.yml` file (typically in `~/.config/waymore/`) with the `FILTER_KEYWORDS` key, otherwise you can pass a specific Regex value to use, e.g. `-ko "admin"` to only get links containing the word `admin`, or `-ko "\.js(\?\|$)"` to only get JS files. The Regex check is NOT case sensitive. |
waymore-6.6/waymore.egg-info/requires.txt → waymore-7.0/requirements.txt RENAMED
@@ -5,3 +5,4 @@ termcolor
5
5
  psutil
6
6
  urlparse3
7
7
  tldextract
8
+ aiohttp
waymore-7.0/waymore/__init__.py ADDED
@@ -0,0 +1 @@
1
+ __version__ = "7.0"