waymore 7.5__tar.gz → 7.7__tar.gz
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- {waymore-7.5/waymore.egg-info → waymore-7.7}/PKG-INFO +4 -2
- {waymore-7.5 → waymore-7.7}/README.md +301 -299
- waymore-7.7/waymore/__init__.py +1 -0
- {waymore-7.5 → waymore-7.7}/waymore/waymore.py +7284 -6734
- {waymore-7.5 → waymore-7.7/waymore.egg-info}/PKG-INFO +4 -2
- waymore-7.5/waymore/__init__.py +0 -1
- {waymore-7.5 → waymore-7.7}/LICENSE +0 -0
- {waymore-7.5 → waymore-7.7}/pyproject.toml +0 -0
- {waymore-7.5 → waymore-7.7}/requirements.txt +0 -0
- {waymore-7.5 → waymore-7.7}/setup.cfg +0 -0
- {waymore-7.5 → waymore-7.7}/setup.py +0 -0
- {waymore-7.5 → waymore-7.7}/tests/test_import.py +0 -0
- {waymore-7.5 → waymore-7.7}/waymore.egg-info/SOURCES.txt +0 -0
- {waymore-7.5 → waymore-7.7}/waymore.egg-info/dependency_links.txt +0 -0
- {waymore-7.5 → waymore-7.7}/waymore.egg-info/entry_points.txt +0 -0
- {waymore-7.5 → waymore-7.7}/waymore.egg-info/requires.txt +0 -0
- {waymore-7.5 → waymore-7.7}/waymore.egg-info/top_level.txt +0 -0
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
Metadata-Version: 2.4
|
|
2
2
|
Name: waymore
|
|
3
|
-
Version: 7.
|
|
3
|
+
Version: 7.7
|
|
4
4
|
Summary: Find way more from the Wayback Machine, Common Crawl, Alien Vault OTX, URLScan, VirusTotal & Intelligence X!
|
|
5
5
|
Home-page: https://github.com/xnl-h4ck3r/waymore
|
|
6
6
|
Author: xnl-h4ck3r
|
|
@@ -21,7 +21,7 @@ Dynamic: license-file
|
|
|
21
21
|
|
|
22
22
|
<center><img src="https://github.com/xnl-h4ck3r/waymore/blob/main/waymore/images/title.png"></center>
|
|
23
23
|
|
|
24
|
-
## About - v7.
|
|
24
|
+
## About - v7.7
|
|
25
25
|
|
|
26
26
|
The idea behind **waymore** is to find even more links from the Wayback Machine (plus other sources) than other existing tools.
|
|
27
27
|
|
|
@@ -109,6 +109,7 @@ pipx install git+https://github.com/xnl-h4ck3r/waymore.git
|
|
|
109
109
|
| -t | --timeout | This is for archived responses only! How many seconds to wait for the server to send data before giving up (default: 30) |
|
|
110
110
|
| -p | --processes | Basic multithreading is done when getting requests for a file of URLs. This argument determines the number of processes (threads) used (default: 2) |
|
|
111
111
|
| -r | --retries | The number of retries for requests that get connection error or rate limited (default: 1). |
|
|
112
|
+
| -sip | --source-ip OR --bind-ip | Bind outbound HTTP/HTTPS requests to this source IP (useful on multi-homed hosts). Passing this argument overrides the `SOURCE_IP` value in the `config.yml` file. |
|
|
112
113
|
| -m | --memory-threshold | The memory threshold percentage. If the machines memory goes above the threshold, the program will be stopped and ended gracefully before running out of memory (default: 95) |
|
|
113
114
|
| -ko | --keywords-only | Only return links and responses that contain keywords that you are interested in. This can reduce the time it takes to get results. If you provide the flag with no value, Keywords are taken from the comma separated list in the `config.yml` file (typically in `~/.config/waymore/`) with the `FILTER_KEYWORDS` key, otherwise you can pass a specific Regex value to use, e.g. `-ko "admin"` to only get links containing the word `admin`, or `-ko "\.js(\?\|$)"` to only get JS files. The Regex check is NOT case sensitive. |
|
|
114
115
|
| -lr | --limit-requests | Limit the number of requests that will be made when getting links from a source (this doesn\'t apply to Common Crawl). Some targets can return a huge amount of requests needed that are just not feasible to get, so this can be used to manage that situation. This defaults to 0 (Zero) which means there is no limit. |
|
|
@@ -176,6 +177,7 @@ The `config.yml` file (typically in `~/.config/waymore/`) have values that can b
|
|
|
176
177
|
- `TELEGRAM_CHAT_ID` - If the `--notify-telegram` argument is passed, `waymore` will send the notification to this chat ID.
|
|
177
178
|
- `DEFAULT_OUTPUT_DIR` - This is the default location of any output files written if the `-oU` and `-oR` arguments are not used. If the value of this key is blank, then it will default to the location of the `config.yml` file.
|
|
178
179
|
- `INTELX_API_KEY` - You can sign up to [intelx.io here](https://intelx.io/product). It requires an academia or paid API key to do the `/phonebook/search` through their API (as of 2024-09-01, the Phonebook service has been restricted to academia or paid users due to constant abuse by spam accounts). You can get a free API key for academic use if you sign up with a valid academic email address.
|
|
180
|
+
- `SOURCE_IP` - Optional. Bind outbound HTTP/HTTPS requests to a specific source IP on multi-homed hosts. Can also be set via the `--source-ip/--bind-ip` CLI flag (CLI takes precedence).
|
|
179
181
|
|
|
180
182
|
**NOTE: The MIME types cannot be filtered for Alien Vault OTX, Virus Total and Intelligence X because they don't have the ability to filter on MIME Type. Sometimes URLScan does not have a MIME Type defined for a URL. In these cases, URLs will be included regardless of filter or match. Bear this in mind and consider excluding certain providers if this is important.**
|
|
181
183
|
|