hellhound-spider 14.1__tar.gz → 14.2__tar.gz

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (13) hide show
  1. {hellhound_spider-14.1 → hellhound_spider-14.2}/PKG-INFO +28 -15
  2. {hellhound_spider-14.1 → hellhound_spider-14.2}/README.md +23 -14
  3. {hellhound_spider-14.1 → hellhound_spider-14.2}/hellhound_spider.egg-info/PKG-INFO +28 -15
  4. {hellhound_spider-14.1 → hellhound_spider-14.2}/hellhound_spider.egg-info/requires.txt +6 -0
  5. {hellhound_spider-14.1 → hellhound_spider-14.2}/pyproject.toml +7 -1
  6. {hellhound_spider-14.1 → hellhound_spider-14.2}/spider.py +1 -1
  7. {hellhound_spider-14.1 → hellhound_spider-14.2}/LICENSE +0 -0
  8. {hellhound_spider-14.1 → hellhound_spider-14.2}/hellhound_spider.egg-info/SOURCES.txt +0 -0
  9. {hellhound_spider-14.1 → hellhound_spider-14.2}/hellhound_spider.egg-info/dependency_links.txt +0 -0
  10. {hellhound_spider-14.1 → hellhound_spider-14.2}/hellhound_spider.egg-info/entry_points.txt +0 -0
  11. {hellhound_spider-14.1 → hellhound_spider-14.2}/hellhound_spider.egg-info/top_level.txt +0 -0
  12. {hellhound_spider-14.1 → hellhound_spider-14.2}/man/spider.1 +0 -0
  13. {hellhound_spider-14.1 → hellhound_spider-14.2}/setup.cfg +0 -0
{hellhound_spider-14.1 → hellhound_spider-14.2}/PKG-INFO RENAMED
@@ -1,6 +1,6 @@
1
1
  Metadata-Version: 2.4
2
2
  Name: hellhound-spider
3
- Version: 14.1
3
+ Version: 14.2
4
4
  Summary: Autonomous web crawler and recon engine for security testing — SPA + Non-SPA crawling, header analysis, subdomain enumeration, and intelligence classification
5
5
  Author-email: Sree Danush S <lazzer@gmail.com>
6
6
  License-Expression: GPL-3.0-or-later
@@ -28,6 +28,10 @@ Provides-Extra: spa
28
28
  Requires-Dist: playwright>=1.40.0; extra == "spa"
29
29
  Requires-Dist: playwright-stealth>=1.0.6; extra == "spa"
30
30
  Requires-Dist: patchright>=0.5.0; extra == "spa"
31
+ Provides-Extra: dns
32
+ Requires-Dist: dnspython>=2.4.0; extra == "dns"
33
+ Provides-Extra: full
34
+ Requires-Dist: hellhound-spider[dns,spa]; extra == "full"
31
35
  Dynamic: license-file
32
36
 
33
37
  <p align="center">
@@ -42,7 +46,8 @@ Dynamic: license-file
42
46
 
43
47
  <p align="center">
44
48
  <img src="https://img.shields.io/badge/python-3.10+-blue?style=flat-square&logo=python&logoColor=white"/>
45
- <img src="https://img.shields.io/badge/version-14.1-red?style=flat-square"/>
49
+ <img src="https://img.shields.io/badge/version-14.2-red?style=flat-square"/>
50
+ <img src="https://img.shields.io/badge/pypi-hellhound--spider-blue?style=flat-square&logo=pypi&logoColor=white"/>
46
51
  <img src="https://img.shields.io/badge/platform-Linux%20%7C%20macOS%20%7C%20Windows-lightgrey?style=flat-square"/>
47
52
  <img src="https://img.shields.io/badge/license-GPL--3.0-blue?style=flat-square"/>
48
53
  </p>
@@ -61,36 +66,44 @@ Output pipes straight into other tools — `spider https://target.com | httpx` j
61
66
 
62
67
  ## Installation
63
68
 
64
- ### Linux / macOS
69
+ ### via pip (any OS)
65
70
 
66
71
  ```bash
67
- git clone https://github.com/project-hellhound-org/hellhound-spider.git
68
- cd hellhound-spider
69
- chmod +x install.sh
70
- ./install.sh
72
+ pip install hellhound-spider
71
73
  ```
72
74
 
73
- The installer creates an isolated virtual environment (`.venv`) and a system-wide `spider` wrapper:
75
+ This gets you the core crawler — HTTP-only scanning (`--no-playwright`) works right away. Everything else is opt-in, since not everyone needs a headless browser just to crawl:
74
76
 
75
77
  ```bash
76
- spider https://target.com
78
+ pip install "hellhound-spider[spa]" # SPA scanning: Playwright + Patchright
79
+ playwright install chromium # the browser binary itself — not a pip package, separate ~150MB download
80
+
81
+ pip install "hellhound-spider[dns]" # full DNS intel (SPF/DMARC/MX via dnspython)
82
+ pip install "hellhound-spider[full]" # spa + dns together
77
83
  ```
78
84
 
79
- ### Windows
85
+ One thing pip genuinely can't install for you: **WhatWeb** (optional technology fingerprinting) is a system binary, not a Python package — `apt install whatweb` (or your distro's equivalent) if you want it. Spider runs fine without it either way.
86
+
87
+ ### From source (Linux / macOS)
80
88
 
81
89
  ```bash
82
90
  git clone https://github.com/project-hellhound-org/hellhound-spider.git
83
91
  cd hellhound-spider
84
- pip install -e . # core install
85
- pip install -e ".[spa]" # with Playwright SPA support
86
- playwright install chromium
92
+ chmod +x install.sh
93
+ ./install.sh
94
+ ```
95
+
96
+ The installer creates an isolated virtual environment (`.venv`), handles Playwright/Patchright/WhatWeb for you interactively, and installs a system-wide `spider` wrapper — this is the same thing `pip install` gives you, just with the optional pieces walked through for you instead of opt-in flags.
97
+
98
+ ```bash
99
+ spider https://target.com
87
100
  ```
88
101
 
89
102
  ### Uninstall
90
103
 
91
104
  ```bash
92
- ./uninstall.sh # Linux / macOS
93
- pip uninstall hellhound-spider # Windows
105
+ ./uninstall.sh # if installed via install.sh
106
+ pip uninstall hellhound-spider # if installed via pip
94
107
  ```
95
108
 
96
109
  ---
{hellhound_spider-14.1 → hellhound_spider-14.2}/README.md RENAMED
@@ -10,7 +10,8 @@
10
10
 
11
11
  <p align="center">
12
12
  <img src="https://img.shields.io/badge/python-3.10+-blue?style=flat-square&logo=python&logoColor=white"/>
13
- <img src="https://img.shields.io/badge/version-14.1-red?style=flat-square"/>
13
+ <img src="https://img.shields.io/badge/version-14.2-red?style=flat-square"/>
14
+ <img src="https://img.shields.io/badge/pypi-hellhound--spider-blue?style=flat-square&logo=pypi&logoColor=white"/>
14
15
  <img src="https://img.shields.io/badge/platform-Linux%20%7C%20macOS%20%7C%20Windows-lightgrey?style=flat-square"/>
15
16
  <img src="https://img.shields.io/badge/license-GPL--3.0-blue?style=flat-square"/>
16
17
  </p>
@@ -29,36 +30,44 @@ Output pipes straight into other tools — `spider https://target.com | httpx` j
29
30
 
30
31
  ## Installation
31
32
 
32
- ### Linux / macOS
33
+ ### via pip (any OS)
33
34
 
34
35
  ```bash
35
- git clone https://github.com/project-hellhound-org/hellhound-spider.git
36
- cd hellhound-spider
37
- chmod +x install.sh
38
- ./install.sh
36
+ pip install hellhound-spider
39
37
  ```
40
38
 
41
- The installer creates an isolated virtual environment (`.venv`) and a system-wide `spider` wrapper:
39
+ This gets you the core crawler — HTTP-only scanning (`--no-playwright`) works right away. Everything else is opt-in, since not everyone needs a headless browser just to crawl:
42
40
 
43
41
  ```bash
44
- spider https://target.com
42
+ pip install "hellhound-spider[spa]" # SPA scanning: Playwright + Patchright
43
+ playwright install chromium # the browser binary itself — not a pip package, separate ~150MB download
44
+
45
+ pip install "hellhound-spider[dns]" # full DNS intel (SPF/DMARC/MX via dnspython)
46
+ pip install "hellhound-spider[full]" # spa + dns together
45
47
  ```
46
48
 
47
- ### Windows
49
+ One thing pip genuinely can't install for you: **WhatWeb** (optional technology fingerprinting) is a system binary, not a Python package — `apt install whatweb` (or your distro's equivalent) if you want it. Spider runs fine without it either way.
50
+
51
+ ### From source (Linux / macOS)
48
52
 
49
53
  ```bash
50
54
  git clone https://github.com/project-hellhound-org/hellhound-spider.git
51
55
  cd hellhound-spider
52
- pip install -e . # core install
53
- pip install -e ".[spa]" # with Playwright SPA support
54
- playwright install chromium
56
+ chmod +x install.sh
57
+ ./install.sh
58
+ ```
59
+
60
+ The installer creates an isolated virtual environment (`.venv`), handles Playwright/Patchright/WhatWeb for you interactively, and installs a system-wide `spider` wrapper — this is the same thing `pip install` gives you, just with the optional pieces walked through for you instead of opt-in flags.
61
+
62
+ ```bash
63
+ spider https://target.com
55
64
  ```
56
65
 
57
66
  ### Uninstall
58
67
 
59
68
  ```bash
60
- ./uninstall.sh # Linux / macOS
61
- pip uninstall hellhound-spider # Windows
69
+ ./uninstall.sh # if installed via install.sh
70
+ pip uninstall hellhound-spider # if installed via pip
62
71
  ```
63
72
 
64
73
  ---
{hellhound_spider-14.1 → hellhound_spider-14.2}/hellhound_spider.egg-info/PKG-INFO RENAMED
@@ -1,6 +1,6 @@
1
1
  Metadata-Version: 2.4
2
2
  Name: hellhound-spider
3
- Version: 14.1
3
+ Version: 14.2
4
4
  Summary: Autonomous web crawler and recon engine for security testing — SPA + Non-SPA crawling, header analysis, subdomain enumeration, and intelligence classification
5
5
  Author-email: Sree Danush S <lazzer@gmail.com>
6
6
  License-Expression: GPL-3.0-or-later
@@ -28,6 +28,10 @@ Provides-Extra: spa
28
28
  Requires-Dist: playwright>=1.40.0; extra == "spa"
29
29
  Requires-Dist: playwright-stealth>=1.0.6; extra == "spa"
30
30
  Requires-Dist: patchright>=0.5.0; extra == "spa"
31
+ Provides-Extra: dns
32
+ Requires-Dist: dnspython>=2.4.0; extra == "dns"
33
+ Provides-Extra: full
34
+ Requires-Dist: hellhound-spider[dns,spa]; extra == "full"
31
35
  Dynamic: license-file
32
36
 
33
37
  <p align="center">
@@ -42,7 +46,8 @@ Dynamic: license-file
42
46
 
43
47
  <p align="center">
44
48
  <img src="https://img.shields.io/badge/python-3.10+-blue?style=flat-square&logo=python&logoColor=white"/>
45
- <img src="https://img.shields.io/badge/version-14.1-red?style=flat-square"/>
49
+ <img src="https://img.shields.io/badge/version-14.2-red?style=flat-square"/>
50
+ <img src="https://img.shields.io/badge/pypi-hellhound--spider-blue?style=flat-square&logo=pypi&logoColor=white"/>
46
51
  <img src="https://img.shields.io/badge/platform-Linux%20%7C%20macOS%20%7C%20Windows-lightgrey?style=flat-square"/>
47
52
  <img src="https://img.shields.io/badge/license-GPL--3.0-blue?style=flat-square"/>
48
53
  </p>
@@ -61,36 +66,44 @@ Output pipes straight into other tools — `spider https://target.com | httpx` j
61
66
 
62
67
  ## Installation
63
68
 
64
- ### Linux / macOS
69
+ ### via pip (any OS)
65
70
 
66
71
  ```bash
67
- git clone https://github.com/project-hellhound-org/hellhound-spider.git
68
- cd hellhound-spider
69
- chmod +x install.sh
70
- ./install.sh
72
+ pip install hellhound-spider
71
73
  ```
72
74
 
73
- The installer creates an isolated virtual environment (`.venv`) and a system-wide `spider` wrapper:
75
+ This gets you the core crawler — HTTP-only scanning (`--no-playwright`) works right away. Everything else is opt-in, since not everyone needs a headless browser just to crawl:
74
76
 
75
77
  ```bash
76
- spider https://target.com
78
+ pip install "hellhound-spider[spa]" # SPA scanning: Playwright + Patchright
79
+ playwright install chromium # the browser binary itself — not a pip package, separate ~150MB download
80
+
81
+ pip install "hellhound-spider[dns]" # full DNS intel (SPF/DMARC/MX via dnspython)
82
+ pip install "hellhound-spider[full]" # spa + dns together
77
83
  ```
78
84
 
79
- ### Windows
85
+ One thing pip genuinely can't install for you: **WhatWeb** (optional technology fingerprinting) is a system binary, not a Python package — `apt install whatweb` (or your distro's equivalent) if you want it. Spider runs fine without it either way.
86
+
87
+ ### From source (Linux / macOS)
80
88
 
81
89
  ```bash
82
90
  git clone https://github.com/project-hellhound-org/hellhound-spider.git
83
91
  cd hellhound-spider
84
- pip install -e . # core install
85
- pip install -e ".[spa]" # with Playwright SPA support
86
- playwright install chromium
92
+ chmod +x install.sh
93
+ ./install.sh
94
+ ```
95
+
96
+ The installer creates an isolated virtual environment (`.venv`), handles Playwright/Patchright/WhatWeb for you interactively, and installs a system-wide `spider` wrapper — this is the same thing `pip install` gives you, just with the optional pieces walked through for you instead of opt-in flags.
97
+
98
+ ```bash
99
+ spider https://target.com
87
100
  ```
88
101
 
89
102
  ### Uninstall
90
103
 
91
104
  ```bash
92
- ./uninstall.sh # Linux / macOS
93
- pip uninstall hellhound-spider # Windows
105
+ ./uninstall.sh # if installed via install.sh
106
+ pip uninstall hellhound-spider # if installed via pip
94
107
  ```
95
108
 
96
109
  ---
{hellhound_spider-14.1 → hellhound_spider-14.2}/hellhound_spider.egg-info/requires.txt RENAMED
@@ -2,6 +2,12 @@ aiohttp>=3.9.0
2
2
  beautifulsoup4>=4.12.0
3
3
  lxml>=5.0.0
4
4
 
5
+ [dns]
6
+ dnspython>=2.4.0
7
+
8
+ [full]
9
+ hellhound-spider[dns,spa]
10
+
5
11
  [spa]
6
12
  playwright>=1.40.0
7
13
  playwright-stealth>=1.0.6
{hellhound_spider-14.1 → hellhound_spider-14.2}/pyproject.toml RENAMED
@@ -4,7 +4,7 @@ build-backend = "setuptools.build_meta"
4
4
 
5
5
  [project]
6
6
  name = "hellhound-spider"
7
- version = "14.1"
7
+ version = "14.2"
8
8
  description = "Autonomous web crawler and recon engine for security testing — SPA + Non-SPA crawling, header analysis, subdomain enumeration, and intelligence classification"
9
9
  readme = "README.md"
10
10
  requires-python = ">=3.10"
@@ -41,6 +41,12 @@ spa = [
41
41
  "playwright-stealth>=1.0.6",
42
42
  "patchright>=0.5.0",
43
43
  ]
44
+ dns = [
45
+ "dnspython>=2.4.0",
46
+ ]
47
+ full = [
48
+ "hellhound-spider[spa,dns]",
49
+ ]
44
50
 
45
51
  [project.urls]
46
52
  Homepage = "https://github.com/project-hellhound-org/hellhound-spider"
{hellhound_spider-14.1 → hellhound_spider-14.2}/spider.py RENAMED
@@ -61,7 +61,7 @@ except Exception:
61
61
 
62
62
 
63
63
 
64
- VERSION = "14.1"
64
+ VERSION = "14.2"
65
65
  __author__ = "Sree Danush S (L4ZZ3RJ0D)"
66
66
  __license__ = "GPLv3"
67
67
  __credits__ = ["L4ZZ3RJ0D"]
{hellhound_spider-14.1 → hellhound_spider-14.2}/LICENSE RENAMED
File without changes