man-spider 1.1.1__py3-none-any.whl → 2.0.0__py3-none-any.whl

{man_spider-1.1.1.dist-info → man_spider-2.0.0.dist-info}/METADATA

@@ -1,30 +1,34 @@
-Metadata-Version: 2.3
+Metadata-Version: 2.4
 Name: man-spider
-Version: 1.1.1
+Version: 2.0.0
 Summary: Full-featured SMB spider capable of searching file content
-License: GPL-3.0
-Author: TheTechromancer
-Requires-Python: >=3.8,<3.14
-Classifier: License :: OSI Approved :: GNU General Public License v3 (GPLv3)
-Classifier: Programming Language :: Python :: 3
-Classifier: Programming Language :: Python :: 3.8
-Classifier: Programming Language :: Python :: 3.9
-Classifier: Programming Language :: Python :: 3.10
-Classifier: Programming Language :: Python :: 3.11
-Classifier: Programming Language :: Python :: 3.12
-Classifier: Programming Language :: Python :: 3.13
-Requires-Dist: extractous (>=0.3.0,<0.4.0)
-Requires-Dist: impacket (>=0.12.0,<0.13.0)
-Requires-Dist: python-magic (>=0.4.27,<0.5.0)
-Project-URL: Homepage, https://github.com/blacklanternsecurity/MANSPIDER
 Project-URL: Repository, https://github.com/blacklanternsecurity/MANSPIDER
+Project-URL: Homepage, https://github.com/blacklanternsecurity/MANSPIDER
+Author: TheTechromancer
+License: GPL-3.0
+License-File: LICENSE
+Requires-Python: >=3.10
+Requires-Dist: charset-normalizer
+Requires-Dist: impacket
+Requires-Dist: kreuzberg
 Description-Content-Type: text/markdown
 
 # MANSPIDER
 ### Crawl SMB shares for juicy information. File content searching + regex is supported!
 
-### UPDATE 2025-05-26
-**Manspider has been updated to support kerberos!** Also, the textract library has been replaced with [Extractous](https://github.com/yobix-ai/extractous), so you can now feel free to run it outside Docker. 🎉
+---
+
+## What's New in v2.0
+
+**Manspider 2.0 is here!** This brings significant improvements:
+
+- **New and improved text extraction** powered by [Kreuzberg](https://github.com/Goldziher/kreuzberg) - now supporting PDF, DOCX, XLSX, PPTX, images with OCR, and many more formats
+- **Modern package management** with [uv](https://github.com/astral-sh/uv) for faster, more reliable installations
+- **Python 3.14 support** - ready for the latest Python releases
+- **Date filtering** - search files by modification date with `--modified-after` and `--modified-before`
+- **Comprehensive unit tests** - improved reliability and stability
+
+---
 
 ![manspider](https://user-images.githubusercontent.com/20261699/74963251-6a08de80-53df-11ea-88f4-60c39665dfa2.gif)
 
@@ -39,19 +43,35 @@ Description-Content-Type: text/markdown
 ### MANSPIDER will crawl every share on every target system. If provided creds don't work, it will fall back to "guest", then to a null session.
 ![manspider](https://user-images.githubusercontent.com/20261699/80316979-f9ab7e80-87ce-11ea-9628-3c22a07e8378.png)
 
-### Installation:
-(Optional) Install these dependencies to add additional file parsing capability:
+### Installation
+
+#### Quick Run with uvx (recommended)
+~~~bash
+# Run directly without installing
+uvx --from git+https://github.com/blacklanternsecurity/MANSPIDER manspider --help
 ~~~
-# for images (png, jpeg)
-$ sudo apt install tesseract-ocr
 
-# for legacy document support (.doc)
-$ sudo apt install antiword
+#### Install with uv
+~~~bash
+# Install globally
+uv tool install git+https://github.com/blacklanternsecurity/MANSPIDER
+
+# Run
+manspider --help
 ~~~
-Install manspider (please be patient, this can take a while):
+
+#### Install with pipx
+~~~bash
+pipx install git+https://github.com/blacklanternsecurity/MANSPIDER
 ~~~
-$ pip install pipx
-$ pipx install git+https://github.com/blacklanternsecurity/MANSPIDER
+
+#### Optional Dependencies
+~~~bash
+# for OCR on images (png, jpeg)
+sudo apt install tesseract-ocr
+
+# for legacy .doc support (kreuzberg uses libreoffice)
+sudo apt install libreoffice
 ~~~
 
 ## Installation (Docker)
@@ -133,6 +153,11 @@ $ manspider share.evilcorp.local -e kdbx kdb 1pif agilekeychain opvault lpd dash
 $ manspider share.evilcorp.local -e pfx p12 pkcs12 pem key crt cer csr jks keystore key keys der -d evilcorp -u bob -p Passw0rd
 ~~~
 
+### Example #10: Search for recently modified files
+~~~
+$ manspider share.evilcorp.local -e docx xlsx pdf --modified-after 2026-01-01 -d evilcorp -u bob -p Passw0rd
+~~~
+
 ### Usage Tip #1:
 You can run multiple instances of manspider at one time. This is useful when one instance is already running, and you want to search what it's downloaded (similar to `grep -R`). To do this, specify the keyword `loot` as the target, which will search the downloaded files in `$HOME/.manspider/loot`.
 
@@ -162,9 +187,9 @@ For example, you could specify any or all of these:
 
 ## Usage:
 ~~~
-usage: manspider [-h] [-u USERNAME] [-p PASSWORD] [-d DOMAIN] [-m MAXDEPTH] [-H HASH] [-t THREADS] [-f REGEX [REGEX ...]] [-e EXT [EXT ...]] [--exclude-extensions EXT [EXT ...]]
-                 [-c REGEX [REGEX ...]] [--sharenames SHARE [SHARE ...]] [--exclude-sharenames [SHARE ...]] [--dirnames DIR [DIR ...]] [--exclude-dirnames DIR [DIR ...]] [-q] [-n]
-                 [-mfail INT] [-o] [-s SIZE] [-v]
+usage: manspider [-h] [-u USERNAME] [-p PASSWORD] [-d DOMAIN] [-l LOOT_DIR] [-m MAXDEPTH] [-H HASH] [-k] [-aesKey HEX] [-dc-ip IP] [-t THREADS] [-f REGEX [REGEX ...]] [-e EXT [EXT ...]]
+                 [--exclude-extensions EXT [EXT ...]] [-c REGEX [REGEX ...]] [--sharenames SHARE [SHARE ...]] [--exclude-sharenames [SHARE ...]] [--dirnames DIR [DIR ...]]
+                 [--exclude-dirnames DIR [DIR ...]] [-q] [-n] [-mfail INT] [-o] [-s SIZE] [-v]
                  targets [targets ...]
 
 Scan for juicy data on SMB shares. Matching files and logs are stored in $HOME/.manspider. All filters are case-insensitive.
@@ -173,26 +198,31 @@ positional arguments:
   targets               IPs, Hostnames, CIDR ranges, or files containing targets to spider (NOTE: local searching also supported, specify directory name or keyword "loot" to search
                         downloaded files)
 
-optional arguments:
+options:
   -h, --help            show this help message and exit
-  -u USERNAME, --username USERNAME
+  -u, --username USERNAME
                         username for authentication
-  -p PASSWORD, --password PASSWORD
+  -p, --password PASSWORD
                         password for authentication
-  -d DOMAIN, --domain DOMAIN
-                        domain for authentication
-  -m MAXDEPTH, --maxdepth MAXDEPTH
+  -d, --domain DOMAIN   domain for authentication
+  -l, --loot-dir LOOT_DIR
+                        loot directory (default ~/.manspider/)
+  -m, --maxdepth MAXDEPTH
                         maximum depth to spider (default: 10)
-  -H HASH, --hash HASH  NTLM hash for authentication
-  -t THREADS, --threads THREADS
+  -H, --hash HASH       NTLM hash for authentication
+  -k, --kerberos        Use Kerberos authentication. Grabs credentials from ccache file (KRB5CCNAME) based on target parameters
+  -aesKey, --aes-key HEX
+                        AES key to use for Kerberos Authentication (128 or 256 bits)
+  -dc-ip, --dc-ip IP    IP Address of the domain controller. If omitted it will use the domain part (FQDN) specified in the target parameter
+  -t, --threads THREADS
                         concurrent threads (default: 5)
-  -f REGEX [REGEX ...], --filenames REGEX [REGEX ...]
+  -f, --filenames REGEX [REGEX ...]
                         filter filenames using regex (space-separated)
-  -e EXT [EXT ...], --extensions EXT [EXT ...]
+  -e, --extensions EXT [EXT ...]
                         only show filenames with these extensions (space-separated, e.g. `docx xlsx` for only word & excel docs)
   --exclude-extensions EXT [EXT ...]
                         ignore files with these extensions
-  -c REGEX [REGEX ...], --content REGEX [REGEX ...]
+  -c, --content REGEX [REGEX ...]
                         search for file content using regex (multiple supported)
   --sharenames SHARE [SHARE ...]
                         only search shares with these names (multiple supported)
@@ -204,11 +234,38 @@ optional arguments:
                         don't search directories containing these strings (multiple supported)
   -q, --quiet           don't display matching file content
   -n, --no-download     don't download matching files
-  -mfail INT, --max-failed-logons INT
+  -mfail, --max-failed-logons INT
                         limit failed logons
   -o, --or-logic        use OR logic instead of AND (files are downloaded if filename OR extension OR content match)
-  -s SIZE, --max-filesize SIZE
+  -s, --max-filesize SIZE
                         don't retrieve files over this size, e.g. "500K" or ".5M" (default: 10M)
   -v, --verbose         show debugging messages
+  --modified-after DATE
+                        only show files modified after this date (format: YYYY-MM-DD)
+  --modified-before DATE
+                        only show files modified before this date (format: YYYY-MM-DD)
 ~~~
 
+## Development
+
+### Testing
+
+```bash
+# Run tests
+uv run pytest
+```
+
+### Linting
+
+This project uses [ruff](https://github.com/astral-sh/ruff) for linting and formatting.
+
+```bash
+# Run linter
+uv run ruff check .
+
+# Run linter with auto-fix
+uv run ruff check --fix .
+
+# Run formatter
+uv run ruff format .
+```

man_spider-2.0.0.dist-info/RECORD

@@ -0,0 +1,18 @@
+man_spider/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+man_spider/manspider.py,sha256=un_CwO2EbwCoXRfIccvCeddMy5jFWfG4PuTKr9lHf9M,10445
+man_spider/lib/__init__.py,sha256=ur53cnY4wqGh1C19LDk61D62vzk0iXZRYshU33Mqe-Q,86
+man_spider/lib/errors.py,sha256=NP-T7KtgNAEOoUKAJipSSk45QeyWrZb4y8uTgj6VB-w,1065
+man_spider/lib/file.py,sha256=W96HlDVZip9bdeMYZfBxVKGg2vrwqvPRjPtCjHriN1w,1527
+man_spider/lib/logger.py,sha256=kcqrVHdY_yddqFSI1YhlSK1A4JNi8JiMGgjei8-UXvg,2420
+man_spider/lib/processpool.py,sha256=6kg_KL49XVdQXLiBlYram8pK-PTmebjrAuVJvvIGB54,3865
+man_spider/lib/smb.py,sha256=Co_wPted46gEoVomcmV55VWrj_yO-8i65shsWEX5Mxk,9686
+man_spider/lib/spider.py,sha256=l_eBetH0FMHS2BnxBOXd_5NA09E-5-6BfGXV_6q_nh4,7416
+man_spider/lib/spiderling.py,sha256=Sdk-PHTl7vui36jiQEAXqEHUIGWaBwpxTY5t2AywGfQ,18751
+man_spider/lib/util.py,sha256=0wqPXVA0yhtsZPFht4BDXZJxkOnXEsMkNduJPA4g8bE,5016
+man_spider/lib/parser/__init__.py,sha256=FRoKwIMIYfP1ESv02iKyCG9PH4vR2wZg1Cpqj7ryI3g,22
+man_spider/lib/parser/parser.py,sha256=zHFagYBXp7fDe6H1Fp-_HqEbXCHPgvDueXxRI334EJo,7093
+man_spider-2.0.0.dist-info/METADATA,sha256=IByvTAoKnT6zRf2I5S78BO5BlAVt_-zEzSSrgP27uOI,10897
+man_spider-2.0.0.dist-info/WHEEL,sha256=WLgqFyCfm_KASv4WHyYy0P3pM_m7J5L9k2skdKLirC8,87
+man_spider-2.0.0.dist-info/entry_points.txt,sha256=tNKDPBaLZJ65HCR2zP37LGmXVFvVoxRoGvmLdoOLyXg,56
+man_spider-2.0.0.dist-info/licenses/LICENSE,sha256=qvZcoAC_iNU83gvyvlLTL2TKCCmP0CBDzRQgXZKePAM,35102
+man_spider-2.0.0.dist-info/RECORD,,

{man_spider-1.1.1.dist-info → man_spider-2.0.0.dist-info}/WHEEL

@@ -1,4 +1,4 @@
 Wheel-Version: 1.0
-Generator: poetry-core 2.1.3
+Generator: hatchling 1.28.0
 Root-Is-Purelib: true
 Tag: py3-none-any

man_spider-2.0.0.dist-info/entry_points.txt

@@ -0,0 +1,2 @@
+[console_scripts]
+manspider = man_spider.manspider:main

man_spider-1.1.1.dist-info/RECORD

@@ -1,18 +0,0 @@
-man_spider/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-man_spider/lib/__init__.py,sha256=ur53cnY4wqGh1C19LDk61D62vzk0iXZRYshU33Mqe-Q,86
-man_spider/lib/errors.py,sha256=InHvv7ZfWn766Jm6DsWRRZCzWhWxaDzlfmGyDg3SOJo,1061
-man_spider/lib/file.py,sha256=6k1U680OLjuM4uqteeTbUDZojpy7MVDBR3pBp_LD4hk,1503
-man_spider/lib/logger.py,sha256=apDRFLWy2j7ShrxatHqBkYAGyv7b9FQyAO0uDvTHqdM,2440
-man_spider/lib/parser/__init__.py,sha256=m0KGcdcwfM6xh0l1YFLvlXSeCI82auoB6ztrWN7qGyM,21
-man_spider/lib/parser/parser.py,sha256=x2uzuS2ESZrAOR6hnfd5Goi8Sy04wRjNTXVf0LoGask,5006
-man_spider/lib/processpool.py,sha256=KkT7ZCzi6_6c9bNlW04MioSb8G8muoUcxIIF8DXEMrA,3742
-man_spider/lib/smb.py,sha256=uy9SbnwjYwiRh-7TVI7U0D8tcrU34o9pIHIAfo-IinQ,8974
-man_spider/lib/spider.py,sha256=KcklxlgcTCOfBR6wlR8SRDGwES4M-IHedl7wyfjVrao,7185
-man_spider/lib/spiderling.py,sha256=aVHkpyJI8YvKQyNldoLP7CzfMP0HYudpnzkzZx-wypo,15687
-man_spider/lib/util.py,sha256=Ti7R8JMcA9q1iSyqYPBn9aCQtNoua7jYCH70rfgslHE,3130
-man_spider/manspider.py,sha256=l4vfG_1CQjt6jVP_owAHybhajizSXTa9D3nocHOU3BY,8917
-man_spider-1.1.1.dist-info/LICENSE,sha256=qvZcoAC_iNU83gvyvlLTL2TKCCmP0CBDzRQgXZKePAM,35102
-man_spider-1.1.1.dist-info/METADATA,sha256=e1AtliskoGLNQ1iXBzwbtLDHzjRWe8JfWEWvQzIcRWM,9648
-man_spider-1.1.1.dist-info/WHEEL,sha256=b4K_helf-jlQoXBBETfwnf4B04YC67LOev0jo4fX5m8,88
-man_spider-1.1.1.dist-info/entry_points.txt,sha256=ECMHYrXRR3rO40LF4AiKmuM2DbPvdmkxINp0Wa_qVCc,55
-man_spider-1.1.1.dist-info/RECORD,,

man_spider-1.1.1.dist-info/entry_points.txt

@@ -1,3 +0,0 @@
-[console_scripts]
-manspider=man_spider.manspider:main
-