webpeek 1.2.1__tar.gz

webpeek-1.2.1/PKG-INFO

@@ -0,0 +1,195 @@
+Metadata-Version: 2.4
+Name: webpeek
+Version: 1.2.1
+Summary: OSINT CLI tool for web reconnaissance
+Home-page: https://github.com/JorgeRosbel/webpeek
+Author: JorgeRosbel
+Author-email: JorgeRosbel <jorge@rosbel.dev>
+License: MIT
+Project-URL: Homepage, https://github.com/JorgeRosbel/webpeek
+Requires-Python: >=3.8
+Description-Content-Type: text/markdown
+Requires-Dist: click>=8.0
+Requires-Dist: requests>=2.28
+Requires-Dist: dnspython>=2.1
+Requires-Dist: whois>=0.9
+Requires-Dist: beautifulsoup4>=4.9
+Requires-Dist: lxml>=4.6
+Requires-Dist: colorama>=0.4
+Requires-Dist: tldextract>=3.1
+Requires-Dist: pwntools>=4.0
+Requires-Dist: playwright>=1.40
+Requires-Dist: pyee>=10.0
+Requires-Dist: greenlet>=3.0
+Provides-Extra: dev
+Requires-Dist: twine; extra == "dev"
+Requires-Dist: build; extra == "dev"
+Dynamic: author
+Dynamic: home-page
+Dynamic: requires-python
+
+# webpeek
+
+OSINT CLI tool for web reconnaissance - gather passive and active information about websites.
+
+## Installation
+
+### From PyPI (recommended when published)
+```bash
+pip install webpeek
+```
+
+### From GitHub
+```bash
+pip install git+https://github.com/JorgeRosbel/webpeek.git
+```
+
+### Local development
+```bash
+git clone https://github.com/JorgeRosbel/webpeek.git
+cd webpeek
+pip install -e .
+```
+
+## Usage
+
+```bash
+# Basic scan
+webpeek example.com
+
+# Hybrid mode (active + passive)
+webpeek example.com -H
+
+# Passive only
+webpeek example.com -P
+
+# Active only
+webpeek example.com -A
+
+# Dynamic mode (for JavaScript sites)
+webpeek example.com -H -y
+
+# Specific modules
+webpeek example.com -T -l -e -p
+
+# Save to file
+webpeek example.com -H -oN result.txt
+
+# Without colors
+webpeek example.com -C
+
+# Help
+webpeek --help
+```
+
+## Options
+
+| Short | Flag | Description |
+|-------|------|-------------|
+| `-H` | `--hybrid` | Run both active and passive modules |
+| `-A` | `--active` | Run all active modules |
+| `-P` | `--passive` | Run all passive modules |
+| `-y` | `--dynamic` | Use headless browser (Playwright) |
+| `-oN` | `--output` | Save output to file |
+| `-C` | `--no-color` | Disable colors |
+| `-v` | `--verbose` | Verbose output |
+
+---
+
+## Passive Modules
+
+Gather information from public sources without connecting directly to the target.
+
+| Short | Flag | Description |
+|-------|------|-------------|
+| `-w` | `--whois` | Domain registration info |
+| `-d` | `--dns` | DNS A records |
+| `-m` | `--mx` | MX records |
+| `-t` | `--txt` | TXT records (SPF, DKIM) |
+| `-S` | `--subdomains` | Find subdomains |
+
+---
+
+## Active Modules
+
+Gather information by connecting directly to the target.
+
+| Short | Flag | Description |
+|-------|------|-------------|
+| `-h` | `--headers` | HTTP headers |
+| `-c` | `--security` | Security headers |
+| `-T` | `--tech` | Detect technologies |
+| `-W` | `--wplugins` | WordPress plugins |
+| `-s` | `--ssl` | SSL certificate info |
+| `-g` | `--geo` | Geolocation |
+| `-O` | `--os` | OS detection |
+| `-i` | `--title` | Page title |
+| `-D` | `--description` | Meta description |
+| `-e` | `--emails` | Extract emails |
+| `-p` | `--phones` | Extract phone numbers |
+| `-M` | `--sitemap` | Sitemap URLs |
+| `-r` | `--robots` | Robots.txt |
+| `-l` | `--social` | Social networks |
+
+---
+
+## Dynamic Mode
+
+Use `-y` for JavaScript-rendered sites (React, Vue, Angular, etc.):
+
+```bash
+webpeek example.com -T -y
+```
+
+First time using dynamic mode will download Chromium (~150MB).
+
+---
+
+## Example Output
+
+```
+╔════════════════════════════════════════════════════════╗
+║  🌐 WEBPEEK v1.0.0 - example.com                  ║
+╚════════════════════════════════════════════════════════╝
+
+  📡 PASSIVE MODE
+  ─────────────────────
+  ◉ WHOIS:
+      └─ Registrar: NameCheap, Inc.
+      └─ Created: 2025-12-14
+      └─ Expires: 2026-12-14
+
+  ◉ DNS:
+      └─ 93.184.216.34
+
+  ⚡ ACTIVE MODE
+  ─────────────────────
+  ◉ IP:
+      └─ 93.184.216.34
+
+  ◉ Geo:
+      └─ US, California (Cloudflare, Inc.)
+
+  ◉ Technologies:
+      └─ Cloudflare
+      └─ Nginx
+
+  ◉ SSL:
+      └─ example.com (expires in 90 days)
+
+╔════════════════════════════════════════════════════════╗
+║  Scan complete!                                  ║
+╚════════════════════════════════════════════════════════╝
+```
+
+---
+
+## Uninstall
+
+```bash
+pip uninstall webpeek
+```
+
+## License
+
+MIT

webpeek-1.2.1/README.md

@@ -0,0 +1,165 @@
+# webpeek
+
+OSINT CLI tool for web reconnaissance - gather passive and active information about websites.
+
+## Installation
+
+### From PyPI (recommended when published)
+```bash
+pip install webpeek
+```
+
+### From GitHub
+```bash
+pip install git+https://github.com/JorgeRosbel/webpeek.git
+```
+
+### Local development
+```bash
+git clone https://github.com/JorgeRosbel/webpeek.git
+cd webpeek
+pip install -e .
+```
+
+## Usage
+
+```bash
+# Basic scan
+webpeek example.com
+
+# Hybrid mode (active + passive)
+webpeek example.com -H
+
+# Passive only
+webpeek example.com -P
+
+# Active only
+webpeek example.com -A
+
+# Dynamic mode (for JavaScript sites)
+webpeek example.com -H -y
+
+# Specific modules
+webpeek example.com -T -l -e -p
+
+# Save to file
+webpeek example.com -H -oN result.txt
+
+# Without colors
+webpeek example.com -C
+
+# Help
+webpeek --help
+```
+
+## Options
+
+| Short | Flag | Description |
+|-------|------|-------------|
+| `-H` | `--hybrid` | Run both active and passive modules |
+| `-A` | `--active` | Run all active modules |
+| `-P` | `--passive` | Run all passive modules |
+| `-y` | `--dynamic` | Use headless browser (Playwright) |
+| `-oN` | `--output` | Save output to file |
+| `-C` | `--no-color` | Disable colors |
+| `-v` | `--verbose` | Verbose output |
+
+---
+
+## Passive Modules
+
+Gather information from public sources without connecting directly to the target.
+
+| Short | Flag | Description |
+|-------|------|-------------|
+| `-w` | `--whois` | Domain registration info |
+| `-d` | `--dns` | DNS A records |
+| `-m` | `--mx` | MX records |
+| `-t` | `--txt` | TXT records (SPF, DKIM) |
+| `-S` | `--subdomains` | Find subdomains |
+
+---
+
+## Active Modules
+
+Gather information by connecting directly to the target.
+
+| Short | Flag | Description |
+|-------|------|-------------|
+| `-h` | `--headers` | HTTP headers |
+| `-c` | `--security` | Security headers |
+| `-T` | `--tech` | Detect technologies |
+| `-W` | `--wplugins` | WordPress plugins |
+| `-s` | `--ssl` | SSL certificate info |
+| `-g` | `--geo` | Geolocation |
+| `-O` | `--os` | OS detection |
+| `-i` | `--title` | Page title |
+| `-D` | `--description` | Meta description |
+| `-e` | `--emails` | Extract emails |
+| `-p` | `--phones` | Extract phone numbers |
+| `-M` | `--sitemap` | Sitemap URLs |
+| `-r` | `--robots` | Robots.txt |
+| `-l` | `--social` | Social networks |
+
+---
+
+## Dynamic Mode
+
+Use `-y` for JavaScript-rendered sites (React, Vue, Angular, etc.):
+
+```bash
+webpeek example.com -T -y
+```
+
+First time using dynamic mode will download Chromium (~150MB).
+
+---
+
+## Example Output
+
+```
+╔════════════════════════════════════════════════════════╗
+║  🌐 WEBPEEK v1.0.0 - example.com                  ║
+╚════════════════════════════════════════════════════════╝
+
+  📡 PASSIVE MODE
+  ─────────────────────
+  ◉ WHOIS:
+      └─ Registrar: NameCheap, Inc.
+      └─ Created: 2025-12-14
+      └─ Expires: 2026-12-14
+
+  ◉ DNS:
+      └─ 93.184.216.34
+
+  ⚡ ACTIVE MODE
+  ─────────────────────
+  ◉ IP:
+      └─ 93.184.216.34
+
+  ◉ Geo:
+      └─ US, California (Cloudflare, Inc.)
+
+  ◉ Technologies:
+      └─ Cloudflare
+      └─ Nginx
+
+  ◉ SSL:
+      └─ example.com (expires in 90 days)
+
+╔════════════════════════════════════════════════════════╗
+║  Scan complete!                                  ║
+╚════════════════════════════════════════════════════════╝
+```
+
+---
+
+## Uninstall
+
+```bash
+pip uninstall webpeek
+```
+
+## License
+
+MIT

webpeek-1.2.1/pyproject.toml

@@ -0,0 +1,40 @@
+[build-system]
+requires = ["setuptools>=61.0", "wheel"]
+build-backend = "setuptools.build_meta"
+
+[project]
+name = "webpeek"
+version = "1.2.1"
+description = "OSINT CLI tool for web reconnaissance"
+readme = "README.md"
+license = {text = "MIT"}
+authors = [
+    {name = "JorgeRosbel", email = "jorge@rosbel.dev"}
+]
+requires-python = ">=3.8"
+dependencies = [
+    "click>=8.0",
+    "requests>=2.28",
+    "dnspython>=2.1",
+    "whois>=0.9",
+    "beautifulsoup4>=4.9",
+    "lxml>=4.6",
+    "colorama>=0.4",
+    "tldextract>=3.1",
+    "pwntools>=4.0",
+    "playwright>=1.40",
+    "pyee>=10.0",
+    "greenlet>=3.0",
+]
+
+[project.urls]
+Homepage = "https://github.com/JorgeRosbel/webpeek"
+
+[project.scripts]
+webpeek = "webpeek.cli:cli"
+
+[project.optional-dependencies]
+dev = ["twine", "build"]
+
+[tool.setuptools.packages.find]
+where = ["."]

webpeek-1.2.1/setup.cfg

@@ -0,0 +1,4 @@
+[egg_info]
+tag_build = 
+tag_date = 0
+

webpeek-1.2.1/setup.py

@@ -0,0 +1,42 @@
+from setuptools import setup, find_packages
+
+setup(
+    name='webpeek',
+    version='1.2.0',
+    description='OSINT CLI tool for web reconnaissance',
+    author='JorgeRosbel',
+    author_email='jorge@rosbel.dev',
+    url='https://github.com/JorgeRosbel/webpeek',
+    packages=find_packages(),
+    install_requires=[
+        'click>=8.0',
+        'requests>=2.28',
+        'dnspython>=2.1',
+        'Whois>=0.9',
+        'beautifulsoup4>=4.9',
+        'lxml>=4.6',
+        'colorama>=0.4',
+        'tldextract>=3.1',
+        'pwntools>=4.0',
+        'playwright>=1.40',
+        'pyee>=10.0',
+        'greenlet>=3.0',
+    ],
+    entry_points={
+        'console_scripts': [
+            'webpeek=webpeek.cli:cli',
+        ],
+    },
+    python_requires='>=3.8',
+    classifiers=[
+        'Development Status :: 4 - Beta',
+        'Intended Audience :: Developers',
+        'License :: OSI Approved :: MIT License',
+        'Programming Language :: Python :: 3',
+        'Programming Language :: Python :: 3.8',
+        'Programming Language :: Python :: 3.9',
+        'Programming Language :: Python :: 3.10',
+        'Programming Language :: Python :: 3.11',
+        'Programming Language :: Python :: 3.12',
+    ],
+)

webpeek-1.2.1/webpeek/__init__.py

@@ -0,0 +1 @@
+__version__ = "1.0.0"

webpeek-1.2.1/webpeek/cli.py

@@ -0,0 +1,137 @@
+import click
+import tldextract
+import socket
+import re
+from pwn import log
+from webpeek.core.scanner import Scanner
+from webpeek.core.output import print_results, save_to_file
+from webpeek.utils.colors import Colors, RESET
+
+
+def is_valid_domain(domain):
+    pattern = r'^(?:[a-zA-Z0-9](?:[a-zA-Z0-9-]{0,61}[a-zA-Z0-9])?\.)+[a-zA-Z]{2,}$'
+    return bool(re.match(pattern, domain))
+
+
+def validate_target(target):
+    ext = tldextract.extract(target)
+    if not ext.domain or not ext.suffix:
+        return None
+    
+    domain = f"{ext.domain}.{ext.suffix}"
+    
+    if not is_valid_domain(domain):
+        return None
+    
+    try:
+        socket.gethostbyname(domain)
+        return domain
+    except socket.gaierror:
+        return None
+
+
+ALL_ACTIVE_MODULES = ['headers', 'tech', 'ssl', 'geo', 'title', 'description', 'security', 'wplugins', 'sitemap', 'robots', 'os', 'emails', 'phones']
+ALL_PASSIVE_MODULES = ['whois', 'dns', 'mx', 'txt', 'subdomains']
+
+
+@click.command()
+@click.argument('target')
+@click.option('-H', '--hybrid', 'hybrid_mode', is_flag=True, help='Run both active and passive modules')
+@click.option('-A', '--active', is_flag=True, help='Run all active modules')
+@click.option('-P', '--passive', is_flag=True, help='Run all passive modules')
+@click.option('-w', '--whois', is_flag=True, help='WHOIS lookup')
+@click.option('-d', '--dns', is_flag=True, help='DNS lookup')
+@click.option('-m', '--mx', is_flag=True, help='MX records')
+@click.option('-t', '--txt', is_flag=True, help='TXT records (SPF, DKIM)')
+@click.option('-h', '--headers', is_flag=True, help='HTTP headers')
+@click.option('-T', '--tech', is_flag=True, help='Detect technologies')
+@click.option('-s', '--ssl', is_flag=True, help='SSL certificate info')
+@click.option('-g', '--geo', is_flag=True, help='Geolocation')
+@click.option('-O', '--os', is_flag=True, help='OS detection via TTL')
+@click.option('-i', '--title', is_flag=True, help='Page title')
+@click.option('-D', '--description', 'desc', is_flag=True, help='Meta description')
+@click.option('-e', '--emails', is_flag=True, help='Extract emails')
+@click.option('-p', '--phones', is_flag=True, help='Extract phone numbers')
+@click.option('-S', '--subdomains', is_flag=True, help='Find subdomains')
+@click.option('-c', '--security', is_flag=True, help='Security headers audit')
+@click.option('-W', '--wplugins', is_flag=True, help='WordPress plugins')
+@click.option('-M', '--sitemap', is_flag=True, help='Extract URLs from sitemap')
+@click.option('-r', '--robots', is_flag=True, help='Fetch robots.txt')
+@click.option('-oN', '--output', type=click.Path(), help='Save output to file')
+@click.option('-C', '--no-color', is_flag=True, help='Disable colors')
+@click.option('-v', '--verbose', is_flag=True, help='Verbose output')
+def cli(target, hybrid_mode, active, passive, whois, dns, mx, txt, headers, tech, ssl, geo, os, title, desc, emails, phones, subdomains, security, wplugins, sitemap, robots, output, no_color, verbose):
+    use_color = not no_color
+    
+    domain = validate_target(target)
+    if not domain:
+        print(f"{Colors.error('[ERROR] Invalid domain: ' + target)}")
+        return
+    
+    scanner = Scanner(domain, verbose, use_color)
+    
+    active_modules = []
+    passive_modules = []
+    
+    specific_flags = [whois, dns, mx, txt, subdomains, headers, tech, ssl, geo, os, title, desc, emails, phones, security, wplugins, sitemap, robots]
+    is_custom = any(specific_flags) and not hybrid_mode and not active and not passive
+    
+    if hybrid_mode:
+        active_modules = ALL_ACTIVE_MODULES.copy()
+        passive_modules = ALL_PASSIVE_MODULES.copy()
+    elif active:
+        active_modules = ALL_ACTIVE_MODULES.copy()
+    elif passive:
+        passive_modules = ALL_PASSIVE_MODULES.copy()
+    elif any(specific_flags):
+        active_modules = []
+        passive_modules = []
+    else:
+        active_modules = ALL_ACTIVE_MODULES.copy()
+        passive_modules = ALL_PASSIVE_MODULES.copy()
+    
+    if whois: passive_modules.append('whois')
+    if dns: passive_modules.append('dns')
+    if mx: passive_modules.append('mx')
+    if txt: passive_modules.append('txt')
+    if subdomains: passive_modules.append('subdomains')
+    if emails: active_modules.append('emails')
+    if phones: active_modules.append('phones')
+    if headers: active_modules.append('headers')
+    if tech: active_modules.append('tech')
+    if ssl: active_modules.append('ssl')
+    if geo: active_modules.append('geo')
+    if os: active_modules.append('os')
+    if title: active_modules.append('title')
+    if desc: active_modules.append('description')
+    if security: active_modules.append('security')
+    if wplugins: active_modules.append('wplugins')
+    if sitemap: active_modules.append('sitemap')
+    if robots: active_modules.append('robots')
+    
+    active_modules = list(set(active_modules))
+    passive_modules = list(set(passive_modules))
+    
+    results = {}
+    
+    if passive_modules:
+        results.update(scanner.scan_passive(passive_modules))
+    
+    if active_modules:
+        results.update(scanner.scan_active(active_modules))
+    
+    print_results(domain, results, use_color, is_custom)
+    
+    if output:
+        from webpeek.utils.colors import format_plain
+        plain_output = format_plain(domain, results)
+        
+        if save_to_file(output, plain_output):
+            if use_color:
+                click.echo(f"{Colors.pass_('Results saved to ' + output)}")
+            else:
+                click.echo(f"Results saved to {output}")
+
+
+if __name__ == '__main__':
+    cli()

webpeek-1.2.1/webpeek/core/output.py

@@ -0,0 +1,51 @@
+from webpeek.utils.colors import format_output, Colors
+
+
+def format_list_value(value):
+    if isinstance(value, dict):
+        return value
+    
+    if not isinstance(value, list):
+        return str(value)
+    
+    if not value:
+        return ""
+    
+    if isinstance(value[0], dict):
+        if 'name' in value[0] and 'version' in value[0]:
+            return "\n".join(f"  • {v['name']} ({v['version']})" for v in value)
+        return "\n".join(f"  • {v}" for v in value)
+    
+    return "\n".join(f"  • {v}" for v in value)
+
+
+def print_results(target, results, use_color=True, is_custom=False):
+    clean_results = {}
+    for key, value in results.items():
+        if key == 'IP' and is_custom:
+            continue
+        if value and (isinstance(value, dict) or str(value).strip()):
+            if isinstance(value, dict):
+                clean_results[key] = value
+            else:
+                formatted = format_list_value(value)
+                clean_results[key] = formatted[:200]
+
+    if not clean_results:
+        if use_color:
+            print(f"{Colors.warning('No results found')}")
+        else:
+            print("No results found")
+        return
+
+    output = format_output(target, clean_results, use_color, is_custom)
+    print(output)
+
+
+def save_to_file(filename, content):
+    try:
+        with open(filename, 'w') as f:
+            f.write(content)
+        return True
+    except Exception as e:
+        return False