webtools-cli 1.1.0__tar.gz → 1.1.1__tar.gz

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
@@ -0,0 +1,171 @@
1
+ Metadata-Version: 2.4
2
+ Name: webtools-cli
3
+ Version: 1.1.1
4
+ Summary: Advanced Web Intelligence & Scraping Toolkit with CLI and Web UI
5
+ Author: Abhinav Adarsh
6
+ License-Expression: MIT
7
+ Project-URL: Homepage, https://webtoolscli.pages.dev
8
+ Keywords: web-scraping,osint,seo,intelligence,cli
9
+ Classifier: Development Status :: 4 - Beta
10
+ Classifier: Environment :: Console
11
+ Classifier: Intended Audience :: Developers
12
+ Classifier: Programming Language :: Python :: 3
13
+ Classifier: Programming Language :: Python :: 3.9
14
+ Classifier: Programming Language :: Python :: 3.10
15
+ Classifier: Programming Language :: Python :: 3.11
16
+ Classifier: Programming Language :: Python :: 3.12
17
+ Classifier: Topic :: Internet :: WWW/HTTP
18
+ Requires-Python: >=3.9
19
+ Description-Content-Type: text/markdown
20
+ License-File: LICENSE
21
+ Requires-Dist: flask
22
+ Requires-Dist: requests
23
+ Requires-Dist: beautifulsoup4
24
+ Requires-Dist: qrcode
25
+ Requires-Dist: opencv-python
26
+ Requires-Dist: numpy
27
+ Requires-Dist: textblob
28
+ Requires-Dist: Pillow
29
+ Requires-Dist: mtranslate
30
+ Requires-Dist: colorama
31
+ Requires-Dist: pyreadline3; platform_system == "Windows"
32
+ Provides-Extra: playwright
33
+ Requires-Dist: playwright; extra == "playwright"
34
+ Dynamic: license-file
35
+
36
+ # WebTools CLI
37
+
38
+ [![PyPI Version](https://img.shields.io/pypi/v/webtools-cli)](https://pypi.org/project/webtools-cli/)
39
+ [![License](https://img.shields.io/github/license/abhinavgautam08/webtools-cli)](https://github.com/abhinavgautam08/webtools-cli/blob/main/LICENSE)
40
+ [![Python Version](https://img.shields.io/badge/python-3.9+-blue?logo=python&logoColor=white)](https://pypi.org/project/webtools-cli/)
41
+
42
+ ![WebTools CLI Interface](https://i.postimg.cc/7LXjQqBm/CLI.png)
43
+
44
+ try : [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1l4-ZChKGYhOFrPwp2_JPLJ1X0ZYSVrZk?usp=sharing)
45
+
46
+ An advanced web intelligence suite for researchers, OSINT enthusiasts, and developers. It brings the power of deep web analysis and automated scraping directly into your terminal.
47
+
48
+ ---
49
+
50
+ ## 🚀 Why WebTools CLI?
51
+
52
+ - **🎯 Stealth & Speed**: Smart proxy rotation and Turbo-Fetch logic for evasion and performance.
53
+ - **🧠 AI-Powered**: Automated content summarization, sentiment analysis, and readability scoring.
54
+ - **🔧 Security-Centric**: Built-in honeypot detection, threat leveling, and image forensic analysis.
55
+ - **💻 Terminal-First**: Designed for power users who live in the command line.
56
+ - **🛡️ Cross-Platform**: Works seamlessly on Windows, Linux, and macOS (with auto-download for Windows tunnels).
57
+ - **🔌 SPA Ready**: Automatic Playwright fallback for JavaScript-heavy sites like LinkedIn/Instagram.
58
+
59
+ ---
60
+
61
+ ## 📦 Installation
62
+
63
+ See the installation guide for recommended system specifications.
64
+
65
+ ### Quick Install
66
+
67
+ Install globally via pip:
68
+
69
+ ```bash
70
+ pip install webtools-cli
71
+ ```
72
+
73
+ To upgrade to the latest version:
74
+
75
+ ```bash
76
+ pip install webtools-cli --upgrade
77
+ ```
78
+
79
+ ### Optional Dependencies
80
+
81
+ For Single Page Application (SPA) support:
82
+
83
+ ```bash
84
+ pip install "webtools-cli[playwright]"
85
+ playwright install chromium
86
+ ```
87
+
88
+ ---
89
+
90
+ ## 📋 Key Features
91
+
92
+ ### Advanced Scraping & Stealth
93
+ - **Smart Proxy Rotation**: Automatically rotates User-Agents and Proxies to evade detection.
94
+ - **Turbo-Fetch**: Parallel chunk downloads for large media (Videos/Images).
95
+ - **Deep Crawl**: Recursive link mapping up to 3 levels deep.
96
+ - **Headless Fallback**: Integrated Playwright support for auth-walled or SPA environments.
97
+
98
+ ### Intelligence & Security Analysis
99
+ - **OSINT Toolkit**: Auto-extract emails, phones, locations, social media, and tech stacks.
100
+ - **SEO Auditor**: Page score, heading hierarchy, link integrity, and image alt-text auditing.
101
+ - **Image Forensics**: CLI-based Error Level Analysis (ELA) and AI-likelihood detection.
102
+ - **Honeypot Detector**: Identifies hidden traps and anti-bot measures (Cloudflare/CAPTCHAs).
103
+
104
+ ### Modern Experience
105
+ - **Premium Visual Engine**: Sleek glassmorphism, fluid gradients, and premium Motion One animations.
106
+ - **Edge-to-Edge Responsiveness**: Rock-solid layout stability on every device, from iPhone SE to 4K monitors.
107
+ - **Dynamic Interactions**: Flickering grid backgrounds, hover-glow effects, and high-performance transitions.
108
+
109
+ ---
110
+
111
+ ## 🚀 Getting Started
112
+
113
+ ### Basic Usage
114
+
115
+ #### Launch Interactive Menu
116
+ ```bash
117
+ webtools
118
+ ```
119
+
120
+ #### Non-Interactive Script Mode
121
+ ```bash
122
+ python -m webtools
123
+ ```
124
+
125
+ ### Slash Commands Reference
126
+
127
+ Navigate the suite using quick terminal commands:
128
+
129
+ | Command | Alias | Description |
130
+ |---------|-------|-------------|
131
+ | `/web` | `/w` | Launch **Web UI** (Cloudflare Tunnel + QR) |
132
+ | `/cli` | `/c` | Launch **CLI Intelligence** scan |
133
+ | `/image` | `/i` | **Image Forensics** & AI Likelihood |
134
+ | `/history`| `/hi`| View and manage scan history |
135
+ | `/help` | `/h` | Show full command documentation |
136
+ | `/clear` | - | Purge all locally scraped data |
137
+ | `/quit` | `/q` | Exit the application |
138
+
139
+ ---
140
+
141
+ ## ☁️ Deployment Options
142
+
143
+ - **Local Development**: Run on your machine with a generated QR code for mobile access.
144
+ - **Cloud Tunnels**: Automatic `cloudflared` integration to expose your UI globally.
145
+ - **Google Colab**: Compatible with Colab for cloud-based scraping (see badge above).
146
+
147
+ ---
148
+
149
+ ## 🤝 Resources & Support
150
+
151
+ - **[GitHub Repository](https://github.com/abhinavgautam08/webtools-cli)** - Source code and updates.
152
+ - **[Issue Tracker](https://github.com/abhinavgautam08/webtools-cli/issues)** - Report bugs or request features.
153
+ - **[License](./LICENSE)** - MIT License.
154
+
155
+ ---
156
+
157
+ ## ⚖️ Legal
158
+
159
+ This tool is for **educational and testing purposes only**. Always respect `robots.txt` and the Terms of Service of the websites you scrape. Neither the author nor the contributors are responsible for any misuse of this tool.
160
+
161
+ ---
162
+
163
+ <p align="center">
164
+ Built with ❤️ by
165
+ <strong>
166
+ <a href="https://abhinavgautam08.pages.dev/" target="_blank" rel="noopener noreferrer">
167
+ Abhinav Adarsh
168
+ </a>
169
+ </strong>
170
+ and the open source community
171
+ </p>
@@ -0,0 +1,136 @@
1
+ # WebTools CLI
2
+
3
+ [![PyPI Version](https://img.shields.io/pypi/v/webtools-cli)](https://pypi.org/project/webtools-cli/)
4
+ [![License](https://img.shields.io/github/license/abhinavgautam08/webtools-cli)](https://github.com/abhinavgautam08/webtools-cli/blob/main/LICENSE)
5
+ [![Python Version](https://img.shields.io/badge/python-3.9+-blue?logo=python&logoColor=white)](https://pypi.org/project/webtools-cli/)
6
+
7
+ ![WebTools CLI Interface](https://i.postimg.cc/7LXjQqBm/CLI.png)
8
+
9
+ try : [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1l4-ZChKGYhOFrPwp2_JPLJ1X0ZYSVrZk?usp=sharing)
10
+
11
+ An advanced web intelligence suite for researchers, OSINT enthusiasts, and developers. It brings the power of deep web analysis and automated scraping directly into your terminal.
12
+
13
+ ---
14
+
15
+ ## 🚀 Why WebTools CLI?
16
+
17
+ - **🎯 Stealth & Speed**: Smart proxy rotation and Turbo-Fetch logic for evasion and performance.
18
+ - **🧠 AI-Powered**: Automated content summarization, sentiment analysis, and readability scoring.
19
+ - **🔧 Security-Centric**: Built-in honeypot detection, threat leveling, and image forensic analysis.
20
+ - **💻 Terminal-First**: Designed for power users who live in the command line.
21
+ - **🛡️ Cross-Platform**: Works seamlessly on Windows, Linux, and macOS (with auto-download for Windows tunnels).
22
+ - **🔌 SPA Ready**: Automatic Playwright fallback for JavaScript-heavy sites like LinkedIn/Instagram.
23
+
24
+ ---
25
+
26
+ ## 📦 Installation
27
+
28
+ See the installation guide for recommended system specifications.
29
+
30
+ ### Quick Install
31
+
32
+ Install globally via pip:
33
+
34
+ ```bash
35
+ pip install webtools-cli
36
+ ```
37
+
38
+ To upgrade to the latest version:
39
+
40
+ ```bash
41
+ pip install webtools-cli --upgrade
42
+ ```
43
+
44
+ ### Optional Dependencies
45
+
46
+ For Single Page Application (SPA) support:
47
+
48
+ ```bash
49
+ pip install "webtools-cli[playwright]"
50
+ playwright install chromium
51
+ ```
52
+
53
+ ---
54
+
55
+ ## 📋 Key Features
56
+
57
+ ### Advanced Scraping & Stealth
58
+ - **Smart Proxy Rotation**: Automatically rotates User-Agents and Proxies to evade detection.
59
+ - **Turbo-Fetch**: Parallel chunk downloads for large media (Videos/Images).
60
+ - **Deep Crawl**: Recursive link mapping up to 3 levels deep.
61
+ - **Headless Fallback**: Integrated Playwright support for auth-walled or SPA environments.
62
+
63
+ ### Intelligence & Security Analysis
64
+ - **OSINT Toolkit**: Auto-extract emails, phones, locations, social media, and tech stacks.
65
+ - **SEO Auditor**: Page score, heading hierarchy, link integrity, and image alt-text auditing.
66
+ - **Image Forensics**: CLI-based Error Level Analysis (ELA) and AI-likelihood detection.
67
+ - **Honeypot Detector**: Identifies hidden traps and anti-bot measures (Cloudflare/CAPTCHAs).
68
+
69
+ ### Modern Experience
70
+ - **Premium Visual Engine**: Sleek glassmorphism, fluid gradients, and premium Motion One animations.
71
+ - **Edge-to-Edge Responsiveness**: Rock-solid layout stability on every device, from iPhone SE to 4K monitors.
72
+ - **Dynamic Interactions**: Flickering grid backgrounds, hover-glow effects, and high-performance transitions.
73
+
74
+ ---
75
+
76
+ ## 🚀 Getting Started
77
+
78
+ ### Basic Usage
79
+
80
+ #### Launch Interactive Menu
81
+ ```bash
82
+ webtools
83
+ ```
84
+
85
+ #### Non-Interactive Script Mode
86
+ ```bash
87
+ python -m webtools
88
+ ```
89
+
90
+ ### Slash Commands Reference
91
+
92
+ Navigate the suite using quick terminal commands:
93
+
94
+ | Command | Alias | Description |
95
+ |---------|-------|-------------|
96
+ | `/web` | `/w` | Launch **Web UI** (Cloudflare Tunnel + QR) |
97
+ | `/cli` | `/c` | Launch **CLI Intelligence** scan |
98
+ | `/image` | `/i` | **Image Forensics** & AI Likelihood |
99
+ | `/history`| `/hi`| View and manage scan history |
100
+ | `/help` | `/h` | Show full command documentation |
101
+ | `/clear` | - | Purge all locally scraped data |
102
+ | `/quit` | `/q` | Exit the application |
103
+
104
+ ---
105
+
106
+ ## ☁️ Deployment Options
107
+
108
+ - **Local Development**: Run on your machine with a generated QR code for mobile access.
109
+ - **Cloud Tunnels**: Automatic `cloudflared` integration to expose your UI globally.
110
+ - **Google Colab**: Compatible with Colab for cloud-based scraping (see badge above).
111
+
112
+ ---
113
+
114
+ ## 🤝 Resources & Support
115
+
116
+ - **[GitHub Repository](https://github.com/abhinavgautam08/webtools-cli)** - Source code and updates.
117
+ - **[Issue Tracker](https://github.com/abhinavgautam08/webtools-cli/issues)** - Report bugs or request features.
118
+ - **[License](./LICENSE)** - MIT License.
119
+
120
+ ---
121
+
122
+ ## ⚖️ Legal
123
+
124
+ This tool is for **educational and testing purposes only**. Always respect `robots.txt` and the Terms of Service of the websites you scrape. Neither the author nor the contributors are responsible for any misuse of this tool.
125
+
126
+ ---
127
+
128
+ <p align="center">
129
+ Built with ❤️ by
130
+ <strong>
131
+ <a href="https://abhinavgautam08.pages.dev/" target="_blank" rel="noopener noreferrer">
132
+ Abhinav Adarsh
133
+ </a>
134
+ </strong>
135
+ and the open source community
136
+ </p>
@@ -4,7 +4,7 @@ build-backend = "setuptools.build_meta"
4
4
 
5
5
  [project]
6
6
  name = "webtools-cli"
7
- version = "1.1.0"
7
+ version = "1.1.1"
8
8
  description = "Advanced Web Intelligence & Scraping Toolkit with CLI and Web UI"
9
9
  readme = "README.md"
10
10
  license = "MIT"
@@ -45,7 +45,7 @@ playwright = ["playwright"]
45
45
  webtools = "webtools.cli:main"
46
46
 
47
47
  [project.urls]
48
- Homepage = "https://github.com/abhinavgautam08/webtools-cli"
48
+ Homepage = "https://webtoolscli.pages.dev"
49
49
 
50
50
  [tool.setuptools.packages.find]
51
51
  include = ["webtools*"]