aiwaf 0.1.9.0.4__py3-none-any.whl → 0.1.9.0.6__py3-none-any.whl

{aiwaf-0.1.9.0.4.dist-info → aiwaf-0.1.9.0.6.dist-info}/METADATA

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: aiwaf
-Version: 0.1.9.0.4
+Version: 0.1.9.0.6
 Summary: AI-powered Web Application Firewall
 Home-page: https://github.com/aayushgauba/aiwaf
 Author: Aayush Gauba
@@ -68,7 +68,7 @@ aiwaf/
 ## 🚀 Features
 
 - **IP Blocklist**  
-  Instantly blocks suspicious IPs (supports CSV fallback or Django model).
+  Instantly blocks suspicious IPs using Django models with real-time performance.
 
 - **Rate Limiting**  
   Sliding‑window blocks flooders (> `AIWAF_RATE_MAX` per `AIWAF_RATE_WINDOW`), then blacklists them.
@@ -98,9 +98,9 @@ aiwaf/
   Blocks guessed or invalid UUIDs that don't resolve to real models.
 
 - **Built-in Request Logger**  
-  Optional middleware logger that captures requests to CSV:
+  Optional middleware logger that captures requests to Django models:
   - **Automatic fallback** when main access logs unavailable
-  - **CSV format** for easy analysis and training
+  - **Real-time storage** in database for instant access
   - **Captures response times** for better anomaly detection
   - **Zero configuration** - works out of the box
 
@@ -221,28 +221,33 @@ AIWAF_ACCESS_LOG = "/var/log/nginx/access.log"
 
 ---
 
-### Storage Configuration
+### Database Models
 
-**Choose storage backend:**
+AI-WAF uses Django models for real-time, high-performance storage:
 
 ```python
-# Use Django models (default) - requires database tables
-AIWAF_STORAGE_MODE = "models"
-
-# OR use CSV files - no database required
-AIWAF_STORAGE_MODE = "csv"
-AIWAF_CSV_DATA_DIR = "aiwaf_data"  # Directory for CSV files
+# All data is stored in Django models - no configuration needed
+# Tables created automatically with migrations:
+# - aiwaf_blacklistentry     # Blocked IP addresses
+# - aiwaf_ipexemption        # Exempt IP addresses  
+# - aiwaf_dynamickeyword     # Dynamic keywords with counts
+# - aiwaf_featuresample      # Feature samples for ML training
+# - aiwaf_requestlog         # Request logs (if middleware logging enabled)
 ```
 
-**CSV Mode Features:**
-- No database migrations required
-- Files stored in `aiwaf_data/` directory:
-  - `blacklist.csv` - Blocked IP addresses
-  - `exemptions.csv` - Exempt IP addresses  
-  - `keywords.csv` - Dynamic keywords
-  - `access_samples.csv` - Feature samples for ML training
-- Perfect for lightweight deployments or when you prefer file-based storage
-- Management commands work identically in both modes
+**Benefits of Django Models:**
+- ⚡ **Real-time performance** - No file I/O bottlenecks
+- 🔄 **Instant updates** - Changes visible immediately across all processes
+- 🚀 **Better concurrency** - No file locking issues
+- 📊 **Rich querying** - Use Django ORM for complex operations
+- 🔍 **Admin integration** - View/manage data through Django admin
+
+**Database Setup:**
+```bash
+# Create and apply migrations
+python manage.py makemigrations aiwaf
+python manage.py migrate aiwaf
+```
 
 ---
 
@@ -253,8 +258,6 @@ Enable AI-WAF's built-in request logger as a fallback when main access logs aren
 ```python
 # Enable middleware logging
 AIWAF_MIDDLEWARE_LOGGING = True                    # Enable/disable logging
-AIWAF_MIDDLEWARE_LOG = "aiwaf_requests.log"        # Log file path
-AIWAF_MIDDLEWARE_CSV = True                        # Use CSV format (recommended)
 ```
 
 **Then add middleware to MIDDLEWARE list:**
@@ -276,8 +279,8 @@ python manage.py aiwaf_logging --clear     # Clear log files
 
 **Benefits:**
 - **Automatic fallback** when `AIWAF_ACCESS_LOG` unavailable
-- **CSV format** with precise timestamps and response times
-- **Zero configuration** - trainer automatically detects and uses CSV logs
+- **Database storage** with precise timestamps and response times
+- **Zero configuration** - trainer automatically detects and uses model logs
 - **Lightweight** - fails silently to avoid breaking your application
 
 ---
@@ -386,7 +389,7 @@ python manage.py detect_and_train
 ```
 
 ### What happens:
-1. Read access logs (incl. rotated or gzipped) **OR** AI-WAF middleware CSV logs
+1. Read access logs (incl. rotated or gzipped) **OR** AI-WAF middleware model logs
 2. Auto‑block IPs with ≥ 6 total 404s
 3. Extract features & train IsolationForest
 4. Save `model.pkl` with current scikit-learn version
@@ -411,7 +414,7 @@ python manage.py detect_and_train
 5. Extract top 10 dynamic keywords from 4xx/5xx
 6. Remove any keywords associated with newly exempt paths
 
-**Note:** If main access log (`AIWAF_ACCESS_LOG`) is unavailable, trainer automatically falls back to AI-WAF middleware CSV logs.
+**Note:** If main access log (`AIWAF_ACCESS_LOG`) is unavailable, trainer automatically falls back to AI-WAF middleware model logs.
 
 ---
 

aiwaf-0.1.9.0.6.dist-info/RECORD

@@ -0,0 +1,32 @@
+aiwaf/__init__.py,sha256=CaCYDiHa_an8eS3dgJs0d6bCNQN7KUMc2sJBLEXNt8I,220
+aiwaf/apps.py,sha256=nCez-Ptlv2kaEk5HenA8b1pATz1VfhrHP1344gwcY1A,142
+aiwaf/blacklist_manager.py,sha256=LYCeKFB-7e_C6Bg2WeFJWFIIQlrfRMPuGp30ivrnhQY,1196
+aiwaf/decorators.py,sha256=IUKOdM_gdroffImRZep1g1wT6gNqD10zGwcp28hsJCs,825
+aiwaf/middleware.py,sha256=uKGelYd7SLB37BMcR7SQ_83NIPy6n2Y17ZvTOFpAOWM,12262
+aiwaf/middleware_logger.py,sha256=LWZVDAnjh6CGESirA8eMbhGgJKB7lVDGRQqVroH95Lo,4742
+aiwaf/models.py,sha256=vQxgY19BDVMjoO903UNrTZC1pNoLltMU6wbyWPoAEns,2719
+aiwaf/storage.py,sha256=z2QjAySa95FN3SPJL2GBL11tE8JYrAH6mB7BMSZ6GEM,7310
+aiwaf/trainer.py,sha256=dOjdQ5zqEuwzffgTu7WZMokFcW5b0-KTDSjMeHBcIhw,9203
+aiwaf/utils.py,sha256=BJk5vJCYdGPl_4QQiknjhCbkzv5HZCXgFcBJDMJpHok,3390
+aiwaf/management/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+aiwaf/management/commands/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+aiwaf/management/commands/add_exemption.py,sha256=U_ByfJw1EstAZ8DaSoRb97IGwYzXs0DBJkVAqeN4Wak,1128
+aiwaf/management/commands/add_ipexemption.py,sha256=srgdVPDJtF7G9GGIqaZ7L3qTuNheoS_uwlhlRO4W2bc,945
+aiwaf/management/commands/aiwaf_diagnose.py,sha256=nXFRhq66N4QC3e4scYJ2sUngJce-0yDxtBO3R2BllRM,6134
+aiwaf/management/commands/aiwaf_logging.py,sha256=FCIqULn2tii2vD9VxL7vk3PV4k4vr7kaA00KyaCExYY,7692
+aiwaf/management/commands/aiwaf_reset.py,sha256=0FIBqpZS8xgFFvAKJ-0zAC_-QNQwRkOHpXb8N-OdFr8,3740
+aiwaf/management/commands/clear_cache.py,sha256=cdnuTgxkhKLqT_6k6yTcEBlREovNRQxAE51ceXlGYMA,647
+aiwaf/management/commands/detect_and_train.py,sha256=-o-LZ7QZ5GeJPCekryox1DGXKMmFEkwwrcDsiM166K0,269
+aiwaf/management/commands/diagnose_blocking.py,sha256=HKb_FdN4b6QdyqNDf54B08I5jyWfrv9Mh-SFBrr3LbU,4140
+aiwaf/management/commands/regenerate_model.py,sha256=SUy7TCTTDJy4kRZNAbTIVBxSmljUaAC6ms0JTfSO6BE,3445
+aiwaf/management/commands/setup_models.py,sha256=JzuxwAqO3e-8L4PdFlXkyEQmOA8EGCXBfaOwfCNv1Gg,1678
+aiwaf/management/commands/test_exemption.py,sha256=qX7GMnpGFhRzC8cTtJMVN7pvjXziEWJ934cyOLN3cqs,5511
+aiwaf/management/commands/test_exemption_fix.py,sha256=ngyGaHUCmQQ6y--6j4q1viZJtR-RvI526yDqvEaEXPs,2553
+aiwaf/resources/model.pkl,sha256=5t6h9BX8yoh2xct85MXOO60jdlWyg1APskUOW0jZE1Y,1288265
+aiwaf/templatetags/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
+aiwaf/templatetags/aiwaf_tags.py,sha256=XXfb7Tl4DjU3Sc40GbqdaqOEtKTUKELBEk58u83wBNw,357
+aiwaf-0.1.9.0.6.dist-info/licenses/LICENSE,sha256=Ir8PX4dxgAcdB0wqNPIkw84fzIIRKE75NoUil9RX0QU,1069
+aiwaf-0.1.9.0.6.dist-info/METADATA,sha256=xhkKJlK7aW0mObUkrIboi4E4GTP1aLpyoo_I0QUJs4E,13763
+aiwaf-0.1.9.0.6.dist-info/WHEEL,sha256=_zCd3N1l69ArxyTb8rzEoP9TpbYXkqRFSNOD5OuxnTs,91
+aiwaf-0.1.9.0.6.dist-info/top_level.txt,sha256=kU6EyjobT6UPCxuWpI_BvcHDG0I2tMgKaPlWzVxe2xI,6
+aiwaf-0.1.9.0.6.dist-info/RECORD,,

aiwaf/management/commands/debug_csv.py

@@ -1,155 +0,0 @@
-from django.core.management.base import BaseCommand
-import os
-import csv
-
-class Command(BaseCommand):
-    help = 'Debug and fix AI-WAF CSV functionality'
-
-    def add_arguments(self, parser):
-        parser.add_argument(
-            '--test-ip',
-            type=str,
-            help='Test IP address to add to exemption list',
-            default='127.0.0.1'
-        )
-        parser.add_argument(
-            '--fix',
-            action='store_true',
-            help='Attempt to fix identified issues',
-        )
-
-    def handle(self, *args, **options):
-        self.stdout.write(self.style.HTTP_INFO("🔍 AI-WAF CSV Debug & Fix"))
-        self.stdout.write("")
-        
-        # Check storage mode
-        from django.conf import settings
-        storage_mode = getattr(settings, 'AIWAF_STORAGE_MODE', 'models')
-        csv_dir = getattr(settings, 'AIWAF_CSV_DATA_DIR', 'aiwaf_data')
-        
-        self.stdout.write(f"Storage Mode: {storage_mode}")
-        self.stdout.write(f"CSV Directory: {csv_dir}")
-        self.stdout.write("")
-        
-        # Check middleware logging
-        middleware_logging = getattr(settings, 'AIWAF_MIDDLEWARE_LOGGING', False)
-        middleware_log = getattr(settings, 'AIWAF_MIDDLEWARE_LOG', 'aiwaf_requests.log')
-        
-        self.stdout.write(f"Middleware Logging: {middleware_logging}")
-        self.stdout.write(f"Middleware Log File: {middleware_log}")
-        self.stdout.write("")
-        
-        # Check if CSV directory exists
-        if os.path.exists(csv_dir):
-            self.stdout.write(self.style.SUCCESS(f"✅ CSV directory exists: {csv_dir}"))
-        else:
-            self.stdout.write(self.style.ERROR(f"❌ CSV directory missing: {csv_dir}"))
-            if options['fix']:
-                os.makedirs(csv_dir, exist_ok=True)
-                self.stdout.write(self.style.SUCCESS(f"✅ Created CSV directory: {csv_dir}"))
-        
-        # Check CSV files
-        csv_files = ['blacklist.csv', 'exemptions.csv', 'keywords.csv']
-        for filename in csv_files:
-            filepath = os.path.join(csv_dir, filename)
-            if os.path.exists(filepath):
-                # Count entries
-                try:
-                    with open(filepath, 'r', newline='', encoding='utf-8') as f:
-                        reader = csv.reader(f)
-                        rows = list(reader)
-                        entry_count = len(rows) - 1 if rows else 0  # Subtract header
-                        self.stdout.write(self.style.SUCCESS(f"✅ {filename}: {entry_count} entries"))
-                except Exception as e:
-                    self.stdout.write(self.style.ERROR(f"❌ {filename}: Error reading - {e}"))
-            else:
-                self.stdout.write(self.style.WARNING(f"⚠️  {filename}: Not found"))
-        
-        self.stdout.write("")
-        
-        # Test storage functionality
-        self.stdout.write(self.style.HTTP_INFO("🧪 Testing Storage Functions"))
-        
-        try:
-            from aiwaf.storage import get_exemption_store, get_blacklist_store, get_keyword_store
-            
-            # Test exemption store
-            exemption_store = get_exemption_store()
-            self.stdout.write(f"Exemption Store: {exemption_store.__name__}")
-            
-            # Test blacklist store
-            blacklist_store = get_blacklist_store()
-            self.stdout.write(f"Blacklist Store: {blacklist_store.__name__}")
-            
-            # Test keyword store
-            keyword_store = get_keyword_store()
-            self.stdout.write(f"Keyword Store: {keyword_store.__name__}")
-            
-        except Exception as e:
-            self.stdout.write(self.style.ERROR(f"❌ Storage import failed: {e}"))
-            return
-        
-        self.stdout.write("")
-        
-        # Test exemption functionality
-        test_ip = options['test_ip']
-        self.stdout.write(f"🧪 Testing exemption with IP: {test_ip}")
-        
-        try:
-            # Check if already exempted
-            is_exempted_before = exemption_store.is_exempted(test_ip)
-            self.stdout.write(f"Before: IP {test_ip} exempted = {is_exempted_before}")
-            
-            # Add to exemption
-            exemption_store.add_ip(test_ip, "Test exemption from debug command")
-            self.stdout.write(f"✅ Added {test_ip} to exemption list")
-            
-            # Check if now exempted
-            is_exempted_after = exemption_store.is_exempted(test_ip)
-            self.stdout.write(f"After: IP {test_ip} exempted = {is_exempted_after}")
-            
-            if is_exempted_after:
-                self.stdout.write(self.style.SUCCESS("✅ Exemption functionality working!"))
-            else:
-                self.stdout.write(self.style.ERROR("❌ Exemption functionality not working!"))
-                
-            # List all exemptions
-            all_exemptions = exemption_store.get_all()
-            self.stdout.write(f"Total exemptions: {len(all_exemptions)}")
-            
-            for exemption in all_exemptions:
-                self.stdout.write(f"  - {exemption.get('ip_address', exemption)}")
-                
-        except Exception as e:
-            self.stdout.write(self.style.ERROR(f"❌ Exemption test failed: {e}"))
-        
-        self.stdout.write("")
-        
-        # Check middleware logger file
-        csv_log_file = middleware_log.replace('.log', '.csv')
-        if os.path.exists(csv_log_file):
-            try:
-                with open(csv_log_file, 'r', newline='', encoding='utf-8') as f:
-                    reader = csv.reader(f)
-                    rows = list(reader)
-                    entry_count = len(rows) - 1 if rows else 0
-                    self.stdout.write(self.style.SUCCESS(f"✅ Middleware CSV log: {entry_count} entries"))
-            except Exception as e:
-                self.stdout.write(self.style.ERROR(f"❌ Middleware CSV log error: {e}"))
-        else:
-            self.stdout.write(self.style.WARNING(f"⚠️  Middleware CSV log not found: {csv_log_file}"))
-            self.stdout.write("   Make some requests to generate log entries")
-        
-        # Recommendations
-        self.stdout.write("")
-        self.stdout.write(self.style.HTTP_INFO("💡 Recommendations:"))
-        
-        if storage_mode != 'csv':
-            self.stdout.write("1. Set AIWAF_STORAGE_MODE = 'csv' in settings.py")
-            
-        if not middleware_logging:
-            self.stdout.write("2. Set AIWAF_MIDDLEWARE_LOGGING = True in settings.py")
-            
-        self.stdout.write("3. Add AIWAFLoggerMiddleware to MIDDLEWARE in settings.py")
-        self.stdout.write("4. Make some requests to generate log data")
-        self.stdout.write("5. Run 'python manage.py detect_and_train' to train with data")

aiwaf-0.1.9.0.4.dist-info/RECORD

@@ -1,27 +0,0 @@
-aiwaf/__init__.py,sha256=w99RK2Yc4N5TICgJLmsEL_DOiNe7LoCy5GZMkf1t_hQ,220
-aiwaf/apps.py,sha256=nCez-Ptlv2kaEk5HenA8b1pATz1VfhrHP1344gwcY1A,142
-aiwaf/blacklist_manager.py,sha256=92ltIrFfv8WOC4CXwvNVZYfivkRZHGNg3E2QAbHQipQ,550
-aiwaf/decorators.py,sha256=IUKOdM_gdroffImRZep1g1wT6gNqD10zGwcp28hsJCs,825
-aiwaf/middleware.py,sha256=fajFXsETb2kGQJzHi7cEV3bQA88yqHbZvRDPNR1y2OA,11188
-aiwaf/middleware_logger.py,sha256=v5tsiFhfdFTDBRRsfw-vfmhW2sNJx7EYRem99pgMsP0,6858
-aiwaf/models.py,sha256=XaG1pd_oZu3y-fw66u4wblGlWcUY9gvsTNKGD0kQk7Y,1672
-aiwaf/storage.py,sha256=Gh92OCE52j9d8vjBQCoJbjA5-fsMQkdbYYypJMuZjtQ,14167
-aiwaf/trainer.py,sha256=Cem-qi1KMjfw7MFDxyxjn7nAJGPrk-I8An4HHniiT00,9877
-aiwaf/utils.py,sha256=BJk5vJCYdGPl_4QQiknjhCbkzv5HZCXgFcBJDMJpHok,3390
-aiwaf/management/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-aiwaf/management/commands/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-aiwaf/management/commands/add_ipexemption.py,sha256=srgdVPDJtF7G9GGIqaZ7L3qTuNheoS_uwlhlRO4W2bc,945
-aiwaf/management/commands/aiwaf_diagnose.py,sha256=nXFRhq66N4QC3e4scYJ2sUngJce-0yDxtBO3R2BllRM,6134
-aiwaf/management/commands/aiwaf_logging.py,sha256=FCIqULn2tii2vD9VxL7vk3PV4k4vr7kaA00KyaCExYY,7692
-aiwaf/management/commands/aiwaf_reset.py,sha256=0FIBqpZS8xgFFvAKJ-0zAC_-QNQwRkOHpXb8N-OdFr8,3740
-aiwaf/management/commands/debug_csv.py,sha256=Vp55g1qWAuRUuAHoz56nuPxMrcccFCHKRGeYyui8Pxw,6794
-aiwaf/management/commands/detect_and_train.py,sha256=-o-LZ7QZ5GeJPCekryox1DGXKMmFEkwwrcDsiM166K0,269
-aiwaf/management/commands/regenerate_model.py,sha256=SUy7TCTTDJy4kRZNAbTIVBxSmljUaAC6ms0JTfSO6BE,3445
-aiwaf/resources/model.pkl,sha256=5t6h9BX8yoh2xct85MXOO60jdlWyg1APskUOW0jZE1Y,1288265
-aiwaf/templatetags/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
-aiwaf/templatetags/aiwaf_tags.py,sha256=XXfb7Tl4DjU3Sc40GbqdaqOEtKTUKELBEk58u83wBNw,357
-aiwaf-0.1.9.0.4.dist-info/licenses/LICENSE,sha256=Ir8PX4dxgAcdB0wqNPIkw84fzIIRKE75NoUil9RX0QU,1069
-aiwaf-0.1.9.0.4.dist-info/METADATA,sha256=PtBnfHANxkOI4buUl8kQqglCgzXjGR2dtC6IZdJSEKc,13571
-aiwaf-0.1.9.0.4.dist-info/WHEEL,sha256=_zCd3N1l69ArxyTb8rzEoP9TpbYXkqRFSNOD5OuxnTs,91
-aiwaf-0.1.9.0.4.dist-info/top_level.txt,sha256=kU6EyjobT6UPCxuWpI_BvcHDG0I2tMgKaPlWzVxe2xI,6
-aiwaf-0.1.9.0.4.dist-info/RECORD,,