pytrends-modern 0.1.1__tar.gz → 0.2.0__tar.gz

{pytrends_modern-0.1.1/pytrends_modern.egg-info → pytrends_modern-0.2.0}/PKG-INFO

@@ -1,7 +1,7 @@
 Metadata-Version: 2.4
 Name: pytrends-modern
-Version: 0.1.1
-Summary: Modern Google Trends API - Combining the best of pytrends, with RSS feeds, Selenium scraping, and enhanced features
+Version: 0.2.0
+Summary: Modern Google Trends API - Combining the best of pytrends, with RSS feeds, Selenium scraping, DrissionPage browser automation, and enhanced features
 Author: pytrends-modern contributors
 License: MIT
 Project-URL: Homepage, https://github.com/yiromo/pytrends-modern
@@ -28,6 +28,9 @@ Requires-Dist: lxml>=4.9.0
 Provides-Extra: selenium
 Requires-Dist: selenium>=4.0.0; extra == "selenium"
 Requires-Dist: webdriver-manager>=4.0.0; extra == "selenium"
+Provides-Extra: browser
+Requires-Dist: camoufox[geoip]>=0.4.11; extra == "browser"
+Requires-Dist: browserforge[all]>=1.0.0; extra == "browser"
 Provides-Extra: cli
 Requires-Dist: click>=8.0.0; extra == "cli"
 Requires-Dist: rich>=13.0.0; extra == "cli"
@@ -74,6 +77,9 @@ pytrends-modern is a **next-generation** Google Trends library that combines:
 # Basic installation
 pip install pytrends-modern
 
+# With browser mode (Camoufox for bypassing rate limits)
+pip install pytrends-modern[browser]
+
 # With Selenium support (for advanced scraping)
 pip install pytrends-modern[selenium]
 
@@ -112,6 +118,71 @@ related = pytrends.related_queries()
 print(related['Python']['top'])
 ```
 
+### 🦊 Browser Mode (Camoufox) - Bypass Rate Limits
+
+**NEW!** Use Camoufox with advanced fingerprinting to bypass Google's rate limits by using your Google account:
+
+```python
+from pytrends_modern import TrendReq, BrowserConfig
+from pytrends_modern.camoufox_setup import setup_profile
+
+# First-time setup: Configure Google account login
+setup_profile()  # Opens browser - log in to Google once
+
+# Use browser mode (persistent login, no rate limits!)
+config = BrowserConfig(headless=False)
+pytrends = TrendReq(browser_config=config)
+
+# Works like normal API
+pytrends.kw_list = ['Python']
+df = pytrends.interest_over_time()
+print(df.head())
+```
+
+**Browser Mode Limitations:**
+- ⚠️ Only 1 keyword at a time (no comparisons)
+- ⚠️ Only 'today 1-m' timeframe
+- ⚠️ Only WORLDWIDE region
+- ✅ No rate limits (uses your Google account)
+- ✅ Perfect anti-detection with Camoufox fingerprinting
+
+**Setup from command line:**
+```bash
+# Check profile status
+python -m pytrends_modern.camoufox_setup status
+
+# Run setup (opens browser for Google login)
+python -m pytrends_modern.camoufox_setup
+
+# Export profile for Docker/other machines
+python -m pytrends_modern.camoufox_setup export camoufox-profile.tar.gz
+
+# Import profile on another machine
+python -m pytrends_modern.camoufox_setup import camoufox-profile.tar.gz
+```
+
+**Docker Usage:**
+
+Yes! You can export your profile and use it in Docker containers:
+
+```bash
+# 1. Export profile locally
+python -m pytrends_modern.camoufox_setup export profile.tar.gz
+
+# 2. Use in Dockerfile
+COPY profile.tar.gz /tmp/
+RUN mkdir -p /root/.config && \
+    cd /root/.config && \
+    tar -xzf /tmp/profile.tar.gz
+
+# 3. Use headless mode in container
+config = BrowserConfig(headless=True)
+```
+
+See `Dockerfile.example` for complete Docker setup.
+
+⚠️ **Security**: Profile contains Google session - keep secure, don't commit to git!
+
 ### RSS Feed (Fast Real-Time Data)
 
 ```python
@@ -389,6 +460,44 @@ This project builds upon and combines features from:
 - CLI interface
 - Multiple export formats
 
+## 📌 Important Notes
+
+### Google API Changes
+
+Google has deprecated several trending search API endpoints. **pytrends-modern provides two working alternatives:**
+
+#### Option 1: Fast RSS Feed (Recommended for most use cases)
+```python
+from pytrends_modern import TrendsRSS
+
+rss = TrendsRSS()
+trends = rss.get_trends(geo='US')  # ~0.7s, returns 10 trends with images/articles
+```
+**Pros:** Lightning fast, includes rich media, no browser needed  
+**Cons:** Limited to 10 trends, no filtering options
+
+#### Option 2: Selenium Web Scraper (For complete data)
+```python
+from pytrends_modern import TrendsScraper
+
+scraper = TrendsScraper(headless=True)
+df = scraper.trending_searches(geo='US', hours=24)  # ~15s, returns 400+ trends
+scraper.close()
+```
+**Pros:** Complete data (400+ trends), supports categories/filters  
+**Cons:** Slower, requires Chrome browser
+
+### Working Features
+✅ All core API methods work perfectly:
+- `interest_over_time()` - Historical search trends
+- `interest_by_region()` - Geographic distribution  
+- `related_queries()` / `related_topics()` - Related searches
+- `suggestions()` - Keyword suggestions
+- And more!
+
+✅ RSS feeds for 125+ countries  
+✅ Selenium scraper for comprehensive trending data
+
 ## ⚠️ Disclaimer
 
 This is an unofficial library and is not affiliated with or endorsed by Google. Use responsibly and in accordance with Google's Terms of Service.

{pytrends_modern-0.1.1 → pytrends_modern-0.2.0}/README.md

@@ -27,6 +27,9 @@ pytrends-modern is a **next-generation** Google Trends library that combines:
 # Basic installation
 pip install pytrends-modern
 
+# With browser mode (Camoufox for bypassing rate limits)
+pip install pytrends-modern[browser]
+
 # With Selenium support (for advanced scraping)
 pip install pytrends-modern[selenium]
 
@@ -65,6 +68,71 @@ related = pytrends.related_queries()
 print(related['Python']['top'])
 ```
 
+### 🦊 Browser Mode (Camoufox) - Bypass Rate Limits
+
+**NEW!** Use Camoufox with advanced fingerprinting to bypass Google's rate limits by using your Google account:
+
+```python
+from pytrends_modern import TrendReq, BrowserConfig
+from pytrends_modern.camoufox_setup import setup_profile
+
+# First-time setup: Configure Google account login
+setup_profile()  # Opens browser - log in to Google once
+
+# Use browser mode (persistent login, no rate limits!)
+config = BrowserConfig(headless=False)
+pytrends = TrendReq(browser_config=config)
+
+# Works like normal API
+pytrends.kw_list = ['Python']
+df = pytrends.interest_over_time()
+print(df.head())
+```
+
+**Browser Mode Limitations:**
+- ⚠️ Only 1 keyword at a time (no comparisons)
+- ⚠️ Only 'today 1-m' timeframe
+- ⚠️ Only WORLDWIDE region
+- ✅ No rate limits (uses your Google account)
+- ✅ Perfect anti-detection with Camoufox fingerprinting
+
+**Setup from command line:**
+```bash
+# Check profile status
+python -m pytrends_modern.camoufox_setup status
+
+# Run setup (opens browser for Google login)
+python -m pytrends_modern.camoufox_setup
+
+# Export profile for Docker/other machines
+python -m pytrends_modern.camoufox_setup export camoufox-profile.tar.gz
+
+# Import profile on another machine
+python -m pytrends_modern.camoufox_setup import camoufox-profile.tar.gz
+```
+
+**Docker Usage:**
+
+Yes! You can export your profile and use it in Docker containers:
+
+```bash
+# 1. Export profile locally
+python -m pytrends_modern.camoufox_setup export profile.tar.gz
+
+# 2. Use in Dockerfile
+COPY profile.tar.gz /tmp/
+RUN mkdir -p /root/.config && \
+    cd /root/.config && \
+    tar -xzf /tmp/profile.tar.gz
+
+# 3. Use headless mode in container
+config = BrowserConfig(headless=True)
+```
+
+See `Dockerfile.example` for complete Docker setup.
+
+⚠️ **Security**: Profile contains Google session - keep secure, don't commit to git!
+
 ### RSS Feed (Fast Real-Time Data)
 
 ```python
@@ -342,6 +410,44 @@ This project builds upon and combines features from:
 - CLI interface
 - Multiple export formats
 
+## 📌 Important Notes
+
+### Google API Changes
+
+Google has deprecated several trending search API endpoints. **pytrends-modern provides two working alternatives:**
+
+#### Option 1: Fast RSS Feed (Recommended for most use cases)
+```python
+from pytrends_modern import TrendsRSS
+
+rss = TrendsRSS()
+trends = rss.get_trends(geo='US')  # ~0.7s, returns 10 trends with images/articles
+```
+**Pros:** Lightning fast, includes rich media, no browser needed  
+**Cons:** Limited to 10 trends, no filtering options
+
+#### Option 2: Selenium Web Scraper (For complete data)
+```python
+from pytrends_modern import TrendsScraper
+
+scraper = TrendsScraper(headless=True)
+df = scraper.trending_searches(geo='US', hours=24)  # ~15s, returns 400+ trends
+scraper.close()
+```
+**Pros:** Complete data (400+ trends), supports categories/filters  
+**Cons:** Slower, requires Chrome browser
+
+### Working Features
+✅ All core API methods work perfectly:
+- `interest_over_time()` - Historical search trends
+- `interest_by_region()` - Geographic distribution  
+- `related_queries()` / `related_topics()` - Related searches
+- `suggestions()` - Keyword suggestions
+- And more!
+
+✅ RSS feeds for 125+ countries  
+✅ Selenium scraper for comprehensive trending data
+
 ## ⚠️ Disclaimer
 
 This is an unofficial library and is not affiliated with or endorsed by Google. Use responsibly and in accordance with Google's Terms of Service.

pytrends_modern-0.2.0/examples/example_browser_mode.py

@@ -0,0 +1,92 @@
+#!/usr/bin/env python3
+"""
+Example: Using pytrends-modern with Camoufox browser mode
+
+This example shows how to bypass Google's rate limits by using
+your Google account with Camoufox's advanced fingerprinting.
+"""
+
+# Step 1: First-time setup (only need to do this once)
+print("=" * 70)
+print("STEP 1: Check if profile is configured")
+print("=" * 70)
+
+from pytrends_modern.camoufox_setup import is_profile_configured, setup_profile
+
+if not is_profile_configured():
+    print("\n⚠️  Profile not configured. Running setup...")
+    print("This will open a browser for you to log in to Google.")
+    print()
+    
+    # Run setup - browser will open
+    setup_profile()
+else:
+    print("\n✅ Profile already configured!")
+    print("Your Google login is saved and ready to use.\n")
+
+# Step 2: Use browser mode
+print("=" * 70)
+print("STEP 2: Use browser mode with your Google account")
+print("=" * 70)
+
+from pytrends_modern import TrendReq, BrowserConfig
+
+# Create browser configuration
+config = BrowserConfig(
+    headless=False,  # Set to True for headless mode
+    humanize=True,   # Human-like cursor movements
+    os='linux',      # or 'windows', 'macos'
+    geoip=True       # Auto-detect location from IP
+)
+
+# Initialize with browser mode
+pytrends = TrendReq(browser_config=config)
+
+# Test with a keyword
+keyword = "Artificial Intelligence"
+print(f"\n🔍 Fetching data for: {keyword}")
+print("⏳ Browser will open briefly...")
+
+# Set keyword (browser mode only supports 1 keyword)
+pytrends.kw_list = [keyword]
+
+# Get interest over time
+print("\n📊 Interest Over Time:")
+df_time = pytrends.interest_over_time()
+print(df_time.head(10))
+print(f"Total: {len(df_time)} data points")
+
+# Get interest by region
+print("\n🌍 Interest By Region (Top 10):")
+df_region = pytrends.interest_by_region()
+df_region_sorted = df_region.sort_values(by=keyword, ascending=False).head(10)
+print(df_region_sorted)
+
+# Get related topics
+print("\n🔗 Related Topics:")
+topics = pytrends.related_topics()
+if keyword in topics and topics[keyword].get('top') is not None:
+    print(topics[keyword]['top'].head(10))
+else:
+    print("No related topics available")
+
+# Get related queries
+print("\n❓ Related Queries:")
+queries = pytrends.related_queries()
+if keyword in queries and queries[keyword].get('top') is not None:
+    print(queries[keyword]['top'].head(10))
+else:
+    print("No related queries available")
+
+print("\n" + "=" * 70)
+print("✅ Example complete!")
+print("=" * 70)
+print("\n💡 Tips:")
+print("   - Your Google login is saved in ~/.config/camoufox-pytrends-profile")
+print("   - You only need to log in once")
+print("   - Browser mode has NO rate limits!")
+print("   - Camoufox's fingerprinting bypasses bot detection")
+print("\n⚠️  Limitations:")
+print("   - Only 1 keyword (no comparisons)")
+print("   - Only 'today 1-m' timeframe")
+print("   - Only WORLDWIDE region")

{pytrends_modern-0.1.1 → pytrends_modern-0.2.0}/pyproject.toml

@@ -4,8 +4,8 @@ build-backend = "setuptools.build_meta"
 
 [project]
 name = "pytrends-modern"
-version = "0.1.1"
-description = "Modern Google Trends API - Combining the best of pytrends, with RSS feeds, Selenium scraping, and enhanced features"
+version = "0.2.0"
+description = "Modern Google Trends API - Combining the best of pytrends, with RSS feeds, Selenium scraping, DrissionPage browser automation, and enhanced features"
 readme = "README.md"
 requires-python = ">=3.8"
 license = {text = "MIT"}
@@ -37,6 +37,10 @@ selenium = [
     "selenium>=4.0.0",
     "webdriver-manager>=4.0.0",
 ]
+browser = [
+    "camoufox[geoip]>=0.4.11",
+    "browserforge[all]>=1.0.0",
+]
 cli = [
     "click>=8.0.0",
     "rich>=13.0.0",
@@ -92,3 +96,8 @@ python_files = ["test_*.py"]
 python_classes = ["Test*"]
 python_functions = ["test_*"]
 addopts = "-v --cov=pytrends_modern --cov-report=term-missing"
+
+[tool.uv.workspace]
+members = [
+    "test_space",
+]

{pytrends_modern-0.1.1 → pytrends_modern-0.2.0}/pytrends_modern/__init__.py

@@ -2,12 +2,15 @@
 pytrends-modern: Modern Google Trends API
 """
 
-__version__ = "1.0.0"
+__version__ = "0.2.0"
 __author__ = "pytrends-modern contributors"
 __license__ = "MIT"
 
 from pytrends_modern.request import TrendReq
 from pytrends_modern.rss import TrendsRSS
+from pytrends_modern.scraper import TrendsScraper
+from pytrends_modern.browser_config_camoufox import BrowserConfig
+from pytrends_modern import camoufox_setup
 from pytrends_modern.exceptions import (
     TooManyRequestsError,
     ResponseError,
@@ -19,6 +22,9 @@ from pytrends_modern.exceptions import (
 __all__ = [
     "TrendReq",
     "TrendsRSS",
+    "TrendsScraper",
+    "BrowserConfig",
+    "camoufox_setup",
     "TooManyRequestsError",
     "ResponseError",
     "InvalidParameterError",

pytrends_modern-0.2.0/pytrends_modern/browser_config.py

@@ -0,0 +1,94 @@
+"""Browser configuration for DrissionPage automation."""
+
+from typing import Optional
+
+
+class BrowserConfig:
+    """Configuration for DrissionPage browser automation.
+    
+    When enabled, TrendReq will use DrissionPage to capture network traffic
+    from trends.google.com instead of making direct API calls.
+    
+    ⚠️ LIMITATIONS when using BrowserConfig:
+    - Only 1 keyword supported (no comparison)
+    - Only 'today 1-m' timeframe supported
+    - Only WORLDWIDE geo supported (no geo filtering)
+    - Requires Chrome/Chromium browser installed
+    
+    Args:
+        browser_path: Path to Chrome/Chromium executable.
+                     Defaults: '/usr/bin/chromium' or '/usr/bin/chrome'
+        port: Browser remote debugging port (default: 9222)
+        headless: Run browser in headless mode (default: True)
+        proxy: Proxy server URL (e.g., 'http://proxy.com:8080')
+        proxy_username: Proxy username (for authenticated proxies)
+        proxy_password: Proxy password (for authenticated proxies)
+        user_data_dir: Browser profile directory to persist login session.
+                      If not provided, creates temp directory (won't persist)
+    
+    Example:
+        >>> from pytrends_modern import TrendReq, BrowserConfig
+        >>> # Without auth - manual login required once
+        >>> config = BrowserConfig(
+        ...     browser_path='/usr/bin/chromium',
+        ...     user_data_dir='~/.config/chromium-pytrends'
+        ... )
+        >>> # With proxy auth
+        >>> config = BrowserConfig(
+        ...     browser_path='/usr/bin/chromium',
+        ...     proxy='153.80.44.3:64804',
+        ...     proxy_username='user',
+        ...     proxy_password='pass',
+        ...     user_data_dir='~/.config/chromium-pytrends'
+        ... )
+        >>> pytrends = TrendReq(browser_config=config)
+        >>> pytrends.build_payload(['Python'])  # Only 1 keyword!
+        >>> df = pytrends.interest_over_time()
+    """
+    
+    def __init__(
+        self,
+        browser_path: Optional[str] = None,
+        port: int = 9222,
+        headless: bool = True,
+        proxy: Optional[str] = None,
+        proxy_username: Optional[str] = None,
+        proxy_password: Optional[str] = None,
+        user_data_dir: Optional[str] = None
+    ):
+        self.browser_path = browser_path or self._get_default_browser_path()
+        self.port = port
+        self.headless = headless
+        self.proxy = proxy
+        self.proxy_username = proxy_username
+        self.proxy_password = proxy_password
+        self.user_data_dir = user_data_dir
+    
+    @staticmethod
+    def _get_default_browser_path() -> str:
+        """Get default browser path based on common locations."""
+        import os
+        
+        # Common Chrome/Chromium paths
+        paths = [
+            '/usr/bin/chromium',
+            '/usr/bin/chromium-browser',
+            '/usr/bin/chrome',
+            '/usr/bin/google-chrome',
+            '/snap/bin/chromium',
+            'C:\\Program Files\\Google\\Chrome\\Application\\chrome.exe',
+            'C:\\Program Files (x86)\\Google\\Chrome\\Application\\chrome.exe',
+        ]
+        
+        for path in paths:
+            if os.path.exists(path):
+                return path
+        
+        # Default fallback
+        return '/usr/bin/chromium'
+    
+    def __repr__(self) -> str:
+        return (
+            f"BrowserConfig(browser_path='{self.browser_path}', "
+            f"port={self.port}, headless={self.headless}, proxy={self.proxy})"
+        )

pytrends_modern-0.2.0/pytrends_modern/browser_config_camoufox.py

@@ -0,0 +1,67 @@
+"""Browser configuration for Camoufox automation"""
+
+from typing import Optional
+import os as os_module
+
+
+class BrowserConfig:
+    """Configuration for Camoufox browser automation.
+    
+    Uses Camoufox (Playwright Firefox) with advanced fingerprinting and
+    anti-detection to bypass Google's bot detection.
+    
+    ⚠️ LIMITATIONS:
+    - Only 1 keyword supported (no comparison)
+    - Only 'today 1-m' timeframe supported
+    - Only WORLDWIDE geo supported (no geo filtering)
+    - Requires Google account login (first run)
+    
+    Args:
+        headless: Run browser in headless mode (default: False)
+                 Set to 'virtual' on Linux to use Xvfb
+        proxy_server: Proxy server URL (e.g., 'http://proxy.com:8080')
+        proxy_username: Proxy username (for authenticated proxies)
+        proxy_password: Proxy password (for authenticated proxies)
+        user_data_dir: Browser profile directory to persist login session.
+                      Default: ~/.config/camoufox-pytrends
+        humanize: Enable human-like cursor movement (default: True)
+        os: Operating system for fingerprint ('windows', 'macos', 'linux')
+        geoip: Auto-detect geolocation from proxy IP (default: True if proxy)
+    
+    Example:
+        >>> from pytrends_modern import TrendReq, BrowserConfig
+        >>> # Simple usage (logs in once, saves session)
+        >>> config = BrowserConfig()
+        >>> pytrends = TrendReq(browser_config=config)
+        >>> pytrends.build_payload(['Python'])
+        >>> df = pytrends.interest_over_time()
+        >>>
+        >>> # With proxy
+        >>> config = BrowserConfig(
+        ...     proxy_server='http://proxy.com:8080',
+        ...     proxy_username='user',
+        ...     proxy_password='pass',
+        ...     geoip=True
+        ... )
+    """
+    
+    def __init__(
+        self,
+        headless: bool = False,
+        proxy_server: Optional[str] = None,
+        proxy_username: Optional[str] = None,
+        proxy_password: Optional[str] = None,
+        user_data_dir: Optional[str] = None,
+        humanize: bool = True,
+        os: str = 'linux',
+        geoip: bool = True,
+    ):
+        self.headless = headless
+        self.proxy_server = proxy_server
+        self.proxy_username = proxy_username
+        self.proxy_password = proxy_password
+        self.user_data_dir = user_data_dir or os_module.path.expanduser('~/.config/camoufox-pytrends-profile')
+        self.humanize = humanize
+        self.os = os
+        self.geoip = geoip if proxy_server else False
+