npm - @elizaos/plugin-browser - Versions diffs - 1.0.0-beta.8 → 1.0.0 - Mend

@elizaos/plugin-browser 1.0.0-beta.8 → 1.0.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.

Files changed (7) hide show

package/README.md CHANGED Viewed

@@ -1,384 +1,64 @@
 # @elizaos/plugin-browser
-Core Node.js plugin for Eliza OS that provides essential services and actions for file operations, media processing, and cloud integrations.
-## Overview
-The Node plugin serves as a foundational component of Eliza OS, bridging core Node.js capabilities with the Eliza ecosystem. It provides crucial services for file operations, media processing, speech synthesis, and cloud integrations, enabling both local and cloud-based functionality for Eliza agents.
+Browser plugin for Eliza OS that provides web browsing and scraping capabilities.
 ## Features
-- **AWS S3 Integration**: File upload and management with AWS S3
-- **Browser Automation**: Web scraping and content extraction with Playwright
-- **Image Processing**: Image description and analysis capabilities
-- **PDF Processing**: PDF text extraction and parsing
-- **Speech Synthesis**: Text-to-speech using ElevenLabs and VITS
-- **Transcription**: Speech-to-text using various providers (OpenAI, Deepgram, Local)
-- **Video Processing**: YouTube video download and transcription
-- **LLaMA Integration**: Local LLM support with LLaMA models
+- **Web Browsing**: Navigate and interact with web pages
+- **Content Extraction**: Extract text and metadata from web pages
+- **CAPTCHA Solving**: Automatic CAPTCHA detection and solving
+- **Stealth Mode**: Reduced bot detection with proper user agents and headers
 ## Installation
 ```bash
-npx elizaos plugin add @elizaos/plugin-browser
-```
-## Configuration
-The plugin requires various environment variables depending on which services you plan to use:
-### Core Settings
-```env
-OPENAI_API_KEY=your_openai_api_key
-```
-### Voice Settings (Optional)
-```env
-ELEVENLABS_API_KEY=your_elevenlabs_api_key
-ELEVENLABS_MODEL_ID=eleven_monolingual_v1
-ELEVENLABS_VOICE_ID=your_voice_id
-ELEVENLABS_VOICE_STABILITY=0.5
-ELEVENLABS_VOICE_SIMILARITY_BOOST=0.75
-ELEVENLABS_OPTIMIZE_STREAMING_LATENCY=0
-ELEVENLABS_OUTPUT_FORMAT=pcm_16000
-VITS_VOICE=en_US-hfc_female-medium
-```
-### AWS Settings (Optional)
-```env
-AWS_ACCESS_KEY_ID=your_aws_access_key
-AWS_SECRET_ACCESS_KEY=your_aws_secret_key
-AWS_REGION=your_aws_region
-AWS_S3_BUCKET=your_s3_bucket
-AWS_S3_UPLOAD_PATH=your_upload_path
-AWS_S3_ENDPOINT=an_alternative_endpoint
-AWS_S3_SSL_ENABLED=boolean(true|false)
-AWS_S3_FORCE_PATH_STYLE=boolean(true|false)
+npm install @elizaos/plugin-browser
 ```
 ## Usage
 ```typescript
-import { createNodePlugin } from '@elizaos/plugin-node';
-// Initialize the plugin
-const nodePlugin = createNodePlugin();
+import { browserPlugin } from '@elizaos/plugin-browser';
-// Register with Eliza OS
-elizaos.registerPlugin(nodePlugin);
+// Add to your Eliza configuration
+export default {
+  plugins: [browserPlugin],
+  // ... other config
+};
 ```
-## Services
-### AwsS3Service
-Handles file uploads and management with AWS S3.
-### BrowserService
-Provides web scraping and content extraction capabilities using Playwright.
-### ImageDescriptionService
-Processes and analyzes images to generate descriptions. Supports multiple providers:
-- Local processing using Florence model
-- OpenAI Vision API
-- Google Gemini
-Configuration:
-```env
-# For OpenAI Vision
-OPENAI_API_KEY=your_openai_api_key
-# For Google Gemini
-GOOGLE_GENERATIVE_AI_API_KEY=your_google_api_key
-```
-Provider selection:
-- If `imageVisionModelProvider` is set to `google/openai`, it will use this one.
-- Else if `model` is set to `google/openai`, it will use this one.
-- Default if nothing is set is OpenAI.
-The service automatically handles different image formats, including GIFs (first frame extraction).
-Features by provider:
-**Local (Florence):**
-- Basic image captioning
-- Local processing without API calls
-**OpenAI Vision:**
-- Detailed image descriptions
-- Text detection
-- Object recognition
-**Google Gemini 1.5:**
-- High-quality image understanding
-- Detailed descriptions with natural language
-- Multi-modal context understanding
-- Support for complex scenes and content
-The provider can be configured through the runtime settings, allowing easy switching between providers based on your needs.
-### LlamaService
-Provides local LLM capabilities using LLaMA models.
-### PdfService
-Extracts and processes text content from PDF files.
-### SpeechService
-Handles text-to-speech conversion using ElevenLabs and VITS.
-### TranscriptionService
-Converts speech to text using various providers.
-### VideoService
-Processes video content, including YouTube video downloads and transcription.
-## Actions
-### describeImage
-Analyzes and generates descriptions for images.
-```typescript
-// Example usage
-const result = await runtime.executeAction('DESCRIBE_IMAGE', {
-  imageUrl: 'path/to/image.jpg',
-});
-```
-## Dependencies
-The plugin requires several peer dependencies:
-- `onnxruntime-node`: 1.20.1
-- `whatwg-url`: 7.1.0
-And trusted dependencies:
-- `onnxruntime-node`: 1.20.1
-- `sharp`: 0.33.5
-## Safety & Security
-### File Operations
-- **Path Sanitization**: All file paths are sanitized to prevent directory traversal attacks
-- **File Size Limits**: Enforced limits on upload sizes
-- **Type Checking**: Strict file type validation
-- **Temporary File Cleanup**: Automatic cleanup of temporary files
-### API Keys & Credentials
-- **Environment Isolation**: Sensitive credentials are isolated in environment variables
-- **Access Scoping**: Services are initialized with minimum required permissions
-- **Key Rotation**: Support for credential rotation without service interruption
-### Media Processing
-- **Resource Limits**: Memory and CPU usage limits for media processing
-- **Timeout Controls**: Automatic termination of long-running processes
-- **Format Validation**: Strict media format validation before processing
-## Troubleshooting
+## Configuration
-### Common Issues
+The plugin uses the following environment variables:
-1. **Service Initialization Failures**
+- `CAPSOLVER_API_KEY` - API key for CAPTCHA solving service (optional)
-```bash
-Error: Service initialization failed
-```
-- Verify environment variables are properly set
-- Check service dependencies are installed
-- Ensure sufficient system permissions
-2. **Media Processing Errors**
+## Services
-```bash
-Error: Failed to process media file
-```
+### BrowserService
-- Verify file format is supported
-- Check available system memory
-- Ensure ffmpeg is properly installed
+Provides web browsing capabilities including:
+- Page content extraction
+- CAPTCHA detection and solving
+- Alternative source fallbacks (Internet Archive, Google Search)
+- Content caching for performance
-3. **AWS S3 Connection Issues**
+## Development
 ```bash
-Error: AWS credentials not configured
-```
+# Install dependencies
+npm install
-- Verify AWS credentials are set
-- Check S3 bucket permissions
-- Ensure correct region configuration
+# Build the plugin
+npm run build
-### Debug Mode
+# Development mode with watch
+npm run dev
-Enable debug logging for detailed troubleshooting:
-```typescript
-process.env.DEBUG = 'eliza:plugin-node:*';
+# Format code
+npm run format
 ```
-### System Requirements
-- Node.js 16.x or higher
-- FFmpeg for media processing
-- Minimum 4GB RAM recommended
-- CUDA-compatible GPU (optional, for ML features)
-### Performance Optimization
-1. **Cache Management**
-   - Regular cleanup of `content_cache` directory
-   - Implement cache size limits
-   - Monitor disk usage
-2. **Memory Usage**
-   - Configure max buffer sizes
-   - Implement streaming for large files
-   - Monitor memory consumption
-3. **Concurrent Operations**
-   - Adjust queue size limits
-   - Configure worker threads
-   - Monitor process pool
-## Support
-For issues and feature requests, please:
-1. Check the troubleshooting guide above
-2. Review existing GitHub issues
-3. Submit a new issue with:
-   - System information
-   - Error logs
-   - Steps to reproduce
-## Future Enhancements
-1. **File Operations**
-   - Enhanced streaming capabilities
-   - Advanced compression options
-   - Batch file processing
-   - File type detection
-   - Metadata management
-   - Version control integration
-2. **Media Processing**
-   - Additional video formats
-   - Advanced image processing
-   - Audio enhancement tools
-   - Real-time processing
-   - Quality optimization
-   - Format conversion
-3. **Cloud Integration**
-   - Multi-cloud support
-   - Advanced caching
-   - CDN optimization
-   - Auto-scaling features
-   - Cost optimization
-   - Backup automation
-4. **Speech Services**
-   - Additional voice models
-   - Language expansion
-   - Emotion detection
-   - Voice cloning
-   - Real-time synthesis
-   - Custom voice training
-5. **Browser Automation**
-   - Headless optimization
-   - Parallel processing
-   - Session management
-   - Cookie handling
-   - Proxy support
-   - Resource optimization
-6. **Security Features**
-   - Enhanced encryption
-   - Access control
-   - Audit logging
-   - Threat detection
-   - Rate limiting
-   - Compliance tools
-7. **Performance Optimization**
-   - Memory management
-   - CPU utilization
-   - Concurrent operations
-   - Resource pooling
-   - Cache strategies
-   - Load balancing
-8. **Developer Tools**
-   - Enhanced debugging
-   - Testing framework
-   - Documentation generator
-   - CLI improvements
-   - Monitoring tools
-   - Integration templates
-We welcome community feedback and contributions to help prioritize these enhancements.
-## Contributing
-Contributions are welcome! Please see the [CONTRIBUTING.md](CONTRIBUTING.md) file for more information.
-## Credits
-This plugin integrates with and builds upon several key technologies:
-- [Node.js](https://nodejs.org/) - The core runtime environment
-- [FFmpeg](https://ffmpeg.org/) - Media processing capabilities
-- [ElevenLabs](https://elevenlabs.io/) - Voice synthesis
-- [OpenAI](https://openai.com/) - Transcription and AI services
-- [AWS S3](https://aws.amazon.com/s3/) - Cloud storage
-- [Playwright](https://playwright.dev/) - Browser automation
-- [LLaMA](https://github.com/facebookresearch/llama) - Local language models
-- [VITS](https://github.com/jaywalnut310/vits) - Voice synthesis
-- [Deepgram](https://deepgram.com/) - Speech recognition
-- [Sharp](https://sharp.pixelplumbing.com/) - Image processing
-Special thanks to:
-- The Node.js community and all the open-source contributors who make these integrations possible.
-- The Eliza community for their contributions and feedback.
-For more information about Node.js capabilities:
-- [Node.js Documentation](https://nodejs.org/en/docs/)
-- [Node.js Developer Portal](https://nodejs.org/en/about/)
-- [Node.js GitHub Repository](https://github.com/nodejs/node)
 ## License
-This plugin is part of the Eliza project. See the main project repository for license information.
+MIT

package/dist/index.d.ts ADDED Viewed

@@ -0,0 +1,5 @@
+import { Plugin } from '@elizaos/core';
+declare const browserPlugin: Plugin;
+export { browserPlugin };

package/dist/index.js CHANGED Viewed

@@ -11,11 +11,11 @@ import {
 import CaptchaSolver from "capsolver-npm";
 import { chromium } from "patchright";
 async function generateSummary(runtime, text) {
-  text = await trimTokens(text, 1e5, runtime);
+  const trimmedText = await trimTokens(text, 1e5, runtime);
   const prompt = `Please generate a concise summary for the following text:
   Text: """
-  ${text}
+  ${trimmedText}
   """
   Respond with a JSON object in the following format:
@@ -166,6 +166,7 @@ var BrowserService = class _BrowserService extends Service {
     try {
       if (!this.context) {
         logger.log("Browser context not initialized. Call initializeBrowser() first.");
+        throw new Error("Browser context not initialized");
       }
       page = await this.context.newPage();
       await page.setExtraHTTPHeaders({
@@ -174,6 +175,7 @@ var BrowserService = class _BrowserService extends Service {
       const response = await page.goto(url, { waitUntil: "networkidle" });
       if (!response) {
         logger.error("Failed to load the page");
+        throw new Error("Failed to load the page");
       }
       if (response.status() === 403 || response.status() === 404) {
         return await this.tryAlternativeSources(url, runtime);
@@ -312,13 +314,13 @@ ${bodyContent}`
       } catch (error) {
         logger.error("Error fetching from Google Search:", error);
         logger.error("Failed to fetch content from alternative sources");
-        return {
-          title: url,
-          description: "Error, could not fetch content from alternative sources",
-          bodyContent: ""
-        };
       }
     }
+    return {
+      title: url,
+      description: "Error, could not fetch content from alternative sources",
+      bodyContent: ""
+    };
   }
 };
@@ -327,7 +329,23 @@ var browserPlugin = {
   name: "browser-plugin",
   description: "Plugin for browser actions",
   services: [BrowserService],
-  actions: []
+  actions: [],
+  tests: [
+    {
+      name: "test browser service",
+      tests: [
+        {
+          name: "Browser service initialization",
+          fn: async (runtime) => {
+            const service = await BrowserService.start(runtime);
+            if (!service) {
+              throw new Error("Failed to initialize BrowserService");
+            }
+          }
+        }
+      ]
+    }
+  ]
 };
 export {
   browserPlugin

package/dist/index.js.map CHANGED Viewed

	@@ -1 +1 @@
1	- {"version":3,"sources":["../src/services/browser.ts","../src/index.ts"],"sourcesContent":["import {\n type IAgentRuntime,\n type IBrowserService,\n ModelType,\n Service,\n type ServiceTypeName,\n ServiceType,\n logger,\n parseJSONObjectFromText,\n stringToUuid,\n trimTokens,\n} from '@elizaos/core';\nimport CaptchaSolver from 'capsolver-npm';\nimport { type Browser, type BrowserContext, type Page, chromium } from 'patchright';\n\n/*\n Asynchronously generates a summary for a given text using a machine learning model.\n \n @param {IAgentRuntime} runtime - The runtime environment for the agent\n * @param {string} text - The text to generate a summary for\n * @returns {Promise<{ title: string; description: string }>} A promise that resolves to an object containing the generated title and summary\n /\nasync function generateSummary(\n runtime: IAgentRuntime,\n text: string\n): Promise<{ title: string; description: string }> {\n // make sure text is under 128k characters\n text = await trimTokens(text, 100000, runtime);\n\n const prompt = `Please generate a concise summary for the following text:\n\n Text: \"\"\"\n ${text}\n \"\"\"\n\n Respond with a JSON object in the following format:\n \\`\\`\\`json\n {\n \"title\": \"Generated Title\",\n \"summary\": \"Generated summary and/or description of the text\"\n }\n \\`\\`\\``;\n\n const response = await runtime.useModel(ModelType.TEXT_SMALL, {\n prompt,\n });\n\n const parsedResponse = parseJSONObjectFromText(response);\n\n if (parsedResponse?.title && parsedResponse?.summary) {\n return {\n title: parsedResponse.title,\n description: parsedResponse.summary,\n };\n }\n\n return {\n title: '',\n description: '',\n };\n}\n\n/\n Represents the content of a page.\n * @typedef { Object } PageContent\n * @property { string } title - The title of the page.\n * @property { string } description - The description of the page.\n * @property { string } bodyContent - The main content of the page.\n /\ntype PageContent = {\n title: string;\n description: string;\n bodyContent: string;\n};\n\n/\n Represents a BrowserService class that extends Service and implements IBrowserService interface.\n * Provides methods for initializing browser, stopping browser, fetching page content, solving CAPTCHAs, detecting CAPTCHAs, and getting cache key.\n * @extends Service\n * @implements IBrowserService\n /\nexport class BrowserService extends Service implements IBrowserService {\n private browser: Browser \| undefined;\n private context: BrowserContext \| undefined;\n private captchaSolver: CaptchaSolver;\n private cacheKey = 'content/browser';\n\n static serviceType: ServiceTypeName = ServiceType.BROWSER;\n capabilityDescription = 'The agent is able to browse the web and fetch content';\n\n /\n Constructor for the Agent class.\n * @param {IAgentRuntime} runtime - The runtime object for the agent.\n /\n constructor(runtime: IAgentRuntime) {\n super();\n this.runtime = runtime;\n this.browser = undefined;\n this.context = undefined;\n this.captchaSolver = new CaptchaSolver(runtime.getSetting('CAPSOLVER_API_KEY') \|\| '');\n }\n\n /\n Starts the BrowserService asynchronously.\n \n @param {IAgentRuntime} runtime - The runtime for the agent.\n * @returns {Promise<BrowserService>} A promise that resolves to the initialized BrowserService.\n /\n static async start(runtime: IAgentRuntime): Promise<BrowserService> {\n const service = new BrowserService(runtime);\n await service.initializeBrowser();\n return service;\n }\n\n /\n Function to stop the browser service asynchronously.\n \n @param {IAgentRuntime} runtime - The runtime environment for the agent.\n /\n static async stop(runtime: IAgentRuntime) {\n const service = runtime.getService(ServiceType.BROWSER);\n if (service) {\n await service.stop();\n }\n }\n\n /\n Initializes the browser by launching Chromium with specified options and setting the user agent based on the platform.\n * @returns {Promise<void>} A promise that resolves once the browser is successfully initialized.\n /\n async initializeBrowser() {\n if (!this.browser) {\n this.browser = await chromium.launch({\n headless: true,\n args: [\n '--disable-dev-shm-usage', // Uses /tmp instead of /dev/shm. Prevents memory issues on low-memory systems\n '--block-new-web-contents', // Prevents creation of new windows/tabs\n ],\n });\n\n const platform = process.platform;\n let userAgent = '';\n\n // Change the user agent to match the platform to reduce bot detection\n switch (platform) {\n case 'darwin':\n userAgent =\n 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36';\n break;\n case 'win32':\n userAgent =\n 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36';\n break;\n case 'linux':\n userAgent =\n 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36';\n break;\n default:\n userAgent =\n 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36';\n }\n\n this.context = await this.browser.newContext({\n userAgent,\n acceptDownloads: false,\n });\n }\n }\n\n /\n Asynchronously stops the browser and context if they are currently running.\n /\n async stop() {\n if (this.context) {\n await this.context.close();\n this.context = undefined;\n }\n if (this.browser) {\n await this.browser.close();\n this.browser = undefined;\n }\n }\n\n /\n Asynchronously fetches the content of a web page.\n \n @param {string} url - The URL of the web page to fetch content from.\n * @param {IAgentRuntime} runtime - The runtime environment for the web scraping agent.\n * @returns {Promise<PageContent>} A Promise that resolves with the content of the web page.\n /\n async getPageContent(url: string, runtime: IAgentRuntime): Promise<PageContent> {\n await this.initializeBrowser();\n return await this.fetchPageContent(url, runtime);\n }\n\n /\n Generates a cache key for the provided URL by converting it to a UUID string.\n \n @param {string} url - The URL for which a cache key is being generated.\n * @returns {string} A UUID string representing the cache key for the URL.\n /\n private getCacheKey(url: string): string {\n return stringToUuid(url);\n }\n\n /\n Fetches the content of a page from the specified URL using a headless browser.\n \n @param {string} url - The URL of the page to fetch the content from.\n * @param {IAgentRuntime} runtime - The runtime environment for the agent.\n * @returns {Promise<PageContent>} A promise that resolves to the content of the fetched page.\n /\n private async fetchPageContent(url: string, runtime: IAgentRuntime): Promise<PageContent> {\n const cacheKey = this.getCacheKey(url);\n const cached = await runtime.getCache<any>(`${this.cacheKey}/${cacheKey}`);\n\n if (cached) {\n return cached.content;\n }\n\n let page: Page \| undefined;\n\n try {\n if (!this.context) {\n logger.log('Browser context not initialized. Call initializeBrowser() first.');\n }\n\n page = await this.context.newPage();\n\n // Enable stealth mode\n await page.setExtraHTTPHeaders({\n 'Accept-Language': 'en-US,en;q=0.9',\n });\n\n const response = await page.goto(url, { waitUntil: 'networkidle' });\n\n if (!response) {\n logger.error('Failed to load the page');\n }\n\n if (response.status() === 403 \|\| response.status() === 404) {\n return await this.tryAlternativeSources(url, runtime);\n }\n\n // Check for CAPTCHA\n const captchaDetected = await this.detectCaptcha(page);\n if (captchaDetected) {\n await this.solveCaptcha(page, url);\n }\n const documentTitle = await page.evaluate(() => document.title);\n const bodyContent = await page.evaluate(() => document.body.innerText);\n const { title: parsedTitle, description } = await generateSummary(\n runtime,\n `${documentTitle}\\n${bodyContent}`\n );\n const content = { title: parsedTitle, description, bodyContent };\n await runtime.setCache<any>(`${this.cacheKey}/${cacheKey}`, {\n url,\n content,\n });\n return content;\n } catch (error) {\n logger.error('Error:', error);\n return {\n title: url,\n description: 'Error, could not fetch content',\n bodyContent: '',\n };\n } finally {\n if (page) {\n await page.close();\n }\n }\n }\n\n /\n Detects if a captcha is present on the page based on the specified selectors.\n \n @param {Page} page The Puppeteer page to check for captcha.\n * @returns {Promise<boolean>} A boolean indicating whether a captcha was detected.\n /\n private async detectCaptcha(page: Page): Promise<boolean> {\n const captchaSelectors = [\n 'iframe[src=\"captcha\"]',\n 'div[class=\"captcha\"]',\n '#captcha',\n '.g-recaptcha',\n '.h-captcha',\n ];\n\n for (const selector of captchaSelectors) {\n const element = await page.$(selector);\n if (element) return true;\n }\n\n return false;\n }\n\n /\n Solves the CAPTCHA challenge on the provided page using either hCaptcha or reCaptcha.\n \n @param {Page} page - The page where the CAPTCHA challenge needs to be solved.\n * @param {string} url - The URL of the website with the CAPTCHA challenge.\n * @returns {Promise<void>} - A promise that resolves once the CAPTCHA is solved.\n /\n private async solveCaptcha(page: Page, url: string): Promise<void> {\n try {\n const hcaptchaKey = await this.getHCaptchaWebsiteKey(page);\n if (hcaptchaKey) {\n const solution = await this.captchaSolver.hcaptchaProxyless({\n websiteURL: url,\n websiteKey: hcaptchaKey,\n });\n await page.evaluate((token) => {\n // eslint-disable-next-line\n // @ts-ignore\n window.hcaptcha.setResponse(token);\n }, solution.gRecaptchaResponse);\n return;\n }\n\n const recaptchaKey = await this.getReCaptchaWebsiteKey(page);\n if (recaptchaKey) {\n const solution = await this.captchaSolver.recaptchaV2Proxyless({\n websiteURL: url,\n websiteKey: recaptchaKey,\n });\n await page.evaluate((token) => {\n // eslint-disable-next-line\n // @ts-ignore\n document.getElementById('g-recaptcha-response').innerHTML = token;\n }, solution.gRecaptchaResponse);\n }\n } catch (error) {\n logger.error('Error solving CAPTCHA:', error);\n }\n }\n\n /\n Get the hCaptcha website key from the given Page\n * @param {Page} page - The Page object to extract the hCaptcha website key from\n * @returns {Promise<string>} The hCaptcha website key\n /\n private async getHCaptchaWebsiteKey(page: Page): Promise<string> {\n return page.evaluate(() => {\n const hcaptchaIframe = document.querySelector('iframe[src=\"hcaptcha.com\"]');\n if (hcaptchaIframe) {\n const src = hcaptchaIframe.getAttribute('src');\n const match = src?.match(/sitekey=([^&])/);\n return match ? match[1] : '';\n }\n return '';\n });\n }\n\n /\n Retrieves the ReCaptcha website key from a given page.\n * @param {Page} page - The page to extract the ReCaptcha website key from.\n * @returns {Promise<string>} The ReCaptcha website key, or an empty string if not found.\n /\n private async getReCaptchaWebsiteKey(page: Page): Promise<string> {\n return page.evaluate(() => {\n const recaptchaElement = document.querySelector('.g-recaptcha');\n return recaptchaElement ? recaptchaElement.getAttribute('data-sitekey') \|\| '' : '';\n });\n }\n\n /\n Try fetching content from alternative sources if the original source fails.\n \n @param {string} url - The URL of the content to fetch.\n * @param {IAgentRuntime} runtime - The runtime environment.\n * @returns {Promise<{ title: string; description: string; bodyContent: string }>} The fetched content with title, description, and body.\n */\n private async tryAlternativeSources(\n url: string,\n runtime: IAgentRuntime\n ): Promise<{ title: string; description: string; bodyContent: string }> {\n // because this (tryAlternativeSources) calls fetchPageContent\n // and fetchPageContent calls tryAlternativeSources\n // we need these url.matches to progress\n // through the things to try\n if (!url.match(/web.archive.org\\/web/)) {\n // Try Internet Archive\n const archiveUrl = `https://web.archive.org/web/${url}`;\n try {\n return await this.fetchPageContent(archiveUrl, runtime);\n } catch (error) {\n logger.error('Error fetching from Internet Archive:', error);\n }\n }\n\n if (!url.match(/www.google.com\\/search/)) {\n // Try Google Search as a last resort\n const googleSearchUrl = `https://www.google.com/search?q=${encodeURIComponent(url)}`;\n try {\n return await this.fetchPageContent(googleSearchUrl, runtime);\n } catch (error) {\n logger.error('Error fetching from Google Search:', error);\n logger.error('Failed to fetch content from alternative sources');\n return {\n title: url,\n description: 'Error, could not fetch content from alternative sources',\n bodyContent: '',\n };\n }\n }\n }\n}\n","import type { Plugin } from '@elizaos/core';\n\nimport { BrowserService } from './services/browser';\n\nexport const browserPlugin: Plugin = {\n name: 'browser-plugin',\n description: 'Plugin for browser actions',\n services: [BrowserService],\n actions: [],\n};\n"],"mappings":";AAAA;AAAA,EAGE;AAAA,EACA;AAAA,EAEA;AAAA,EACA;AAAA,EACA;AAAA,EACA;AAAA,EACA;AAAA,OACK;AACP,OAAO,mBAAmB;AAC1B,SAAuD,gBAAgB;AASvE,eAAe,gBACb,SACA,MACiD;AAEjD,SAAO,MAAM,WAAW,MAAM,KAAQ,OAAO;AAE7C,QAAM,SAAS;AAAA;AAAA;AAAA,IAGb,IAAI;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAWN,QAAM,WAAW,MAAM,QAAQ,SAAS,UAAU,YAAY;AAAA,IAC5D;AAAA,EACF,CAAC;AAED,QAAM,iBAAiB,wBAAwB,QAAQ;AAEvD,MAAI,gBAAgB,SAAS,gBAAgB,SAAS;AACpD,WAAO;AAAA,MACL,OAAO,eAAe;AAAA,MACtB,aAAa,eAAe;AAAA,IAC9B;AAAA,EACF;AAEA,SAAO;AAAA,IACL,OAAO;AAAA,IACP,aAAa;AAAA,EACf;AACF;AAqBO,IAAM,iBAAN,MAAM,wBAAuB,QAAmC;AAAA,EAC7D;AAAA,EACA;AAAA,EACA;AAAA,EACA,WAAW;AAAA,EAEnB,OAAO,cAA+B,YAAY;AAAA,EAClD,wBAAwB;AAAA;AAAA;AAAA;AAAA;AAAA,EAMxB,YAAY,SAAwB;AAClC,UAAM;AACN,SAAK,UAAU;AACf,SAAK,UAAU;AACf,SAAK,UAAU;AACf,SAAK,gBAAgB,IAAI,cAAc,QAAQ,WAAW,mBAAmB,KAAK,EAAE;AAAA,EACtF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAQA,aAAa,MAAM,SAAiD;AAClE,UAAM,UAAU,IAAI,gBAAe,OAAO;AAC1C,UAAM,QAAQ,kBAAkB;AAChC,WAAO;AAAA,EACT;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAOA,aAAa,KAAK,SAAwB;AACxC,UAAM,UAAU,QAAQ,WAAW,YAAY,OAAO;AACtD,QAAI,SAAS;AACX,YAAM,QAAQ,KAAK;AAAA,IACrB;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA,EAMA,MAAM,oBAAoB;AACxB,QAAI,CAAC,KAAK,SAAS;AACjB,WAAK,UAAU,MAAM,SAAS,OAAO;AAAA,QACnC,UAAU;AAAA,QACV,MAAM;AAAA,UACJ;AAAA;AAAA,UACA;AAAA;AAAA,QACF;AAAA,MACF,CAAC;AAED,YAAM,WAAW,QAAQ;AACzB,UAAI,YAAY;AAGhB,cAAQ,UAAU;AAAA,QAChB,KAAK;AACH,sBACE;AACF;AAAA,QACF,KAAK;AACH,sBACE;AACF;AAAA,QACF,KAAK;AACH,sBACE;AACF;AAAA,QACF;AACE,sBACE;AAAA,MACN;AAEA,WAAK,UAAU,MAAM,KAAK,QAAQ,WAAW;AAAA,QAC3C;AAAA,QACA,iBAAiB;AAAA,MACnB,CAAC;AAAA,IACH;AAAA,EACF;AAAA;AAAA;AAAA;AAAA,EAKA,MAAM,OAAO;AACX,QAAI,KAAK,SAAS;AAChB,YAAM,KAAK,QAAQ,MAAM;AACzB,WAAK,UAAU;AAAA,IACjB;AACA,QAAI,KAAK,SAAS;AAChB,YAAM,KAAK,QAAQ,MAAM;AACzB,WAAK,UAAU;AAAA,IACjB;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EASA,MAAM,eAAe,KAAa,SAA8C;AAC9E,UAAM,KAAK,kBAAkB;AAC7B,WAAO,MAAM,KAAK,iBAAiB,KAAK,OAAO;AAAA,EACjD;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAQQ,YAAY,KAAqB;AACvC,WAAO,aAAa,GAAG;AAAA,EACzB;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EASA,MAAc,iBAAiB,KAAa,SAA8C;AACxF,UAAM,WAAW,KAAK,YAAY,GAAG;AACrC,UAAM,SAAS,MAAM,QAAQ,SAAc,GAAG,KAAK,QAAQ,IAAI,QAAQ,EAAE;AAEzE,QAAI,QAAQ;AACV,aAAO,OAAO;AAAA,IAChB;AAEA,QAAI;AAEJ,QAAI;AACF,UAAI,CAAC,KAAK,SAAS;AACjB,eAAO,IAAI,kEAAkE;AAAA,MAC/E;AAEA,aAAO,MAAM,KAAK,QAAQ,QAAQ;AAGlC,YAAM,KAAK,oBAAoB;AAAA,QAC7B,mBAAmB;AAAA,MACrB,CAAC;AAED,YAAM,WAAW,MAAM,KAAK,KAAK,KAAK,EAAE,WAAW,cAAc,CAAC;AAElE,UAAI,CAAC,UAAU;AACb,eAAO,MAAM,yBAAyB;AAAA,MACxC;AAEA,UAAI,SAAS,OAAO,MAAM,OAAO,SAAS,OAAO,MAAM,KAAK;AAC1D,eAAO,MAAM,KAAK,sBAAsB,KAAK,OAAO;AAAA,MACtD;AAGA,YAAM,kBAAkB,MAAM,KAAK,cAAc,IAAI;AACrD,UAAI,iBAAiB;AACnB,cAAM,KAAK,aAAa,MAAM,GAAG;AAAA,MACnC;AACA,YAAM,gBAAgB,MAAM,KAAK,SAAS,MAAM,SAAS,KAAK;AAC9D,YAAM,cAAc,MAAM,KAAK,SAAS,MAAM,SAAS,KAAK,SAAS;AACrE,YAAM,EAAE,OAAO,aAAa,YAAY,IAAI,MAAM;AAAA,QAChD;AAAA,QACA,GAAG,aAAa;AAAA,EAAK,WAAW;AAAA,MAClC;AACA,YAAM,UAAU,EAAE,OAAO,aAAa,aAAa,YAAY;AAC/D,YAAM,QAAQ,SAAc,GAAG,KAAK,QAAQ,IAAI,QAAQ,IAAI;AAAA,QAC1D;AAAA,QACA;AAAA,MACF,CAAC;AACD,aAAO;AAAA,IACT,SAAS,OAAO;AACd,aAAO,MAAM,UAAU,KAAK;AAC5B,aAAO;AAAA,QACL,OAAO;AAAA,QACP,aAAa;AAAA,QACb,aAAa;AAAA,MACf;AAAA,IACF,UAAE;AACA,UAAI,MAAM;AACR,cAAM,KAAK,MAAM;AAAA,MACnB;AAAA,IACF;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAQA,MAAc,cAAc,MAA8B;AACxD,UAAM,mBAAmB;AAAA,MACvB;AAAA,MACA;AAAA,MACA;AAAA,MACA;AAAA,MACA;AAAA,IACF;AAEA,eAAW,YAAY,kBAAkB;AACvC,YAAM,UAAU,MAAM,KAAK,EAAE,QAAQ;AACrC,UAAI,QAAS,QAAO;AAAA,IACtB;AAEA,WAAO;AAAA,EACT;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EASA,MAAc,aAAa,MAAY,KAA4B;AACjE,QAAI;AACF,YAAM,cAAc,MAAM,KAAK,sBAAsB,IAAI;AACzD,UAAI,aAAa;AACf,cAAM,WAAW,MAAM,KAAK,cAAc,kBAAkB;AAAA,UAC1D,YAAY;AAAA,UACZ,YAAY;AAAA,QACd,CAAC;AACD,cAAM,KAAK,SAAS,CAAC,UAAU;AAG7B,iBAAO,SAAS,YAAY,KAAK;AAAA,QACnC,GAAG,SAAS,kBAAkB;AAC9B;AAAA,MACF;AAEA,YAAM,eAAe,MAAM,KAAK,uBAAuB,IAAI;AAC3D,UAAI,cAAc;AAChB,cAAM,WAAW,MAAM,KAAK,cAAc,qBAAqB;AAAA,UAC7D,YAAY;AAAA,UACZ,YAAY;AAAA,QACd,CAAC;AACD,cAAM,KAAK,SAAS,CAAC,UAAU;AAG7B,mBAAS,eAAe,sBAAsB,EAAE,YAAY;AAAA,QAC9D,GAAG,SAAS,kBAAkB;AAAA,MAChC;AAAA,IACF,SAAS,OAAO;AACd,aAAO,MAAM,0BAA0B,KAAK;AAAA,IAC9C;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAOA,MAAc,sBAAsB,MAA6B;AAC/D,WAAO,KAAK,SAAS,MAAM;AACzB,YAAM,iBAAiB,SAAS,cAAc,6BAA6B;AAC3E,UAAI,gBAAgB;AAClB,cAAM,MAAM,eAAe,aAAa,KAAK;AAC7C,cAAM,QAAQ,KAAK,MAAM,iBAAiB;AAC1C,eAAO,QAAQ,MAAM,CAAC,IAAI;AAAA,MAC5B;AACA,aAAO;AAAA,IACT,CAAC;AAAA,EACH;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAOA,MAAc,uBAAuB,MAA6B;AAChE,WAAO,KAAK,SAAS,MAAM;AACzB,YAAM,mBAAmB,SAAS,cAAc,cAAc;AAC9D,aAAO,mBAAmB,iBAAiB,aAAa,cAAc,KAAK,KAAK;AAAA,IAClF,CAAC;AAAA,EACH;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EASA,MAAc,sBACZ,KACA,SACsE;AAKtE,QAAI,CAAC,IAAI,MAAM,sBAAsB,GAAG;AAEtC,YAAM,aAAa,+BAA+B,GAAG;AACrD,UAAI;AACF,eAAO,MAAM,KAAK,iBAAiB,YAAY,OAAO;AAAA,MACxD,SAAS,OAAO;AACd,eAAO,MAAM,yCAAyC,KAAK;AAAA,MAC7D;AAAA,IACF;AAEA,QAAI,CAAC,IAAI,MAAM,wBAAwB,GAAG;AAExC,YAAM,kBAAkB,mCAAmC,mBAAmB,GAAG,CAAC;AAClF,UAAI;AACF,eAAO,MAAM,KAAK,iBAAiB,iBAAiB,OAAO;AAAA,MAC7D,SAAS,OAAO;AACd,eAAO,MAAM,sCAAsC,KAAK;AACxD,eAAO,MAAM,kDAAkD;AAC/D,eAAO;AAAA,UACL,OAAO;AAAA,UACP,aAAa;AAAA,UACb,aAAa;AAAA,QACf;AAAA,MACF;AAAA,IACF;AAAA,EACF;AACF;;;ACpZO,IAAM,gBAAwB;AAAA,EACnC,MAAM;AAAA,EACN,aAAa;AAAA,EACb,UAAU,CAAC,cAAc;AAAA,EACzB,SAAS,CAAC;AACZ;","names":[]}
1	+ {"version":3,"sources":["../src/services/browser.ts","../src/index.ts"],"sourcesContent":["import {\n type IAgentRuntime,\n ModelType,\n Service,\n type ServiceTypeName,\n ServiceType,\n logger,\n parseJSONObjectFromText,\n stringToUuid,\n trimTokens,\n} from '@elizaos/core';\nimport CaptchaSolver from 'capsolver-npm';\nimport { type Browser, type BrowserContext, type Page, chromium } from 'patchright';\n\n// Type for cached content\ninterface CachedContent {\n url: string;\n content: PageContent;\n}\n\n/*\n Asynchronously generates a summary for a given text using a machine learning model.\n \n @param {IAgentRuntime} runtime - The runtime environment for the agent\n * @param {string} text - The text to generate a summary for\n * @returns {Promise<{ title: string; description: string }>} A promise that resolves to an object containing the generated title and summary\n /\nasync function generateSummary(\n runtime: IAgentRuntime,\n text: string\n): Promise<{ title: string; description: string }> {\n // make sure text is under 128k characters\n const trimmedText = await trimTokens(text, 100000, runtime);\n\n const prompt = `Please generate a concise summary for the following text:\n\n Text: \"\"\"\n ${trimmedText}\n \"\"\"\n\n Respond with a JSON object in the following format:\n \\`\\`\\`json\n {\n \"title\": \"Generated Title\",\n \"summary\": \"Generated summary and/or description of the text\"\n }\n \\`\\`\\``;\n\n const response = await runtime.useModel(ModelType.TEXT_SMALL, {\n prompt,\n });\n\n const parsedResponse = parseJSONObjectFromText(response);\n\n if (parsedResponse?.title && parsedResponse?.summary) {\n return {\n title: parsedResponse.title,\n description: parsedResponse.summary,\n };\n }\n\n return {\n title: '',\n description: '',\n };\n}\n\n/\n Represents the content of a page.\n * @typedef { Object } PageContent\n * @property { string } title - The title of the page.\n * @property { string } description - The description of the page.\n * @property { string } bodyContent - The main content of the page.\n /\ntype PageContent = {\n title: string;\n description: string;\n bodyContent: string;\n};\n\n/\n Represents a BrowserService class that extends Service.\n * Provides methods for initializing browser, stopping browser, fetching page content, solving CAPTCHAs, detecting CAPTCHAs, and getting cache key.\n * @extends Service\n /\nexport class BrowserService extends Service {\n private browser: Browser \| undefined;\n private context: BrowserContext \| undefined;\n private captchaSolver: CaptchaSolver;\n private cacheKey = 'content/browser';\n\n static serviceType: ServiceTypeName = ServiceType.BROWSER;\n capabilityDescription = 'The agent is able to browse the web and fetch content';\n\n /\n Constructor for the Agent class.\n * @param {IAgentRuntime} runtime - The runtime object for the agent.\n /\n constructor(runtime: IAgentRuntime) {\n super();\n this.runtime = runtime;\n this.browser = undefined;\n this.context = undefined;\n this.captchaSolver = new CaptchaSolver(runtime.getSetting('CAPSOLVER_API_KEY') \|\| '');\n }\n\n /\n Starts the BrowserService asynchronously.\n \n @param {IAgentRuntime} runtime - The runtime for the agent.\n * @returns {Promise<BrowserService>} A promise that resolves to the initialized BrowserService.\n /\n static async start(runtime: IAgentRuntime): Promise<BrowserService> {\n const service = new BrowserService(runtime);\n await service.initializeBrowser();\n return service;\n }\n\n /\n Function to stop the browser service asynchronously.\n \n @param {IAgentRuntime} runtime - The runtime environment for the agent.\n /\n static async stop(runtime: IAgentRuntime) {\n const service = runtime.getService(ServiceType.BROWSER);\n if (service) {\n await service.stop();\n }\n }\n\n /\n Initializes the browser by launching Chromium with specified options and setting the user agent based on the platform.\n * @returns {Promise<void>} A promise that resolves once the browser is successfully initialized.\n /\n async initializeBrowser() {\n if (!this.browser) {\n this.browser = await chromium.launch({\n headless: true,\n args: [\n '--disable-dev-shm-usage', // Uses /tmp instead of /dev/shm. Prevents memory issues on low-memory systems\n '--block-new-web-contents', // Prevents creation of new windows/tabs\n ],\n });\n\n const platform = process.platform;\n let userAgent = '';\n\n // Change the user agent to match the platform to reduce bot detection\n switch (platform) {\n case 'darwin':\n userAgent =\n 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36';\n break;\n case 'win32':\n userAgent =\n 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36';\n break;\n case 'linux':\n userAgent =\n 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36';\n break;\n default:\n userAgent =\n 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36';\n }\n\n this.context = await this.browser.newContext({\n userAgent,\n acceptDownloads: false,\n });\n }\n }\n\n /\n Asynchronously stops the browser and context if they are currently running.\n /\n async stop() {\n if (this.context) {\n await this.context.close();\n this.context = undefined;\n }\n if (this.browser) {\n await this.browser.close();\n this.browser = undefined;\n }\n }\n\n /\n Asynchronously fetches the content of a web page.\n \n @param {string} url - The URL of the web page to fetch content from.\n * @param {IAgentRuntime} runtime - The runtime environment for the web scraping agent.\n * @returns {Promise<PageContent>} A Promise that resolves with the content of the web page.\n /\n async getPageContent(url: string, runtime: IAgentRuntime): Promise<PageContent> {\n await this.initializeBrowser();\n return await this.fetchPageContent(url, runtime);\n }\n\n /\n Generates a cache key for the provided URL by converting it to a UUID string.\n \n @param {string} url - The URL for which a cache key is being generated.\n * @returns {string} A UUID string representing the cache key for the URL.\n /\n private getCacheKey(url: string): string {\n return stringToUuid(url);\n }\n\n /\n Fetches the content of a page from the specified URL using a headless browser.\n \n @param {string} url - The URL of the page to fetch the content from.\n * @param {IAgentRuntime} runtime - The runtime environment for the agent.\n * @returns {Promise<PageContent>} A promise that resolves to the content of the fetched page.\n /\n private async fetchPageContent(url: string, runtime: IAgentRuntime): Promise<PageContent> {\n const cacheKey = this.getCacheKey(url);\n const cached = await runtime.getCache<CachedContent>(`${this.cacheKey}/${cacheKey}`);\n\n if (cached) {\n return cached.content;\n }\n\n let page: Page \| undefined;\n\n try {\n if (!this.context) {\n logger.log('Browser context not initialized. Call initializeBrowser() first.');\n throw new Error('Browser context not initialized');\n }\n\n page = await this.context.newPage();\n\n // Enable stealth mode\n await page.setExtraHTTPHeaders({\n 'Accept-Language': 'en-US,en;q=0.9',\n });\n\n const response = await page.goto(url, { waitUntil: 'networkidle' });\n\n if (!response) {\n logger.error('Failed to load the page');\n throw new Error('Failed to load the page');\n }\n\n if (response.status() === 403 \|\| response.status() === 404) {\n return await this.tryAlternativeSources(url, runtime);\n }\n\n // Check for CAPTCHA\n const captchaDetected = await this.detectCaptcha(page);\n if (captchaDetected) {\n await this.solveCaptcha(page, url);\n }\n const documentTitle = await page.evaluate(() => document.title);\n const bodyContent = await page.evaluate(() => document.body.innerText);\n const { title: parsedTitle, description } = await generateSummary(\n runtime,\n `${documentTitle}\\n${bodyContent}`\n );\n const content = { title: parsedTitle, description, bodyContent };\n await runtime.setCache<CachedContent>(`${this.cacheKey}/${cacheKey}`, {\n url,\n content,\n });\n return content;\n } catch (error) {\n logger.error('Error:', error);\n return {\n title: url,\n description: 'Error, could not fetch content',\n bodyContent: '',\n };\n } finally {\n if (page) {\n await page.close();\n }\n }\n }\n\n /\n Detects if a captcha is present on the page based on the specified selectors.\n \n @param {Page} page The Puppeteer page to check for captcha.\n * @returns {Promise<boolean>} A boolean indicating whether a captcha was detected.\n /\n private async detectCaptcha(page: Page): Promise<boolean> {\n const captchaSelectors = [\n 'iframe[src=\"captcha\"]',\n 'div[class=\"captcha\"]',\n '#captcha',\n '.g-recaptcha',\n '.h-captcha',\n ];\n\n for (const selector of captchaSelectors) {\n const element = await page.$(selector);\n if (element) return true;\n }\n\n return false;\n }\n\n /\n Solves the CAPTCHA challenge on the provided page using either hCaptcha or reCaptcha.\n \n @param {Page} page - The page where the CAPTCHA challenge needs to be solved.\n * @param {string} url - The URL of the website with the CAPTCHA challenge.\n * @returns {Promise<void>} - A promise that resolves once the CAPTCHA is solved.\n /\n private async solveCaptcha(page: Page, url: string): Promise<void> {\n try {\n const hcaptchaKey = await this.getHCaptchaWebsiteKey(page);\n if (hcaptchaKey) {\n const solution = await this.captchaSolver.hcaptchaProxyless({\n websiteURL: url,\n websiteKey: hcaptchaKey,\n });\n await page.evaluate((token) => {\n // eslint-disable-next-line\n // @ts-ignore\n window.hcaptcha.setResponse(token);\n }, solution.gRecaptchaResponse);\n return;\n }\n\n const recaptchaKey = await this.getReCaptchaWebsiteKey(page);\n if (recaptchaKey) {\n const solution = await this.captchaSolver.recaptchaV2Proxyless({\n websiteURL: url,\n websiteKey: recaptchaKey,\n });\n await page.evaluate((token) => {\n // eslint-disable-next-line\n // @ts-ignore\n document.getElementById('g-recaptcha-response').innerHTML = token;\n }, solution.gRecaptchaResponse);\n }\n } catch (error) {\n logger.error('Error solving CAPTCHA:', error);\n }\n }\n\n /\n Get the hCaptcha website key from the given Page\n * @param {Page} page - The Page object to extract the hCaptcha website key from\n * @returns {Promise<string>} The hCaptcha website key\n /\n private async getHCaptchaWebsiteKey(page: Page): Promise<string> {\n return page.evaluate(() => {\n const hcaptchaIframe = document.querySelector('iframe[src=\"hcaptcha.com\"]');\n if (hcaptchaIframe) {\n const src = hcaptchaIframe.getAttribute('src');\n const match = src?.match(/sitekey=([^&])/);\n return match ? match[1] : '';\n }\n return '';\n });\n }\n\n /\n Retrieves the ReCaptcha website key from a given page.\n * @param {Page} page - The page to extract the ReCaptcha website key from.\n * @returns {Promise<string>} The ReCaptcha website key, or an empty string if not found.\n /\n private async getReCaptchaWebsiteKey(page: Page): Promise<string> {\n return page.evaluate(() => {\n const recaptchaElement = document.querySelector('.g-recaptcha');\n return recaptchaElement ? recaptchaElement.getAttribute('data-sitekey') \|\| '' : '';\n });\n }\n\n /\n Try fetching content from alternative sources if the original source fails.\n \n @param {string} url - The URL of the content to fetch.\n * @param {IAgentRuntime} runtime - The runtime environment.\n * @returns {Promise<{ title: string; description: string; bodyContent: string }>} The fetched content with title, description, and body.\n */\n private async tryAlternativeSources(\n url: string,\n runtime: IAgentRuntime\n ): Promise<{ title: string; description: string; bodyContent: string }> {\n // because this (tryAlternativeSources) calls fetchPageContent\n // and fetchPageContent calls tryAlternativeSources\n // we need these url.matches to progress\n // through the things to try\n if (!url.match(/web.archive.org\\/web/)) {\n // Try Internet Archive\n const archiveUrl = `https://web.archive.org/web/${url}`;\n try {\n return await this.fetchPageContent(archiveUrl, runtime);\n } catch (error) {\n logger.error('Error fetching from Internet Archive:', error);\n }\n }\n\n if (!url.match(/www.google.com\\/search/)) {\n // Try Google Search as a last resort\n const googleSearchUrl = `https://www.google.com/search?q=${encodeURIComponent(url)}`;\n try {\n return await this.fetchPageContent(googleSearchUrl, runtime);\n } catch (error) {\n logger.error('Error fetching from Google Search:', error);\n logger.error('Failed to fetch content from alternative sources');\n }\n }\n\n // Return error content if all alternatives fail\n return {\n title: url,\n description: 'Error, could not fetch content from alternative sources',\n bodyContent: '',\n };\n }\n}\n","import type { Plugin , IAgentRuntime} from \"@elizaos/core\";\n\nimport { BrowserService } from \"./services/browser\";\n\nexport const browserPlugin: Plugin = {\n name: \"browser-plugin\",\n description: \"Plugin for browser actions\",\n services: [BrowserService],\n actions: [],\n tests: [\n {\n name: \"test browser service\",\n tests: [\n {\n name: \"Browser service initialization\",\n fn: async (runtime: IAgentRuntime) => {\n const service = await BrowserService.start(runtime);\n if (!service) {\n throw new Error(\"Failed to initialize BrowserService\");\n }\n },\n },\n ],\n }\n ],\n};\n"],"mappings":";AAAA;AAAA,EAEE;AAAA,EACA;AAAA,EAEA;AAAA,EACA;AAAA,EACA;AAAA,EACA;AAAA,EACA;AAAA,OACK;AACP,OAAO,mBAAmB;AAC1B,SAAuD,gBAAgB;AAevE,eAAe,gBACb,SACA,MACiD;AAEjD,QAAM,cAAc,MAAM,WAAW,MAAM,KAAQ,OAAO;AAE1D,QAAM,SAAS;AAAA;AAAA;AAAA,IAGb,WAAW;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAWb,QAAM,WAAW,MAAM,QAAQ,SAAS,UAAU,YAAY;AAAA,IAC5D;AAAA,EACF,CAAC;AAED,QAAM,iBAAiB,wBAAwB,QAAQ;AAEvD,MAAI,gBAAgB,SAAS,gBAAgB,SAAS;AACpD,WAAO;AAAA,MACL,OAAO,eAAe;AAAA,MACtB,aAAa,eAAe;AAAA,IAC9B;AAAA,EACF;AAEA,SAAO;AAAA,IACL,OAAO;AAAA,IACP,aAAa;AAAA,EACf;AACF;AAoBO,IAAM,iBAAN,MAAM,wBAAuB,QAAQ;AAAA,EAClC;AAAA,EACA;AAAA,EACA;AAAA,EACA,WAAW;AAAA,EAEnB,OAAO,cAA+B,YAAY;AAAA,EAClD,wBAAwB;AAAA;AAAA;AAAA;AAAA;AAAA,EAMxB,YAAY,SAAwB;AAClC,UAAM;AACN,SAAK,UAAU;AACf,SAAK,UAAU;AACf,SAAK,UAAU;AACf,SAAK,gBAAgB,IAAI,cAAc,QAAQ,WAAW,mBAAmB,KAAK,EAAE;AAAA,EACtF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAQA,aAAa,MAAM,SAAiD;AAClE,UAAM,UAAU,IAAI,gBAAe,OAAO;AAC1C,UAAM,QAAQ,kBAAkB;AAChC,WAAO;AAAA,EACT;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAOA,aAAa,KAAK,SAAwB;AACxC,UAAM,UAAU,QAAQ,WAAW,YAAY,OAAO;AACtD,QAAI,SAAS;AACX,YAAM,QAAQ,KAAK;AAAA,IACrB;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA,EAMA,MAAM,oBAAoB;AACxB,QAAI,CAAC,KAAK,SAAS;AACjB,WAAK,UAAU,MAAM,SAAS,OAAO;AAAA,QACnC,UAAU;AAAA,QACV,MAAM;AAAA,UACJ;AAAA;AAAA,UACA;AAAA;AAAA,QACF;AAAA,MACF,CAAC;AAED,YAAM,WAAW,QAAQ;AACzB,UAAI,YAAY;AAGhB,cAAQ,UAAU;AAAA,QAChB,KAAK;AACH,sBACE;AACF;AAAA,QACF,KAAK;AACH,sBACE;AACF;AAAA,QACF,KAAK;AACH,sBACE;AACF;AAAA,QACF;AACE,sBACE;AAAA,MACN;AAEA,WAAK,UAAU,MAAM,KAAK,QAAQ,WAAW;AAAA,QAC3C;AAAA,QACA,iBAAiB;AAAA,MACnB,CAAC;AAAA,IACH;AAAA,EACF;AAAA;AAAA;AAAA;AAAA,EAKA,MAAM,OAAO;AACX,QAAI,KAAK,SAAS;AAChB,YAAM,KAAK,QAAQ,MAAM;AACzB,WAAK,UAAU;AAAA,IACjB;AACA,QAAI,KAAK,SAAS;AAChB,YAAM,KAAK,QAAQ,MAAM;AACzB,WAAK,UAAU;AAAA,IACjB;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EASA,MAAM,eAAe,KAAa,SAA8C;AAC9E,UAAM,KAAK,kBAAkB;AAC7B,WAAO,MAAM,KAAK,iBAAiB,KAAK,OAAO;AAAA,EACjD;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAQQ,YAAY,KAAqB;AACvC,WAAO,aAAa,GAAG;AAAA,EACzB;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EASA,MAAc,iBAAiB,KAAa,SAA8C;AACxF,UAAM,WAAW,KAAK,YAAY,GAAG;AACrC,UAAM,SAAS,MAAM,QAAQ,SAAwB,GAAG,KAAK,QAAQ,IAAI,QAAQ,EAAE;AAEnF,QAAI,QAAQ;AACV,aAAO,OAAO;AAAA,IAChB;AAEA,QAAI;AAEJ,QAAI;AACF,UAAI,CAAC,KAAK,SAAS;AACjB,eAAO,IAAI,kEAAkE;AAC7E,cAAM,IAAI,MAAM,iCAAiC;AAAA,MACnD;AAEA,aAAO,MAAM,KAAK,QAAQ,QAAQ;AAGlC,YAAM,KAAK,oBAAoB;AAAA,QAC7B,mBAAmB;AAAA,MACrB,CAAC;AAED,YAAM,WAAW,MAAM,KAAK,KAAK,KAAK,EAAE,WAAW,cAAc,CAAC;AAElE,UAAI,CAAC,UAAU;AACb,eAAO,MAAM,yBAAyB;AACtC,cAAM,IAAI,MAAM,yBAAyB;AAAA,MAC3C;AAEA,UAAI,SAAS,OAAO,MAAM,OAAO,SAAS,OAAO,MAAM,KAAK;AAC1D,eAAO,MAAM,KAAK,sBAAsB,KAAK,OAAO;AAAA,MACtD;AAGA,YAAM,kBAAkB,MAAM,KAAK,cAAc,IAAI;AACrD,UAAI,iBAAiB;AACnB,cAAM,KAAK,aAAa,MAAM,GAAG;AAAA,MACnC;AACA,YAAM,gBAAgB,MAAM,KAAK,SAAS,MAAM,SAAS,KAAK;AAC9D,YAAM,cAAc,MAAM,KAAK,SAAS,MAAM,SAAS,KAAK,SAAS;AACrE,YAAM,EAAE,OAAO,aAAa,YAAY,IAAI,MAAM;AAAA,QAChD;AAAA,QACA,GAAG,aAAa;AAAA,EAAK,WAAW;AAAA,MAClC;AACA,YAAM,UAAU,EAAE,OAAO,aAAa,aAAa,YAAY;AAC/D,YAAM,QAAQ,SAAwB,GAAG,KAAK,QAAQ,IAAI,QAAQ,IAAI;AAAA,QACpE;AAAA,QACA;AAAA,MACF,CAAC;AACD,aAAO;AAAA,IACT,SAAS,OAAO;AACd,aAAO,MAAM,UAAU,KAAK;AAC5B,aAAO;AAAA,QACL,OAAO;AAAA,QACP,aAAa;AAAA,QACb,aAAa;AAAA,MACf;AAAA,IACF,UAAE;AACA,UAAI,MAAM;AACR,cAAM,KAAK,MAAM;AAAA,MACnB;AAAA,IACF;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAQA,MAAc,cAAc,MAA8B;AACxD,UAAM,mBAAmB;AAAA,MACvB;AAAA,MACA;AAAA,MACA;AAAA,MACA;AAAA,MACA;AAAA,IACF;AAEA,eAAW,YAAY,kBAAkB;AACvC,YAAM,UAAU,MAAM,KAAK,EAAE,QAAQ;AACrC,UAAI,QAAS,QAAO;AAAA,IACtB;AAEA,WAAO;AAAA,EACT;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EASA,MAAc,aAAa,MAAY,KAA4B;AACjE,QAAI;AACF,YAAM,cAAc,MAAM,KAAK,sBAAsB,IAAI;AACzD,UAAI,aAAa;AACf,cAAM,WAAW,MAAM,KAAK,cAAc,kBAAkB;AAAA,UAC1D,YAAY;AAAA,UACZ,YAAY;AAAA,QACd,CAAC;AACD,cAAM,KAAK,SAAS,CAAC,UAAU;AAG7B,iBAAO,SAAS,YAAY,KAAK;AAAA,QACnC,GAAG,SAAS,kBAAkB;AAC9B;AAAA,MACF;AAEA,YAAM,eAAe,MAAM,KAAK,uBAAuB,IAAI;AAC3D,UAAI,cAAc;AAChB,cAAM,WAAW,MAAM,KAAK,cAAc,qBAAqB;AAAA,UAC7D,YAAY;AAAA,UACZ,YAAY;AAAA,QACd,CAAC;AACD,cAAM,KAAK,SAAS,CAAC,UAAU;AAG7B,mBAAS,eAAe,sBAAsB,EAAE,YAAY;AAAA,QAC9D,GAAG,SAAS,kBAAkB;AAAA,MAChC;AAAA,IACF,SAAS,OAAO;AACd,aAAO,MAAM,0BAA0B,KAAK;AAAA,IAC9C;AAAA,EACF;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAOA,MAAc,sBAAsB,MAA6B;AAC/D,WAAO,KAAK,SAAS,MAAM;AACzB,YAAM,iBAAiB,SAAS,cAAc,6BAA6B;AAC3E,UAAI,gBAAgB;AAClB,cAAM,MAAM,eAAe,aAAa,KAAK;AAC7C,cAAM,QAAQ,KAAK,MAAM,iBAAiB;AAC1C,eAAO,QAAQ,MAAM,CAAC,IAAI;AAAA,MAC5B;AACA,aAAO;AAAA,IACT,CAAC;AAAA,EACH;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EAOA,MAAc,uBAAuB,MAA6B;AAChE,WAAO,KAAK,SAAS,MAAM;AACzB,YAAM,mBAAmB,SAAS,cAAc,cAAc;AAC9D,aAAO,mBAAmB,iBAAiB,aAAa,cAAc,KAAK,KAAK;AAAA,IAClF,CAAC;AAAA,EACH;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA;AAAA,EASA,MAAc,sBACZ,KACA,SACsE;AAKtE,QAAI,CAAC,IAAI,MAAM,sBAAsB,GAAG;AAEtC,YAAM,aAAa,+BAA+B,GAAG;AACrD,UAAI;AACF,eAAO,MAAM,KAAK,iBAAiB,YAAY,OAAO;AAAA,MACxD,SAAS,OAAO;AACd,eAAO,MAAM,yCAAyC,KAAK;AAAA,MAC7D;AAAA,IACF;AAEA,QAAI,CAAC,IAAI,MAAM,wBAAwB,GAAG;AAExC,YAAM,kBAAkB,mCAAmC,mBAAmB,GAAG,CAAC;AAClF,UAAI;AACF,eAAO,MAAM,KAAK,iBAAiB,iBAAiB,OAAO;AAAA,MAC7D,SAAS,OAAO;AACd,eAAO,MAAM,sCAAsC,KAAK;AACxD,eAAO,MAAM,kDAAkD;AAAA,MACjE;AAAA,IACF;AAGA,WAAO;AAAA,MACL,OAAO;AAAA,MACP,aAAa;AAAA,MACb,aAAa;AAAA,IACf;AAAA,EACF;AACF;;;AC5ZO,IAAM,gBAAwB;AAAA,EACnC,MAAM;AAAA,EACN,aAAa;AAAA,EACb,UAAU,CAAC,cAAc;AAAA,EACzB,SAAS,CAAC;AAAA,EACV,OAAO;AAAA,IACL;AAAA,MACE,MAAM;AAAA,MACN,OAAO;AAAA,QACL;AAAA,UACE,MAAM;AAAA,UACN,IAAI,OAAO,YAA2B;AACpC,kBAAM,UAAU,MAAM,eAAe,MAAM,OAAO;AAClD,gBAAI,CAAC,SAAS;AACZ,oBAAM,IAAI,MAAM,qCAAqC;AAAA,YACvD;AAAA,UACF;AAAA,QACF;AAAA,MACF;AAAA,IACF;AAAA,EACF;AACF;","names":[]}

package/package.json CHANGED Viewed

@@ -1,13 +1,20 @@
 {
   "name": "@elizaos/plugin-browser",
-  "version": "1.0.0-beta.8",
+  "description": "Plugin for browser actions and web scraping",
+  "version": "1.0.0",
   "type": "module",
   "main": "dist/index.js",
   "module": "dist/index.js",
   "types": "dist/index.d.ts",
+  "keywords": [
+    "plugin",
+    "elizaos",
+    "browser",
+    "web-scraping"
+  ],
   "repository": {
     "type": "git",
-    "url": "https://github.com/elizaos-plugins/plugin-browser"
+    "url": ""
   },
   "exports": {
     "./package.json": "./package.json",
@@ -19,39 +26,37 @@
     }
   },
   "files": [
-    "dist",
-    "scripts",
-    "package.json",
-    "LICENSE",
-    "tsup.config.ts"
+    "dist"
   ],
   "dependencies": {
-    "@elizaos/core": "^1.0.0-beta.8",
+    "@elizaos/core": "^1.0.0",
+    "@elizaos/plugin-anthropic": "^1.0.0-beta.54",
+    "@elizaos/plugin-bootstrap": "^1.0.0-beta.76",
+    "@elizaos/plugin-knowledge": "^1.0.0-beta.78",
+    "@elizaos/plugin-openai": "^1.0.0-beta.74",
+    "@elizaos/plugin-telegram": "^1.0.0-beta.55",
+    "@elizaos/plugin-twitter": "^1.0.0-beta.57",
     "@types/uuid": "10.0.0",
     "capsolver-npm": "2.0.2",
     "fluent-ffmpeg": "2.1.3",
     "glob": "11.0.0",
     "patchright": "1.50.1",
-    "uuid": "11.0.3"
+    "uuid": "11.0.3",
+    "zod": "3.25.23"
   },
   "devDependencies": {
-    "@types/node": "22.8.4",
-    "prettier": "3.5.3",
-    "tsup": "8.4.0",
-    "vitest": "^1.6.1",
-    "zod": "^3.22.4"
+    "tsup": "8.5.0",
+    "typescript": "5.8.3",
+    "prettier": "3.5.3"
   },
   "scripts": {
-    "build": "tsup",
     "dev": "tsup --watch",
-    "postinstall": "node scripts/postinstall.js",
+    "build": "tsup",
     "lint": "prettier --write ./src",
-    "clean": "rm -rf dist .turbo node_modules .turbo-tsconfig.json tsconfig.tsbuildinfo",
+    "test": "elizaos test",
     "format": "prettier --write ./src",
     "format:check": "prettier --check ./src",
-    "test": "vitest run",
-    "test:watch": "vitest",
-    "test:coverage": "vitest run --coverage"
+    "clean": "rm -rf dist .turbo node_modules .turbo-tsconfig.json tsconfig.tsbuildinfo"
   },
   "peerDependencies": {
     "whatwg-url": "7.1.0"
@@ -59,5 +64,8 @@
   "publishConfig": {
     "access": "public"
   },
-  "gitHead": "a84e25ee21e33387a1303e62a2f95dc670ffddd4"
+  "resolutions": {
+    "zod": "3.25.23"
+  },
+  "gitHead": "646c632924826e2b75c2304a75ee56959fe4a460"
 }

package/scripts/postinstall.js DELETED Viewed

@@ -1,67 +0,0 @@
-import { execSync } from 'node:child_process';
-import fs from 'node:fs';
-import os from 'node:os';
-const platform = os.platform();
-const rel = os.release();
-if (platform !== 'linux') {
-  console.log('Skipping [patchright] installation: non-Linux platform detected:', platform);
-  process.exit(0);
-}
-function getDistroName() {
-  try {
-    const osReleaseContent = fs.readFileSync('/etc/os-release', 'utf8');
-    const lines = osReleaseContent.split('\n');
-    const info = {};
-    for (const line of lines) {
-      const [key, value] = line.split('=');
-      if (key && value) {
-        info[key.toLowerCase()] = value.replace(/"/g, '').toLowerCase().trim();
-      }
-    }
-    return info.id || info.id_like || null;
-  } catch (err) {
-    console.error('Error reading /etc/os-release:', err.message);
-  }
-  return null;
-}
-const distro = getDistroName();
-console.log('Detected Linux distribution:', distro || 'unknown');
-const supportedDistros = [
-  'ubuntu',
-  'debian',
-  'pve',
-  'raspbian',
-  'pop',
-  'zorin',
-  'linuxmint',
-  'elementary',
-  'pureos',
-  'kali',
-];
-if (!distro || !supportedDistros.some((name) => distro.includes(name))) {
-  console.log(
-    'Skipping [patchright] installation on unsupported platform:',
-    platform,
-    rel,
-    distro || 'unknown distro'
-  );
-  process.exit(0);
-}
-try {
-  execSync('npx patchright install', {
-    stdio: 'inherit',
-  });
-} catch (err) {
-  console.error(
-    "Failed to install [patchright] you may need to install [patchright] deps with 'sudo npx patchright install-deps'. Error: ",
-    err.message
-  );
-  process.exit(1);
-}

package/tsup.config.ts DELETED Viewed

@@ -1,23 +0,0 @@
-import { defineConfig } from 'tsup';
-export default defineConfig({
-  entry: ['src/index.ts'],
-  outDir: 'dist',
-  tsconfig: './tsconfig.build.json', // Use build-specific tsconfig
-  sourcemap: true,
-  clean: true,
-  format: ['esm'], // Ensure you're targeting CommonJS
-  dts: false, // Skip DTS generation to avoid external import issues // Ensure you're targeting CommonJS
-  external: [
-    'dotenv', // Externalize dotenv to prevent bundling
-    'fs', // Externalize fs to use Node.js built-in module
-    'path', // Externalize other built-ins if necessary
-    '@reflink/reflink',
-    'https',
-    'http',
-    'agentkeepalive',
-    'zod',
-    '@elizaos/core',
-    // Add other modules you want to externalize
-  ],
-});