mcpbrowser 0.2.1 → 0.2.3

package/README.md

@@ -1,21 +1,38 @@
 # MCPBrowser (MCP fetch tool with authenticated Chrome)
 
+[![VS Code Marketplace](https://img.shields.io/visual-studio-marketplace/v/cherchyk.mcpbrowser.svg)](https://marketplace.visualstudio.com/items?itemName=cherchyk.mcpbrowser)
 [![npm version](https://img.shields.io/npm/v/mcpbrowser.svg)](https://www.npmjs.com/package/mcpbrowser)
 [![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
 
-An MCP server that exposes an authenticated page fetch tool for GitHub Copilot. It drives your signed-in Chrome/Edge via DevTools, reusing your profile to read restricted pages.
+Alternative web fetcher for GitHub Copilot when normal URL access fails due to authentication or anti-crawler restrictions. Uses your Chrome/Edge browser session via DevTools Protocol to bypass login requirements and bot detection.
 
-## 🚀 One-Click Install for VS Code
+## 🚀 Installation Options
 
-<details>
-<summary><b>📋 Click to copy the configuration snippet</b></summary>
+### Option 1: VS Code Extension (Easiest - One Click)
 
-Add this to your VS Code `mcp.json` file:
+**From VS Code Marketplace:**
+```bash
+code --install-extension cherchyk.mcpbrowser
+```
+Or search "MCPBrowser" in VS Code Extensions view.
 
-**Location:**
-- Windows: `%APPDATA%\Code\User\mcp.json`
-- Mac/Linux: `~/.config/Code/User/mcp.json`
+**From GitHub Release:**
+Download from [GitHub Releases](https://github.com/cherchyk/MCPBrowser/releases):
+```bash
+code --install-extension mcpbrowser-0.1.4.vsix
+```
+
+The extension automatically:
+- Installs the MCPBrowser npm package globally
+- Configures mcp.json for GitHub Copilot
+- Complete one-click setup - no manual steps needed
+
+📦 [View on Marketplace](https://marketplace.visualstudio.com/items?itemName=cherchyk.mcpbrowser)
+
+### Option 2: npm Package (Recommended for Manual Setup)
+Published on npm as [mcpbrowser](https://www.npmjs.com/package/mcpbrowser) v0.2.2.
 
+Add to your `mcp.json`:
 ```jsonc
 "MCPBrowser": {
   "type": "stdio",
@@ -25,21 +42,16 @@ Add this to your VS Code `mcp.json` file:
 }
 ```
 
-Or clone from GitHub:
-```jsonc
-"MCPBrowser": {
-  "type": "stdio",
-  "command": "npx",
-  "args": ["-y", "github:cherchyk/MCPBrowser"],
-  "description": "Loads authenticated web pages using your Chrome session"
-}
-```
+**mcp.json Location:**
+- Windows: `%APPDATA%\Code\User\mcp.json`
+- Mac/Linux: `~/.config/Code/User/mcp.json`
 
-</details>
+### Option 3: MCP Registry
+Available in the [MCP Registry](https://registry.modelcontextprotocol.io/) as `io.github.cherchyk/browser` v0.2.2.
 
-## Quick Install
+Search for "browser" in the registry to find configuration instructions.
 
-### Option 1: Install from GitHub (Recommended)
+### Option 4: Clone from GitHub (Development)
 ```bash
 git clone https://github.com/cherchyk/MCPBrowser.git
 cd MCPBrowser
@@ -106,6 +118,7 @@ In Copilot Chat, you should see the `MCPBrowser` server listed. Ask it to load a
 
 ## How it works
 - Tool `load_and_extract` (inside the MCP server) drives your live Chrome (DevTools Protocol) so it inherits your auth cookies, returning `text` and `html` (truncated up to 2M chars per field) for analysis.
+- **Smart confirmation**: Copilot asks for confirmation ONLY on first request to a new domain - explains browser will open for authentication. Subsequent requests to same domain work automatically (session preserved).
 - **Domain-aware tab reuse**: Automatically reuses the same tab for URLs on the same domain, preserving authentication session. Different domains open new tabs.
 - **Automatic page loading**: Waits for network idle (`networkidle0`) by default, ensuring JavaScript-heavy pages (SPAs, dashboards) fully load before returning content.
 - **Automatic auth detection**: Detects ANY authentication redirect (domain changes, login/auth/sso/oauth URLs) and waits for you to complete sign-in, then returns to target page.

package/extension/.vscodeignore

@@ -0,0 +1,6 @@
+.vscode/**
+.vscode-test/**
+node_modules/**
+.gitignore
+.yarnrc
+*.vsix

package/extension/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2025 cherchyk
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

package/extension/README.md

@@ -0,0 +1,61 @@
+# MCPBrowser
+
+Alternative web fetcher for GitHub Copilot when normal URL access fails due to authentication or anti-crawler restrictions.
+
+## Features
+
+- 🚀 **One-Click Setup**: Installs npm package and configures mcp.json automatically
+- 🔐 **Bypass Authentication**: Opens pages in your Chrome/Edge browser - you authenticate if needed, MCPBrowser waits and fetches the final page content
+- 🤖 **Beat Anti-Crawler**: Works when sites block Copilot's normal fetching
+- ⚙️ **Auto-Configuration**: Complete setup with a single click
+
+## How It Works
+
+When Copilot needs to access an authenticated or protected page:
+1. MCPBrowser opens the URL in your Chrome/Edge browser
+2. If authentication is required, you log in normally in the browser
+3. MCPBrowser waits for the page to fully load (handles redirects automatically)
+4. Once loaded, it extracts the content and returns it to Copilot
+5. The browser tab stays open to reuse your session for future requests
+
+## Usage
+
+### Installation Steps
+
+1. Install this extension from VS Code marketplace
+2. You'll see a notification: **"MCPBrowser is available! Would you like to configure it for GitHub Copilot?"**
+3. Click **"Configure Now"**
+4. Wait for "Installing MCPBrowser npm package..." to complete
+5. When you see **"MCPBrowser configured successfully!"**, click **"Restart Now"**
+6. After restart, MCPBrowser is ready to use with Copilot!
+
+### Using with GitHub Copilot
+
+Once configured, Copilot will automatically use MCPBrowser when it encounters auth/crawler blocks. You can also explicitly request it:
+
+**Example prompts:**
+```
+Read https://internal.company.com/docs (I'm already logged in)
+
+Load the content from https://portal.azure.com/resources - use my authenticated session
+
+Fetch https://github.com/private-repo/issues using MCPBrowser
+```
+
+Copilot will use your Chrome/Edge browser session to access these pages, bypassing authentication and anti-crawler restrictions.
+
+### Manual Commands
+
+Command Palette (`Ctrl+Shift+P` or `Cmd+Shift+P`):
+- **Configure MCPBrowser for GitHub Copilot** - Set up or update configuration
+- **Remove MCPBrowser from GitHub Copilot** - Remove configuration
+
+## About MCPBrowser
+
+Alternative web fetcher for GitHub Copilot when normal URL access fails. Uses Chrome DevTools Protocol to access authenticated and crawler-protected pages through your browser session.
+
+Learn more: [MCPBrowser on GitHub](https://github.com/cherchyk/MCPBrowser)
+
+## License
+
+MIT

package/extension/icon.svg

@@ -0,0 +1,35 @@
+<svg width="128" height="128" viewBox="0 0 128 128" xmlns="http://www.w3.org/2000/svg">
+  <!-- Background circle -->
+  <circle cx="64" cy="64" r="60" fill="#0078D4"/>
+  
+  <!-- Browser window outline -->
+  <rect x="24" y="28" width="80" height="56" rx="4" fill="white"/>
+  <rect x="28" y="32" width="72" height="48" rx="2" fill="#E8F4FD"/>
+  
+  <!-- Browser chrome bar -->
+  <rect x="28" y="32" width="72" height="8" fill="#0078D4"/>
+  
+  <!-- Browser dots (window controls) -->
+  <circle cx="33" cy="36" r="1.5" fill="white"/>
+  <circle cx="38" cy="36" r="1.5" fill="white"/>
+  <circle cx="43" cy="36" r="1.5" fill="white"/>
+  
+  <!-- Lock/Shield icon (authentication symbol) -->
+  <g transform="translate(48, 48)">
+    <!-- Shield -->
+    <path d="M 16 4 L 16 14 C 16 18 12 22 8 24 C 4 22 0 18 0 14 L 0 4 L 8 0 Z" 
+          fill="#10B981" stroke="none"/>
+    <!-- Checkmark inside shield -->
+    <path d="M 5 12 L 7 14 L 12 8" 
+          stroke="white" 
+          stroke-width="2" 
+          stroke-linecap="round" 
+          stroke-linejoin="round" 
+          fill="none"/>
+  </g>
+  
+  <!-- Connection indicator (small dots) -->
+  <circle cx="90" cy="48" r="3" fill="#10B981"/>
+  <circle cx="98" cy="48" r="2" fill="#10B981" opacity="0.7"/>
+  <circle cx="104" cy="48" r="1.5" fill="#10B981" opacity="0.4"/>
+</svg>

package/extension/package-lock.json

@@ -0,0 +1,44 @@
+{
+  "name": "mcpbrowser",
+  "version": "0.1.2",
+  "lockfileVersion": 3,
+  "requires": true,
+  "packages": {
+    "": {
+      "name": "mcpbrowser",
+      "version": "0.1.2",
+      "license": "MIT",
+      "devDependencies": {
+        "@types/node": "^20.19.27",
+        "@types/vscode": "^1.107.0"
+      },
+      "engines": {
+        "vscode": "^1.107.0"
+      }
+    },
+    "node_modules/@types/node": {
+      "version": "20.19.27",
+      "resolved": "https://registry.npmjs.org/@types/node/-/node-20.19.27.tgz",
+      "integrity": "sha512-N2clP5pJhB2YnZJ3PIHFk5RkygRX5WO/5f0WC08tp0wd+sv0rsJk3MqWn3CbNmT2J505a5336jaQj4ph1AdMug==",
+      "dev": true,
+      "license": "MIT",
+      "dependencies": {
+        "undici-types": "~6.21.0"
+      }
+    },
+    "node_modules/@types/vscode": {
+      "version": "1.107.0",
+      "resolved": "https://registry.npmjs.org/@types/vscode/-/vscode-1.107.0.tgz",
+      "integrity": "sha512-XS8YE1jlyTIowP64+HoN30OlC1H9xqSlq1eoLZUgFEC8oUTO6euYZxti1xRiLSfZocs4qytTzR6xCBYtioQTCg==",
+      "dev": true,
+      "license": "MIT"
+    },
+    "node_modules/undici-types": {
+      "version": "6.21.0",
+      "resolved": "https://registry.npmjs.org/undici-types/-/undici-types-6.21.0.tgz",
+      "integrity": "sha512-iwDZqg0QAGrg9Rav5H4n0M64c3mkR59cJ6wQp+7C4nI0gsmExaedaYLNO44eT4AtBBwjbTiGPMlt2Md0T9H9JQ==",
+      "dev": true,
+      "license": "MIT"
+    }
+  }
+}

package/extension/package.json

@@ -0,0 +1,55 @@
+{
+  "name": "mcpbrowser",
+  "displayName": "MCPBrowser",
+  "description": "Alternative web fetcher for Copilot when auth/crawler blocks prevent normal access. Installs and configures MCPBrowser",
+  "version": "0.1.4",
+  "publisher": "cherchyk",
+  "icon": "icon.png",
+  "engines": {
+    "vscode": "^1.107.0"
+  },
+  "categories": [
+    "Other"
+  ],
+  "keywords": [
+    "mcp",
+    "model-context-protocol",
+    "github-copilot",
+    "browser",
+    "authentication"
+  ],
+  "activationEvents": [
+    "onStartupFinished"
+  ],
+  "main": "./src/extension.js",
+  "contributes": {
+    "commands": [
+      {
+        "command": "mcpbrowser.configure",
+        "title": "Configure MCPBrowser for GitHub Copilot"
+      },
+      {
+        "command": "mcpbrowser.remove",
+        "title": "Remove MCPBrowser from GitHub Copilot"
+      }
+    ]
+  },
+  "repository": {
+    "type": "git",
+    "url": "git+https://github.com/cherchyk/MCPBrowser.git"
+  },
+  "bugs": {
+    "url": "https://github.com/cherchyk/MCPBrowser/issues"
+  },
+  "homepage": "https://github.com/cherchyk/MCPBrowser#readme",
+  "license": "MIT",
+  "devDependencies": {
+    "@types/node": "^20.19.27",
+    "@types/vscode": "^1.107.0"
+  },
+  "scripts": {
+    "test": "echo \"Error: no test specified\" && exit 1"
+  },
+  "author": "",
+  "type": "commonjs"
+}

package/extension/src/extension.js

@@ -0,0 +1,257 @@
+const vscode = require('vscode');
+const fs = require('fs').promises;
+const path = require('path');
+const os = require('os');
+const { exec } = require('child_process');
+const util = require('util');
+const execPromise = util.promisify(exec);
+
+/**
+ * Get the path to VS Code's mcp.json configuration file
+ */
+function getMcpConfigPath() {
+    if (process.platform === 'win32') {
+        return path.join(process.env.APPDATA, 'Code', 'User', 'mcp.json');
+    }
+    // macOS and Linux
+    return path.join(os.homedir(), '.config', 'Code', 'User', 'mcp.json');
+}
+
+/**
+ * Check if MCPBrowser is already configured in mcp.json
+ */
+async function isMcpBrowserConfigured() {
+    try {
+        const mcpPath = getMcpConfigPath();
+        const content = await fs.readFile(mcpPath, 'utf-8');
+        const config = JSON.parse(content);
+        return config.servers && config.servers.MCPBrowser !== undefined;
+    } catch (error) {
+        // File doesn't exist or can't be read
+        return false;
+    }
+}
+
+/**
+ * Install MCPBrowser npm package globally
+ */
+async function installMcpBrowser() {
+    try {
+        vscode.window.showInformationMessage('Installing MCPBrowser npm package...');
+        
+        // Install globally so npx can find it reliably
+        await execPromise('npm install -g mcpbrowser@latest');
+        
+        vscode.window.showInformationMessage('MCPBrowser package installed successfully!');
+        return true;
+    } catch (error) {
+        console.error('Error installing MCPBrowser:', error);
+        vscode.window.showErrorMessage(`Failed to install MCPBrowser: ${error.message}`);
+        return false;
+    }
+}
+
+/**
+ * Add MCPBrowser configuration to mcp.json
+ */
+async function configureMcpBrowser() {
+    try {
+        const mcpPath = getMcpConfigPath();
+        let config;
+
+        try {
+            const content = await fs.readFile(mcpPath, 'utf-8');
+            config = JSON.parse(content);
+        } catch (error) {
+            // File doesn't exist, create new config
+            config = { servers: {} };
+            // Ensure directory exists
+            await fs.mkdir(path.dirname(mcpPath), { recursive: true });
+        }
+
+        // Ensure servers object exists
+        if (!config.servers) {
+            config.servers = {};
+        }
+
+        // Add MCPBrowser configuration
+        config.servers.MCPBrowser = {
+            type: "stdio",
+            command: "npx",
+            args: ["-y", "mcpbrowser@latest"],
+            description: "**USE AUTOMATICALLY** when normal URL fetch fails due to: 401/403 errors, login/auth requirements, SSO prompts, anti-crawler/bot detection. **FIRST ACCESS**: Ask confirmation ONLY for first request to a domain - explain browser will open for authentication. **SUBSEQUENT REQUESTS**: Use automatically (session preserved). Loads pages using authenticated Chrome session via DevTools Protocol (works for Microsoft, GitHub, AWS, Google, corporate sites, etc.). Waits for page load automatically (up to 60s, handles redirects)."
+        };
+
+        // Write back to file with pretty formatting
+        await fs.writeFile(mcpPath, JSON.stringify(config, null, 2), 'utf-8');
+        
+        return true;
+    } catch (error) {
+        console.error('Error configuring MCPBrowser:', error);
+        throw error;
+    }
+}
+
+/**
+ * Remove MCPBrowser configuration from mcp.json
+ */
+async function removeMcpBrowser() {
+    try {
+        const mcpPath = getMcpConfigPath();
+        const content = await fs.readFile(mcpPath, 'utf-8');
+        const config = JSON.parse(content);
+
+        if (config.servers && config.servers.MCPBrowser) {
+            delete config.servers.MCPBrowser;
+            await fs.writeFile(mcpPath, JSON.stringify(config, null, 2), 'utf-8');
+            return true;
+        }
+        
+        return false;
+    } catch (error) {
+        console.error('Error removing MCPBrowser:', error);
+        throw error;
+    }
+}
+
+/**
+ * Check if MCPBrowser npm package is installed
+ */
+async function checkMcpBrowserInstalled() {
+    try {
+        const { exec } = require('child_process');
+        return new Promise((resolve) => {
+            exec('npm list -g mcpbrowser', (error, stdout, stderr) => {
+                // If package is found globally or locally, it will be in stdout
+                resolve(stdout.includes('mcpbrowser'));
+            });
+        });
+    } catch (error) {
+        return false;
+    }
+}
+
+/**
+ * Show notification to configure MCPBrowser
+ */
+async function showConfigurationPrompt(context) {
+    const configured = await isMcpBrowserConfigured();
+    
+    if (!configured) {
+        const action = await vscode.window.showInformationMessage(
+            'MCPBrowser is available! Would you like to configure it for GitHub Copilot?',
+            'Configure Now',
+            'Not Now',
+            "Don't Ask Again"
+        );
+
+        if (action === 'Configure Now') {
+            vscode.commands.executeCommand('mcpbrowser.configure');
+        } else if (action === "Don't Ask Again") {
+            // Store in workspace state to not show again
+            context.globalState.update('mcpbrowser.dontAskAgain', true);
+        }
+    }
+}
+
+/**
+ * Extension activation
+ */
+async function activate(context) {
+    console.log('MCPBrowser extension is now active');
+
+    // Register configure command
+    let configureCommand = vscode.commands.registerCommand('mcpbrowser.configure', async () => {
+        try {
+            const configured = await isMcpBrowserConfigured();
+            
+            if (configured) {
+                const action = await vscode.window.showWarningMessage(
+                    'MCPBrowser is already configured. Do you want to update it?',
+                    'Update',
+                    'Cancel'
+                );
+                
+                if (action !== 'Update') {
+                    return;
+                }
+            }
+            
+            // Step 1: Install npm package
+            const installed = await installMcpBrowser();
+            if (!installed) {
+                return; // Installation failed, abort
+            }
+            
+            // Step 2: Configure mcp.json
+            await configureMcpBrowser();
+            
+            const restart = await vscode.window.showInformationMessage(
+                '✓ MCPBrowser configured successfully! Restart VS Code to use it with GitHub Copilot.',
+                'Restart Now',
+                'Later'
+            );
+
+            if (restart === 'Restart Now') {
+                vscode.commands.executeCommand('workbench.action.reloadWindow');
+            }
+        } catch (error) {
+            vscode.window.showErrorMessage(
+                `Failed to configure MCPBrowser: ${error.message}`
+            );
+        }
+    });
+
+    // Register remove command
+    let removeCommand = vscode.commands.registerCommand('mcpbrowser.remove', async () => {
+        try {
+            const confirm = await vscode.window.showWarningMessage(
+                'Are you sure you want to remove MCPBrowser configuration?',
+                'Remove',
+                'Cancel'
+            );
+
+            if (confirm !== 'Remove') {
+                return;
+            }
+
+            const removed = await removeMcpBrowser();
+            
+            if (removed) {
+                vscode.window.showInformationMessage(
+                    '✓ MCPBrowser configuration removed. Restart VS Code for changes to take effect.'
+                );
+            } else {
+                vscode.window.showInformationMessage(
+                    'MCPBrowser was not configured.'
+                );
+            }
+        } catch (error) {
+            vscode.window.showErrorMessage(
+                `Failed to remove MCPBrowser: ${error.message}`
+            );
+        }
+    });
+
+    context.subscriptions.push(configureCommand);
+    context.subscriptions.push(removeCommand);
+
+    // Show configuration prompt if not already configured and user hasn't dismissed
+    const dontAskAgain = context.globalState.get('mcpbrowser.dontAskAgain', false);
+    if (!dontAskAgain) {
+        // Wait a bit after startup to not be intrusive
+        setTimeout(() => {
+            showConfigurationPrompt(context);
+        }, 5000);
+    }
+}
+
+/**
+ * Extension deactivation
+ */
+function deactivate() {}
+
+module.exports = {
+    activate,
+    deactivate
+};

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "mcpbrowser",
-  "version": "0.2.1",
+  "version": "0.2.3",
   "mcpName": "io.github.cherchyk/browser",
   "type": "module",
   "description": "MCP server that loads authenticated web pages using Chrome DevTools Protocol",

package/server.json

@@ -1,17 +1,17 @@
 {
   "$schema": "https://static.modelcontextprotocol.io/schemas/2025-12-11/server.schema.json",
   "name": "io.github.cherchyk/browser",
-  "description": "MCP server for loading authenticated web pages using Chrome DevTools Protocol",
+  "description": "Alternative web fetcher for authenticated and crawler-protected pages. Bypasses login requirements and anti-bot restrictions using Chrome DevTools Protocol",
   "repository": {
     "url": "https://github.com/cherchyk/MCPBrowser",
     "source": "github"
   },
-  "version": "0.2.0",
+  "version": "0.2.3",
   "packages": [
     {
       "registryType": "npm",
       "identifier": "mcpbrowser",
-      "version": "0.2.0",
+      "version": "0.2.3",
       "transport": {
         "type": "stdio"
       }

package/src/mcp-browser.js

@@ -191,7 +191,7 @@ async function main() {
   const tools = [
     {
       name: "load_and_extract",
-      description: "Fetch and extract content from authenticated web pages using a local Chrome/Edge browser via DevTools Protocol. Automatically detects auth redirects by waiting for network idle. Supports smart tab reuse within the same domain to preserve authentication sessions. Returns both plain text and HTML content.",
+      description: "**FALLBACK MECHANISM**: Use this when normal URL fetching fails due to authentication requirements, login redirects, 401/403 errors, anti-crawler/bot detection, or session requirements. **FIRST ACCESS ONLY**: Ask user for confirmation ONLY if this is the first request to this domain/site - explain a browser window will open where they may need to authenticate. **SUBSEQUENT REQUESTS**: Use automatically without asking - browser session is already authenticated. Loads web pages using your authenticated Chrome/Edge browser session via DevTools Protocol, bypassing auth and crawler restrictions. Automatically handles auth redirects, waits for network idle, and supports tab reuse to preserve sessions. Returns both plain text and HTML content.",
       inputSchema: {
         type: "object",
         properties: {