@ayga/mcp-client 2.0.1 → 3.0.0

package/README.md

@@ -1,189 +1,229 @@
-# Ayga MCP Client (Node.js)
-
-Modern, lightweight MCP client for Redis API with **40 AI parsers** across **9 categories**.
-
-## 🚀 Quick Start
-
-### Install via npx (recommended)
-
-```bash
-npx @ayga/mcp-client
-```
-
-### VS Code Copilot Configuration
-
-Add to `%APPDATA%\Code\User\mcp.json`:
-
-```json
-{
-  "inputs": [
-    {
-      "id": "REDIS_API_KEY",
-      "type": "promptString",
-      "description": "ayga-mcp-client Redis API key",
-      "password": true
-    }
-  ],
-  "servers": {
-    "ayga": {
-      "type": "stdio",
-      "command": "npx",
-      "args": ["@ayga/mcp-client@latest"],
-      "env": {
-        "REDIS_API_KEY": "${input:REDIS_API_KEY}"
-      }
-    }
-  }
-}
-```
-
-### Claude Desktop Configuration
-
-Add to `%APPDATA%\Claude\claude_desktop_config.json`:
-
-```json
-{
-  "mcpServers": {
-    "ayga": {
-      "command": "npx",
-      "args": ["@ayga/mcp-client@latest"],
-      "env": {
-        "REDIS_API_KEY": "your-api-key-here"
-      }
-    }
-  }
-}
-```
-
-## 📦 Available Parsers (40 total)
-
-### AI Chat (8)
-- `search_perplexity` - Perplexity AI with sources
-- `search_chatgpt` - ChatGPT with web search
-- `search_claude` - Anthropic Claude
-- `search_gemini` - Google Gemini
-- `search_copilot` - Microsoft Copilot
-- `search_grok` - xAI Grok
-- `search_deepseek` - DeepSeek AI
-- `search_deepai` - DeepAI
-
-### Search Engines (8)
-- `search_google_search` - Google Search
-- `search_bing_search` - Bing Search
-- `search_duckduckgo` - DuckDuckGo
-- `search_yahoo_search` - Yahoo Search
-- `search_yandex_search` - Yandex Search
-- `search_baidu_search` - Baidu Search
-- `search_rambler_search` - Rambler Search
-- `search_you_search` - You.com
-
-### Instagram (4)
-- `search_instagram_profile` - User profiles
-- `search_instagram_post` - Individual posts
-- `search_instagram_tag` - Hashtag pages
-- `search_instagram_geo` - Location pages
-
-### TikTok (1)
-- `search_tiktok_profile` - User profiles and videos
-
-### YouTube (5)
-- `search_youtube_search` - Search videos
-- `search_youtube_video` - Video details
-- `search_youtube_comments` - Video comments
-- `search_youtube_channel_videos` - Channel videos
-- `search_youtube_channel_about` - Channel info
-
-### Google Trends (1)
-- `search_google_trends` - Trends data
-
-### Pinterest (1)
-- `search_pinterest_search` - Search pins
-
-### Reddit (2)
-- `search_reddit_posts` - Search posts
-- `search_reddit_comments` - Post comments
-
-### Translation (3)
-- `search_google_translate` - Google Translate
-- `search_bing_translate` - Bing Translator
-- `search_yandex_translate` - Yandex Translator
-
-### HTML Content (3)
-- `search_link_extractor` - Extract links
-- `search_article_extractor` - Extract articles (Mozilla Readability)
-- `search_text_extractor` - Extract text content
-
-## 💡 Usage Examples
-
-### In Claude Desktop/VS Code
-
-```
-@ayga list_parsers
-@ayga search_perplexity query="What is MCP protocol?"
-@ayga search_google_trends query="AI trends 2026"
-@ayga search_youtube_search query="Python tutorials" timeout=90
-@ayga search_google_translate query="Hello world"
-```
-
-### Command Line
-
-```bash
-# Set API key
-export REDIS_API_KEY="your-api-key"
-
-# Run server
-npx @ayga/mcp-client
-```
-
-## 🏗️ Architecture
-
-```
-┌─────────────────────────────────────┐
-│     VS Code / Claude Desktop        │
-└─────────────┬───────────────────────┘
-              │ MCP stdio
-┌─────────────▼───────────────────────┐
-│  @ayga/mcp-client (Node.js)         │
-│  - 40 parsers                       │
-│  - MCP protocol                     │
-│  - JWT authentication               │
-└─────────────┬───────────────────────┘
-              │ HTTPS REST API
-┌─────────────▼───────────────────────┐
-│  redis_wrapper (Python/FastAPI)     │
-│  https://redis.ayga.tech            │
-└─────────────┬───────────────────────┘
-              │ Redis Queue
-┌─────────────▼───────────────────────┐
-│         A-Parser (Windows)          │
-└─────────────────────────────────────┘
-```
-
-## 🔑 Getting API Key
-
-1. Visit https://redis.ayga.tech
-2. Sign up or log in
-3. Generate API key
-4. Use in configuration
-
-## 🆚 vs Python Version
-
-| Feature          | Node.js (2.0.0)        | Python (1.4.1)               |
-| ---------------- | ---------------------- | ---------------------------- |
-| **Installation** | `npx @ayga/mcp-client` | `uvx ayga-mcp-client==1.4.1` |
-| **Startup**      | ~50-100ms              | ~716ms                       |
-| **Dependencies** | MCP SDK only           | mcp, httpx, pydantic         |
-| **Size**         | ~500 lines             | ~1200 lines                  |
-| **Runtime**      | Node.js 18+            | Python 3.11+                 |
-| **Parsers**      | ✅ All 40               | ✅ All 40                     |
-
-## 📄 License
-
-MIT
-
-## 🔗 Links
-
-- **API Backend**: https://redis.ayga.tech
-- **Python Version**: https://pypi.org/project/ayga-mcp-client/
-- **GitHub**: https://github.com/ozand/ayga-mcp-nodejs
-- **Issues**: https://github.com/ozand/ayga-mcp-nodejs/issues
+# Ayga MCP Client (Node.js) v3.0.0
+
+Modern, lightweight MCP client with **6 consolidated AI tools** - optimized for LLM context windows.
+
+## What's New in v3.0.0
+
+**Context-Optimized Architecture**: Reduced from 40+ individual tools to 6 consolidated tools, saving ~80% context tokens while maintaining full functionality.
+
+| Tool | Engines | Default |
+|------|---------|---------|
+| `ask_ai` | perplexity, chatgpt, claude, gemini, copilot, grok, deepseek, deepai | perplexity |
+| `search_web` | google_search, bing_search, duckduckgo, yandex_search, yahoo_search, baidu_search, google_trends, rambler_search, you_search | google_search |
+| `get_social` | instagram_profile, instagram_post, instagram_tag, instagram_geo, tiktok_profile, pinterest_search, reddit_posts, reddit_comments | instagram_profile |
+| `get_video` | youtube_search, youtube_video, youtube_comments, youtube_channel_videos, youtube_channel_about | youtube_search |
+| `translate` | google_translate, bing_translate, yandex_translate | google_translate |
+| `extract` | text_extractor, article_extractor, link_extractor | text_extractor |
+
+## Quick Start
+
+### Install via npx (recommended)
+
+```bash
+npx @ayga/mcp-client
+```
+
+### VS Code Copilot Configuration
+
+Add to `%APPDATA%\Code\User\mcp.json`:
+
+```json
+{
+  "inputs": [
+    {
+      "id": "REDIS_API_KEY",
+      "type": "promptString",
+      "description": "ayga-mcp-client Redis API key",
+      "password": true
+    }
+  ],
+  "servers": {
+    "ayga": {
+      "type": "stdio",
+      "command": "npx",
+      "args": ["@ayga/mcp-client@latest"],
+      "env": {
+        "REDIS_API_KEY": "${input:REDIS_API_KEY}"
+      }
+    }
+  }
+}
+```
+
+### Claude Desktop Configuration
+
+Add to `%APPDATA%\Claude\claude_desktop_config.json`:
+
+```json
+{
+  "mcpServers": {
+    "ayga": {
+      "command": "npx",
+      "args": ["@ayga/mcp-client@latest"],
+      "env": {
+        "REDIS_API_KEY": "your-api-key-here"
+      }
+    }
+  }
+}
+```
+
+## Usage Examples
+
+### Basic Usage (uses default engine)
+
+```
+ask_ai query="What is quantum computing?"
+search_web query="latest AI news"
+get_video query="Python tutorials"
+translate query="Hello world"
+```
+
+### With Specific Engine
+
+```
+ask_ai query="Explain transformers" engine="claude"
+search_web query="weather today" engine="duckduckgo"
+get_social query="@openai" engine="instagram_profile"
+get_video query="dQw4w9WgXcQ" engine="youtube_video"
+```
+
+### With Timeout
+
+```
+ask_ai query="Complex analysis" engine="perplexity" timeout=120
+```
+
+## Environment Variables
+
+| Variable | Description | Default |
+|----------|-------------|---------|
+| `REDIS_API_KEY` | API key for authentication | (required) |
+| `API_URL` | Backend API URL | https://redis.ayga.tech |
+| `DEFAULT_AI_ENGINE` | Default for ask_ai | perplexity |
+| `DEFAULT_SEARCH_ENGINE` | Default for search_web | google_search |
+| `DEFAULT_SOCIAL_ENGINE` | Default for get_social | instagram_profile |
+| `DEFAULT_VIDEO_ENGINE` | Default for get_video | youtube_search |
+| `DEFAULT_TRANSLATION_ENGINE` | Default for translate | google_translate |
+| `DEFAULT_EXTRACTION_ENGINE` | Default for extract | text_extractor |
+| `DYNAMIC_PARSERS` | Enable dynamic parser loading | true |
+
+## Architecture
+
+```
++-------------------------------------+
+|     VS Code / Claude Desktop        |
++-----------------+-------------------+
+                  | MCP stdio
++-----------------v-------------------+
+|  @ayga/mcp-client (Node.js)         |
+|  - 6 consolidated tools             |
+|  - 36 parser engines                |
+|  - JWT authentication               |
++-----------------+-------------------+
+                  | HTTPS REST API
++-----------------v-------------------+
+|  redis_wrapper (Python/FastAPI)     |
+|  https://redis.ayga.tech            |
++-----------------+-------------------+
+                  | Redis Queue
++-----------------v-------------------+
+|         A-Parser (Windows)          |
++-------------------------------------+
+```
+
+## Tool Reference
+
+### ask_ai
+Query AI models for answers, analysis, and research.
+
+**Engines**: perplexity, chatgpt, claude, gemini, copilot, grok, deepseek, deepai
+
+```
+ask_ai query="What are the benefits of Rust?" engine="claude"
+```
+
+### search_web
+Search the web or get trends data.
+
+**Engines**: google_search, bing_search, duckduckgo, yandex_search, yahoo_search, baidu_search, google_trends, rambler_search, you_search
+
+```
+search_web query="best programming languages 2026"
+search_web query="AI" engine="google_trends"
+```
+
+### get_social
+Get data from social media platforms.
+
+**Engines**: instagram_profile, instagram_post, instagram_tag, instagram_geo, tiktok_profile, pinterest_search, reddit_posts, reddit_comments
+
+```
+get_social query="@openai" engine="instagram_profile"
+get_social query="machine learning" engine="reddit_posts"
+```
+
+### get_video
+Search and get YouTube content.
+
+**Engines**: youtube_search, youtube_video, youtube_comments, youtube_channel_videos, youtube_channel_about
+
+```
+get_video query="Python crash course"
+get_video query="https://youtube.com/watch?v=..." engine="youtube_comments"
+```
+
+### translate
+Translate text between languages.
+
+**Engines**: google_translate, bing_translate, yandex_translate
+
+```
+translate query="Hello, how are you?"
+translate query="Bonjour" engine="yandex_translate"
+```
+
+### extract
+Extract content from web pages.
+
+**Engines**: text_extractor, article_extractor, link_extractor
+
+```
+extract query="https://example.com/article" engine="article_extractor"
+extract query="https://example.com" engine="link_extractor"
+```
+
+## Migration from v2.x
+
+**v2.x (40+ tools)**:
+```
+search_perplexity query="What is MCP?"
+search_google_search query="latest news"
+search_youtube_video query="..."
+```
+
+**v3.x (6 consolidated tools)**:
+```
+ask_ai query="What is MCP?"                    # uses default: perplexity
+ask_ai query="What is MCP?" engine="perplexity"  # explicit
+search_web query="latest news"                 # uses default: google_search
+get_video query="..." engine="youtube_video"
+```
+
+## Getting API Key
+
+1. Visit https://redis.ayga.tech
+2. Sign up or log in
+3. Generate API key
+4. Use in configuration
+
+## License
+
+MIT
+
+## Links
+
+- **API Backend**: https://redis.ayga.tech
+- **Python Version**: https://pypi.org/project/ayga-mcp-client/
+- **GitHub**: https://github.com/ozand/ayga-mcp-nodejs
+- **Issues**: https://github.com/ozand/ayga-mcp-nodejs/issues

package/dist/index.js

@@ -2,23 +2,32 @@
 import { Server } from "@modelcontextprotocol/sdk/server/index.js";
 import { StdioServerTransport } from "@modelcontextprotocol/sdk/server/stdio.js";
 import { CallToolRequestSchema, ListToolsRequestSchema, } from "@modelcontextprotocol/sdk/types.js";
-import { PARSERS, getParserById } from "./parsers.js";
+import { getRegistry } from "./parser-registry.js";
+import { TOOL_CATEGORIES, getParsersForTool, getDefaultEngine, buildToolSchema } from "./tool-definitions.js";
 // Configuration
 const API_URL = process.env.API_URL || "https://redis.ayga.tech";
 const API_KEY = process.env.REDIS_API_KEY;
+// Dynamic parser loading (set DYNAMIC_PARSERS=false to disable)
+const ENABLE_DYNAMIC = process.env.DYNAMIC_PARSERS !== "false";
 class AygaMCPServer {
     server;
     jwtToken;
     tokenExpiry;
+    registry;
     constructor() {
         this.server = new Server({
             name: "ayga-mcp-client",
-            version: "2.0.0",
+            version: "3.0.0",
         }, {
             capabilities: {
                 tools: {},
             },
         });
+        this.registry = getRegistry({
+            apiUrl: API_URL,
+            apiKey: API_KEY,
+            enableDynamic: ENABLE_DYNAMIC,
+        });
         this.setupHandlers();
         this.setupErrorHandlers();
     }
@@ -60,7 +69,7 @@ class AygaMCPServer {
         }
     }
     async submitParserTask(parserId, query, timeout = 60) {
-        const parser = getParserById(parserId);
+        const parser = await this.registry.getParserById(parserId);
         if (!parser) {
             throw new Error(`Unknown parser: ${parserId}`);
         }
@@ -135,61 +144,59 @@ class AygaMCPServer {
         throw new Error(`Timeout waiting for result after ${timeout}s (${attempts} attempts)`);
     }
     setupHandlers() {
-        // List available tools
+        // List available tools - 6 consolidated tools instead of 40+
         this.server.setRequestHandler(ListToolsRequestSchema, async () => {
-            const tools = PARSERS.map((parser) => ({
-                name: `search_${parser.id}`,
-                description: `${parser.description} (Category: ${parser.category})`,
-                inputSchema: {
-                    type: "object",
-                    properties: {
-                        query: {
-                            type: "string",
-                            description: parser.category === "Translation"
-                                ? "Text to translate"
-                                : "Search query or URL",
-                        },
-                        timeout: {
-                            type: "number",
-                            description: "Timeout in seconds (default: 60)",
-                            default: 60,
-                        },
-                    },
-                    required: ["query"],
-                },
-            }));
-            // Add list_parsers tool
+            const parsers = await this.registry.getParsers();
+            const tools = [];
+            // Build consolidated tools from categories
+            for (const toolCat of TOOL_CATEGORIES) {
+                const engines = getParsersForTool(toolCat.id, parsers).map(p => p.id);
+                if (engines.length > 0) {
+                    tools.push(buildToolSchema(toolCat, engines));
+                }
+            }
+            // Add list_parsers utility tool
             tools.push({
                 name: "list_parsers",
                 description: "List all available parsers with their categories",
                 inputSchema: {
                     type: "object",
-                    properties: {},
+                    properties: {
+                        _placeholder: {
+                            type: "boolean",
+                            description: "Placeholder. Always pass true.",
+                        },
+                    },
+                    required: ["_placeholder"],
                 },
             });
+            this.log(`Registered ${tools.length} consolidated tools (${parsers.length} parsers available)`);
             return { tools };
         });
         // Call tool
         this.server.setRequestHandler(CallToolRequestSchema, async (request) => {
             const { name, arguments: args } = request.params;
             try {
-                // Handle list_parsers tool
+                // Handle list_parsers utility tool
                 if (name === "list_parsers") {
-                    const category = args?.category;
-                    let parsers = PARSERS;
-                    if (category) {
-                        parsers = PARSERS.filter((p) => p.category === category);
+                    const parsers = await this.registry.getParsers();
+                    const categories = await this.registry.getCategories();
+                    // Group parsers by consolidated tool
+                    const toolMapping = {};
+                    for (const toolCat of TOOL_CATEGORIES) {
+                        const engines = getParsersForTool(toolCat.id, parsers);
+                        if (engines.length > 0) {
+                            toolMapping[toolCat.id] = {
+                                tool: toolCat.name,
+                                parsers: engines.map(e => e.id),
+                            };
+                        }
                     }
-                    const categories = [...new Set(PARSERS.map((p) => p.category))];
                     const result = {
                         total: parsers.length,
+                        consolidatedTools: TOOL_CATEGORIES.length,
                         categories: categories,
-                        parsers: parsers.map((p) => ({
-                            id: p.id,
-                            name: p.name,
-                            category: p.category,
-                            description: p.description,
-                        })),
+                        toolMapping: toolMapping,
                     };
                     return {
                         content: [
@@ -200,16 +207,21 @@ class AygaMCPServer {
                         ],
                     };
                 }
-                // Handle parser tools
-                if (name.startsWith("search_")) {
-                    const parserId = name.replace("search_", "");
+                // Handle consolidated tools (ask_ai, search_web, get_social, etc.)
+                const toolCat = TOOL_CATEGORIES.find(t => t.id === name);
+                if (toolCat) {
                     const query = args?.query;
                     const timeout = args?.timeout || 60;
+                    // Get engine - use provided or default
+                    let engine = args?.engine;
+                    if (!engine) {
+                        engine = getDefaultEngine(name);
+                    }
                     if (!query) {
                         throw new Error("Query parameter is required");
                     }
-                    this.log(`Executing ${name} with query: ${query.substring(0, 50)}...`);
-                    const result = await this.submitParserTask(parserId, query, timeout);
+                    this.log(`Executing ${name} with engine=${engine}, query: ${query.substring(0, 50)}...`);
+                    const result = await this.submitParserTask(engine, query, timeout);
                     return {
                         content: [
                             {
@@ -219,7 +231,7 @@ class AygaMCPServer {
                         ],
                     };
                 }
-                throw new Error(`Unknown tool: ${name}`);
+                throw new Error(`Unknown tool: ${name}. Available: ${TOOL_CATEGORIES.map(t => t.id).join(", ")}, list_parsers`);
             }
             catch (error) {
                 this.log(`Tool execution error: ${error}`, "error");
@@ -257,9 +269,12 @@ class AygaMCPServer {
     async run() {
         const transport = new StdioServerTransport();
         await this.server.connect(transport);
-        this.log("Ayga MCP Server v2.0.0 started");
+        // Pre-fetch parsers
+        const parsers = await this.registry.getParsers();
+        this.log("Ayga MCP Server v3.0.0 started (consolidated tools)");
         this.log(`API URL: ${API_URL}`);
-        this.log(`Total parsers: ${PARSERS.length}`);
+        this.log(`Dynamic loading: ${ENABLE_DYNAMIC ? "enabled" : "disabled"}`);
+        this.log(`Total parsers: ${parsers.length}`);
         this.log("Server ready on stdio transport");
     }
 }