@juspay/neurolink 9.1.0 → 9.2.0

package/CHANGELOG.md

@@ -1,3 +1,15 @@
+## [9.2.0](https://github.com/juspay/neurolink/compare/v9.1.1...v9.2.0) (2026-02-06)
+
+### Features
+
+- **(multimodal):** add file processor system with 17+ file types and SVG text injection ([9a7b585](https://github.com/juspay/neurolink/commit/9a7b5851e562f7bd55164d1c3dca42d8f18cc827))
+
+## [9.1.1](https://github.com/juspay/neurolink/compare/v9.1.0...v9.1.1) (2026-02-05)
+
+### Bug Fixes
+
+- **(csv-processor):** enhance metadata detection with data types and quality analysis ([2d27c5c](https://github.com/juspay/neurolink/commit/2d27c5cc4cd99b52da079fba741006216c0282ea))
+
 ## [9.1.0](https://github.com/juspay/neurolink/compare/v9.0.1...v9.1.0) (2026-02-05)
 
 ### Features

package/README.md

@@ -55,6 +55,7 @@ Extracted from production systems at Juspay and battle-tested at enterprise scal
 - **Structured Output with Zod Schemas** – Type-safe JSON generation with automatic validation using `schema` + `output.format: "json"` in `generate()`. → [Structured Output Guide](docs/features/structured-output.md)
 - **CSV File Support** – Attach CSV files to prompts for AI-powered data analysis with auto-detection. → [CSV Guide](docs/features/multimodal-chat.md#csv-file-support)
 - **PDF File Support** – Process PDF documents with native visual analysis for Vertex AI, Anthropic, Bedrock, AI Studio. → [PDF Guide](docs/features/pdf-support.md)
+- **50+ File Types** – Process Excel, Word, RTF, JSON, YAML, XML, HTML, SVG, Markdown, and 50+ code languages with intelligent content extraction. → [File Processors Guide](docs/features/file-processors.md)
 - **LiteLLM Integration** – Access 100+ AI models from all major providers through unified interface. → [Setup Guide](docs/litellm-integration.md)
 - **SageMaker Integration** – Deploy and use custom trained models on AWS infrastructure. → [Setup Guide](docs/sagemaker-integration.md)
 - **OpenRouter Integration** – Access 300+ models from OpenAI, Anthropic, Google, Meta, and more through a single unified API. → [Setup Guide](docs/getting-started/providers/openrouter.md)
@@ -242,6 +243,48 @@ const result = await neurolink.generate({
 
 ---
 
+### 📁 Multimodal & File Processing
+
+**17+ file categories supported** (50+ total file types including code languages) with intelligent content extraction and provider-agnostic processing:
+
+| Category      | Supported Types                                            | Processing                          |
+| ------------- | ---------------------------------------------------------- | ----------------------------------- |
+| **Documents** | Excel (`.xlsx`, `.xls`), Word (`.docx`), RTF, OpenDocument | Sheet extraction, text extraction   |
+| **Data**      | JSON, YAML, XML                                            | Validation, syntax highlighting     |
+| **Markup**    | HTML, SVG, Markdown, Text                                  | OWASP-compliant sanitization        |
+| **Code**      | 50+ languages (TypeScript, Python, Java, Go, etc.)         | Language detection, syntax metadata |
+| **Config**    | `.env`, `.ini`, `.toml`, `.cfg`                            | Secure parsing                      |
+| **Media**     | Images (PNG, JPEG, WebP, GIF), PDFs, CSV                   | Provider-specific formatting        |
+
+```typescript
+// Process any supported file type
+const result = await neurolink.generate({
+  input: {
+    text: "Analyze this data and code",
+    files: [
+      "./data.xlsx", // Excel spreadsheet
+      "./config.yaml", // YAML configuration
+      "./diagram.svg", // SVG (injected as sanitized text)
+      "./main.py", // Python source code
+    ],
+  },
+});
+
+// CLI: Use --file for any supported type
+// neurolink generate "Analyze this" --file ./report.xlsx --file ./config.json
+```
+
+**Key Features:**
+
+- **ProcessorRegistry** - Priority-based processor selection with fallback
+- **OWASP Security** - HTML/SVG sanitization prevents XSS attacks
+- **Auto-detection** - FileDetector identifies file types by extension and content
+- **Provider-agnostic** - All processors work across all 13 AI providers
+
+**[📖 File Processors Guide](docs/features/file-processors.md)** - Complete reference for all file types
+
+---
+
 ### 🏢 Enterprise & Production Features
 
 **Production-ready capabilities for regulated industries:**
@@ -373,13 +416,13 @@ Run AI-powered workflows directly in GitHub Actions with 13 provider support and
     post_comment: true
 ```
 
-| Feature                | Description                                     |
-| ---------------------- | ----------------------------------------------- |
-| **Multi-Provider**     | 13 providers with unified interface             |
-| **PR/Issue Comments**  | Auto-post AI responses with intelligent updates |
-| **Multimodal Support** | Attach images, PDFs, CSVs to prompts            |
-| **Cost Tracking**      | Built-in analytics and quality evaluation       |
-| **Extended Thinking**  | Deep reasoning with thinking tokens             |
+| Feature                | Description                                                                               |
+| ---------------------- | ----------------------------------------------------------------------------------------- |
+| **Multi-Provider**     | 13 providers with unified interface                                                       |
+| **PR/Issue Comments**  | Auto-post AI responses with intelligent updates                                           |
+| **Multimodal Support** | Attach images, PDFs, CSVs, Excel, Word, JSON, YAML, XML, HTML, SVG, code files to prompts |
+| **Cost Tracking**      | Built-in analytics and quality evaluation                                                 |
+| **Extended Thinking**  | Deep reasoning with thinking tokens                                                       |
 
 **[📖 GitHub Action Guide](docs/guides/github-action.md)** - Complete setup and examples
 
@@ -506,6 +549,10 @@ const result = await neurolink.generate({
       "./sales_data.csv", // Auto-detected as CSV
       "examples/data/invoice.pdf", // Auto-detected as PDF
       "./diagrams/architecture.png", // Auto-detected as image
+      "./report.xlsx", // Auto-detected as Excel
+      "./config.json", // Auto-detected as JSON
+      "./diagram.svg", // Auto-detected as SVG (injected as text)
+      "./app.ts", // Auto-detected as TypeScript code
     ],
   },
   provider: "vertex", // PDF-capable provider (see docs/features/pdf-support.md)

package/dist/agent/directTools.d.ts

@@ -219,12 +219,12 @@ export declare const directAgentTools: {
         content: z.ZodString;
         mode: z.ZodDefault<z.ZodEnum<["create", "overwrite", "append"]>>;
     }, "strip", z.ZodTypeAny, {
-        content: string;
         path: string;
+        content: string;
         mode: "create" | "overwrite" | "append";
     }, {
-        content: string;
         path: string;
+        content: string;
         mode?: "create" | "overwrite" | "append" | undefined;
     }>, {
         success: boolean;
@@ -249,8 +249,8 @@ export declare const directAgentTools: {
         written?: undefined;
     }> & {
         execute: (args: {
-            content: string;
             path: string;
+            content: string;
             mode: "create" | "overwrite" | "append";
         }, options: import("ai").ToolExecutionOptions) => PromiseLike<{
             success: boolean;

package/dist/cli/commands/config.d.ts

@@ -54,17 +54,17 @@ declare const ConfigSchema: z.ZodObject<{
             location: string;
             projectId?: string | undefined;
             credentials?: string | undefined;
+            privateKey?: string | undefined;
             serviceAccountKey?: string | undefined;
             clientEmail?: string | undefined;
-            privateKey?: string | undefined;
         }, {
             model?: string | undefined;
             projectId?: string | undefined;
             credentials?: string | undefined;
+            privateKey?: string | undefined;
             location?: string | undefined;
             serviceAccountKey?: string | undefined;
             clientEmail?: string | undefined;
-            privateKey?: string | undefined;
         }>>;
         anthropic: z.ZodOptional<z.ZodObject<{
             apiKey: z.ZodOptional<z.ZodString>;
@@ -153,9 +153,9 @@ declare const ConfigSchema: z.ZodObject<{
             location: string;
             projectId?: string | undefined;
             credentials?: string | undefined;
+            privateKey?: string | undefined;
             serviceAccountKey?: string | undefined;
             clientEmail?: string | undefined;
-            privateKey?: string | undefined;
         } | undefined;
         anthropic?: {
             model: string;
@@ -201,10 +201,10 @@ declare const ConfigSchema: z.ZodObject<{
             model?: string | undefined;
             projectId?: string | undefined;
             credentials?: string | undefined;
+            privateKey?: string | undefined;
             location?: string | undefined;
             serviceAccountKey?: string | undefined;
             clientEmail?: string | undefined;
-            privateKey?: string | undefined;
         } | undefined;
         anthropic?: {
             model?: string | undefined;
@@ -473,9 +473,9 @@ declare const ConfigSchema: z.ZodObject<{
             location: string;
             projectId?: string | undefined;
             credentials?: string | undefined;
+            privateKey?: string | undefined;
             serviceAccountKey?: string | undefined;
             clientEmail?: string | undefined;
-            privateKey?: string | undefined;
         } | undefined;
         anthropic?: {
             model: string;
@@ -570,10 +570,10 @@ declare const ConfigSchema: z.ZodObject<{
             model?: string | undefined;
             projectId?: string | undefined;
             credentials?: string | undefined;
+            privateKey?: string | undefined;
             location?: string | undefined;
             serviceAccountKey?: string | undefined;
             clientEmail?: string | undefined;
-            privateKey?: string | undefined;
         } | undefined;
         anthropic?: {
             model?: string | undefined;

package/dist/image-gen/ImageGenService.d.ts

@@ -0,0 +1,143 @@
+/**
+ * Image Generation Service
+ *
+ * Handles AI image generation using NeuroLink SDK with configurable providers
+ * and models. Supports reference images and PDFs for contextual generation.
+ *
+ * @packageDocumentation
+ * @module @juspay/neurolink/image-gen
+ * @category ImageGeneration
+ *
+ * @example
+ * ```typescript
+ * import { ImageGenService } from '@juspay/neurolink';
+ *
+ * const service = new ImageGenService();
+ *
+ * const result = await service.generate({
+ *   prompt: 'A serene mountain landscape at sunset',
+ *   style: 'photorealistic',
+ *   aspectRatio: '16:9'
+ * });
+ *
+ * if (result.success && result.imageBuffer) {
+ *   fs.writeFileSync('output.png', result.imageBuffer);
+ * }
+ * ```
+ */
+import type { ImageGenConfig, ImageGenOptions, ImageGenResult } from "./types.js";
+/**
+ * Image generation service for AI-powered image creation
+ *
+ * Uses NeuroLink SDK to generate images with support for:
+ * - Multiple providers (Vertex AI, OpenAI, etc.)
+ * - Reference images for style guidance
+ * - PDF documents for contextual generation
+ * - Configurable aspect ratios and styles
+ *
+ * @example Basic usage
+ * ```typescript
+ * const service = new ImageGenService();
+ * const result = await service.generate({
+ *   prompt: 'A cute robot playing chess'
+ * });
+ * ```
+ *
+ * @example With custom configuration
+ * ```typescript
+ * const service = new ImageGenService({
+ *   defaultProvider: 'openai',
+ *   defaultModel: 'dall-e-3',
+ *   timeout: 60000
+ * });
+ * ```
+ */
+export declare class ImageGenService {
+    private config;
+    private neurolinkInstance;
+    private instanceId;
+    /**
+     * Create a new ImageGenService instance
+     *
+     * @param config - Optional configuration overrides
+     */
+    constructor(config?: Partial<ImageGenConfig>);
+    /**
+     * Get or create the NeuroLink instance
+     * Uses dynamic import to avoid circular dependencies
+     *
+     * @returns NeuroLink instance for image generation
+     */
+    private getNeuroLink;
+    /**
+     * Generate an image from a text prompt
+     *
+     * @param options - Generation options including prompt, style, etc.
+     * @returns Promise resolving to generation result
+     *
+     * @example Simple generation
+     * ```typescript
+     * const result = await service.generate({
+     *   prompt: 'A futuristic cityscape'
+     * });
+     * ```
+     *
+     * @example With reference images
+     * ```typescript
+     * const referenceImage = fs.readFileSync('style-reference.jpg');
+     * const result = await service.generate({
+     *   prompt: 'A portrait in this style',
+     *   images: [referenceImage],
+     *   aspectRatio: '1:1'
+     * });
+     * ```
+     */
+    generate(options: ImageGenOptions): Promise<ImageGenResult>;
+    /**
+     * Extract image data from various result formats
+     *
+     * Handles multiple output formats:
+     * - result.imageOutput?.base64
+     * - result.images?.[0]
+     * - data:image URI in content
+     * - Buffer directly
+     *
+     * @param result - Raw result from NeuroLink generate
+     * @returns Extracted image data or null
+     */
+    private extractImageFromResult;
+    /**
+     * Check if image generation is enabled
+     */
+    isEnabled(): boolean;
+    /**
+     * Get the default model
+     */
+    getModel(): string;
+    /**
+     * Get the default provider
+     */
+    getProvider(): string;
+    /**
+     * Get the service configuration
+     */
+    getConfig(): Readonly<ImageGenConfig>;
+    /**
+     * Get the service instance ID (for debugging)
+     */
+    getInstanceId(): string;
+    /**
+     * Update service configuration
+     *
+     * @param config - Partial configuration to merge
+     */
+    updateConfig(config: Partial<ImageGenConfig>): void;
+    /**
+     * Enable image generation
+     */
+    enable(): void;
+    /**
+     * Disable image generation
+     */
+    disable(): void;
+}

package/dist/image-gen/ImageGenService.js

@@ -0,0 +1,345 @@
+/**
+ * Image Generation Service
+ *
+ * Handles AI image generation using NeuroLink SDK with configurable providers
+ * and models. Supports reference images and PDFs for contextual generation.
+ *
+ * @packageDocumentation
+ * @module @juspay/neurolink/image-gen
+ * @category ImageGeneration
+ *
+ * @example
+ * ```typescript
+ * import { ImageGenService } from '@juspay/neurolink';
+ *
+ * const service = new ImageGenService();
+ *
+ * const result = await service.generate({
+ *   prompt: 'A serene mountain landscape at sunset',
+ *   style: 'photorealistic',
+ *   aspectRatio: '16:9'
+ * });
+ *
+ * if (result.success && result.imageBuffer) {
+ *   fs.writeFileSync('output.png', result.imageBuffer);
+ * }
+ * ```
+ */
+import { withTimeout } from "../utils/errorHandling.js";
+import { DEFAULT_IMAGE_GEN_CONFIG } from "./types.js";
+/**
+ * Image generation service for AI-powered image creation
+ *
+ * Uses NeuroLink SDK to generate images with support for:
+ * - Multiple providers (Vertex AI, OpenAI, etc.)
+ * - Reference images for style guidance
+ * - PDF documents for contextual generation
+ * - Configurable aspect ratios and styles
+ *
+ * @example Basic usage
+ * ```typescript
+ * const service = new ImageGenService();
+ * const result = await service.generate({
+ *   prompt: 'A cute robot playing chess'
+ * });
+ * ```
+ *
+ * @example With custom configuration
+ * ```typescript
+ * const service = new ImageGenService({
+ *   defaultProvider: 'openai',
+ *   defaultModel: 'dall-e-3',
+ *   timeout: 60000
+ * });
+ * ```
+ */
+export class ImageGenService {
+    config;
+    neurolinkInstance = null;
+    instanceId;
+    /**
+     * Create a new ImageGenService instance
+     *
+     * @param config - Optional configuration overrides
+     */
+    constructor(config) {
+        this.config = {
+            ...DEFAULT_IMAGE_GEN_CONFIG,
+            ...config,
+        };
+        this.instanceId = `ImageGenService-${Date.now()}-${Math.random().toString(36).substring(2, 11)}`;
+    }
+    /**
+     * Get or create the NeuroLink instance
+     * Uses dynamic import to avoid circular dependencies
+     *
+     * @returns NeuroLink instance for image generation
+     */
+    async getNeuroLink() {
+        if (!this.neurolinkInstance) {
+            // Dynamically import to avoid circular dependencies
+            const { NeuroLink } = await import("../neurolink.js");
+            this.neurolinkInstance = new NeuroLink({
+                conversationMemory: { enabled: false },
+                enableOrchestration: false,
+            });
+        }
+        return this.neurolinkInstance;
+    }
+    /**
+     * Generate an image from a text prompt
+     *
+     * @param options - Generation options including prompt, style, etc.
+     * @returns Promise resolving to generation result
+     *
+     * @example Simple generation
+     * ```typescript
+     * const result = await service.generate({
+     *   prompt: 'A futuristic cityscape'
+     * });
+     * ```
+     *
+     * @example With reference images
+     * ```typescript
+     * const referenceImage = fs.readFileSync('style-reference.jpg');
+     * const result = await service.generate({
+     *   prompt: 'A portrait in this style',
+     *   images: [referenceImage],
+     *   aspectRatio: '1:1'
+     * });
+     * ```
+     */
+    async generate(options) {
+        const startTime = Date.now();
+        // Check if service is enabled
+        if (!this.config.enabled) {
+            return {
+                success: false,
+                error: "Image generation is disabled",
+            };
+        }
+        // Validate prompt
+        if (!options.prompt || options.prompt.trim().length === 0) {
+            return {
+                success: false,
+                error: "Prompt is required for image generation",
+            };
+        }
+        try {
+            const neurolink = await this.getNeuroLink();
+            // Build enhanced prompt with style and negative prompt
+            let enhancedPrompt = options.prompt;
+            if (options.style) {
+                enhancedPrompt = `${options.style} style: ${enhancedPrompt}`;
+            }
+            if (options.negativePrompt) {
+                enhancedPrompt = `${enhancedPrompt}. Avoid: ${options.negativePrompt}`;
+            }
+            // Build input with optional reference images/PDFs
+            const input = { text: enhancedPrompt };
+            // Process reference images
+            if (options.images?.length) {
+                const maxImages = this.config.maxReferenceImages ?? 5;
+                const imagesToUse = options.images.slice(0, maxImages);
+                // Convert Buffers to base64 strings if needed
+                input.images = imagesToUse.map((img) => Buffer.isBuffer(img) ? img.toString("base64") : img);
+            }
+            // Process reference PDFs
+            if (options.pdfFiles?.length) {
+                const maxPdfs = this.config.maxReferencePdfs ?? 1;
+                input.pdfFiles = options.pdfFiles.slice(0, maxPdfs);
+            }
+            // Determine provider and model
+            const provider = options.provider ?? this.config.defaultProvider;
+            const model = options.model ?? this.config.defaultModel;
+            const region = options.region ?? this.config.defaultRegion;
+            // Build generation parameters
+            const generateParams = {
+                input,
+                provider,
+                model,
+                disableTools: true,
+                temperature: options.temperature ?? this.config.defaultTemperature ?? 0.75,
+                timeout: this.config.timeout,
+            };
+            // Add region if specified (for Vertex AI)
+            if (region) {
+                generateParams.region = region;
+            }
+            // Add number of images
+            const maxImages = this.config.maxImages ?? 4;
+            const numberOfImages = Math.min(options.numberOfImages ?? 1, maxImages);
+            generateParams.numberOfImages = numberOfImages;
+            // Add aspect ratio if specified
+            if (options.aspectRatio) {
+                generateParams.aspectRatio = options.aspectRatio;
+            }
+            // Call NeuroLink generate with timeout protection
+            const result = await withTimeout(neurolink.generate(generateParams), this.config.timeout, new Error(`Image generation timed out after ${this.config.timeout}ms`));
+            // Extract image from result
+            const imageOutput = this.extractImageFromResult(result);
+            const generationTimeMs = Date.now() - startTime;
+            if (imageOutput) {
+                return {
+                    success: true,
+                    imageBuffer: imageOutput.imageBuffer,
+                    base64: imageOutput.base64,
+                    mimeType: imageOutput.mimeType,
+                    model,
+                    provider,
+                    generationTimeMs,
+                };
+            }
+            return {
+                success: false,
+                error: "No image generated",
+                model,
+                provider,
+                generationTimeMs,
+            };
+        }
+        catch (error) {
+            const errorMessage = error instanceof Error ? error.message : String(error);
+            return {
+                success: false,
+                error: `Generation failed: ${errorMessage}`,
+                generationTimeMs: Date.now() - startTime,
+            };
+        }
+    }
+    /**
+     * Extract image data from various result formats
+     *
+     * Handles multiple output formats:
+     * - result.imageOutput?.base64
+     * - result.images?.[0]
+     * - data:image URI in content
+     * - Buffer directly
+     *
+     * @param result - Raw result from NeuroLink generate
+     * @returns Extracted image data or null
+     */
+    extractImageFromResult(result) {
+        if (!result || typeof result !== "object") {
+            return null;
+        }
+        const res = result;
+        // Check for imageOutput with base64
+        const imageOutput = res.imageOutput ?? res.images?.[0];
+        if (imageOutput && typeof imageOutput === "object") {
+            const img = imageOutput;
+            if (typeof img.base64 === "string") {
+                const base64 = img.base64;
+                const mimeType = img.mimeType ?? "image/png";
+                return {
+                    imageBuffer: Buffer.from(base64, "base64"),
+                    base64,
+                    mimeType,
+                };
+            }
+        }
+        // Check if imageOutput is a Buffer
+        if (Buffer.isBuffer(imageOutput)) {
+            const base64 = imageOutput.toString("base64");
+            return {
+                imageBuffer: imageOutput,
+                base64,
+                mimeType: "image/png",
+            };
+        }
+        // Check for data URI format in content
+        const content = res.content;
+        if (typeof content === "string" && content.startsWith("data:image")) {
+            const match = content.match(/^data:image\/(\w+);base64,(.+)$/);
+            if (match?.[2]) {
+                const mimeType = `image/${match[1]}`;
+                const base64 = match[2];
+                return {
+                    imageBuffer: Buffer.from(base64, "base64"),
+                    base64,
+                    mimeType,
+                };
+            }
+        }
+        // Check for raw base64 in content
+        if (typeof content === "string" && !content.startsWith("data:")) {
+            // Try to detect if it's base64 encoded image data
+            try {
+                const buffer = Buffer.from(content, "base64");
+                // Check for PNG magic bytes
+                if (buffer[0] === 0x89 && buffer[1] === 0x50) {
+                    return {
+                        imageBuffer: buffer,
+                        base64: content,
+                        mimeType: "image/png",
+                    };
+                }
+                // Check for JPEG magic bytes
+                if (buffer[0] === 0xff && buffer[1] === 0xd8) {
+                    return {
+                        imageBuffer: buffer,
+                        base64: content,
+                        mimeType: "image/jpeg",
+                    };
+                }
+            }
+            catch {
+                // Not valid base64, ignore
+            }
+        }
+        return null;
+    }
+    /**
+     * Check if image generation is enabled
+     */
+    isEnabled() {
+        return this.config.enabled;
+    }
+    /**
+     * Get the default model
+     */
+    getModel() {
+        return this.config.defaultModel;
+    }
+    /**
+     * Get the default provider
+     */
+    getProvider() {
+        return this.config.defaultProvider;
+    }
+    /**
+     * Get the service configuration
+     */
+    getConfig() {
+        return { ...this.config };
+    }
+    /**
+     * Get the service instance ID (for debugging)
+     */
+    getInstanceId() {
+        return this.instanceId;
+    }
+    /**
+     * Update service configuration
+     *
+     * @param config - Partial configuration to merge
+     */
+    updateConfig(config) {
+        this.config = {
+            ...this.config,
+            ...config,
+        };
+    }
+    /**
+     * Enable image generation
+     */
+    enable() {
+        this.config.enabled = true;
+    }
+    /**
+     * Disable image generation
+     */
+    disable() {
+        this.config.enabled = false;
+    }
+}