@aj-archipelago/cortex 1.3.57 → 1.3.59

package/README.md

@@ -561,6 +561,12 @@ Each model configuration can include:
 }
 ```
 
+**Rate Limiting**: The `requestsPerSecond` parameter controls the rate limiting for each model endpoint. If not specified, Cortex defaults to **100 requests per second** per endpoint. This rate limiting is implemented using the Bottleneck library with a token bucket algorithm that includes:
+- Minimum time between requests (`minTime`)
+- Maximum concurrent requests (`maxConcurrent`)
+- Token reservoir that refreshes every second
+- Optional Redis clustering support when `storageConnectionString` is configured
+
 ### API Compatibility
 
 Cortex provides OpenAI-compatible REST endpoints that allow you to use various models through a standardized interface. When `enableRestEndpoints` is set to `true`, Cortex exposes the following endpoints:

package/config.js

@@ -435,6 +435,17 @@ var config = convict({
                 "maxReturnTokens": 4096,
                 "supportsStreaming": true
             },
+            "apptek-translate": {
+                "type": "APPTEK-TRANSLATE",
+                "url": "{{APPTEK_API_ENDPOINT}}",
+                "headers": {
+                    "x-token": "{{APPTEK_API_KEY}}",
+                    "Accept": "application/json",
+                    "Content-Type": "text/plain"
+                },
+                "requestsPerSecond": 10,
+                "maxTokenLength": 128000
+            },
         },
         env: 'CORTEX_MODELS'
     },
@@ -533,6 +544,17 @@ var config = convict({
         format: String,
         default: null,
         env: 'JINA_API_KEY'
+    },
+    apptekApiKey: {
+        format: String,
+        default: null,
+        env: 'APPTEK_API_KEY',
+        sensitive: true
+    },
+    apptekApiEndpoint: {
+        format: String,
+        default: null,
+        env: 'APPTEK_API_ENDPOINT'
     }
 });
 

package/helper-apps/cortex-file-handler/INTERFACE.md

@@ -1,18 +1,20 @@
 # Cortex File Handler Interface Documentation
 
 ## Overview
+
 The Cortex File Handler is a service that processes files through various operations including uploading, downloading, chunking, and document processing. It supports multiple storage backends (Azure Blob Storage, Google Cloud Storage, and Local File System).
 
 ## Request Methods
 
 ### POST
+
 - **Purpose**: Upload a file
 - **Content-Type**: `multipart/form-data`
 - **Parameters**:
   - `hash` (optional): Unique identifier for the file
   - `requestId` (required): Unique identifier for the request
   - File content must be included in the form data
-- **Behavior**: 
+- **Behavior**:
   - Uploads file to primary storage (Azure or Local)
   - If GCS is configured, also uploads to GCS
   - If hash is provided, stores file metadata in Redis
@@ -26,6 +28,7 @@ The Cortex File Handler is a service that processes files through various operat
 - **Note**: The `save` parameter is not supported in POST requests. To convert and save a document as text, use GET with the `save` parameter.
 
 ### GET
+
 - **Purpose**: Process or retrieve files
 - **Parameters** (can be in query string or request body):
   - `uri` (required if not using fetch/load/restore): URL of the file to process
@@ -48,13 +51,13 @@ The Cortex File Handler is a service that processes files through various operat
     - Truncates long filenames
 - **Behavior**:
   - For documents (PDF, DOC, etc.):
-    - If `save=true`: 
+    - If `save=true`:
       - Converts document to text
       - Saves text file to primary storage (Azure or Local)
       - Deletes original document from storage
       - Does not save to GCS
       - Returns object with primary storage URL
-    - If `save=false`: 
+    - If `save=false`:
       - Converts document to text
       - Returns array of text chunks
       - Does not persist any files
@@ -72,6 +75,7 @@ The Cortex File Handler is a service that processes files through various operat
     - Ensures correct file extension based on content type
 
 ### DELETE
+
 - **Purpose**: Remove files from storage
 - **Parameters** (can be in query string or request body):
   - `requestId` (required): Unique identifier for the request
@@ -82,12 +86,14 @@ The Cortex File Handler is a service that processes files through various operat
 - **Response**: Array of deleted file URLs
 
 ## Storage Configuration
+
 - **Azure**: Enabled if `AZURE_STORAGE_CONNECTION_STRING` is set
 - **GCS**: Enabled if `GCP_SERVICE_ACCOUNT_KEY_BASE64` or `GCP_SERVICE_ACCOUNT_KEY` is set
 - **Local**: Used as fallback if Azure is not configured
 
 ## Response Format
-- **Success**: 
+
+- **Success**:
   - Status: 200
   - Body: Varies by operation (see specific methods above)
 - **Error**:
@@ -95,6 +101,7 @@ The Cortex File Handler is a service that processes files through various operat
   - Body: Error message string
 
 ## Progress Tracking
+
 - Progress updates are published to Redis for each operation
 - Progress includes:
   - `progress`: Completion percentage (0-1)
@@ -105,8 +112,9 @@ The Cortex File Handler is a service that processes files through various operat
 - Progress updates are published to Redis channel associated with `requestId`
 
 ## File Types
+
 - **Documents**: Processed based on `DOC_EXTENSIONS` list
-  - Supported extensions: 
+  - Supported extensions:
     - Text: .txt, .json, .csv, .md, .xml, .js, .html, .css
     - Office: .doc, .docx, .xls, .xlsx
   - Document processing limitations:
@@ -135,6 +143,7 @@ The Cortex File Handler is a service that processes files through various operat
     - Truncates filenames longer than 200 characters
 
 ## Storage Behavior
+
 - **Primary Storage** (Azure or Local):
   - Files are stored with UUID-based names
   - Organized by requestId folders
@@ -151,6 +160,7 @@ The Cortex File Handler is a service that processes files through various operat
   - Used for progress tracking
 
 ## Cleanup
+
 - Automatic cleanup of inactive files
 - Removes files from:
   - Primary storage (Azure/Local)
@@ -163,16 +173,17 @@ The Cortex File Handler is a service that processes files through various operat
   - On error conditions
 
 ## Error Handling
-- **400 Bad Request**: 
+
+- **400 Bad Request**:
   - Missing required parameters
   - Invalid or inaccessible URL
   - Unsupported file type
-- **404 Not Found**: 
+- **404 Not Found**:
   - File or hash not found
   - File not found in storage
-- **500 Internal Server Error**: 
+- **500 Internal Server Error**:
   - Processing errors
   - Storage errors
   - Document conversion errors
   - PDF processing errors (scanned, encrypted, password-protected)
-- All errors include descriptive message in response body 
+- All errors include descriptive message in response body

package/helper-apps/cortex-file-handler/package-lock.json

@@ -1,12 +1,12 @@
 {
   "name": "@aj-archipelago/cortex-file-handler",
-  "version": "1.0.18",
+  "version": "2.6.1",
   "lockfileVersion": 3,
   "requires": true,
   "packages": {
     "": {
       "name": "@aj-archipelago/cortex-file-handler",
-      "version": "1.0.18",
+      "version": "2.6.1",
       "dependencies": {
         "@azure/storage-blob": "^12.13.0",
         "@distube/ytdl-core": "^4.14.3",

package/helper-apps/cortex-file-handler/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@aj-archipelago/cortex-file-handler",
-  "version": "2.0.02",
+  "version": "2.6.1",
   "description": "File handling service for Cortex - handles file uploads, media chunking, and document processing",
   "type": "module",
   "main": "src/index.js",

package/helper-apps/cortex-file-handler/scripts/setup-azure-container.js

@@ -1,25 +1,25 @@
-import { BlobServiceClient } from '@azure/storage-blob';
+import { BlobServiceClient } from "@azure/storage-blob";
 
 async function createContainer() {
-    try {
-        const blobServiceClient = BlobServiceClient.fromConnectionString(
-            'UseDevelopmentStorage=true',
-        );
-        const containerClient =
-      blobServiceClient.getContainerClient('test-container');
+  try {
+    const blobServiceClient = BlobServiceClient.fromConnectionString(
+      "UseDevelopmentStorage=true",
+    );
+    const containerClient =
+      blobServiceClient.getContainerClient("test-container");
 
-        console.log('Creating container...');
-        await containerClient.create();
-        console.log('Container created successfully');
-    } catch (error) {
+    console.log("Creating container...");
+    await containerClient.create();
+    console.log("Container created successfully");
+  } catch (error) {
     // Ignore if container already exists
-        if (error.statusCode === 409) {
-            console.log('Container already exists');
-        } else {
-            console.error('Error creating container:', error);
-            process.exit(1);
-        }
+    if (error.statusCode === 409) {
+      console.log("Container already exists");
+    } else {
+      console.error("Error creating container:", error);
+      process.exit(1);
     }
+  }
 }
 
 createContainer();

package/helper-apps/cortex-file-handler/scripts/setup-test-containers.js

@@ -1,52 +1,52 @@
-import { BlobServiceClient } from '@azure/storage-blob';
-import { Storage } from '@google-cloud/storage';
+import { BlobServiceClient } from "@azure/storage-blob";
+import { Storage } from "@google-cloud/storage";
 
 async function createAzureContainer() {
-    try {
-        const blobServiceClient = BlobServiceClient.fromConnectionString(
-            'UseDevelopmentStorage=true',
-        );
-        const containerClient =
-      blobServiceClient.getContainerClient('test-container');
+  try {
+    const blobServiceClient = BlobServiceClient.fromConnectionString(
+      "UseDevelopmentStorage=true",
+    );
+    const containerClient =
+      blobServiceClient.getContainerClient("test-container");
 
-        console.log('Creating Azure container...');
-        await containerClient.create();
-        console.log('Azure container created successfully');
-    } catch (error) {
+    console.log("Creating Azure container...");
+    await containerClient.create();
+    console.log("Azure container created successfully");
+  } catch (error) {
     // Ignore if container already exists
-        if (error.statusCode === 409) {
-            console.log('Azure container already exists');
-        } else {
-            console.error('Error creating Azure container:', error);
-            process.exit(1);
-        }
+    if (error.statusCode === 409) {
+      console.log("Azure container already exists");
+    } else {
+      console.error("Error creating Azure container:", error);
+      process.exit(1);
     }
+  }
 }
 
 async function createGCSBucket() {
-    try {
-        const storage = new Storage({
-            projectId: 'test-project',
-            apiEndpoint: 'http://localhost:4443',
-        });
+  try {
+    const storage = new Storage({
+      projectId: "test-project",
+      apiEndpoint: "http://localhost:4443",
+    });
 
-        console.log('Creating GCS bucket...');
-        await storage.createBucket('cortextempfiles');
-        console.log('GCS bucket created successfully');
-    } catch (error) {
+    console.log("Creating GCS bucket...");
+    await storage.createBucket("cortextempfiles");
+    console.log("GCS bucket created successfully");
+  } catch (error) {
     // Ignore if bucket already exists
-        if (error.code === 409) {
-            console.log('GCS bucket already exists');
-        } else {
-            console.error('Error creating GCS bucket:', error);
-            process.exit(1);
-        }
+    if (error.code === 409) {
+      console.log("GCS bucket already exists");
+    } else {
+      console.error("Error creating GCS bucket:", error);
+      process.exit(1);
     }
+  }
 }
 
 async function setup() {
-    await createAzureContainer();
-    await createGCSBucket();
+  await createAzureContainer();
+  await createGCSBucket();
 }
 
 setup();