bedrock-wrapper 2.4.5 → 2.6.0

package/CHANGELOG.md

@@ -1,6 +1,23 @@
 # Changelog
 All notable changes to this project will be documented in this file.
 
+## [2.6.0] - 2025-09-30 (Claude Sonnet 4.5)
+### Added
+- Support for Claude Sonnet 4.5 models
+  - Claude-4-5-Sonnet
+  - Claude-4-5-Sonnet-Thinking
+
+## [2.5.0] - 2025-08-12 (Converse API)
+### Added
+- Support for Converse API (streaming and non-streaming)
+
+### Technical Details
+- **Model Configuration**: All models use standard messages API format
+- **API Compatibility**: Supports OpenAI-style requests
+- **Response Processing**: Automatic reasoning tag handling based on model variant
+- **Streaming Fallback**: Automatic detection and fallback to non-streaming for unsupported models
+- **Testing Coverage**: Full integration with existing test suites and interactive example
+
 ## [2.4.5] - 2025-08-06 (GPT-OSS Models)
 ### Added
 - Support for OpenAI GPT-OSS models on AWS Bedrock

package/README.md

@@ -39,7 +39,7 @@ Bedrock Wrapper is an npm package that simplifies the integration of existing Op
     ```javascript
     const openaiChatCompletionsCreateObject = {
         "messages": messages,
-        "model": "Llama-3-1-8b",
+        "model": "Claude-4.5-Sonnet",
         "max_tokens": LLM_MAX_GEN_TOKENS,
         "stream": true,
         "temperature": LLM_TEMPERATURE,
@@ -48,7 +48,7 @@ Bedrock Wrapper is an npm package that simplifies the integration of existing Op
     };
     ```
 
-    the `messages` variable should be in openai's role/content format  
+    the `messages` variable should be in openai's role/content format (not all models support system prompts)
     ```javascript
     messages = [
         {
@@ -98,6 +98,24 @@ Bedrock Wrapper is an npm package that simplifies the integration of existing Op
         console.log(`\n\completeResponse:\n${completeResponse}\n`); // ⇠ do stuff with the complete response
     }
 
+5. **NEW: Using the Converse API (optional)**
+    
+    You can now optionally use AWS Bedrock's Converse API instead of the Invoke API by passing `useConverseAPI: true` in the options parameter:
+    ```javascript
+    // Use the Converse API for unified request/response format across all models
+    for await (const chunk of bedrockWrapper(awsCreds, openaiChatCompletionsCreateObject, { useConverseAPI: true })) {
+        completeResponse += chunk;
+        process.stdout.write(chunk);
+    }
+    ```
+    
+    The Converse API provides:
+    - **Consistent API**: Single request/response format across all models
+    - **Simplified conversation management**: Better handling of multi-turn conversations
+    - **System prompts**: Cleaner separation of system instructions
+    - **Tool use support**: Native support for function calling (where supported)
+    - **Unified multimodal**: Consistent handling of text and image inputs
+
 ---
 
 ### Supported Models
@@ -108,6 +126,8 @@ Bedrock Wrapper is an npm package that simplifies the integration of existing Op
 | Claude-4-1-Opus-Thinking   | us.anthropic.claude-opus-4-1-20250805-v1:0   |  ✅  |
 | Claude-4-Opus              | us.anthropic.claude-opus-4-20250514-v1:0     |  ✅  |
 | Claude-4-Opus-Thinking     | us.anthropic.claude-opus-4-20250514-v1:0     |  ✅  |
+| Claude-4.5-Sonnet          | us.anthropic.claude-sonnet-4-5-20250929-v1:0 |  ✅  |
+| Claude-4.5-Sonnet-Thinking | us.anthropic.claude-sonnet-4-5-20250929-v1:0 |  ✅  |
 | Claude-4-Sonnet            | us.anthropic.claude-sonnet-4-20250514-v1:0   |  ✅  |
 | Claude-4-Sonnet-Thinking   | us.anthropic.claude-sonnet-4-20250514-v1:0   |  ✅  |
 | Claude-3-7-Sonnet-Thinking | us.anthropic.claude-3-7-sonnet-20250219-v1:0 |  ✅  |
@@ -150,7 +170,7 @@ Please modify the `bedrock_models.js` file and submit a PR 🏆 or create an Iss
 
 ### Image Support
 
-For models with image support (Claude 4 series, Claude 3.7 Sonnet, Claude 3.5 Sonnet, Claude 3 Haiku, Nova Pro, and Nova Lite), you can include images in your messages using the following format:
+For models with image support (Claude 4+ series including Claude 4.5 Sonnet, Claude 3.7 Sonnet, Claude 3.5 Sonnet, Claude 3 Haiku, Nova Pro, and Nova Lite), you can include images in your messages using the following format (not all models support system prompts):
 
 ```javascript
 messages = [
@@ -239,6 +259,79 @@ const result = await bedrockWrapper(awsCreds, {
 
 ---
 
+### Parameter Restrictions
+
+Some AWS Bedrock models have specific parameter restrictions that are automatically handled by the wrapper:
+
+#### Claude 4+ Models (Temperature/Top-P Mutual Exclusion)
+
+**Affected Models:**
+- Claude-4.5-Sonnet & Claude-4.5-Sonnet-Thinking
+- Claude-4-Sonnet & Claude-4-Sonnet-Thinking  
+- Claude-4-Opus & Claude-4-Opus-Thinking
+- Claude-4-1-Opus & Claude-4-1-Opus-Thinking
+
+**Restriction:** These models cannot accept both `temperature` and `top_p` parameters simultaneously.
+
+**Automatic Handling:** When both parameters are provided, the wrapper automatically:
+1. **Keeps `temperature`** (prioritized as more commonly used)
+2. **Removes `top_p`** to prevent validation errors
+3. **Works with both APIs** (Invoke API and Converse API)
+
+```javascript
+const request = {
+    messages: [{ role: "user", content: "Hello" }],
+    model: "Claude-4.5-Sonnet",
+    temperature: 0.7,  // ✅ Kept
+    top_p: 0.9         // ❌ Automatically removed
+};
+
+// No error thrown - wrapper handles the restriction automatically
+const response = await bedrockWrapper(awsCreds, request);
+```
+
+**Why This Happens:** AWS Bedrock enforces this restriction on newer Claude models to ensure optimal performance and prevent conflicting sampling parameters.
+
+---
+
+### 🧪 Testing
+
+The package includes comprehensive test suites to verify functionality:
+
+```bash
+# Test all models with the Both APIs (Comparison)
+npm run test
+
+# Test all models with the Invoke API
+npm run test:invoke
+
+# Test all models with the Converse API
+npm run test:converse
+
+# Test vision/multimodal capabilities with Both APIs (Comparison)
+npm run test-vision
+
+# Test vision/multimodal capabilities with Invoke API
+npm run test-vision:invoke
+
+# Test vision/multimodal capabilities with Converse API
+npm run test-vision:converse
+
+# Test stop sequences functionality with Both APIs (Comparison)
+npm run test-stop
+
+# Test stop sequences functionality with Invoke API
+npm run test-stop:invoke
+
+# Test stop sequences functionality with Converse API
+npm run test-stop:converse
+
+# Interactive testing
+npm run interactive
+```
+
+---
+
 ### 📢 P.S.
 
 In case you missed it at the beginning of this doc, for an even easier setup, use the 🔀 [Bedrock Proxy Endpoint](https://github.com/jparkerweb/bedrock-proxy-endpoint) project to spin up your own custom OpenAI server endpoint (using the standard `baseUrl`, and `apiKey` params).

package/bedrock-models.js

@@ -126,6 +126,72 @@ export const bedrock_models = [
             "max_images_per_request": 10
         }
     },
+    {
+        // =======================
+        // == Claude 4.5 Sonnet ==
+        // =======================
+        "modelName":                     "Claude-4.5-Sonnet",
+        // "modelId":                       "anthropic.claude-sonnet-4-5-20250929-v1:0",
+        "modelId":                       "us.anthropic.claude-sonnet-4-5-20250929-v1:0",
+        "vision":                        true,
+        "messages_api":                  true,
+        "system_as_separate_field":      true,
+        "display_role_names":            true,
+        "max_tokens_param_name":         "max_tokens",
+        "max_supported_response_tokens": 131072,
+        "stop_sequences_param_name":     "stop_sequences",
+        "response_chunk_element":        "delta.text",
+        "response_nonchunk_element":     "content[0].text",
+        "thinking_response_chunk_element": "delta.thinking",
+        "thinking_response_nonchunk_element": "content[0].thinking",
+        "parameter_restrictions": {
+            "mutually_exclusive": [["temperature", "top_p"]]
+        },
+        "special_request_schema": {
+            "anthropic_version": "bedrock-2023-05-31",
+            "anthropic_beta": ["output-128k-2025-02-19"],
+        },
+        "image_support": {
+            "max_image_size": 20971520, // 20MB
+            "supported_formats": ["jpeg", "png", "gif", "webp"],
+            "max_images_per_request": 10
+        }
+    },
+    {
+        // ================================
+        // == Claude 4.5 Sonnet Thinking ==
+        // ================================
+        "modelName":                     "Claude-4.5-Sonnet-Thinking",
+        // "modelId":                       "anthropic.claude-sonnet-4-5-20250929-v1:0",
+        "modelId":                       "us.anthropic.claude-sonnet-4-5-20250929-v1:0",
+        "vision":                        true,
+        "messages_api":                  true,
+        "system_as_separate_field":      true,
+        "display_role_names":            true,
+        "max_tokens_param_name":         "max_tokens",
+        "max_supported_response_tokens": 131072,
+        "stop_sequences_param_name":     "stop_sequences",
+        "response_chunk_element":        "delta.text",
+        "response_nonchunk_element":     "content[0].text",
+        "thinking_response_chunk_element": "delta.thinking",
+        "thinking_response_nonchunk_element": "content[0].thinking",
+        "parameter_restrictions": {
+            "mutually_exclusive": [["temperature", "top_p"]]
+        },
+        "special_request_schema": {
+            "anthropic_version": "bedrock-2023-05-31",
+            "anthropic_beta": ["output-128k-2025-02-19"],
+            "thinking": {
+                "type": "enabled",
+                "budget_tokens": 16000
+            },
+        },
+        "image_support": {
+            "max_image_size": 20971520, // 20MB
+            "supported_formats": ["jpeg", "png", "gif", "webp"],
+            "max_images_per_request": 10
+        }
+    },
     {
         // =====================
         // == Claude 4 Sonnet ==
@@ -144,6 +210,9 @@ export const bedrock_models = [
         "response_nonchunk_element":     "content[0].text",
         "thinking_response_chunk_element": "delta.thinking",
         "thinking_response_nonchunk_element": "content[0].thinking",
+        "parameter_restrictions": {
+            "mutually_exclusive": [["temperature", "top_p"]]
+        },
         "special_request_schema": {
             "anthropic_version": "bedrock-2023-05-31",
             "anthropic_beta": ["output-128k-2025-02-19"],
@@ -172,6 +241,9 @@ export const bedrock_models = [
         "response_nonchunk_element":     "content[0].text",
         "thinking_response_chunk_element": "delta.thinking",
         "thinking_response_nonchunk_element": "content[0].thinking",
+        "parameter_restrictions": {
+            "mutually_exclusive": [["temperature", "top_p"]]
+        },
         "special_request_schema": {
             "anthropic_version": "bedrock-2023-05-31",
             "anthropic_beta": ["output-128k-2025-02-19"],