@hasna/connectors 0.0.1

package/connectors/connect-aws/GEMINI.md

@@ -0,0 +1,145 @@
+# GEMINI.md
+
+This file provides guidance to Gemini when working with this repository.
+
+## Project Overview
+
+connect-aws is a TypeScript connector for AWS services (S3, Lambda, DynamoDB) with multi-profile configuration support. It implements AWS Signature V4 signing natively without requiring the AWS SDK.
+
+## Build & Run Commands
+
+```bash
+# Install dependencies
+bun install
+
+# Run CLI in development
+bun run dev
+
+# Build for distribution
+bun run build
+
+# Type check
+bun run typecheck
+```
+
+## Code Style
+
+- TypeScript with strict mode
+- ESM modules (`type: module`)
+- Async/await for all async operations
+- Minimal dependencies: commander, chalk
+- Type annotations required everywhere
+
+## Project Structure
+
+```
+src/
+├── api/           # API client modules
+│   ├── client.ts  # HTTP client with authentication
+│   └── index.ts   # Main connector class
+├── cli/
+│   └── index.ts   # CLI commands
+├── types/
+│   └── index.ts   # TypeScript types
+├── utils/
+│   ├── config.ts  # Multi-profile configuration
+│   └── output.ts  # CLI output formatting
+└── index.ts       # Library exports
+```
+
+## Authentication
+
+API Key authentication. Credentials can be set via:
+- Environment variable (see below)
+- Profile configuration: `connect-aws config set-key <key>`
+
+
+## Key Patterns
+
+### Multi-Profile Configuration
+
+Profiles stored in `~/.connect/connect-aws/profiles/`:
+- Each profile is a separate JSON file
+- `current_profile` file tracks active profile
+- `--profile` flag overrides for single command
+- Environment variables override profile config
+
+### Authentication
+
+Uses AWS Signature V4 signing for all requests. Credentials can be set via:
+- Environment variables: `AWS_ACCESS_KEY_ID`, `AWS_SECRET_ACCESS_KEY`, `AWS_REGION`
+- Profile configuration: `connect-aws config set-credentials`
+
+### Service APIs
+
+Each AWS service has its own API module:
+- **S3Api**: List buckets, list/get/put/delete objects, copy objects
+- **LambdaApi**: List functions, get function info, invoke functions
+- **DynamoDBApi**: List/describe tables, get/put/delete/query/scan items
+
+## CLI Commands
+
+### S3
+```bash
+connect-aws s3 ls                      # List buckets
+connect-aws s3 ls <bucket> [prefix]    # List objects
+connect-aws s3 get <bucket> <key>      # Download object
+connect-aws s3 put <bucket> <key> <file> # Upload file
+connect-aws s3 rm <bucket> <key>       # Delete object
+connect-aws s3 cp <s3://src> <s3://dst> # Copy object
+connect-aws s3 head <bucket> <key>     # Get metadata
+```
+
+### Lambda
+```bash
+connect-aws lambda list                # List functions
+connect-aws lambda get <name>          # Get function info
+connect-aws lambda invoke <name>       # Invoke function
+connect-aws lambda invoke <name> -p '{"key":"value"}' # With payload
+connect-aws lambda invoke <name> --async # Async invocation
+```
+
+### DynamoDB
+```bash
+connect-aws dynamodb list              # List tables
+connect-aws dynamodb describe <table>  # Describe table
+connect-aws dynamodb get <table> <key> # Get item
+connect-aws dynamodb put <table> <item> # Put item
+connect-aws dynamodb delete <table> <key> # Delete item
+connect-aws dynamodb query <table> -k "pk = :pk" -v '...'
+connect-aws dynamodb scan <table>
+```
+
+### Profile & Config
+```bash
+connect-aws profile list               # List profiles
+connect-aws profile use <name>         # Switch profile
+connect-aws profile create <name>      # Create profile
+connect-aws config set-credentials --access-key-id <key> --secret-access-key <secret>
+connect-aws config set-region <region>
+connect-aws config show
+```
+
+## Environment Variables
+
+| Variable | Description |
+|----------|-------------|
+| `AWS_ACCESS_KEY_ID` | AWS Access Key ID (overrides profile) |
+| `AWS_SECRET_ACCESS_KEY` | AWS Secret Access Key (overrides profile) |
+| `AWS_REGION` | AWS Region (overrides profile, default: us-east-1) |
+| `AWS_SESSION_TOKEN` | Session token for temporary credentials |
+
+## Data Storage
+
+```
+~/.connect/connect-aws/
+├── current_profile   # Active profile name
+└── profiles/
+    ├── default.json  # Default profile
+    └── {name}.json   # Named profiles
+```
+
+## Dependencies
+
+- commander: CLI framework
+- chalk: Terminal styling

package/connectors/connect-aws/README.md

@@ -0,0 +1,131 @@
+# connect-aws
+
+AWS connector CLI - S3, Lambda, DynamoDB with multi-profile support
+
+## Installation
+
+```bash
+bun install -g @hasna/connect-aws
+```
+
+## Quick Start
+
+```bash
+# Set your API key
+connect-aws config set-key YOUR_API_KEY
+
+# Or use environment variable
+export AWS_ACCESS_KEY_ID=YOUR_API_KEY
+```
+
+## CLI Commands
+
+### S3
+```bash
+connect-aws s3 ls                      # List buckets
+connect-aws s3 ls <bucket> [prefix]    # List objects
+connect-aws s3 get <bucket> <key>      # Download object
+connect-aws s3 put <bucket> <key> <file> # Upload file
+connect-aws s3 rm <bucket> <key>       # Delete object
+connect-aws s3 cp <s3://src> <s3://dst> # Copy object
+connect-aws s3 head <bucket> <key>     # Get metadata
+```
+
+### Lambda
+```bash
+connect-aws lambda list                # List functions
+connect-aws lambda get <name>          # Get function info
+connect-aws lambda invoke <name>       # Invoke function
+connect-aws lambda invoke <name> -p '{"key":"value"}' # With payload
+connect-aws lambda invoke <name> --async # Async invocation
+```
+
+### DynamoDB
+```bash
+connect-aws dynamodb list              # List tables
+connect-aws dynamodb describe <table>  # Describe table
+connect-aws dynamodb get <table> <key> # Get item
+connect-aws dynamodb put <table> <item> # Put item
+connect-aws dynamodb delete <table> <key> # Delete item
+connect-aws dynamodb query <table> -k "pk = :pk" -v '...'
+connect-aws dynamodb scan <table>
+```
+
+### Profile & Config
+```bash
+connect-aws profile list               # List profiles
+connect-aws profile use <name>         # Switch profile
+connect-aws profile create <name>      # Create profile
+connect-aws config set-credentials --access-key-id <key> --secret-access-key <secret>
+connect-aws config set-region <region>
+connect-aws config show
+```
+
+## Profile Management
+
+```bash
+# Create profiles for different accounts
+connect-aws profile create work --api-key xxx --use
+connect-aws profile create personal --api-key yyy
+
+# Switch profiles
+connect-aws profile use work
+
+# Use profile for single command
+connect-aws -p personal <command>
+
+# List profiles
+connect-aws profile list
+```
+
+## Library Usage
+
+```typescript
+import { Aws } from '@hasna/connect-aws';
+
+const client = new Aws({ apiKey: 'YOUR_API_KEY' });
+
+// Use the client
+// See CLAUDE.md for detailed API documentation
+```
+
+## Environment Variables
+
+| Variable | Description |
+|----------|-------------|
+| `AWS_ACCESS_KEY_ID` | AWS Access Key ID (overrides profile) |
+| `AWS_SECRET_ACCESS_KEY` | AWS Secret Access Key (overrides profile) |
+| `AWS_REGION` | AWS Region (overrides profile, default: us-east-1) |
+| `AWS_SESSION_TOKEN` | Session token for temporary credentials |
+
+## Data Storage
+
+Configuration stored in `~/.connect/connect-aws/`:
+
+```
+~/.connect/connect-aws/
+├── current_profile   # Active profile name
+└── profiles/
+    ├── default.json  # Default profile
+    └── {name}.json   # Named profiles
+```
+
+## Development
+
+```bash
+# Install dependencies
+bun install
+
+# Run CLI in development
+bun run dev
+
+# Build
+bun run build
+
+# Type check
+bun run typecheck
+```
+
+## License
+
+MIT

package/connectors/connect-aws/package.json

@@ -0,0 +1,51 @@
+{
+  "name": "@hasna/connect-aws",
+  "version": "0.0.1",
+  "description": "AWS connector CLI - S3, Lambda, DynamoDB with multi-profile support",
+  "type": "module",
+  "bin": {
+    "connect-aws": "./bin/index.js"
+  },
+  "exports": {
+    ".": {
+      "import": "./dist/index.js",
+      "types": "./dist/index.d.ts"
+    }
+  },
+  "main": "./dist/index.js",
+  "types": "./dist/index.d.ts",
+  "scripts": {
+    "build": "bun build ./src/index.ts --outdir ./dist --target bun && bun build ./src/cli/index.ts --outdir ./bin --target bun",
+    "dev": "bun run ./src/cli/index.ts",
+    "typecheck": "tsc --noEmit",
+    "prepublishOnly": "bun run build"
+  },
+  "keywords": [
+    "aws",
+    "s3",
+    "lambda",
+    "dynamodb",
+    "connector",
+    "cli",
+    "typescript",
+    "bun",
+    "hasna"
+  ],
+  "author": "Hasna",
+  "license": "MIT",
+  "devDependencies": {
+    "@types/bun": "latest",
+    "typescript": "^5"
+  },
+  "dependencies": {
+    "commander": "^12.1.0",
+    "chalk": "^5.3.0"
+  },
+  "engines": {
+    "bun": ">=1.0.0"
+  },
+  "repository": {
+    "type": "git",
+    "url": "git+https://github.com/hasna/opensource-connectors.git"
+  }
+}

package/connectors/connect-aws/src/api/client.ts

@@ -0,0 +1,349 @@
+import type { AWSConfig } from '../types';
+import { AWSApiError } from '../types';
+
+// AWS Service endpoints
+const SERVICE_ENDPOINTS: Record<string, string> = {
+  s3: 's3.{region}.amazonaws.com',
+  lambda: 'lambda.{region}.amazonaws.com',
+  dynamodb: 'dynamodb.{region}.amazonaws.com',
+};
+
+export interface AWSRequestOptions {
+  method?: 'GET' | 'POST' | 'PUT' | 'DELETE' | 'HEAD';
+  params?: Record<string, string | number | boolean | undefined>;
+  body?: string | Uint8Array;
+  headers?: Record<string, string>;
+  service: string;
+  region?: string;
+}
+
+/**
+ * AWS API Client with Signature V4 signing
+ */
+export class AWSClient {
+  private readonly accessKeyId: string;
+  private readonly secretAccessKey: string;
+  private readonly region: string;
+  private readonly sessionToken?: string;
+
+  constructor(config: AWSConfig) {
+    if (!config.accessKeyId) {
+      throw new Error('AWS Access Key ID is required');
+    }
+    if (!config.secretAccessKey) {
+      throw new Error('AWS Secret Access Key is required');
+    }
+    this.accessKeyId = config.accessKeyId;
+    this.secretAccessKey = config.secretAccessKey;
+    this.region = config.region || 'us-east-1';
+    this.sessionToken = config.sessionToken;
+  }
+
+  /**
+   * Get the endpoint for a service
+   */
+  getEndpoint(service: string, region?: string): string {
+    const endpoint = SERVICE_ENDPOINTS[service];
+    if (!endpoint) {
+      throw new Error(`Unknown service: ${service}`);
+    }
+    return endpoint.replace('{region}', region || this.region);
+  }
+
+  /**
+   * Create HMAC-SHA256 signature
+   */
+  private async hmacSha256(key: Uint8Array, message: string): Promise<Uint8Array> {
+    const cryptoKey = await crypto.subtle.importKey(
+      'raw',
+      key.buffer as ArrayBuffer,
+      { name: 'HMAC', hash: 'SHA-256' },
+      false,
+      ['sign']
+    );
+    const signature = await crypto.subtle.sign('HMAC', cryptoKey, new TextEncoder().encode(message));
+    return new Uint8Array(signature);
+  }
+
+  /**
+   * Create SHA-256 hash
+   */
+  private async sha256(message: string | Uint8Array): Promise<string> {
+    const data = typeof message === 'string' ? new TextEncoder().encode(message) : message;
+    const hash = await crypto.subtle.digest('SHA-256', data.buffer as ArrayBuffer);
+    return this.toHex(new Uint8Array(hash));
+  }
+
+  /**
+   * Convert bytes to hex string
+   */
+  private toHex(bytes: Uint8Array): string {
+    return Array.from(bytes)
+      .map(b => b.toString(16).padStart(2, '0'))
+      .join('');
+  }
+
+  /**
+   * Get AWS Signature V4 signing key
+   */
+  private async getSigningKey(dateStamp: string, region: string, service: string): Promise<Uint8Array> {
+    const kDate = await this.hmacSha256(
+      new TextEncoder().encode(`AWS4${this.secretAccessKey}`),
+      dateStamp
+    );
+    const kRegion = await this.hmacSha256(kDate, region);
+    const kService = await this.hmacSha256(kRegion, service);
+    return this.hmacSha256(kService, 'aws4_request');
+  }
+
+  /**
+   * Sign a request using AWS Signature V4
+   */
+  async signRequest(
+    method: string,
+    url: URL,
+    headers: Record<string, string>,
+    body: string | Uint8Array | undefined,
+    service: string,
+    region: string
+  ): Promise<Record<string, string>> {
+    const now = new Date();
+    const amzDate = now.toISOString().replace(/[:-]|\.\d{3}/g, '');
+    const dateStamp = amzDate.substring(0, 8);
+
+    // Prepare payload hash
+    const payloadHash = body ? await this.sha256(body) : await this.sha256('');
+
+    // Prepare headers
+    const signedHeaders: Record<string, string> = {
+      ...headers,
+      host: url.host,
+      'x-amz-date': amzDate,
+      'x-amz-content-sha256': payloadHash,
+    };
+
+    if (this.sessionToken) {
+      signedHeaders['x-amz-security-token'] = this.sessionToken;
+    }
+
+    // Sort headers
+    const sortedHeaderKeys = Object.keys(signedHeaders).sort((a, b) =>
+      a.toLowerCase().localeCompare(b.toLowerCase())
+    );
+    const signedHeadersString = sortedHeaderKeys.map(k => k.toLowerCase()).join(';');
+
+    // Create canonical headers
+    const canonicalHeaders = sortedHeaderKeys
+      .map(k => `${k.toLowerCase()}:${signedHeaders[k].trim()}`)
+      .join('\n') + '\n';
+
+    // Create canonical URI (path must be URI encoded)
+    const canonicalUri = url.pathname || '/';
+
+    // Create canonical query string
+    const params = new URLSearchParams(url.search);
+    const sortedParams = Array.from(params.entries()).sort((a, b) => a[0].localeCompare(b[0]));
+    const canonicalQueryString = sortedParams
+      .map(([k, v]) => `${encodeURIComponent(k)}=${encodeURIComponent(v)}`)
+      .join('&');
+
+    // Create canonical request
+    const canonicalRequest = [
+      method,
+      canonicalUri,
+      canonicalQueryString,
+      canonicalHeaders,
+      signedHeadersString,
+      payloadHash,
+    ].join('\n');
+
+    // Create string to sign
+    const algorithm = 'AWS4-HMAC-SHA256';
+    const credentialScope = `${dateStamp}/${region}/${service}/aws4_request`;
+    const stringToSign = [
+      algorithm,
+      amzDate,
+      credentialScope,
+      await this.sha256(canonicalRequest),
+    ].join('\n');
+
+    // Get signing key and create signature
+    const signingKey = await this.getSigningKey(dateStamp, region, service);
+    const signatureBytes = await this.hmacSha256(signingKey, stringToSign);
+    const signature = this.toHex(signatureBytes);
+
+    // Create authorization header
+    const authorizationHeader = [
+      `${algorithm} Credential=${this.accessKeyId}/${credentialScope}`,
+      `SignedHeaders=${signedHeadersString}`,
+      `Signature=${signature}`,
+    ].join(', ');
+
+    return {
+      ...signedHeaders,
+      Authorization: authorizationHeader,
+    };
+  }
+
+  /**
+   * Make a signed request to an AWS service
+   */
+  async request<T>(
+    path: string,
+    options: AWSRequestOptions
+  ): Promise<T> {
+    const { method = 'GET', params, body, headers = {}, service, region = this.region } = options;
+
+    const endpoint = this.getEndpoint(service, region);
+    const url = new URL(`https://${endpoint}${path}`);
+
+    // Add query params
+    if (params) {
+      Object.entries(params).forEach(([key, value]) => {
+        if (value !== undefined && value !== null && value !== '') {
+          url.searchParams.append(key, String(value));
+        }
+      });
+    }
+
+    // Sign the request
+    const signedHeaders = await this.signRequest(
+      method,
+      url,
+      headers,
+      body,
+      service,
+      region
+    );
+
+    const fetchBody = body instanceof Uint8Array ? body.buffer as ArrayBuffer : body;
+    const response = await fetch(url.toString(), {
+      method,
+      headers: signedHeaders,
+      body: fetchBody,
+    });
+
+    // Handle response
+    const contentType = response.headers.get('content-type') || '';
+    let data: unknown;
+
+    if (response.status === 204) {
+      return {} as T;
+    }
+
+    if (contentType.includes('application/json') || contentType.includes('application/x-amz-json')) {
+      const text = await response.text();
+      if (text) {
+        try {
+          data = JSON.parse(text);
+        } catch {
+          data = text;
+        }
+      }
+    } else if (contentType.includes('application/xml') || contentType.includes('text/xml')) {
+      data = await response.text();
+    } else {
+      // Return raw response for binary data
+      data = await response.arrayBuffer();
+    }
+
+    if (!response.ok) {
+      const requestId = response.headers.get('x-amz-request-id') || undefined;
+      let errorMessage = `AWS Error: ${response.status} ${response.statusText}`;
+      let errorCode: string | undefined;
+
+      if (typeof data === 'string' && data.includes('<Error>')) {
+        // Parse XML error
+        const codeMatch = data.match(/<Code>([^<]+)<\/Code>/);
+        const messageMatch = data.match(/<Message>([^<]+)<\/Message>/);
+        if (codeMatch) errorCode = codeMatch[1];
+        if (messageMatch) errorMessage = messageMatch[1];
+      } else if (typeof data === 'object' && data !== null) {
+        const errData = data as Record<string, unknown>;
+        errorCode = (errData.__type as string)?.split('#').pop() || errData.code as string;
+        errorMessage = (errData.message || errData.Message || errorMessage) as string;
+      }
+
+      throw new AWSApiError(errorMessage, response.status, errorCode, requestId);
+    }
+
+    return data as T;
+  }
+
+  /**
+   * Make a request that returns raw bytes
+   */
+  async requestRaw(
+    path: string,
+    options: AWSRequestOptions
+  ): Promise<{ data: Uint8Array; headers: Headers; status: number }> {
+    const { method = 'GET', params, body, headers = {}, service, region = this.region } = options;
+
+    const endpoint = this.getEndpoint(service, region);
+    const url = new URL(`https://${endpoint}${path}`);
+
+    if (params) {
+      Object.entries(params).forEach(([key, value]) => {
+        if (value !== undefined && value !== null && value !== '') {
+          url.searchParams.append(key, String(value));
+        }
+      });
+    }
+
+    const signedHeaders = await this.signRequest(
+      method,
+      url,
+      headers,
+      body,
+      service,
+      region
+    );
+
+    const fetchBody = body instanceof Uint8Array ? body.buffer as ArrayBuffer : body;
+    const response = await fetch(url.toString(), {
+      method,
+      headers: signedHeaders,
+      body: fetchBody,
+    });
+
+    if (!response.ok) {
+      const requestId = response.headers.get('x-amz-request-id') || undefined;
+      const text = await response.text();
+      let errorMessage = `AWS Error: ${response.status} ${response.statusText}`;
+      let errorCode: string | undefined;
+
+      if (text.includes('<Error>')) {
+        const codeMatch = text.match(/<Code>([^<]+)<\/Code>/);
+        const messageMatch = text.match(/<Message>([^<]+)<\/Message>/);
+        if (codeMatch) errorCode = codeMatch[1];
+        if (messageMatch) errorMessage = messageMatch[1];
+      }
+
+      throw new AWSApiError(errorMessage, response.status, errorCode, requestId);
+    }
+
+    const arrayBuffer = await response.arrayBuffer();
+    return {
+      data: new Uint8Array(arrayBuffer),
+      headers: response.headers,
+      status: response.status,
+    };
+  }
+
+  /**
+   * Get current region
+   */
+  getRegion(): string {
+    return this.region;
+  }
+
+  /**
+   * Get a preview of the access key (for display/debugging)
+   */
+  getAccessKeyPreview(): string {
+    if (this.accessKeyId.length > 8) {
+      return `${this.accessKeyId.substring(0, 4)}...${this.accessKeyId.substring(this.accessKeyId.length - 4)}`;
+    }
+    return '***';
+  }
+}