@aws/ml-container-creator 0.2.4 → 0.2.6

package/README.md

@@ -1,342 +1,106 @@
-# sharp-transformer-deployment
+# ML Container Creator
 
-SageMaker-compatible ML container for deploying transformers models using vllm.
+A CLI tool that creates SageMaker-compatible Docker containers for deploying ML models using the Bring Your Own Container (BYOC) paradigm.
 
-Generated on 2026-05-08T09-52-06 using [ML Container Creator](https://github.com/yourusername/ml-container-creator).
+> **Note:** This is a pre-release (`0.x`). APIs may change between minor versions. Weekly releases are planned until v1.
 
-## Quick Start
-
-### 1. Build the Container
-
-```bash
-./do/build
-```
-
-Builds a Docker image tagged as `sharp-transformer-deployment:latest`.
-
-### 2. Test Locally
-
-```bash
-# Start the container
-./do/run
-
-# In another terminal, test the endpoints
-./do/test
-```
-
-### 3. Push to ECR
-
-```bash
-./do/push
-```
-
-Pushes the image to Amazon ECR in the `us-west-2` region.
-
-### 4. Deploy to SageMaker
-
-```bash
-./do/deploy <your-sagemaker-execution-role-arn>
-```
-
-Creates a SageMaker endpoint named `sharp-transformer-deployment-endpoint`.
-
-### 5. Test the Endpoint
-
-```bash
-./do/test sharp-transformer-deployment-endpoint
-```
-
-## Project Structure
-
-```
-sharp-transformer-deployment/
-├── do/                      # do-framework lifecycle scripts
-│   ├── build                # Build Docker image
-│   ├── push                 # Push to Amazon ECR
-│   ├── deploy               # Deploy to SageMaker
-│   ├── run                  # Run container locally
-│   ├── test                 # Test container or endpoint
-│   ├── clean                # Clean up resources
-│   ├── submit               # Submit build to CodeBuild
-│   ├── config               # Configuration variables
-│   └── README.md            # Detailed do-framework documentation
-├── code/                    # Model serving code
-│   └── serve               # vllm entrypoint script
-├── deploy/                 # Legacy scripts (deprecated)
-│   ├── build_and_push.sh   # Use ./do/build && ./do/push instead
-│   └── deploy.sh           # Use ./do/deploy instead
-
-├── test/                  # Test suite
-│   ├── test_endpoint.sh    # Test SageMaker endpoint
-│   └── test_local_image.sh # Test local container
-
-├── Dockerfile              # Container definition
-├── requirements.txt        # Python dependencies
-└── README.md               # This file
-```
-
-## Configuration
-
-All deployment configuration is centralized in `do/config`:
-
-```bash
-# Project identification
-PROJECT_NAME="sharp-transformer-deployment"
-DEPLOYMENT_CONFIG="transformers-vllm"
-
-# AWS configuration
-AWS_REGION="us-west-2"
-INSTANCE_TYPE="ml.g5.xlarge"
-
-# Framework configuration
-FRAMEWORK="transformers"
-MODEL_SERVER="vllm"
-
-# Model configuration
-MODEL_NAME="openai/gpt-oss-20b"
-
-```
-
-You can override these values by setting environment variables before running do scripts.
-
-## Deployment Workflows
-
-### Local Development Workflow
-
-```bash
-# Build and test locally
-./do/build
-./do/run &
-./do/test
-
-# When satisfied, push to ECR
-./do/push
-```
-
-### CodeBuild Workflow
-
-```bash
-# Submit build to CodeBuild (builds and pushes to ECR)
-./do/submit
-
-# Deploy to SageMaker
-./do/deploy <role-arn>
-
-# Test the endpoint
-./do/test sharp-transformer-deployment-endpoint
-```
+## Supported Configurations
 
-### Cleanup
+| Architecture | Model Servers | Use Case |
+|---|---|---|
+| HTTP (traditional ML) | Flask, FastAPI | sklearn, XGBoost, TensorFlow |
+| Transformers (LLMs) | vLLM, SGLang, TensorRT-LLM, DJL/LMI | HuggingFace models, JumpStart, S3 |
+| Triton | FIL, ONNX, Python, TensorRT-LLM, vLLM | Multi-framework serving |
+| Diffusors | vLLM | Image generation models |
 
-```bash
-# Remove local images
-./do/clean local
-
-# Remove ECR images
-./do/clean ecr
-
-# Delete SageMaker endpoint
-./do/clean endpoint
-
-# Clean everything
-./do/clean all
-```
-
-## do-framework Commands
-
-This project uses the [do-framework](https://github.com/iankoulski/do-framework) for standardized container lifecycle management.
-
-### Available Commands
-
-| Command | Description |
-|---------|-------------|
-| `./do/build` | Build Docker image locally |
-| `./do/push` | Push image to Amazon ECR |
-| `./do/deploy <role-arn>` | Deploy to SageMaker endpoint |
-| `./do/run` | Run container locally on port 8080 |
-| `./do/test [endpoint]` | Test local container or SageMaker endpoint |
-| `./do/clean <target>` | Clean up resources (local/ecr/endpoint/all) |
-| `./do/submit` | Submit build to AWS CodeBuild |
-
-For detailed documentation on each command, see `do/README.md`.
-
-## Framework-Specific Information
-
-### Transformers (vllm)
-
-This container serves transformer models using vllm.
-
-**Model**: openai/gpt-oss-20b
-
-**Server**: vLLM - High-throughput LLM serving with PagedAttention
-
-**Features**:
-- Continuous batching
-- Optimized CUDA kernels
-- OpenAI-compatible API
-
-
-**Inference**: Send requests to `/invocations` endpoint with:
-```json
-{
-  "inputs": "Your prompt here",
-  "parameters": {
-    "max_new_tokens": 100,
-    "temperature": 0.7
-  }
-}
-```
-
-
-
-## SageMaker Endpoints
-
-### Health Check
-
-SageMaker calls the `/ping` endpoint to verify container health:
-
-```bash
-curl http://localhost:8080/ping
-```
+| Deployment Target | Description |
+|---|---|
+| Real-Time Inference | SageMaker real-time endpoints |
+| Async Inference | SageMaker async endpoints with S3 output |
+| Batch Transform | SageMaker batch processing |
+| HyperPod EKS | Kubernetes-based deployment |
 
-Expected response: `200 OK`
-
-### Inference
-
-Send prediction requests to the `/invocations` endpoint:
-
-```bash
-curl -X POST http://localhost:8080/invocations \
-  -H "Content-Type: application/json" \
-  -d '{
-    "inputs": "What is machine learning?",
-    "parameters": {
-      "max_new_tokens": 100,
-      "temperature": 0.7
-    }
-  }'
-```
-
-
-## AWS Requirements
-
-### IAM Permissions
-
-The SageMaker execution role needs these permissions:
-
-- `ecr:GetAuthorizationToken`
-- `ecr:BatchCheckLayerAvailability`
-- `ecr:GetDownloadUrlForLayer`
-- `ecr:BatchGetImage`
-- `s3:GetObject` (if using S3 for model artifacts)
-- `logs:CreateLogGroup`
-- `logs:CreateLogStream`
-- `logs:PutLogEvents`
-
-See `IAM_PERMISSIONS.md` for detailed permission requirements.
-
-### AWS CLI Configuration
+## Quick Start
 
-Ensure AWS CLI is configured with appropriate credentials:
+### Install from npm
 
 ```bash
-aws configure
+npm install -g @aws/ml-container-creator
 ```
 
-Or use environment variables:
+### Or use without installing (npx)
 
 ```bash
-export AWS_ACCESS_KEY_ID=your-access-key
-export AWS_SECRET_ACCESS_KEY=your-secret-key
-export AWS_DEFAULT_REGION=us-west-2
+npx @aws/ml-container-creator --help
 ```
 
-## Troubleshooting
+### Or install from source
 
-### Build Issues
-
-**Docker Not Found**
-
-Install Docker: https://docs.docker.com/get-docker/
-
-**Permission Denied**
-
-Add your user to the docker group:
 ```bash
-sudo usermod -aG docker $USER
+git clone https://github.com/awslabs/ml-container-creator.git
+cd ml-container-creator
+npm install && npm link
 ```
 
-### Deployment Issues
+### Bootstrap AWS infrastructure (one-time)
 
-**ECR Push Failed**
-
-Check AWS credentials and IAM permissions:
 ```bash
-aws sts get-caller-identity
+ml-container-creator bootstrap
 ```
 
-**Endpoint Creation Failed**
-
-- Verify the execution role ARN is correct
-- Check IAM permissions
-- Ensure the instance type is available in your region
+Sets up an IAM execution role, ECR repository, optional S3 buckets, and optional CI Integration Harness for automated testing. Configuration is saved to `~/.ml-container-creator/config.json`.
 
-**Endpoint Stuck in Creating**
+### Generate a project
 
-Check CloudWatch logs:
 ```bash
-aws logs tail /aws/sagemaker/Endpoints/sharp-transformer-deployment-endpoint --follow
-```
+# Interactive
+ml-container-creator
 
-### Runtime Issues
-
-**Container Exits Immediately**
-
-Check container logs:
-```bash
-docker logs $(docker ps -a | grep sharp-transformer-deployment | awk '{print $1}')
+# Non-interactive
+ml-container-creator my-model \
+  --deployment-config=transformers-vllm \
+  --model-name=openai/gpt-oss-20b \
+  --instance-type=ml.g6.12xlarge \
+  --region=us-east-1 \
+  --skip-prompts
 ```
 
-**Out of Memory**
+### Build, push, deploy
 
-Increase instance size or optimize model:
 ```bash
-# Edit do/config
-INSTANCE_TYPE="ml.m5.2xlarge"  # Larger instance
+./do/build        # Build Docker image
+./do/push         # Push to Amazon ECR
+./do/deploy       # Deploy to SageMaker
+./do/test         # Test the endpoint
 ```
 
-## Migration from Legacy Scripts
-
-If you're familiar with the old `deploy/` scripts, see `MIGRATION.md` for a command mapping guide.
-
-**Quick Reference**:
-
-| Legacy Command | do-framework Command |
-|----------------|---------------------|
-| `./deploy/build_and_push.sh` | `./do/build && ./do/push` |
-| `./deploy/deploy.sh <role>` | `./do/deploy <role>` |
-| `./deploy/submit_build.sh` | `./do/submit` |
+## Documentation
 
-The legacy scripts are still available but deprecated. They will display warnings and forward to do-framework commands.
+Full documentation is available at [awslabs.github.io/ml-container-creator](https://awslabs.github.io/ml-container-creator/).
 
-## Additional Resources
+- [Getting Started](https://awslabs.github.io/ml-container-creator/getting-started/) — Installation and walkthroughs
+- [Configuration](https://awslabs.github.io/ml-container-creator/configuration/) — CLI flags, env vars, config files, MCP servers
+- [Deployment Guide](https://awslabs.github.io/ml-container-creator/deployments/) — All deployment targets and lifecycle scripts
+- [CI Integration](https://awslabs.github.io/ml-container-creator/ci-integration/) — Automated lifecycle testing for all deployment configurations
+- [Examples](https://awslabs.github.io/ml-container-creator/EXAMPLES/) — Framework-specific walkthroughs
+- [Troubleshooting](https://awslabs.github.io/ml-container-creator/TROUBLESHOOTING/) — Common issues and solutions
 
-- [do-framework Documentation](https://github.com/iankoulski/do-framework)
-- [AWS SageMaker Documentation](https://docs.aws.amazon.com/sagemaker/)
-- [SageMaker BYOC Guide](https://docs.aws.amazon.com/sagemaker/latest/dg/your-algorithms.html)
+## Prerequisites
 
-- [vLLM Documentation](https://docs.vllm.ai/)
+| Tool | Version | Purpose |
+|---|---|---|
+| [Node.js](https://nodejs.org/) | 24+ | Runs the CLI |
+| [Docker](https://docs.docker.com/get-docker/) | 20+ | Container builds |
+| [AWS CLI](https://aws.amazon.com/cli/) | 2+ | AWS resource management |
 
+## Contributing
 
-## Support
+See [CONTRIBUTING.md](CONTRIBUTING.md) for guidelines.
 
-For issues or questions:
+## Security
 
-1. Check `do/README.md` for detailed command documentation
-2. Review CloudWatch logs for deployment issues
-3. See `MIGRATION.md` if migrating from legacy scripts
-4. Open an issue on the [ML Container Creator repository](https://github.com/yourusername/ml-container-creator)
+See [CONTRIBUTING.md](CONTRIBUTING.md#security-issue-notifications) for reporting security issues.
 
 ## License
 
-This generated project is provided as starter code. Modify as needed for your use case.
+Apache-2.0. See [LICENSE](LICENSE).

package/bin/cli.js

@@ -101,6 +101,7 @@ program
     .addOption(new Option('--discover', 'Enable live registry lookups via MCP discovery'))
 
     // --- Validation ---
+    .addOption(new Option('--no-validate', 'Skip schema-driven validation at generation time'))
     .addOption(new Option('--validate-env-vars', 'Enable environment variable validation (default: true)'))
     .addOption(new Option('--validate-with-docker', 'Enable Docker introspection validation (opt-in)'))
     .addOption(new Option('--offline', 'Disable HuggingFace API lookups'))
@@ -179,7 +180,7 @@ program.configureHelp({
                 groups.features.push(opt);
             } else if (['--smart', '--discover'].includes(long)) {
                 groups.mcp.push(opt);
-            } else if (['--validate-env-vars', '--validate-with-docker', '--offline'].includes(long)) {
+            } else if (['--validate-env-vars', '--validate-with-docker', '--offline', '--no-validate'].includes(long)) {
                 groups.validation.push(opt);
             } else {
                 groups.general.push(opt);
@@ -241,7 +242,7 @@ program
     .command('bootstrap')
     .description('Set up AWS infrastructure (IAM role, ECR repo, S3 buckets)')
     .passThroughOptions()
-    .argument('[action]', 'Bootstrap action (status, use, list, remove, scan, prune, update)')
+    .argument('[action]', 'Bootstrap action (status, use, list, remove, scan, prune, update, sync-schemas)')
     .argument('[args...]', 'Additional arguments')
     .option('--profile <profile>', 'AWS profile name')
     .option('--region <region>', 'AWS region')
@@ -250,6 +251,10 @@ program
     .option('--force', 'Force removal without confirmation')
     .option('--verify', 'Verify resources exist (for status)')
     .option('--delete-stack', 'Delete CloudFormation stack on remove')
+    .option('--ignore-staleness', 'Suppress schema staleness warnings')
+    .option('--ci', 'Provision CI integration infrastructure')
+    .option('--skip-ci', 'Skip CI infrastructure provisioning')
+    .option('--skip-s3', 'Skip S3 bucket creation')
     .action(async (action, args, options) => {
         const { default: BootstrapCommandHandler } = await import('../src/lib/bootstrap-command-handler.js');
         const handler = new BootstrapCommandHandler();

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@aws/ml-container-creator",
-  "version": "0.2.4",
+  "version": "0.2.6",
   "description": "Generator for SageMaker AI BYOC paradigm for predictive inference use-cases.",
   "type": "module",
   "main": "src/app.js",
@@ -19,25 +19,23 @@
     "bin/",
     "src/",
     "templates/",
-    "servers/base-image-picker/catalogs/",
+    "servers/lib/catalogs/",
     "servers/base-image-picker/index.js",
     "servers/base-image-picker/manifest.json",
     "servers/base-image-picker/package.json",
-    "servers/instance-recommender/catalogs/",
-    "servers/instance-recommender/index.js",
-    "servers/instance-recommender/manifest.json",
-    "servers/instance-recommender/package.json",
-    "servers/model-picker/catalogs/",
     "servers/model-picker/index.js",
     "servers/model-picker/manifest.json",
     "servers/model-picker/package.json",
-    "servers/region-picker/catalogs/",
     "servers/region-picker/index.js",
     "servers/region-picker/manifest.json",
     "servers/region-picker/package.json",
     "servers/hyperpod-cluster-picker/index.js",
     "servers/hyperpod-cluster-picker/manifest.json",
     "servers/hyperpod-cluster-picker/package.json",
+    "servers/instance-sizer/lib/",
+    "servers/instance-sizer/index.js",
+    "servers/instance-sizer/manifest.json",
+    "servers/instance-sizer/package.json",
     "servers/lib/bedrock-client.js",
     "servers/lib/custom-validators.js",
     "servers/lib/dynamic-resolver.js",
@@ -91,6 +89,7 @@
     "dev": "npm link && ml-container-creator",
     "clean": "rm -rf test-output-*",
     "validate": "npm run lint && npm run test:all",
+    "validate:catalogs": "node scripts/validate-catalog-enums.js",
     "validate:namespaces": "node scripts/validate-namespaces.js",
     "docs:serve": "mkdocs serve",
     "docs:build": "mkdocs build",

package/servers/base-image-picker/index.js

@@ -104,9 +104,9 @@ let PYTHON_SLIM_CATALOG
 let TRITON_IMAGE_CATALOG
 
 try {
-    TRANSFORMER_IMAGE_CATALOG = loadCatalog('./catalogs/model-servers.json')
-    PYTHON_SLIM_CATALOG = loadCatalog('./catalogs/python-slim.json')
-    TRITON_IMAGE_CATALOG = loadCatalog('./catalogs/triton.json')
+    TRANSFORMER_IMAGE_CATALOG = loadCatalog('../lib/catalogs/model-servers.json')
+    PYTHON_SLIM_CATALOG = loadCatalog('../lib/catalogs/python-slim.json')
+    TRITON_IMAGE_CATALOG = loadCatalog('../lib/catalogs/triton.json')
 } catch (err) {
     process.stderr.write(`[base-image-picker] Fatal: ${err.message}\n`)
     process.exit(1)

package/servers/base-image-picker/manifest.json

@@ -8,8 +8,10 @@
         "discover": true
     },
     "catalogs": {
-        "model-servers": "./catalogs/model-servers.json",
-        "python-slim": "./catalogs/python-slim.json"
+        "model-servers": "../lib/catalogs/model-servers.json",
+        "python-slim": "../lib/catalogs/python-slim.json",
+        "triton": "../lib/catalogs/triton.json",
+        "triton-backends": "../lib/catalogs/triton-backends.json"
     },
     "tool": {
         "name": "get_base_images"