gpu-dev 0.5.30__tar.gz → 0.5.32__tar.gz

{gpu_dev-0.5.30 → gpu_dev-0.5.32}/CLAUDE.md

@@ -183,6 +183,55 @@ kubectl port-forward -n monitoring svc/kube-prometheus-stack-prometheus 9090:909
 kubectl get pods -n monitoring -l app.kubernetes.io/name=grafana
 ```
 
+## Multi-Region Single-State Refactor (Research Notes, May 2026)
+
+**Goal:** One `tf apply` manages all regions. No more `tf-all`, no double Docker builds, no double AMI bakes.
+
+**Approach:** Module-per-region pattern.
+```hcl
+# root main.tf
+module "us_east_2" {
+  source    = "./modules/region"
+  region    = "us-east-2"
+  gpu_types = { h100 = {...}, b200 = {...}, ... }
+  spot_types = []
+  providers = { aws = aws.us_east_2 }
+}
+module "us_east_1" {
+  source    = "./modules/region"
+  region    = "us-east-1"
+  gpu_types = { b300 = {...}, t4 = {...}, ... }
+  spot_types = ["b300", "b200", "h100", ...]
+  providers = { aws = aws.us_east_1 }
+}
+```
+
+**What goes in the module:** VPC, subnets, EKS cluster, ASGs, launch templates, Lambda functions, DDB tables, EFS, monitoring, DNS. Basically everything in the current root except provider config and shared resources.
+
+**What stays at root:** Provider blocks with aliases, ECR replication config, AMI copy (`aws_ami_copy` from primary to secondary regions), global IAM roles if any, CLI config.
+
+**AMI sharing:** Build baked AMI in us-east-2 (primary), `aws_ami_copy` to other regions. One build, replicated. The `ami_baker` stays in root, outputs AMI ID, each module receives it as a variable.
+
+**Docker sharing:** ECR replication already set up. Docker builds once in primary region, auto-replicates.
+
+**Migration plan (since nobody uses east1 yet):**
+1. `tofu workspace select prod-east1 && tofu destroy` — clean slate
+2. Move all resources into `modules/region/`
+3. Create provider aliases in root
+4. Import prod (us-east-2) resources into new module state: `tofu import module.us_east_2.aws_vpc.gpu_dev_vpc vpc-xxx`
+5. Add us-east-1 module — fresh create, no import needed
+6. Delete workspace: `tofu workspace delete prod-east1`
+
+**Risks:**
+- Import step for prod is tedious (~50+ resources) but mechanical
+- Lambda zip paths need to be relative to module, not root
+- EKS auth (aws-auth ConfigMap) is per-cluster — each module manages its own
+- CLI needs to know which region to query — already handled by config
+
+**Estimated effort:** 1 dedicated session (~4-6 hours). Most time on the module extraction + prod import.
+
+**Prerequisite for:** Adding us-west-1, us-west-2, or any future region (becomes one module block each).
+
 ## Recent Fixes (Oct 27, 2025)
 
 **NVIDIA Profiling Bootstrap Configuration (Oct 27, 2025):**
@@ -232,6 +281,9 @@ kubectl get pods -n monitoring -l app.kubernetes.io/name=grafana
 
 ### 📋 Remaining Tasks
 
+- **Merge multi-region into single tf state** - HIGH PRIORITY. Kill prod-east1 workspace, refactor into module-per-region in one state. See research notes below. Enables: one `tf apply`, shared AMI (aws_ami_copy), shared Docker (ECR replication already set up), no double builds. Prerequisite for adding west regions.
+- **Add us-west-1 and us-west-2 spot regions** - BLOCKED on single-state refactor. After refactor, adding a region = adding one module block.
+- **Spot UX improvements** - Queue position should be #1 for each type (not cross-type FIFO). Status should show "queued (waiting for capacity)" not just "queued". Interactive picker should show spot GPU counts from east1 not prod.
 - **FQDN for devservers** - Set up proper domain names for development server access
 - **Automated SSH config per reservation** - ✅ DONE - Each reservation now gets `~/.devgpu/<reservation_id>-sshconfig` file, use with `ssh -F ~/.devgpu/<reservation_id>-sshconfig <pod_name>`
 - **Custom Docker image scaffold** - Create Dockerfile with pre-installed packages (Jupyter, etc.)

{gpu_dev-0.5.30 → gpu_dev-0.5.32}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: gpu-dev
-Version: 0.5.30
+Version: 0.5.32
 Summary: CLI tool for PyTorch GPU developer server reservations
 Author: PyTorch Team
 Requires-Python: >=3.10

{gpu_dev-0.5.30 → gpu_dev-0.5.32}/cli-tools/gpu-dev-cli/gpu_dev.egg-info/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: gpu-dev
-Version: 0.5.30
+Version: 0.5.32
 Summary: CLI tool for PyTorch GPU developer server reservations
 Author: PyTorch Team
 Requires-Python: >=3.10

{gpu_dev-0.5.30 → gpu_dev-0.5.32}/cli-tools/gpu-dev-cli/gpu_dev.egg-info/SOURCES.txt

@@ -1,10 +1,6 @@
 .gitignore
 CLAUDE.md
-PROGRESS.md
-PR_DESCRIPTION.md
 README.md
-TODO.md
-post.md
 pyproject.toml
 .github/workflows/no-gitlinks.yml
 .github/workflows/publish.yml
@@ -37,8 +33,12 @@ docs/icons8-cursor-ai.svg
 terraform-gpu-devservers/.terraform.lock.hcl
 terraform-gpu-devservers/README.md
 terraform-gpu-devservers/alb.tf
+terraform-gpu-devservers/ami-baker.tf
 terraform-gpu-devservers/availability.tf
 terraform-gpu-devservers/backend.tf
+terraform-gpu-devservers/check_b200.py
+terraform-gpu-devservers/cluster-autoscaler.tf
+terraform-gpu-devservers/cmd_proxy.py
 terraform-gpu-devservers/docker-build.tf
 terraform-gpu-devservers/ecr.tf
 terraform-gpu-devservers/efs.tf
@@ -48,6 +48,7 @@ terraform-gpu-devservers/git-cache.tf
 terraform-gpu-devservers/gpu-dev-pod-irsa.tf
 terraform-gpu-devservers/kubernetes.tf
 terraform-gpu-devservers/lambda.tf
+terraform-gpu-devservers/list_b200.py
 terraform-gpu-devservers/main.tf
 terraform-gpu-devservers/mig-config.tf
 terraform-gpu-devservers/mig-parted-config.yaml
@@ -60,6 +61,7 @@ terraform-gpu-devservers/route53.tf
 terraform-gpu-devservers/s3-disk-contents.tf
 terraform-gpu-devservers/ssh-proxy-service.tf
 terraform-gpu-devservers/ssh-proxy.tf
+terraform-gpu-devservers/subnet-0fe3a2c45570091ad
 terraform-gpu-devservers/switch-to.sh
 terraform-gpu-devservers/variables.tf
 terraform-gpu-devservers/.claude/skills/deploy.md
@@ -114,6 +116,7 @@ terraform-gpu-devservers/ssh-proxy/proxy.py
 terraform-gpu-devservers/ssh-proxy/requirements.txt
 terraform-gpu-devservers/templates/al2023-cpu-user-data.sh
 terraform-gpu-devservers/templates/al2023-user-data.sh
+terraform-gpu-devservers/templates/ami-baker-user-data.sh
 terraform-gpu-devservers/templates/user-data-self-managed.sh
 terraform-gpu-devservers/templates/user-data.sh
 tests/submit/README.md