terradev-cli 1.0.0__tar.gz

terradev_cli-1.0.0/PKG-INFO

@@ -0,0 +1,551 @@
+Metadata-Version: 2.1
+Name: terradev-cli
+Version: 1.0.0
+Summary: Parallel provisioning and orchestration for cross-cloud optimized compute
+Home-page: https://github.com/terradev/terradev-cli
+Author: Terradev Team
+Author-email: team@terradev.com
+Project-URL: Bug Reports, https://github.com/terradev/terradev-cli/issues
+Project-URL: Source, https://github.com/terradev/terradev-cli
+Project-URL: Documentation, https://docs.terradev.com
+Project-URL: Changelog, https://github.com/terradev/terradev-cli/blob/main/CHANGELOG.md
+Keywords: cloud,compute,gpu,provisioning,optimization,multi-cloud,parallel,cost-savings,aws,gcp,azure,machine-learning,ai,infrastructure
+Classifier: Development Status :: 4 - Beta
+Classifier: Intended Audience :: Developers
+Classifier: Intended Audience :: System Administrators
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Operating System :: OS Independent
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.9
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Topic :: System :: Systems Administration
+Classifier: Topic :: Software Development :: Libraries :: Python Modules
+Classifier: Topic :: Internet :: WWW/HTTP :: Dynamic Content
+Requires-Python: >=3.9
+Description-Content-Type: text/markdown
+Requires-Dist: click>=8.1.0
+Requires-Dist: aiohttp>=3.8.0
+Requires-Dist: asyncio-throttle>=1.0.2
+Requires-Dist: cryptography>=3.4.8
+Requires-Dist: pyyaml>=6.0
+Requires-Dist: tabulate>=0.9.0
+Requires-Dist: colorama>=0.4.5
+Requires-Dist: rich>=12.0.0
+Requires-Dist: boto3>=1.26.0
+Requires-Dist: google-cloud-compute>=1.8.0
+Requires-Dist: azure-mgmt-compute>=29.0.0
+Requires-Dist: azure-identity>=1.12.0
+Requires-Dist: pandas>=1.5.0
+Requires-Dist: numpy>=1.24.0
+Requires-Dist: python-dotenv>=0.19.0
+Requires-Dist: requests>=2.28.0
+Requires-Dist: urllib3>=1.26.0
+Requires-Dist: jmespath>=1.0.0
+Requires-Dist: six>=1.16.0
+Provides-Extra: dev
+Requires-Dist: pytest>=7.0.0; extra == "dev"
+Requires-Dist: pytest-cov>=4.0.0; extra == "dev"
+Requires-Dist: pytest-asyncio>=0.21.0; extra == "dev"
+Requires-Dist: black>=22.0.0; extra == "dev"
+Requires-Dist: flake8>=5.0.0; extra == "dev"
+Requires-Dist: mypy>=1.0.0; extra == "dev"
+Requires-Dist: pre-commit>=2.20.0; extra == "dev"
+Provides-Extra: docs
+Requires-Dist: sphinx>=5.0.0; extra == "docs"
+Requires-Dist: sphinx-rtd-theme>=1.0.0; extra == "docs"
+Requires-Dist: myst-parser>=0.18.0; extra == "docs"
+
+# 🚀 Terradev CLI - Cross-Cloud Compute Optimization Platform
+
+**Parallel provisioning and orchestration for cross-cloud optimized compute.**
+
+Terradev operates faster than any sequential tool by orders of magnitude to find and stage datasets, then deploy optimal compute instances across multiple cloud providers simultaneously.
+
+---
+
+## 🎯 Overview
+
+Terradev is a CLI tool that fits as a set of procurement heuristics in-between tools like Grafana, Kubernetes and cloud-compute providers. It combines parallel quoting, latency testing, parallelized data storage, and automated containerized deployment to save developers running portable workloads **20%+ on compute costs**.
+
+### 🚀 Key Features
+
+- **🔄 Parallel Provisioning**: Query all cloud providers simultaneously for optimal pricing
+- **💰 Cost Optimization**: Save 20%+ on compute costs through intelligent provider selection
+- **🌐 Multi-Cloud Support**: AWS, GCP, Azure, RunPod, VastAI, Lambda Labs, CoreWeave, TensorDock
+- **⚡ Real-Time Quoting**: Get instant quotes from all providers in parallel
+- **📊 Analytics & Insights**: Comprehensive cost analytics and optimization recommendations
+- **🐳 Container Orchestration**: Automated deployment and management
+- **📦 Dataset Staging**: Parallel dataset staging across regions for optimal access
+- **🔒 Secure Credential Management**: Encrypted storage of cloud provider credentials
+
+---
+
+## 🛠️ Installation
+
+### Prerequisites
+
+- Python 3.9+
+- Cloud provider accounts and API keys
+- Docker (for containerized deployments)
+
+### Quick Install
+
+```bash
+# Clone the repository
+git clone https://github.com/terradev/terradev-cli.git
+cd terradev-cli
+
+# Install dependencies
+pip install -r requirements.txt
+
+# Install CLI
+pip install -e .
+```
+
+### Verify Installation
+
+```bash
+terradev --version
+terradev --help
+```
+
+---
+
+## 🔧 Configuration
+
+### Initial Setup
+
+```bash
+# Configure your cloud providers
+terradev configure --provider aws --region us-east-1
+terradev configure --provider gcp --region us-central1
+terradev configure --provider runpod
+
+# View current configuration
+terradev configure
+```
+
+### Supported Providers
+
+| Provider | GPU Types | Regions | Features |
+|----------|-----------|---------|----------|
+| **AWS** | A100, V100, H100 | Global | Spot instances, on-demand |
+| **GCP** | A100, V100, T4 | Global | Preemptible instances |
+| **Azure** | A100, V100 | Global | Spot instances |
+| **RunPod** | RTX4090, A100 | Global | GPU cloud platform |
+| **VastAI** | A100, RTX4090 | Global | Marketplace |
+| **Lambda Labs** | A100, RTX6000 | Global | AI cloud |
+| **CoreWeave** | A100, RTX4090 | Global | Kubernetes |
+| **TensorDock** | RTX4090, A100 | Global | GPU marketplace |
+
+---
+
+## 🚀 Quick Start
+
+### 1. Get Real-Time Quotes
+
+```bash
+# Get quotes for A100 GPUs across all providers
+terradev quote --gpu-type A100 --parallel 8
+
+# Filter by specific providers and regions
+terradev quote --gpu-type V100 --providers aws gcp runpod --region us-east-1
+```
+
+### 2. Provision Instances
+
+```bash
+# Provision optimal A100 instances
+terradev provision --gpu-type A100 --count 2 --max-price 3.0
+
+# Dry run to see what would be provisioned
+terradev provision --gpu-type RTX4090 --count 1 --dry-run
+```
+
+### 3. Manage Instances
+
+```bash
+# View all instances
+terradev status
+
+# Manage specific instance
+terradev manage --instance-id aws_i-1234567890abcdef --action status
+terradev manage --instance-id runpod_abc123 --action stop
+```
+
+### 4. Stage Datasets
+
+```bash
+# Stage dataset across multiple regions
+terradev stage --dataset "my-training-data" --target-regions us-east-1 us-west-2 eu-west-1
+```
+
+### 5. Execute Commands
+
+```bash
+# Execute commands on instances
+terradev execute --instance-id aws_i-1234567890abcdef --command "nvidia-smi"
+```
+
+---
+
+## 📊 Advanced Features
+
+### Cost Analytics
+
+```bash
+# View cost analytics for the last 30 days
+terradev analytics --days 30 --format table
+
+# Get JSON output for integration
+terradev analytics --days 7 --format json
+```
+
+### Automatic Optimization
+
+```bash
+# Run cost optimization recommendations
+terradev optimize
+```
+
+### Dataset Management
+
+```bash
+# Stage with compression
+terradev stage --dataset "large-dataset.zip" --compression high --target-regions us-east-1
+
+# Stage to specific cloud regions
+terradev stage --dataset "training-images" --target-regions us-east-1 eu-west-1 asia-east-1
+```
+
+---
+
+## 🌐 API Integration
+
+### Environment Variables
+
+```bash
+export TERRADEV_CONFIG_PATH="$HOME/.terradev/config.json"
+export TERRADEV_AUTH_PATH="$HOME/.terradev/auth.json"
+export TERRADEV_LOG_LEVEL="INFO"
+```
+
+### Configuration File
+
+```json
+{
+  "default_providers": ["aws", "gcp", "runpod"],
+  "parallel_queries": 6,
+  "max_price_threshold": 10.0,
+  "preferred_regions": ["us-east-1", "us-west-2", "eu-west-1"],
+  "optimization_settings": {
+    "price_weight": 0.4,
+    "latency_weight": 0.2,
+    "reliability_weight": 0.3,
+    "availability_weight": 0.1
+  }
+}
+```
+
+---
+
+## 🔒 Security
+
+### Credential Management
+
+Terradev uses encrypted credential storage:
+
+```bash
+# Credentials are encrypted at rest
+ls ~/.terradev/
+# config.json  auth.json
+
+# Backup credentials securely
+terradev backup --file my-backup.json
+
+# Restore credentials
+terradev restore --file my-backup.json
+```
+
+### Security Features
+
+- **🔐 Encrypted Storage**: All credentials encrypted with Fernet
+- **🔑 Secure Key Management**: Automatic key generation and rotation
+- **🛡️ Permission Control**: Role-based access to cloud resources
+- **📋 Audit Trail**: Complete audit log of all operations
+- **🔄 Token Rotation**: Automatic API key rotation support
+
+---
+
+## 📈 Performance
+
+### Parallel Processing
+
+Terradev achieves **4-6x faster** provisioning through parallel processing:
+
+```bash
+# Sequential approach (slow)
+# Provider 1: 2.5s → Provider 2: 2.3s → Provider 3: 2.7s = 7.5s total
+
+# Terradev parallel approach (fast)
+# Provider 1: 2.5s ↘
+# Provider 2: 2.3s → 2.7s total (fastest provider)
+# Provider 3: 2.7s ↗
+```
+
+### Cost Savings
+
+Typical cost savings with Terradev:
+
+- **AWS Spot vs On-Demand**: 60-70% savings
+- **Multi-Cloud Arbitrage**: 15-25% savings
+- **Regional Optimization**: 10-20% savings
+- **Dataset Staging**: 50-80% egress cost reduction
+
+---
+
+## 🐳 Docker Integration
+
+### Containerized Deployment
+
+```bash
+# Build Docker image
+docker build -t terradev-cli .
+
+# Run with mounted credentials
+docker run -v ~/.terradev:/root/.terradev terradev-cli quote --gpu-type A100
+```
+
+### Kubernetes Deployment
+
+```yaml
+apiVersion: batch/v1
+kind: Job
+metadata:
+  name: terradev-provision
+spec:
+  template:
+    spec:
+      containers:
+      - name: terradev
+        image: terradev-cli:latest
+        command: ["terradev", "provision", "--gpu-type", "A100"]
+        volumeMounts:
+        - name: config
+          mountPath: /root/.terradev
+      volumes:
+      - name: config
+        secret:
+          secretName: terradev-config
+```
+
+---
+
+## 📊 Monitoring & Analytics
+
+### Real-Time Monitoring
+
+```bash
+# Monitor provisioning progress
+terradev status --watch
+
+# Get detailed analytics
+terradev analytics --days 30 --detailed
+```
+
+### Integration with Grafana
+
+Terradev provides metrics for Grafana dashboards:
+
+- **Cost Metrics**: Real-time cost tracking
+- **Performance Metrics**: Provisioning speed and success rates
+- **Utilization Metrics**: GPU utilization and availability
+- **Savings Metrics**: Cost savings and optimization impact
+
+---
+
+## 🔧 Troubleshooting
+
+### Common Issues
+
+#### Authentication Errors
+
+```bash
+# Check credentials
+terradev configure
+
+# Re-authenticate
+terradev configure --provider aws --api-key YOUR_KEY --secret-key YOUR_SECRET
+```
+
+#### Provider Connection Issues
+
+```bash
+# Test provider connectivity
+terradev quote --provider aws --gpu-type A100 --dry-run
+
+# Check logs
+terradev --verbose status
+```
+
+#### Instance Provisioning Failures
+
+```bash
+# Check instance status
+terradev manage --instance-id INSTANCE_ID --action status
+
+# View detailed error logs
+terradev --verbose provision --gpu-type A100 --dry-run
+```
+
+### Debug Mode
+
+```bash
+# Enable verbose logging
+terradev --verbose quote --gpu-type A100
+
+# Debug specific provider
+terradev --verbose quote --provider aws --gpu-type A100
+```
+
+---
+
+## 🤝 Contributing
+
+### Development Setup
+
+```bash
+# Clone repository
+git clone https://github.com/terradev/terradev-cli.git
+cd terradev-cli
+
+# Create virtual environment
+python -m venv venv
+source venv/bin/activate  # Linux/Mac
+# or
+venv\Scripts\activate  # Windows
+
+# Install development dependencies
+pip install -r requirements-dev.txt
+
+# Install in development mode
+pip install -e .
+```
+
+### Running Tests
+
+```bash
+# Run all tests
+pytest
+
+# Run specific test
+pytest tests/test_providers.py
+
+# Run with coverage
+pytest --cov=terradev_cli
+```
+
+### Adding New Providers
+
+1. Create provider class in `terradev_cli/providers/`
+2. Implement `BaseProvider` interface
+3. Register in `ProviderFactory`
+4. Add tests
+5. Update documentation
+
+---
+
+## 📄 License
+
+This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.
+
+---
+
+## 🆘 Support
+
+### Getting Help
+
+- **Documentation**: [Full documentation](https://docs.terradev.com)
+- **Issues**: [GitHub Issues](https://github.com/terradev/terradev-cli/issues)
+- **Discord**: [Terradev Community](https://discord.gg/terradev)
+- **Email**: support@terradev.com
+
+### Feature Requests
+
+We welcome feature requests! Please:
+
+1. Check existing issues
+2. Use the feature request template
+3. Provide detailed requirements
+4. Include use cases and examples
+
+---
+
+## 🗺️ Roadmap
+
+### Upcoming Features
+
+- **🌐 Web Dashboard**: Web-based management interface
+- **📱 Mobile App**: iOS and Android applications
+- **🔌 Plugin System**: Extensible plugin architecture
+- **🤖 AI Optimization**: ML-based cost optimization
+- **📊 Advanced Analytics**: Predictive cost analysis
+- **🔗 API Gateway**: RESTful API for integration
+- **📈 Real-Time Monitoring**: Live dashboard and alerts
+
+### Provider Expansion
+
+- **Oracle Cloud**: OCI GPU instances
+- **IBM Cloud**: IBM GPU offerings
+- **Alibaba Cloud**: Alibaba GPU instances
+- **DigitalOcean**: DO GPU droplets
+- **Hetzner Cloud**: Hetzner GPU servers
+
+---
+
+## 🎉 Success Stories
+
+### Case Studies
+
+#### Machine Learning Startup
+- **Problem**: High GPU costs on single cloud provider
+- **Solution**: Terradev multi-cloud optimization
+- **Result**: **35% cost reduction** with improved performance
+
+#### Research Institution
+- **Problem**: Slow sequential provisioning
+- **Solution**: Parallel provisioning with Terradev
+- **Result**: **6x faster** instance deployment
+
+#### Enterprise ML Team
+- **Problem**: Complex multi-cloud management
+- **Solution**: Unified Terradev interface
+- **Result**: **50% reduction** in management overhead
+
+---
+
+## 🚀 Get Started Now
+
+Ready to save 20%+ on your compute costs?
+
+```bash
+# Install Terradev
+pip install terradev-cli
+
+# Configure your providers
+terradev configure --provider aws --region us-east-1
+
+# Get your first quotes
+terradev quote --gpu-type A100
+
+# Start saving!
+terradev provision --gpu-type A100 --count 2
+```
+
+**🚀 Terradev - Parallel provisioning for cross-cloud compute optimization**
+
+---
+
+*Built for developers who demand the best performance at the best price.*