vibefast-cli 1.2.1 → 1.3.1

package/docs/archive/TESTING-CHECKLIST.md

@@ -1,450 +0,0 @@
-# 🧪 VibeFast CLI - Complete Testing Checklist
-
-## ⚠️ Current Test Status
-
-### ✅ What's Been Tested
-- [x] CLI builds successfully
-- [x] Worker deploys to Cloudflare
-- [x] Token authentication works
-- [x] Recipe download from R2 works
-- [x] File copying works (17 files)
-- [x] Watermarking works
-- [x] Journal tracking works
-- [x] Feature installation works
-- [x] File deletion works
-
-### ⚠️ What Needs Testing
-- [ ] Navigation injection (Option 3 - in progress)
-- [ ] Navigation removal
-- [ ] All edge cases below
-
----
-
-## 📋 Complete Test Matrix
-
-### 1. Authentication Tests
-
-#### ✅ Login Command
-- [x] `vf login --token VALID_TOKEN` → Success
-- [ ] `vf login --token INVALID_TOKEN` → Error message
-- [ ] `vf login --token ""` → Error message
-- [ ] `vf login` (no token) → Error message
-- [ ] Token persists across CLI runs
-- [ ] Token stored securely in `~/.vibefast/config.json`
-
-#### ✅ Logout Command
-- [x] `vf logout` → Clears token
-- [ ] `vf logout` when not logged in → Graceful message
-- [ ] Commands fail after logout
-
-#### Device Management
-- [ ] `vf devices` → Lists active devices
-- [ ] `vf devices` with no devices → Shows empty list
-- [ ] `vf devices --deactivate <id>` → Removes device
-- [ ] `vf devices --deactivate INVALID_ID` → Error message
-- [ ] Device ID stable across runs
-- [ ] Device ID unique per machine
-
----
-
-### 2. Setup Validation Tests
-
-#### Doctor Command
-- [x] `vf doctor` in VibeFast repo → All checks pass
-- [ ] `vf doctor` in non-VibeFast repo → Error
-- [ ] `vf doctor` without `.vibefast/starter.json` → Error
-- [ ] `vf doctor` with invalid starter.json → Error
-- [ ] `vf doctor` without login → Shows not logged in
-- [ ] `vf doctor` with missing nav markers → Warning
-
-#### Repository Validation
-- [ ] Detects missing signature file
-- [ ] Validates signature name is "vibefast"
-- [ ] Validates targets array exists
-- [ ] Validates targets array not empty
-
----
-
-### 3. Recipe Listing Tests
-
-#### List Command
-- [x] `vf list` → Shows all recipes
-- [ ] `vf list` without login → Error
-- [ ] `vf list` with invalid token → Error
-- [ ] `vf list` groups by native/web
-- [ ] `vf list` shows descriptions
-- [ ] `vf list` when no recipes → Shows empty message
-
----
-
-### 4. Feature Installation Tests
-
-#### Basic Installation
-- [x] `vf add charts` → Installs successfully
-- [x] Files copied to correct locations (17 files)
-- [x] Watermark added to files
-- [x] Journal updated
-- [ ] Navigation added correctly
-- [ ] Re-running `vf add charts` → "Already installed" message
-
-#### Installation with Options
-- [ ] `vf add charts --dry-run` → Shows what would happen, no changes
-- [ ] `vf add charts --force` → Overwrites existing files
-- [ ] `vf add charts --target native` → Installs for native
-- [ ] `vf add charts --target web` → Installs for web
-- [ ] `vf add charts --target invalid` → Error message
-
-#### Edge Cases
-- [ ] Install when not logged in → Error
-- [ ] Install invalid feature → Error from worker
-- [ ] Install when device limit reached → Error
-- [ ] Install when rate limited → Error with retry message
-- [ ] Install with network error → Graceful error
-- [ ] Install when disk full → Error
-- [ ] Install when no write permissions → Error
-- [ ] Install feature that's already installed → Idempotent (no-op)
-
-#### Multiple Installations
-- [ ] Install charts, then chatbot → Both work
-- [ ] Install 5 features in a row → All tracked in journal
-- [ ] Install, remove, reinstall → Works correctly
-
----
-
-### 5. Feature Removal Tests
-
-#### Basic Removal
-- [x] `vf remove charts` → Removes successfully
-- [x] Files deleted (17 files)
-- [ ] Navigation removed correctly
-- [x] Journal updated
-- [ ] Re-running `vf remove charts` → "Not installed" message
-
-#### Removal with Options
-- [ ] `vf remove charts --dry-run` → Shows what would happen
-- [ ] `vf remove charts --target native` → Removes from native
-- [ ] `vf remove charts --target web` → Removes from web
-
-#### Edge Cases
-- [ ] Remove feature that's not installed → Graceful message
-- [ ] Remove when files manually deleted → Handles gracefully
-- [ ] Remove when journal corrupted → Error or recovery
-- [ ] Remove when no write permissions → Error
-
----
-
-### 6. Worker/Backend Tests
-
-#### Token Validation
-- [x] Valid token → Accepted
-- [ ] Invalid token → 403 error
-- [ ] Revoked token → 403 error
-- [ ] Expired token (if implemented) → 403 error
-
-#### Device Slot Management
-- [ ] First device → Registered automatically
-- [ ] Second device → Registered automatically
-- [ ] Third device → Rejected (limit reached)
-- [ ] Deactivate device → Slot freed
-- [ ] Same device multiple requests → Not counted twice
-
-#### Rate Limiting
-- [ ] 30 requests in 1 minute → All succeed
-- [ ] 31st request in 1 minute → 429 error
-- [ ] Wait 1 minute → Rate limit resets
-- [ ] 500 requests in 1 day → All succeed
-- [ ] 501st request in 1 day → 429 error
-
-#### Recipe Delivery
-- [x] Valid recipe request → Returns base64 zip
-- [ ] Invalid recipe name → 404 error
-- [ ] Recipe not in R2 → 404 error
-- [ ] Corrupted zip in R2 → Error
-- [ ] Large recipe (>10MB) → Works
-- [ ] Recipe with special characters → Works
-
----
-
-### 7. File System Tests
-
-#### File Operations
-- [x] Copy files to new location → Success
-- [ ] Copy files to existing location without --force → Error
-- [ ] Copy files to existing location with --force → Overwrites
-- [ ] Copy preserves file permissions → Verified
-- [ ] Copy handles symlinks → Verified
-- [ ] Copy handles large files (>100MB) → Success
-
-#### Directory Operations
-- [ ] Create nested directories → Success
-- [ ] Handle existing directories → No error
-- [ ] Clean up temp files after install → Verified
-- [ ] Clean up temp files after error → Verified
-
-#### Watermarking
-- [x] Watermark added to .ts files → Verified
-- [x] Watermark added to .tsx files → Verified
-- [ ] Watermark added to .js files → Verified
-- [ ] Watermark added to .jsx files → Verified
-- [ ] Watermark NOT added to .json files → Verified
-- [ ] Watermark NOT added to .md files → Verified
-- [ ] Watermark format correct → `// vibefast license: hash-device`
-
----
-
-### 8. Navigation Injection Tests
-
-#### Native (Option 3 - vibefast-features.ts)
-- [ ] First feature added → Array created correctly
-- [ ] Second feature added → Appended to array
-- [ ] Feature object has all required fields
-- [ ] Feature object syntax valid TypeScript
-- [ ] Import statement works in index.tsx
-- [ ] Features render in app
-
-#### Web
-- [ ] Feature card added to page.tsx
-- [ ] Multiple features added correctly
-- [ ] Syntax valid React/JSX
-
-#### Removal
-- [ ] Remove feature → Removed from array
-- [ ] Remove last feature → Array becomes empty
-- [ ] Remove middle feature → Array stays valid
-- [ ] Remove when manually edited → Handles gracefully
-
----
-
-### 9. Journal Tests
-
-#### Journal Creation
-- [ ] First install → Creates `.vibefast/journal.json`
-- [ ] Journal has correct structure
-- [ ] Journal is valid JSON
-
-#### Journal Updates
-- [x] Install feature → Entry added
-- [x] Remove feature → Entry removed
-- [ ] Install multiple features → Multiple entries
-- [ ] Reinstall feature → Entry updated, not duplicated
-
-#### Journal Edge Cases
-- [ ] Corrupted journal → Recovers or errors gracefully
-- [ ] Missing journal → Creates new one
-- [ ] Journal with unknown fields → Ignores them
-- [ ] Very large journal (100+ entries) → Still works
-
----
-
-### 10. Error Handling Tests
-
-#### Network Errors
-- [ ] Worker unreachable → Clear error message
-- [ ] Timeout during download → Retry or error
-- [ ] Partial download → Error and cleanup
-- [ ] DNS failure → Clear error message
-
-#### File System Errors
-- [ ] No write permission → Clear error message
-- [ ] Disk full → Clear error message
-- [ ] File locked by another process → Error
-- [ ] Path too long → Error
-
-#### Data Errors
-- [ ] Corrupted zip file → Error message
-- [ ] Invalid recipe.json → Error message
-- [ ] Missing recipe.json → Error message
-- [ ] Invalid JSON in recipe → Error message
-
-#### User Errors
-- [ ] Typo in feature name → Helpful suggestion
-- [ ] Wrong target specified → Clear error
-- [ ] Command in wrong directory → Clear error
-- [ ] Missing required arguments → Help message
-
----
-
-### 11. Cross-Platform Tests
-
-#### macOS (Your Current Platform)
-- [x] All commands work
-- [x] File paths correct
-- [x] Device ID generation works
-
-#### Linux
-- [ ] All commands work
-- [ ] File paths correct
-- [ ] Device ID generation works
-- [ ] Permissions handled correctly
-
-#### Windows
-- [ ] All commands work
-- [ ] File paths correct (backslashes)
-- [ ] Device ID generation works
-- [ ] Line endings handled correctly (CRLF)
-
----
-
-### 12. Security Tests
-
-#### Token Security
-- [ ] Token not logged to console
-- [ ] Token not in error messages
-- [ ] Token file has correct permissions (600)
-- [ ] Token transmitted over HTTPS only
-
-#### Watermark Security
-- [ ] Watermark can't be easily removed
-- [ ] Watermark doesn't break code
-- [ ] Watermark traceable to customer
-
-#### Input Validation
-- [ ] SQL injection attempts → Rejected
-- [ ] Path traversal attempts → Rejected
-- [ ] Command injection attempts → Rejected
-- [ ] XSS attempts → Rejected
-
----
-
-### 13. Performance Tests
-
-#### Speed
-- [ ] `vf doctor` completes in <1s
-- [ ] `vf list` completes in <2s
-- [ ] `vf add` small feature (<10 files) in <5s
-- [ ] `vf add` large feature (100+ files) in <30s
-- [ ] `vf remove` completes in <3s
-
-#### Resource Usage
-- [ ] CLI uses <100MB RAM
-- [ ] Temp files cleaned up
-- [ ] No memory leaks on repeated use
-
----
-
-### 14. Concurrent Usage Tests
-
-#### Multiple CLI Instances
-- [ ] Two `vf add` commands simultaneously → Both work or one waits
-- [ ] `vf add` and `vf remove` simultaneously → Handled safely
-- [ ] Multiple users on same machine → Separate configs
-
----
-
-### 15. Upgrade/Migration Tests
-
-#### CLI Updates
-- [ ] Update CLI version → Old config still works
-- [ ] Update CLI version → Old journal still works
-- [ ] Breaking change → Migration guide provided
-
-#### Recipe Updates
-- [ ] Install v1.0, update to v1.1 → Works
-- [ ] Recipe format changes → Backward compatible
-
----
-
-### 16. Real-World Scenarios
-
-#### Typical Customer Journey
-- [ ] Buy license → Get token
-- [ ] Install CLI → `npm install -g vibefast-cli`
-- [ ] Login → `vf login --token <TOKEN>`
-- [ ] Check setup → `vf doctor`
-- [ ] Browse features → `vf list`
-- [ ] Install feature → `vf add charts`
-- [ ] Test in app → Feature works
-- [ ] Install another → `vf add chatbot`
-- [ ] Remove unused → `vf remove charts`
-- [ ] Everything works smoothly
-
-#### Edge Case Customer
-- [ ] Install on 3 machines → 3rd rejected
-- [ ] Deactivate old machine → Works
-- [ ] Install on new machine → Works
-- [ ] Hit rate limit → Clear message
-- [ ] Wait and retry → Works
-
-#### Problem Customer
-- [ ] Share token with friend → Both can't use simultaneously (device limit)
-- [ ] Try to remove watermark → Difficult/obvious
-- [ ] Try to bypass auth → Fails
-- [ ] Report bug → Logs help debug
-
----
-
-## 🎯 Priority Testing Order
-
-### P0 (Must Work - Blocking)
-1. ✅ Login/logout
-2. ✅ Doctor validation
-3. ✅ Add feature (basic)
-4. ✅ Remove feature (basic)
-5. ⚠️ Navigation injection (in progress)
-6. Token validation
-7. Device limit enforcement
-
-### P1 (Should Work - Important)
-1. Dry-run mode
-2. Force mode
-3. Error messages
-4. Rate limiting
-5. Multiple features
-6. Journal integrity
-
-### P2 (Nice to Have - Polish)
-1. Performance optimization
-2. Better error messages
-3. Progress indicators
-4. Colored output
-5. Helpful suggestions
-
----
-
-## 🐛 Known Issues
-
-### Current Bugs
-1. ⚠️ Navigation removal doesn't clean vibefast-features.ts array
-2. ⚠️ Need to test all edge cases above
-
-### Workarounds
-1. Manually edit vibefast-features.ts if needed
-2. Use --force to reinstall
-
----
-
-## ✅ Test Completion Status
-
-- **Total Tests:** ~150
-- **Completed:** ~15 (10%)
-- **In Progress:** 2
-- **Remaining:** ~133
-
----
-
-## 🚀 Next Steps
-
-1. Fix navigation removal bug
-2. Test all P0 items
-3. Test all P1 items
-4. Document any issues found
-5. Create automated test suite
-6. Run tests on Linux/Windows
-
----
-
-## 📝 Test Results Log
-
-### 2025-01-12 - Initial Testing
-- ✅ Basic installation works
-- ✅ Watermarking works
-- ✅ File copying works
-- ⚠️ Navigation injection needs Option 3 implementation
-- ⚠️ Navigation removal needs fixing
-
-### Next Test Session
-- [ ] Complete Option 3 implementation
-- [ ] Test full add/remove cycle
-- [ ] Test edge cases
-- [ ] Test on different machines
-