solutious-rudy 0.9.0 → 0.9.1

data/CHANGES.txt

@@ -1,9 +1,63 @@
-RUDY, CHANGES
+RUDY, CHANGES 
+
+
+#### 0.9.1 (2009-08-05) ###########################
+
+* FIXED: "rudy init" now exits with 0
+* FIXED: Removed unnecessary gem dependencies from gemspec
+* ADDED: Configuration examples
+
+
+#### 0.9.0 (2009-08-04) ###########################
+
+* FIXED: Better Windows support
+* FIXED: Added rescue for disk handler in reboot routine
+* FIXED: Another fix for resolving region/zone ambiguity
+* FIXED: No Routines config error during shutdown routine
+* CHANGE: Renamed "rudy machines -S" to "rudy machines -A"
+* CHANGE: Renamed "rudy machines -A" to "rudy machines -T"
+* ADDED: Print friendly error, rather then an angry exception when running on win32 with ruby 1.9
+* ADDED: "rudy machines --disassociate" command
+* ADDED: Allow colons in place of dashes (rudy publish:gem -> publish_gem do; ...; end)
+
+
+#### 0.9.0-RC3 (2009-08-03) ###########################
+
+* FIXED: GH-18 (Error when running startup, reboot, shutdown routines in parallel mode)
+* FIXED: Routine::Handler::User.adduser was specifying invalid home directory with multiple machines
+* FIXED: Socket.connect error in JRuby when checking if SSH is available
+* FIXED: Rudy::AWS::EC2.connect now correctly reconnects when run for the second time
+* FIXED: Global CLI option -R (region) was being ignored in lieu of -z (zone)
+* FIXED: Rudy::Disk#archive wasn't storing size, fstype
+* FIXED: Disk restore was balking when no FS type supplied
+* FIXED: Reboot routine now automatically umounts volumes if the routine is configured to mount after the reboot
+* CHANGE: "rudy myaddress" is now "rudy networks -L"
+* CHANGE: Renamed Volume attributes: create_time, attach_time -> created, attached
+* CHANGE: Renamed Instance attribute: launch_time -> created
+* CHANGE: Global CLI option -C (config) can now accept multiple paths
+* ADDED: "rudy machines -A" to display available machines
+* ADDED: "rudy status" to display all EC2 objects
+* ADDED: "rudy machines -U" to update hostnames
+* ADDED: "rudy machines -S" to create static IP addresses
+* ADDED: Rudy::Routines::Handlers::Disks.mount? etc... methods
+
+
+#### 0.9.0-RC2 (2009-08-02) ###########################
+
+* FIXED: Some status lines were printing on the same line during routines
+* FIXED: user value in defaults wasn't being used for remote commands
+* FIXED: Double printing SSH commands in parallel mode
+* FIXED: Startup routine was creating only one machine
+* FIXED: Reboot now executes commands in correct order
+* CHANGE: Renamed config parameter 'yes' to 'auto'
+* CHANGE: Global config parameter processed differently (see Rudy::Config#look_and_load)
+* ADDED: "rudy ssh" can now run commands in parallel
+* ADDED: rudy networks command
 
 
 #### 0.9.0-RC1 (2009-08-01) ###########################
 
-NOTE: This is a significant re-write from 0.8 (routines, metadata)
+NOTE: This is a significant re-write from 0.8 (primarily the routines, metadata)
 
 * FIXED: Routine blocks now process directives in the order their given (in Ruby 1.8 and 1.9). 
 * FIXED: Region is now based on the zone. Corrects ambiguity when specifying zone and region.
@@ -159,7 +213,7 @@ NOTE: This is a significant re-write from 0.8 (routines, metadata)
 #### 0.6.8 (2009-04-24) ###############################
 
 * CHANGE: Renamed rudy config --rudy option to --project. This was important 
-to maintain consistency in documentation.
+          to maintain consistency in documentation.
 * CHANGE: Cleaned README. See: http://wiki.github.com/solutious/rudy
 
 #### 0.6.7 (2009-04-22) ###############################
@@ -272,6 +326,8 @@ NOTE: This is a complete re-write from 0.1
 * Initial public release
 
 
+#### TODO ###########################################
+
 * TODO: Supply dns values in machines config
 * TODO: Rudy::Routines::Arcade. 
   * install/uninstall: uses package management for the specific os impl
@@ -283,5 +339,6 @@ NOTE: This is a complete re-write from 0.1
 * TODO: look for config file in ./.rudy, then ../.rudy, etc... (git-like)
 * TODO: FIX: When shutting down, warns about disks even when they don't exist (CLI::Routines)
 * TODO: Investigate SSH daemon on Windows
-* TODO: Allow colons in place of dashes (rudy publish:gem)
 * TODO: Supply machines config to routines blocks with only the specific machine group context 
+* TODO: The output for rudy -v should become the default verbose level. -v should print the command output without the header. -vv should print the header. -vvv stays the same but also print full stack traces. 
+

data/README.rdoc

@@ -1,63 +1,90 @@
-= Rudy - v0.9-RC1
+= Rudy - v0.9 BETA
 
 <b>Not your grandparents' EC2 deployment tool.</b>
 
-Rudy is a development and deployment tool for Amazon Web Services. It helps you build and infrastructures in EC2 by organizing them into groups of _zones_,  _environments_, and _roles_. You can run multiple machines with the same role. When you put all this together, you have a unique name for every machine. The default machine is called <tt>m-us-east-1b-stage-app-01</tt> but you can also give them custom names. 
+Rudy is a development and deployment tool for Amazon Web Services. It helps you build and maintain infrastructures in EC2 by organizing them into groups of _zones_,  _environments_, and _roles_. By making it quick and easy to build infrastructures, Rudy makes it feasible to run environments only for the time that you need them. 
 
-All configuration is organized into the zones, environments, and roles that you specify (Rudy assumes positions are identical which is important for backups and scaling). And as you'd expect, the defaults can be changed too.
-
-<b>See Getting-Started[http://solutious.com/projects/rudy/getting-started/] for more info.</b>
+All configuration is organized into this hierarchy so you can define properties (machine image, machine type, IP address, etc...) by role, by environment, or by zone. You can also define routines for running shell commands and scripts, uploading files, creating disks and backups, etc... Routines are organized by hierarchy too so a "startup" routine can run one thing for your database machines and another thing for your application machines. 
 
+Rudy helps with other stuff too. Every machine can be given a hostname based on its zone, environment, role, and position (you can run multiple machines with the same role). These names look like this: <tt>m-us-east-1b-stage-app-01</tt>, but you can also assign your own names. Rudy also automatically creates a private keypair and security for each machine group (e.g. <tt>key-us-east-1b-stage-app</tt> and <tt>grp-us-east-1b-stage-app</tt>).
 
-== Project Status
+<b>Get-Started[http://solutious.com/projects/rudy/getting-started/] with Rudy today to see what all the fuss is about.</b>
 
-<em>This is a BETA release. That means Rudy's not ready for production use! See Project-Status[http://wiki.github.com/solutious/rudy/project-status].</em>
 
-The 0.9 release is a major re-write and has many changes from previous releases. 0.9-RC1 is the first public release from the 0.9 branch and much of the code has not been tested. DO NOT USE IN PRODUCTION. Try it out have some fun and if you have the time send a patch or pull request!
+== Configuration
 
+Rudy is configured via several Ruby-based domain specific languages.
 
-== Configuration
 
 === Machines
 
 The machines configuration describes the "physical" characteristics of your infrastructure. 
 
-    env :stage do                   # Define an environment
-      ami 'ami-e348af8a'         
-                             
-      role :app do                  # Define a role
-        addresses '11.22.33.44'     # Use elastic IPs
+    machines do
+
+      env :stage do                   # Define an environment
+        ami 'ami-e348af8a'            # Specify a machine image
+      
+        role :app do                  # Define a role
+          addresses '11.22.33.44'     # Use elastic IPs
                              
-        disks do                    # Define EBS volumes
-          path "/rudy/disk1" do  
-            size 100             
-            device "/dev/sdr"     
-          end                       
+          disks do                    # Define EBS volumes
+            path "/rudy/disk1" do  
+              size 100
+              device "/dev/sdr"     
+            end                       
+          end
         end
       end
-    end
 
+    end
+    
 === Routines
 
 The routines configuration describes repeatable processes that you can execute on your machines. 
 
-    startup do                      # $ rudy startup
-      adduser :rudy       
-      authorize :rudy               # Enable passwordless login
+    routines do
+    
+      startup do                      # $ rudy startup
+        adduser :rudy       
+        authorize :rudy               # Enable passwordless login
                              
-      disks do                   
-        create "/rudy/disk1"        # Create a disk 
-      end                       
+        disks do                   
+          create "/rudy/disk1"        # Create, format, and mount a volume 
+        end                       
                             
-      remote :rudy do               # Run remote commands via SSH
-        mkdir :p, "great"           # $ mkdir -p great
-        touch "great/scott"         # $ touch great/scott
-        mysql_init :start 
-      end                          
+        remote :rudy do               # Run remote commands via SSH
+          mkdir :p, "great"           # $ mkdir -p great
+          mysql_init :start 
+          your_script 'arg1', 'arg2'  # Call your own scripts
+        end                          
+      end
+    
     end
-
-
-
+    
+See Rudyfile[http://github.com/solutious/rudy/raw/master/Rudyfile] for a complete configuration example. 
+
+
+== Running Commands
+
+Rudy comes with a command-line tool called <tt>rudy</tt>. It provides commands for describing the infrastructures you've built with Rudy. 
+
+    $ rudy machines
+    m-us-east-1d-stage-app-01: ec2-67-202-0-112.compute-1.amazonaws.com
+    m-us-east-1d-stage-app-02: ec2-174-129-117-30.compute-1.amazonaws.com
+    
+    $ rudy disks
+    disk-us-east-1d-stage-app-01-rudy-disk1
+    disk-us-east-1d-stage-app-02-rudy-disk1
+    
+    $ rudy backups
+    back-us-east-1d-stage-app-01-rudy-disk1-20090803-1857-49
+    back-us-east-1d-stage-app-01-rudy-disk1-20090803-1858-36
+    back-us-east-1d-stage-app-02-rudy-disk1-20090803-1911-05
+    
+See <tt>rudy -h</tt> for more info.     
+    
+    
 == Features
 
 * Create complex IT infrastructures from a simple configuration
@@ -69,20 +96,29 @@ The routines configuration describes repeatable processes that you can execute o
 * Powerful command-line tools
   * <tt>$ rudy -u root ssh</tt>
   * <tt>$ rudy -e testing -r database backup-mysql</tt>
-* Use _any Linux_ Amazon machine image (AMI) (partial Solaris support)
+* Use _any Linux_ Amazon machine image (AMI) (partial Windows and Solaris support)
 * Complete command-line interface for EC2. See <tt>bin/rudy-ec2</tt>.
 
+
+== Project Status
+
+<em>This is a BETA release. That means Rudy is not ready for production use! See Project-Status[http://wiki.github.com/solutious/rudy/project-status].</em>
+
+
 == Installation
 
-Via Rubygems, one of:
+Via Rubygems:
 
     $ sudo gem install rudy
-    $ sudo gem install solutious-rudy --source http://gems.github.com/
 
 or via download:
 * rudy-latest.tar.gz[http://github.com/solutious/rudy/tarball/latest]
 * rudy-latest.zip[http://github.com/solutious/rudy/zipball/latest]
 
+or via git:
+
+    $ git clone git://github.com/solutious/rudy.git
+    
 NOTE: <em>If you are not installing via RubyGems, you need to make sure the dependencies are in your LOAD_PATH (<tt>$:</tt>). Ryan Tomayko wrote a gist[http://gist.github.com/54177] about it.</em>
 
 <b>See Getting-Started[http://solutious.com/projects/rudy/getting-started/] for more info.</b>
@@ -106,19 +142,32 @@ NOTE: <em>If you are not installing via RubyGems, you need to make sure the depe
   * Caesars[http://github.com/delano/caesars]
   * Gibbler[http://github.com/delano/gibbler]
 
-
+* Supported Platforms
+  * Linux: Ruby 1.8, 1.9, and JRuby 1.3+
+  * Windows: Ruby 1.8 and JRuby 1.3+ (Net::SSH does not run under Ruby 1.9)
+  * BSD: <i>Needs testing (any takers?)</i>
+  
 == More Info
 
 * Fork at GitHub[http://github.com/solutious/rudy]
-* Read the Documentation[http://wiki.github.com/solutious/rudy]
+* Read the Documentation[http://solutious.com/projects/rudy]
 * Submit issues to the IssueTracker[http://github.com/solutious/rudy/issues]
 * Start a discussion on the GoogleGroup[http://groups.google.com/group/rudy-deployment]
 * Find some Inspiration[http://www.youtube.com/watch?v=CgaiIW5Rzes]
 * For all other inquires, email me directly: delano (@solutious.com)
 
 
+== Contributions
+
+This is a BETA release. We encourage people to find unique and interesting ways to break rudy. If you find an issue, let us know!
+
+* For bigger features please fork the git repo and send me a pull request. 
+* For small or single file changes, send me an email with the details: delano (@solutious.com)
+
+
 == Thanks
 
+* Kalin Harvey for all the feedback
 * The Rilli.com[http://rilli.com] team
   * Adam Bognar
   * Andrew Simpson
@@ -133,31 +182,20 @@ NOTE: <em>If you are not installing via RubyGems, you need to make sure the depe
 * Marcel Molina Jr. for aws-s3
 * Keshia Knight Pulliam
 
-
-== Contributions
-
-* For bigger features please fork the git repo and send me a pull request. 
-* For small or single file changes, send me an email with the details: Delano (@solutious.com)
-
-
 == Credits
 
-* Delano Mandelbaum (delano@solutious.com)
+* Delano Mandelbaum ( http://solutious.com/ )
 * Rudy::AWS::SDB adapted from aws_sdb by Tim Dysinger (http://dysinger.net)
 
 
 == Related Projects
 
-* Sprinkle -- http://github.com/crafterm/sprinkle/
-* Wakame -- http://wakame.rubyforge.org/
-* Pool Party -- http://www.poolpartyrb.com/
-* Rubber -- http://github.com/wr0ngway/rubber/wikis
-* Moonshine -- http://github.com/railsmachine/moonshine/tree
+* Rake -- http://rake.rubyforge.org/
+* Moonshine -- http://github.com/railsmachine/moonshine/tree/
 * Boto -- http://code.google.com/p/boto/
 * Fabric -- http://www.nongnu.org/fab/
 
 
-
 == License
 
 See: LICENSE.txt

data/Rakefile

@@ -10,98 +10,6 @@ require 'fileutils'
 include FileUtils
  
 task :default => :test
- 
-
-
-# TESTS ===============================================================
- 
-Rake::TestTask.new(:test_old) do |t|
-  require 'monkeyspecdoc'
-  test_files = FileList['test/**/*_test.rb'] || []
-  t.test_files = test_files
-  t.ruby_opts = ['-rubygems'] if defined? Gem
-  t.verbose = true
-#  t.warning = true
-  
-end
-
-
-namespace :test do
-  #about 'Measures test coverage'
-  task :coverage do
-    rm_f "coverage"
-    rm_f "coverage.data"
-    rcov = "rcov -Itest --aggregate coverage.data -T -x ' rubygems/*,/Library/Ruby/Site/*,gems/*,rcov*'"
-    system("#{rcov} --html test/**/*_test.rb")
-    system("open coverage/index.html") if RUBY_PLATFORM['darwin']
-  end
-  task :list do
-    puts Dir.glob(File.join('test', '**', '*_test.rb'))
-  end
-  
-  # Run individual test groups with: 
-  # rake test:05 
-  # rake test:60
-  # etc...
-  ('00'..'99').each do |group|
-    task group.to_sym do
-      Rake.run_tests "test/#{group}*/*_test.rb"
-    end
-    
-    # And also individual test files
-    # rake test:50:10
-    # etc...
-    ('00'..'99').each do |test|
-      namespace group.to_sym do
-        task test.to_sym do
-          Rake.run_tests "test/#{group}*/{00,#{test}}*_test.rb"
-        end
-      end
-    end
-  end
-end
-
-task :test do
-
-  #all_tests = Dir.glob(File.join('test', '{05,20,50}*', '*_test.rb')) || []
-  #all_tests.sort.each do |file|
-  #  load file
-  #end
-  Rake.run_tests 'test/**/*_test.rb'
-end
-
-
-# From: shoulda/tasks/list_tests.rake
-namespace :shoulda do
-  #about "List the names of the test methods in a specification like format"
-  task :list_fixed do
-    $LOAD_PATH.unshift("test")
-
-    require 'test/unit'
-    require 'active_support'
-
-    # bug in test unit.  Set to true to stop from running.
-    Test::Unit.run = true
-
-    test_files = Dir.glob(File.join('test', '**', '*_test.rb'))
-    
-    test_files.each do |file|
-      load file
-      klass = File.basename(file, '.rb').classify
-      #unless Object.const_defined?(klass.to_s)    # => raises: wrong constant name 00SetupTest
-      unless Object.constants.member?(klass.to_s)  # fixed
-        puts "Skipping #{klass} because it doesn't map to a Class"
-        next
-      end
-      klass = klass.constantize
-
-      puts klass.name.gsub('Test', '')
-
-      test_methods = klass.instance_methods.grep(/^test/).map {|s| s.gsub(/^test: /, '')}.sort
-      test_methods.each {|m| puts "  " + m }
-    end
-  end
-end
 
 
 # PACKAGE =============================================================

data/Rudyfile

@@ -46,7 +46,7 @@ machines do
     size 'm1.small'                  # EC2 machine type for all machines
                                      # in the 'stage' environment
     role :app do
-      positions 1                    # Only 1 machine in stage-app
+      positions 2                    # 2 machines in stage-app
       #addresses '11.22.33.44'       # Define an elastic IP to reuse
       
       disks do                       # Define EBS volumes 
@@ -63,9 +63,9 @@ machines do
     end
     
     users do                         # Specify existing private keys per user
-      rudy do                       
-        keypair '/path/2/private-key'
-      end
+      #rudy do                       
+      #  keypair '/path/2/private-key'
+      #end
     end
     
   end  
@@ -109,7 +109,7 @@ routines do
           create '/rudy/disk1'       # Create an EBS volume, attach it, give
         end                          # it a filesystem, and mount it.
                                      #
-        remote :rudy do              # Run remote SSH commands after startup
+        remote :root do              # Run remote SSH commands after startup
           mkdir :p, 'great'          # $ mkdir -p great
           touch 'great/scott'        # $ touch great/scott
           ls :l, :a                  # $ ls -l -a *
@@ -130,23 +130,13 @@ routines do
           uptime                     # web servers and databases. 
         end                          #
         remote do                    # Run any startup tasks like starting
-          uptime                     # processes or initializing the filesystem
+          uname                      # processes or initializing the filesystem
         end
-      end
-      
-      backup do                      # $ rudy backup
-        disks do                     # A simple routine that creates an EBS
-          snapshot '/rudy/disk1'     # snapshot of the specified volume.
+        disks do
+          mount "/rudy/disk1"
         end
       end
       
-      restore do                     # $ rudy restore
-        disks do                     # A contrived example of restoring a 
-          destroy '/rudy/disk1'      # disk from a backup. NOTE: You'll need
-          restore '/rudy/disk1'      # to run 'rudy backup' at least once 
-        end                          # before otherise there are no backups
-      end                            # to restore from. 
-      
     end                              
   end                                
   
@@ -171,24 +161,24 @@ routines do
   end
   
   uptime do                          # $ rudy uptime
-    remote { uptime }                # Short block syntax
+    local { uptime }                 # Short block syntax
   end
   
 end
 
 
 # ----------------------------------------------------------- DEFAULTS --------
-# These values are used as defaults for their respective global settings. All
-# non-boolean values are expected to be Symbols. 
+# These values are used as defaults for their respective global settings. They
+# can be overridden by the command-line global options.  
 #
 defaults do
   zone :'us-east-1d'
   environment :stage
   role :app
-  #user ENV['USER']                  # The default remote user
+  color true                         # Terminal colors? true/false
+  #user 'someuser'                   # The default remote user
   #localhost 'hostname'              # A local hostname instead of localhost
-  #color true                        # Terminal colors? true/false
-  #yes false                         # Auto-confirm? true/false
-  #keydir '~/.ssh/'                  # The path to store SSH keys
+  #auto true                         # Skip interactive confirmation?
+  #keydir 'path/2/keys/'             # The path to store SSH keys
 end