fog 0.8.2 → 0.9.0

data/README.rdoc

@@ -12,10 +12,10 @@ fog is the Ruby cloud computing library, top to bottom:
 
 Now type 'fog' to try stuff, confident that fog will let you know what to do. Here is an example of wading through server creation for Amazon Elastic Compute Cloud:
 
-  >> server = AWS.servers.create
+  >> server = Compute[:aws].servers.create
   ArgumentError: image_id is required for this operation
 
-  >> server = AWS.servers.create(:image_id => 'ami-5ee70037')
+  >> server = Compute[:aws].servers.create(:image_id => 'ami-5ee70037')
   <Fog::AWS::EC2::Server [...]>
 
   >> server.destroy # cleanup after yourself or regret it, trust me
@@ -26,7 +26,7 @@ Now type 'fog' to try stuff, confident that fog will let you know what to do. He
 A high level interface to each cloud is provided through collections, such as `images` and `servers`.
 You can see a list of available collections by calling `collections` on the connection object. You can try it out using the `fog` command:
 
-  >> AWS.collections
+  >> Compute[:aws].collections
   [:addresses, :directories, ..., :volumes, :zones]
 
 Some collections are available across multiple providers:
@@ -84,14 +84,14 @@ You can see a list of available requests by calling #requests on the connection
 For instance, ec2 provides methods related to reserved instances that don't have any models (yet). Here is how you can lookup your reserved instances:
 
   $ fog
-  >> AWS[:ec2].describe_reserved_instances
+  >> Compute[:aws].describe_reserved_instances
   #<Excon::Response [...]>
 
 It will return an {excon}[http://github.com/geemus/excon] response, which has `body`, `headers` and `status`. Both return nice hashes.
 
 == Go forth and conquer
 
-Play around and use the console to explore or check out {fog.io}[http://fog.io] for more details and examples. Once you are reading to start scripting fog, here is a quick hint on how to make connections without the command line thing to help you.
+Play around and use the console to explore or check out {fog.io}[http://fog.io] for more details and examples. Once you are ready to start scripting fog, here is a quick hint on how to make connections without the command line thing to help you.
 
   # create a compute connection
   compute = Fog::Compute.new(:provider => 'AWS', :aws_access_key_id => ACCESS_KEY_ID, :aws_secret_access_key => SECRET_ACCESS_KEY)
@@ -117,7 +117,7 @@ Wonder how you can get a lovely fog shirt? Look no further!
 
 * Blue shirts go to people who have contributed indirectly, great examples are writing blog posts or giving lightning talks.
 * Grey shirts and a follow from @fog go to people who have made it on to the {contributors list}[https://github.com/geemus/fog/contributors] by submitting code.
-* Black shirts go to people who have made it on to the {collaborators list}[https://github.com/api/v2/json/repos/show/geemus/fog/collaborators] by coercing geemus into adding them (geemus is currently the only member of this list).
+* Black shirts go to people who have made it on to the {collaborators list}[https://github.com/api/v2/json/repos/show/geemus/fog/collaborators] by coercing geemus into adding them.
 
 == Additional Resources
 

data/Rakefile

@@ -1,7 +1,7 @@
 require 'rubygems'
 require 'bundler/setup'
 require 'date'
-require 'lib/fog'
+require File.dirname(__FILE__) + '/lib/fog'
 
 #############################################################################
 #
@@ -53,8 +53,7 @@ task :examples do
 end
 
 task :test do # => :examples do
-  Rake::Task[:mock_tests].invoke
-  Rake::Task[:real_tests].invoke
+  Rake::Task[:mock_tests].invoke && Rake::Task[:examples].invoke && Rake::Task[:real_tests].invoke
 end
 
 def tests(mocked)
@@ -88,6 +87,19 @@ task :real_tests do
   tests(false)
 end
 
+task :nuke do
+  Fog.providers.each do |provider|
+    begin
+      compute = Fog::Compute.new(:provider => provider)
+      for server in compute.servers
+        Formatador.display_line("[#{provider}] destroying server #{server.identity}")
+        server.destroy rescue nil
+      end
+    rescue
+    end
+  end
+end
+
 desc "Generate RCov test coverage and open in your browser"
 task :coverage do
   require 'rcov'
@@ -116,6 +128,7 @@ end
 #############################################################################
 
 task :release => :build do
+  Rake::Task[:changelog].invoke
   unless `git branch` =~ /^\* master$/
     puts "You must be on the master branch to release!"
     exit!
@@ -127,7 +140,6 @@ task :release => :build do
   sh "git push origin v#{version}"
   sh "gem push pkg/#{name}-#{version}.gem"
   Rake::Task[:docs].invoke
-  Rake::Task[:changelog].invoke
 end
 
 task :build => :gemspec do
@@ -184,7 +196,8 @@ task :changelog do
       unless line[-1..-1] == '.'
         line << '.'
       end
-      line.gsub!(/^\s*\[([^\]]*)\] /, '')
+      line.lstrip!
+      line.gsub!(/^\[([^\]]*)\] /, '')
       tag = $1 || 'misc'
       changes[tag] ||= []
       changes[tag] << (line << ' thanks ' << committer)
@@ -193,7 +206,12 @@ task :changelog do
   end
 
   for committer, commits in committers.to_a.sort {|x,y| y[1] <=> x[1]}
-    if ['Aaron Suggs', 'geemus', 'Wesley Beary'].include?(committer)
+    if [
+        'Aaron Suggs',
+        'geemus',
+        'nightshade427',
+        'Wesley Beary'
+      ].include?(committer)
       next
     end
     changelog << "MVP! #{committer}"
@@ -209,19 +227,41 @@ task :changelog do
     changelog << ''
   end
 
+  old_changelog = File.read('changelog.txt')
+  File.open('changelog.txt', 'w') do |file|
+    file.write(changelog.join("\n"))
+    file.write("\n\n")
+    file.write(old_changelog)
+  end
+
   `echo "#{changelog.join("\n")}" | pbcopy`
   p 'changelog copied to clipboard'
 end
 
 task :docs do
-  # build the docs locally
-  sh "jekyll docs docs/_site"
+  Rake::Task[:upload_fog_io].invoke
+  Rake::Task[:upload_rdoc].invoke
+
+  # write base index with redirect to new version
+  directory.files.create(
+    :body         => redirecter('latest'),
+    :content_type => 'text/html',
+    :key          => 'index.html',
+    :public       => true
+  )
 
+  Formatador.display_line
+end
+
+task :upload_fog_io do
   # connect to storage provider
   Fog.credential = :geemus
   storage = Fog::Storage.new(:provider => 'AWS')
   directory = storage.directories.new(:key => 'fog.io')
 
+  # build the docs locally
+  sh "jekyll docs docs/_site"
+
   # write web page files to versioned 'folder'
   for file_path in Dir.glob('docs/_site/**/*')
     next if File.directory?(file_path)
@@ -254,7 +294,14 @@ task :docs do
     )
   end
   Formatador.redisplay(' ' * 128)
-  Formatador.redisplay('Uploaded docs/_site')
+  Formatador.redisplay("Uploaded docs/_site\n")
+end
+
+task :upload_rdoc do
+  # connect to storage provider
+  Fog.credential = :geemus
+  storage = Fog::Storage.new(:provider => 'AWS')
+  directory = storage.directories.new(:key => 'fog.io')
 
   # write rdoc files to versioned 'folder'
   Rake::Task[:rdoc].invoke
@@ -277,17 +324,7 @@ task :docs do
     :key          => 'latest/rdoc/index.html',
     :public       => true
   )
-  Formatador.redisplay('Uploaded rdoc')
-
-  # write base index with redirect to new version
-  directory.files.create(
-    :body         => redirecter(version),
-    :content_type => 'text/html',
-    :key          => 'index.html',
-    :public       => true
-  )
-
-  Formatador.display_line
+  Formatador.redisplay("Uploaded rdoc\n")
 end
 
 def redirecter(path)
@@ -302,4 +339,4 @@ def redirecter(path)
 </body>
 </html>
 HTML
-end
+end

data/bin/fog

@@ -36,6 +36,12 @@ else
   Formatador.display_line(":#{Fog.credential} provides #{providers}")
   providers = Fog.providers
 
+  # FIXME: hacks until we can `include Fog` in bin
+  CDN     = Fog::CDN
+  Compute = Fog::Compute
+  DNS     = Fog::DNS
+  Storage = Fog::Storage
+
   catch(:IRB_EXIT) { @irb.eval_input }
 
 end

data/changelog.txt

@@ -1,3 +1,110 @@
+0.8.2 05/26/2011 9e6ebb6f7316273eb489f8cb60eb1642e6df357b
+=========================================================
+
+MVP! nightshade427
+
+[aws|compute]
+  better region/zone handling for mocks. thanks geemus
+  indentation fix for last commit. thanks geemus
+  add class level reset for Fog::AWS::Compute::Mock. thanks geemus
+  make mock delay comparison >= so that delay 0 will work properly. thanks geemus
+  respect security zone choice in mocked run_instances     closes #314. thanks geemus
+  respect key_name in mocked run_instances. thanks geemus
+  fix instance format in tests. thanks geemus
+
+[brightbox|compute]
+  fix format for account in tests. thanks geemus
+
+[compute]
+  Test server reloading. thanks Aaron Suggs
+  consistency in #state call and mock test fixes. thanks geemus
+
+[compute|aws]
+  Fix server tests. thanks Aaron Suggs
+  Mock get_password_data request. thanks Aaron Suggs
+  Fix default region when mocking. thanks Aaron Suggs
+  Better key_pair tests. thanks Aaron Suggs
+  Make volumes format more flexible. thanks Aaron Suggs
+
+[core]
+  Fixed credential tests. thanks Aaron Suggs
+  Fix responds_to test helper. thanks Aaron Suggs
+  omit Release commits from changelog. thanks geemus
+  put changelog in clipboard to finish release. thanks geemus
+  more consistent redirector for fog.io. thanks geemus
+  create Fog.available_providers for bin rather than overriding Fog.providers. thanks geemus
+
+[dnsimple|dns]
+  add dnsimple_url param to facilitate using https://test.dnsimple.com     closes #323. thanks geemus
+
+[docs]
+  first pass at compute doc. thanks geemus
+  update version in header/layout. thanks geemus
+  also build/deploy rdocs. thanks geemus
+  make fog.io/latest/foo link to newest versioned docs. thanks geemus
+
+[ecloud]
+  mark bin specs pending unless credentials provided     closes #325. thanks geemus
+
+[local|storage]
+  fixes for pending mocked tests. thanks geemus
+
+[misc]
+  Flatten list of security groups. thanks Dan Peterson
+  Added an example of the head method. thanks Larry Wright
+  Clarified my example. thanks Larry Wright
+  Add a link to fog's Rubydocs. thanks Mathias Meyer
+  :size should be a number in GB, not an instance size (e.g. t1.micro). thanks Michael Conigliaro
+  tests. thanks Nicholas Ricketts
+  added rdoc comments. thanks Nicholas Ricketts
+  Add Amazon API reference link to requests' documentation. thanks Peter Weldon
+  Add reset method to mock classes. thanks anomalousthought
+  Add a reset method to Fog::Mock that resets all providers/services. thanks anomalousthought
+  Add reset method to other providers in addition to Compute providers. thanks anomalousthought
+  Add a reset method to Fog::Mock that resets all providers/services in addition to Compute providers. thanks anomalousthought
+  Public key results are cached, avoid a bug by using that cache. thanks bigfleet
+  0.8.1 changelog. thanks geemus
+  messy first pass at parallelization of testing. thanks geemus
+fix deprecated rdoc rake tasks. thanks geemus
+add mvp suggestion to changelog task. thanks geemus
+  started linode models. thanks nightshade427
+  added images models. thanks nightshade427
+  added kernel modes. thanks nightshade427
+  added datacenters models. thanks nightshade427
+  server provisioning completed. thanks nightshade427
+  server creation and deletion working. thanks nightshade427
+  generalize code. thanks nightshade427
+  creating via stackscripts with callbacks working. thanks nightshade427
+  added shutdown, reboot, boot. thanks nightshade427
+  made config private. thanks nightshade427
+  tests passing. thanks nightshade427
+  revert tests to proper error codes, waiting on fix from linode to support correct error codes. thanks nightshade427
+  code cleanup, tests passing. thanks nightshade427
+  more passing tests. thanks nightshade427
+  more test passing. thanks nightshade427
+  more test passing. thanks nightshade427
+  more test passing. thanks nightshade427
+  more test passing. thanks nightshade427
+  more test passing. thanks nightshade427
+
+[mock]
+  fix Fog::Mock.reset. thanks Dan Peterson
+  error sooner for completely unimplemented services. thanks geemus
+  cleanup and reset related fixes. thanks geemus
+
+[rackspace|compute]
+  make mocks respect Fog::Mock.delay. thanks geemus
+
+[storage]
+  fix/consolidate content-length for utf8. thanks geemus
+
+[tests]
+  add additional fake credentials for mocked tests. thanks geemus
+
+[voxel|compute]
+  fix format for servers in tests. thanks geemus
+
+
 0.8.1 05/13/2011 3a452347a396f0ad1fea7f5475fb3c349b10f527
 =========================================================
 

data/docs/about/getting_started.markdown

@@ -22,10 +22,10 @@ Now we can start writing our script, first off we should require fog.
 
 Now in order to play with our data we need to setup a storage connection.
 
-    storage = Fog::Storage.new(
+    storage = Fog::Storage.new({
       :local_root => '~/fog',
       :provider   => 'Local',
-    )
+    })
 
 `storage` will now contain our storage object, configured to use the Local provider from our specified directory.
 
@@ -70,11 +70,11 @@ Using the same interface you can also practice working against a real provider (
 This time we will turn on mocking and then, just like before, we will need to make a connection.
 
     Fog.mock!
-    storage = Fog::Storage.new(
+    storage = Fog::Storage.new({
       :aws_access_key_id      => 'fake_access_key_id',
       :aws_secret_access_key  => 'fake_secret_access_key',
       :provider               => 'AWS'
-    )
+    })
 
 You may notice that we used bogus credentials, this is fine since we are just simulating things.  To use real S3 you can simply omit `Fog.mock!` and swap in your real credentials.
 

data/docs/about/press.markdown

@@ -5,6 +5,13 @@ title:  Press
 
 Mentions and blog posts from elsewhere in reverse chronological order by day (and alphasorted for same days).
 
+**June 21st, 2011**
+
+* [Mocking fog When Using It With Carrierwave](http://www.engineyard.com/blog/2011/mocking-fog-when-using-it-with-carrierwave/)
+
+**June 14th, 2011**
+
+* [Backing Up Your Data With Fog](http://larrywright.me/blog/articles/221-backing-up-your-data-with-fog)
 
 **April 7th, 2011**
 

data/docs/about/structure.markdown

@@ -33,11 +33,11 @@ As an example, we'll try initializing and persisting a Rackspace Cloud server:
 
     require 'fog'
 
-    compute = Fog::Compute.new(
+    compute = Fog::Compute.new({
       :provider           => 'Rackspace',
       :rackspace_api_key  => key,
       :rackspace_username => username
-    )
+    })
 
     # boot a gentoo server (flavor 1 = 256, image 3 = gentoo 2008.0)
     server = compute.servers.create(:flavor_id => 1, :image_id => 3, :name => 'my_server')
@@ -75,4 +75,4 @@ Enabling mocking easy to use, before you run other commands, simply run:
 
     Fog.mock!
 
-Then proceed as usual, if you run into unimplemented mocks fog will raise an error and as always contributions are welcome!
+Then proceed as usual, if you run into unimplemented mocks fog will raise an error and as always contributions are welcome!

data/docs/compute/index.markdown

@@ -25,11 +25,11 @@ First, create a connection with your new account:
     require 'fog'
 
     # create a connection
-    connection = Fog::Compute.new(
+    connection = Fog::Compute.new({
       :provider                 => 'AWS',
       :aws_secret_access_key    => YOUR_SECRET_ACCESS_KEY,
       :aws_access_key_id        => YOUR_SECRET_ACCESS_KEY_ID
-    )
+    })
 
 With that in hand we are ready to start making EC2 calls!
 
@@ -75,11 +75,11 @@ These return an array of results, where each has stdout, stderr and status value
 Rackspace has <a href="http://www.rackspacecloud.com/cloud_hosting_products/servers">Cloud Servers</a> and you can sign up <a href="https://www.rackspacecloud.com/signup">here</a> and get your credentials <a href="https://manage.rackspacecloud.com/APIAccess.do">here</a>.
 
     # create a connection
-    connection = Fog::Compute.new(
+    connection = Fog::Compute.new({
       :provider           => 'Rackspace',
       :rackspace_username => RACKSPACE_USERNAME,
       :rackspace_api_key  => RACKSPACE_API_KEY
-    )
+    })
 
 We will skip over learning how to do this the 'Rackspace Way' and instead jump right to using bootstrap to get their smallest Ubuntu 10.04 LTS server.
 
@@ -101,4 +101,4 @@ To cover your tracks its a good idea to check for running servers and shut them
 
 ## Summary
 
-Compute can be tricky, but the abstractions in fog make it much easier to get started.  With your servers up and running you can then focus on the task at hand and get some work done.  Congratulations on adding a new tool to your arsenal and let us know what we can do better.
+Compute can be tricky, but the abstractions in fog make it much easier to get started.  With your servers up and running you can then focus on the task at hand and get some work done.  Congratulations on adding a new tool to your arsenal and let us know what we can do better.

data/docs/dns/index.markdown

@@ -21,7 +21,7 @@ For this first example we will use Zerigo (see below for how to use other provid
       :provider     => 'Zerigo',
       :zerigo_email => ZERIGO_EMAIL,
       :zerigo_token => ZERIGO_TOKEN
-    }
+    })
 
 ## Getting in the Zone
 
@@ -68,11 +68,11 @@ You can add more specifics if you need to, but reasonable defaults make it just
 
 If you already have an account with another service you can just as easily use this same code with different credentials. fog currently supports <a href="http://aws.amazon.com/route53/">AWS Route 53</a>, <a href="http://bluebox.net">Blue Box</a>, <a href="http://dnsimple.com">DNSimple</a>, <a href="http://www.linode.com">Linode</a>, <a href="http://www.slicehost.com">Slicehost</a> and <a href="http://www.zerigo.com/managed-dns">Zerigo</a>; so you can have your pick.  As an example you can connect to AWS instead of Zerigo:
 
-    dns = Fog::DNS.new(
+    dns = Fog::DNS.new({
       :provider               => 'AWS',
       :aws_access_key_id      => AWS_ACCESS_KEY_ID,
       :aws_secret_access_key  => AWS_SECRET_ACCESS_KEY
-    )
+    })
 
 ## Go Forth and Resolve