fog 1.25.0 → 1.26.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA1:
-  metadata.gz: f24940adb0f2a2ffbc04371b7b9b284e435f58a3
-  data.tar.gz: f3291ad2ebda9d299c5760b31b2e00c179a518af
+  metadata.gz: b90b267d33e2bb0d68f6a9725763d71b425c1479
+  data.tar.gz: d7e2b1944a76d79710214591aae72e2aa6a6435a
 SHA512:
-  metadata.gz: 34e1b51c62a86bb205dc374f4c560bff95d55c57313c757fa80f66f6703057dafa473506a63fc18cd7a9375785464b4da660950b25bd7594ad6ab72919dc4278
-  data.tar.gz: 6342a65f55310d580cff1590793493709a1354cd5657520066c7981b68f1e3dd645cccf94d778c4f638f1daf7b63f41898dc67def52dd5a3deeae2f3e9e4f746
+  metadata.gz: 628733d43152080c095940f8714823a9184bfba00561765563cdf86e6cb0ec2e23753c6799aa3a7e81ffbeb212446e492c8762d089bce486743701b112b55fac
+  data.tar.gz: f1265d5b0a5dcbbe9355e62f71c0560659c6dc68f7d341b15523061b1a1c27b3ab152ef7fbe61f678b4615e8d4797ac1b1960d94a8fc87bee0a47d4c9cc0bec8

data/.travis.yml

@@ -1,5 +1,7 @@
 language: ruby
 
+sudo: false
+
 script: bundle exec rake travis
 
 matrix:

data/CHANGELOG.md

@@ -1,3 +1,115 @@
+## 1.26.0 12/12/2014
+*Hash* 54dde02c11225c2fa63fa82e08bffcc0ad31a719
+
+Statistic     | Value
+------------- | --------:
+Collaborators | 2
+Downloads     | 7729418
+Forks         | 1364
+Open Issues   | 148
+Watchers      | 3299
+
+**MVP!** Colin Hebert
+
+#### [AWS|Storage]
+*   make s3 IO based uploads retryable again. thanks Frederick Cheung
+*   allow signature version to be set to 2 (WIP). thanks Frederick Cheung
+
+#### [DigitalOcean]
+*   Helper methods for flavor,image,region,ips. thanks Daniel Lobato
+
+#### [Docker]
+*   Environment variables support. thanks Daniel Lobato
+
+#### [Openstack|Compute|Server]
+*   Add test boot from block_device_mapping. thanks Brandon Dunne
+*   Add test boot from block_device_mapping_v2. thanks Brandon Dunne
+*   Rewrite block_device_mapping to support. thanks Brandon Dunne
+
+#### [Openstack|Tests]
+*   Add rake subtask for testing only Openstack. thanks Brandon Dunne
+
+#### [aws|auto_scaling]
+*   Add PlacementTenancy attribute for launch configuration. thanks Benjamin Pillet
+
+#### [aws|dns]
+*   Namespace xml to fix create_health_check. thanks James Findley
+
+#### [aws|s3]
+*   add changelog note about 7 day expiry. thanks geemus
+
+#### [aws|storage]
+*   redirect fixes to match latest and v4 sigs. thanks geemus
+*   catch edge cases around redirect region/host. thanks geemus
+
+#### [digitalocean]
+*   reenable tests. thanks geemus
+
+#### [digitalocean|compute]
+*   add private_networking attribute. thanks geemus
+
+#### [google|storage]
+*   Reintroduce workaround for excon headers issue while keeping fix where file_data was not being saved. thanks Antonio
+
+#### [misc]
+*   Accept any 2xx status from head_containers. thanks Ash Wilson
+*   Update describe_network_acls.rb. thanks Bryan Paxton
+*   Add AssumeRoleWithSAML support for AWS. thanks Colin Hebert
+*   Ensure that if the aws credentials requests requiring the signature fail. thanks Colin Hebert
+*   Fix link to documentation. thanks Colin Hebert
+*   Fix code style. thanks Colin Hebert
+*   Add simple test. thanks Colin Hebert
+*   Fix style. thanks Colin Hebert
+*   fixed backups in DigitalOcean. thanks Denis Barishev
+*   Do not throw a warning about falling back to path_style     ... if the user has already explicitly specified path_style (dots are, after all, a perfectly valid thing to have in a bucket name). thanks Eric Herot
+*   Fix typo: Fog::Connection is deprecated, not Fog::XML::Connection. thanks Joe Rafaniello
+*   recognize aws_signature_version option. thanks Jon K Hellan
+*   Use old style date header for signature v2. thanks Jon K Hellan
+*   Use the new build env on Travis. thanks Josh Kalderimis
+*   Enhance images details call by query. thanks Ladislav Smola
+*   Fix path with contained query. thanks Ladislav Smola
+*   Moving Rackspace logic to fog-rackspace. thanks Matt Darby
+*   Moved to Fog::Core. thanks Matt Darby
+*   Revert "Moving Rackspace logic to fog-rackspace". thanks Matt Darby
+*   Rackspace Orchestration Support. thanks Matt Darby
+*   add block_device_mapping_v2. thanks Naoto TAKAHASHI
+*   fixup! example block_device_mapping_v2. thanks Naoto TAKAHASHI
+*   fixup!. thanks Naoto TAKAHASHI
+*   Disable rackspace until fog-rackspace#10 is fixed. thanks Nat Welch
+*   Rescue "Illegal Seek" exception in case body is a pipe or socket. thanks Paul Gideon Dann
+*   Specs for existing `Fog::Bin` interface. thanks Paul Thornthwaite
+*   Detailed checks for `Brightbox` class. thanks Paul Thornthwaite
+*   Revert "Moved to Fog::Core". thanks Paul Thornthwaite
+*   Mark broken DigitalOcean tests as pending. thanks Paul Thornthwaite
+*   Mark additional DigitalOcean test as pending. thanks Paul Thornthwaite
+*   Disable ALL DigitalOcean tests until fixed. thanks Paul Thornthwaite
+*   Remove Rackspace references until reinstated. thanks Paul Thornthwaite
+*   Reinstate Rackspace "bin" checks. thanks Paul Thornthwaite
+*   More specs to cover `Fog` methods. thanks Paul Thornthwaite
+*   Moved Ecloud to a modular gem. thanks Paulo Henrique Lopes Ribeiro
+*   Moved StormOnDemand to its own gem. thanks Paulo Henrique Lopes Ribeiro
+*   Removing Atmos. thanks Paulo Henrique Lopes Ribeiro
+*   Adds openstack_region parameter to OpenStack Identity Service. thanks Renato Furter
+*   Fix deprecation warning. thanks Sean Handley
+*   Require fog/version for User-Agent header. thanks Terry Howe
+*   ensure version is required. thanks geemus
+*   add github release to changelog task. thanks geemus
+*   bump fog-core dep. thanks geemus
+*   Revert "bump fog-core dep". thanks geemus
+*   bump fog-core dep. thanks geemus
+
+#### [opennebula]
+*   lazily require opennebula gem. thanks geemus
+
+#### [storage|aws]
+*   fix redirect follower + v4 sig regression. thanks geemus
+*   further fixes around region redirecting. thanks geemus
+*   make owner setter on file idempotent. thanks geemus
+*   fix docs/code for put_bucket_logging. thanks geemus
+*   more redirect tweaks. thanks geemus
+*   tweak region redirecting. thanks geemus
+
+
 ## 1.25.0 11/18/2014
 *Hash* 4728432a087f6d9661af0f18a660a27b68b3d947
 
@@ -54,6 +166,7 @@ Watchers      | 3271
 *   Vhost buckets don't work if bucket name has a . in it. thanks Frederick Cheung
 *   switch to signature v4. thanks Frederick Cheung
 *   use request_params to normalize/escape paths properly for delete/copy object. thanks Frederick Cheung
+*   NOTE: v4 signatures mean that signed URLs can now only have up to 7 day expiry
 
 #### [AWS|SNS]
 *   Use Signature v4. thanks Frederick Cheung

data/Rakefile

@@ -52,6 +52,7 @@ task :travis  => ['test', 'test:travis']
 
 Rake::TestTask.new do |t|
   t.pattern = File.join("spec", "**", "*_spec.rb")
+  t.libs << "spec"
 end
 
 namespace :test do
@@ -68,7 +69,9 @@ namespace :test do
   task :ovirt do
       sh("export FOG_MOCK=#{mock} && bundle exec shindont tests/ovirt")
   end
-
+  task :openstack do
+      sh("export FOG_MOCK=#{mock} && bundle exec shindont tests/openstack")
+  end
 end
 
 desc 'Run mocked tests for a specific provider'

data/fog.gemspec

@@ -11,8 +11,8 @@ Gem::Specification.new do |s|
   ## If your rubyforge_project name is different, then edit it and comment out
   ## the sub! line in the Rakefile
   s.name              = 'fog'
-  s.version           = '1.25.0'
-  s.date              = '2014-11-18'
+  s.version           = '1.26.0'
+  s.date              = '2014-12-12'
   s.rubyforge_project = 'fog'
 
   ## Make sure your summary is short. The description may be as long
@@ -46,7 +46,7 @@ Gem::Specification.new do |s|
 
   ## List your runtime dependencies here. Runtime dependencies are those
   ## that are needed for an end user to actually USE your code.
-  s.add_dependency("fog-core", "~> 1.25")
+  s.add_dependency("fog-core", "~> 1.27", ">= 1.27.1")
   s.add_dependency("fog-json")
   s.add_dependency("fog-xml", "~> 0.1.1")
 
@@ -62,9 +62,12 @@ Gem::Specification.new do |s|
   s.add_dependency("fog-voxel")
   s.add_dependency("fog-vmfusion")
   s.add_dependency("fog-terremark")
+  s.add_dependency("fog-ecloud")
+  s.add_dependency("fog-storm_on_demand")
+  s.add_dependency("fog-atmos")
 
-  # Extra Dependencies
-  s.add_dependency("opennebula")
+  # Disabled until Rackspace isn't broken, see fog-rackspace#10
+  #s.add_dependency("fog-rackspace")
 
   ## List your development dependencies here. Development dependencies are
   ## those that are only needed during development
@@ -76,6 +79,7 @@ Gem::Specification.new do |s|
   s.add_development_dependency('rbovirt', '0.0.24')
   s.add_development_dependency('shindo', '~> 0.3.4')
   s.add_development_dependency('fission')
+  s.add_development_dependency('opennebula')
   s.add_development_dependency('pry')
   s.add_development_dependency('google-api-client', '~> 0.6', '>= 0.6.2')
   s.add_development_dependency('docker-api', '>= 1.13.6')

data/lib/fog.rb

@@ -3,6 +3,8 @@
 __LIB_DIR__ = File.expand_path(File.dirname(__FILE__))
 $LOAD_PATH.unshift __LIB_DIR__ unless $LOAD_PATH.include?(__LIB_DIR__)
 
+require 'fog/version'
+
 # Use core
 require 'fog/core'
 

data/lib/fog/aws/models/auto_scaling/configuration.rb

@@ -21,6 +21,7 @@ module Fog
         attribute :security_groups,       :aliases => 'SecurityGroups'
         attribute :user_data,             :aliases => 'UserData'
         attribute :spot_price,            :aliases => 'SpotPrice'
+        attribute :placement_tenancy,     :aliases => 'PlacementTenancy'
 
 
         def initialize(attributes={})

data/lib/fog/aws/models/storage/file.rb

@@ -123,8 +123,8 @@ module Fog
         def owner=(new_owner)
           if new_owner
             attributes[:owner] = {
-              :display_name => new_owner['DisplayName'],
-              :id           => new_owner['ID']
+              :display_name => new_owner['DisplayName'] || new_owner[:display_name],
+              :id           => new_owner['ID'] || new_owner[:id]
             }
           end
         end
@@ -257,7 +257,9 @@ module Fog
           # TODO: optionally upload chunks in parallel using threads
           # (may cause network performance problems with many small chunks)
           # TODO: Support large chunk sizes without reading the chunk into memory
-          body.rewind if body.respond_to?(:rewind)
+          if body.respond_to?(:rewind)
+            body.rewind  rescue nil
+          end
           while (chunk = body.read(multipart_chunk_size)) do
             md5 = Base64.encode64(Digest::MD5.digest(chunk)).strip
             part_upload = service.upload_part(directory.key, key, upload_id, part_tags.size + 1, chunk, 'Content-MD5' => md5 )

data/lib/fog/aws/parsers/sts/assume_role_with_saml.rb

@@ -0,0 +1,26 @@
+module Fog
+  module Parsers
+    module AWS
+      module STS
+        class AssumeRoleWithSAML < Fog::Parsers::Base
+          def reset
+            @response = {}
+          end
+
+          def end_element(name)
+            case name
+            when 'SessionToken', 'SecretAccessKey', 'Expiration', 'AccessKeyId'
+              @response[name] = @value.strip
+            when 'Arn', 'AssumedRoleId'
+              @response[name] = @value.strip
+            when 'PackedPolicySize'
+              @response[name] = @value
+            when 'RequestId'
+              @response[name] = @value
+            end
+          end
+        end
+      end
+    end
+  end
+end

data/lib/fog/aws/requests/auto_scaling/create_launch_configuration.rb

@@ -41,6 +41,8 @@ module Fog
         #     Amazon EC2 instances.
         #   * 'EbsOptimized'<~Boolean> - Whether the instance is optimized for
         #     EBS I/O. Not required, default false.
+        #   * 'PlacementTenancy'<~String> - The tenancy of the instance. Valid
+        #     values: default | dedicated.  Default: default
         #
         # ==== Returns
         # * response<~Excon::Response>:
@@ -93,6 +95,7 @@ module Fog
             'KeyName'                 => nil,
             'LaunchConfigurationARN'  => Fog::AWS::Mock.arn('autoscaling', self.data[:owner_id], "launchConfiguration:00000000-0000-0000-0000-000000000000:launchConfigurationName/#{launch_configuration_name}", @region),
             'LaunchConfigurationName' => launch_configuration_name,
+            'PlacementTenancy'        => nil,
             'RamdiskId'               => nil,
             'SecurityGroups'          => [],
             'UserData'                => nil

data/lib/fog/aws/requests/auto_scaling/describe_launch_configurations.rb

@@ -57,6 +57,7 @@ module Fog
         #             of the launch configuration.
         #           * 'RamdiskId'<~String> - Provides ID of the RAM disk
         #             associated with the EC2 AMI.
+        #           * 'PlacementTenancy'<~String> - The tenancy of the instance.
         #           * 'SecurityGroups'<~Array> - A description of the security
         #             groups to associate with the EC2 instances.
         #           * 'UserData'<~String> - The user data available to the

data/lib/fog/aws/requests/compute/describe_network_acls.rb

@@ -70,8 +70,7 @@ module Fog
             'egress'      => 'egress',
             'rule-action' => 'ruleAction',
             'rule-number' => 'ruleNumber',
-            'protocol'    => 'protocol',
-            'egress'      => 'egress',
+            'protocol'    => 'protocol'
           }
           for filter_key, filter_value in filters
             filter_key = filter_key.to_s

data/lib/fog/aws/requests/dns/create_health_check.rb

@@ -34,18 +34,18 @@ module Fog
 
         def create_health_check(ip_address, port, type, options = {})
           version = @version
-          builder = Nokogiri::XML::Builder.new(:encoding => 'UTF-8') do
-            CreateHealthCheckRequest(:xmlns => "https://route53.amazonaws.com/doc/#{version}/") do
-              CallerReference options[:caller_reference] || "#{Time.now.to_i.to_s}-#{SecureRandom.hex(6)}"
-              HealthCheckConfig do
-                IPAddress ip_address unless ip_address.nil?
-                Port port
-                Type type
-                ResourcePath options[:resource_path] if options.has_key?(:resource_path)
-                FullyQualifiedDomainName options[:fqdn] if options.has_key?(:fqdn)
-                SearchString options[:search_string] if options.has_key?(:search_string)
-                RequestInterval options[:request_interval] if options.has_key?(:request_interval)
-                FailureThreshold options[:failure_threshold] if options.has_key?(:failure_threshold)
+          builder = Nokogiri::XML::Builder.new(:encoding => 'UTF-8') do |xml|
+            xml.CreateHealthCheckRequest(:xmlns => "https://route53.amazonaws.com/doc/#{version}/") do
+              xml.CallerReference options[:caller_reference] || "#{Time.now.to_i.to_s}-#{SecureRandom.hex(6)}"
+              xml.HealthCheckConfig do
+                xml.IPAddress ip_address unless ip_address.nil?
+                xml.Port port
+                xml.Type type
+                xml.ResourcePath options[:resource_path] if options.has_key?(:resource_path)
+                xml.FullyQualifiedDomainName options[:fqdn] if options.has_key?(:fqdn)
+                xml.SearchString options[:search_string] if options.has_key?(:search_string)
+                xml.RequestInterval options[:request_interval] if options.has_key?(:request_interval)
+                xml.FailureThreshold options[:failure_threshold] if options.has_key?(:failure_threshold)
               end
             end
           end

data/lib/fog/aws/requests/storage/put_bucket_logging.rb

@@ -6,18 +6,19 @@ module Fog
         #
         # @param bucket_name [String] name of bucket to modify
         # @param logging_status [Hash]:
-        #   * Owner [Hash]:
-        #     * ID [String]: id of owner
-        #     * DisplayName [String]: display name of owner
-        #   * AccessControlList [Array]:
-        #     * Grantee [Hash]:
-        #       * DisplayName [String] Display name of grantee
-        #       * ID [String] Id of grantee
-        #       or
-        #       * EmailAddress [String] Email address of grantee
-        #       or
-        #       * URI [String] URI of group to grant access for
-        #     * Permission [String] Permission, in [FULL_CONTROL, WRITE, WRITE_ACP, READ, READ_ACP]
+        #   * LoggingEnabled [Hash]: logging options or {} to disable
+        #     * Owner [Hash]:
+        #       * ID [String]: id of owner
+        #       * DisplayName [String]: display name of owner
+        #     * AccessControlList [Array]:
+        #       * Grantee [Hash]:
+        #         * DisplayName [String] Display name of grantee
+        #         * ID [String] Id of grantee
+        #         or
+        #         * EmailAddress [String] Email address of grantee
+        #         or
+        #         * URI [String] URI of group to grant access for
+        #       * Permission [String] Permission, in [FULL_CONTROL, WRITE, WRITE_ACP, READ, READ_ACP]
         #
         # @see http://docs.amazonwebservices.com/AmazonS3/latest/API/RESTBucketPUTlogging.html
 
@@ -37,7 +38,7 @@ DATA
     <TargetGrants>
 DATA
 
-            acl['AccessControlList'].each do |grant|
+            logging_status['AccessControlList'].each do |grant|
               data << "      <Grant>"
               type = case grant['Grantee'].keys.sort
               when ['DisplayName', 'ID']

data/lib/fog/aws/requests/sts/assume_role_with_saml.rb

@@ -0,0 +1,44 @@
+module Fog
+  module AWS
+    class STS
+      class Real
+        require 'fog/aws/parsers/sts/assume_role_with_saml'
+
+        # Assume Role with SAML
+        #
+        # ==== Parameters
+        # * role_arn<~String> - The ARN of the role the caller is assuming.
+        # * principal_arn<~String> - The Amazon Resource Name (ARN) of the SAML provider in IAM that describes the IdP.
+        # * saml_assertion<~String> - The base-64 encoded SAML authentication response provided by the IdP.
+        # * policy<~String> - An optional JSON policy document
+        # * duration<~Integer> - Duration (of seconds) for the assumed role credentials to be valid (default 3600)
+        #
+        # ==== Returns
+        # * response<~Excon::Response>:
+        #   * body<~Hash>:
+        #     * 'Arn'<~String>: The ARN of the assumed role/user
+        #     * 'AccessKeyId'<~String>: The AWS access key of the temporary credentials for the assumed role
+        #     * 'SecretAccessKey'<~String>: The AWS secret key of the temporary credentials for the assumed role
+        #     * 'SessionToken'<~String>: The AWS session token of the temporary credentials for the assumed role
+        #     * 'Expiration'<~Time>: The expiration time of the temporary credentials for the assumed role
+        #
+        # ==== See Also
+        # http://docs.aws.amazon.com/STS/latest/APIReference/API_AssumeRoleWithSAML.html
+        #
+
+        def assume_role_with_saml(role_arn, principal_arn, saml_assertion, policy=nil, duration=3600)
+          request_unsigned({
+            'Action'          => 'AssumeRoleWithSAML',
+            'RoleArn'         => role_arn,  
+            'PrincipalArn'    => principal_arn,
+            'SAMLAssertion'   => saml_assertion,
+            'Policy'          => policy && Fog::JSON.encode(policy),
+            'DurationSeconds' => duration,
+            :idempotent       => true,
+            :parser           => Fog::Parsers::AWS::STS::AssumeRoleWithSAML.new
+          })
+        end
+      end
+    end
+  end
+end

data/lib/fog/aws/signaturev4.rb

@@ -5,7 +5,7 @@ module Fog
   module AWS
     class SignatureV4
       ALGORITHM = 'AWS4-HMAC-SHA256'
-      def initialize(aws_access_key_id, secret_key, region,service)
+      def initialize(aws_access_key_id, secret_key, region, service)
         @region = region
         @service = service
         @aws_access_key_id  = aws_access_key_id
@@ -43,7 +43,7 @@ module Fog
 #{body_sha || Digest::SHA256.hexdigest(params[:body] || '')}
 DATA
         canonical_request.chop!
-        
+
         string_to_sign = <<-DATA
 #{ALGORITHM}
 #{date.to_iso8601_basic}
@@ -52,7 +52,7 @@ DATA
 DATA
 
         string_to_sign.chop!
-        
+
         signature = derived_hmac(date).sign(string_to_sign)
 
         {