fog-aws 0.11.0 → 3.18.0

data/CONTRIBUTING.md

@@ -5,14 +5,14 @@ New contributors are always welcome, when it doubt please ask questions. We stri
 ### Coding
 
 * Pick a task:
-  * Offer feedback on open [pull requests](https://github.com/fog/fog/pulls).
-  * Review open [issues](https://github.com/fog/fog/issues) for things to help on.
-  * [Create an issue](https://github.com/fog/fog/issues/new) to start a discussion on additions or features.
+  * Offer feedback on open [pull requests](https://github.com/fog/fog-aws/pulls).
+  * Review open [issues](https://github.com/fog/fog-aws/issues) for things to help on.
+  * [Create an issue](https://github.com/fog/fog-aws/issues/new) to start a discussion on additions or features.
 * Fork the project, add your changes and tests to cover them in a topic branch.
-* Commit your changes and rebase against `fog/fog` to ensure everything is up to date.
-* [Submit a pull request](https://github.com/fog/fog/compare/).
+* Commit your changes and rebase against `fog/fog-aws` to ensure everything is up to date.
+* [Submit a pull request](https://github.com/fog/fog-aws/compare/).
 
 ### Non-Coding
 
-* Offer feedback on open [issues](https://github.com/fog/fog/issues).
+* Offer feedback on open [issues](https://github.com/fog/fog-aws/issues).
 * Organize or volunteer at events.

data/CONTRIBUTORS.md

@@ -1,5 +1,108 @@
+* Aakash Shah <ashah@pivotal.io>
+* Aaron Stone <aaron@serendipity.cx>
+* Akira Matsuda <ronnie@dio.jp>
+* Alessandro Lepore <lepore.ale@gmail.com>
+* Alex Coomans <alex@alexcoomans.com>
+* Alexander Stuart-Kregor <easkay@me.com>
+* Andrew Kane <acekane1@gmail.com>
+* Anthony Mangano <anthony@backupify.com>
+* Ayumi Yu <ayumi@ayumiyu.com>
+* Ben Balter <ben.balter@github.com>
+* Benjamin Pillet <ben_pillet@yahoo.com>
+* Brett Cave <brett@cave.za.net>
+* Brian Nelson <mrpoundsign@gmail.com>
+* Caged <justin@labratrevenge.com>
+* Carlos Lima <carlos@cpan.org>
+* Chanakya Devraj <chanakya.devraj@cuelogic.co.in>
+* Corey Donohoe <atmos@atmos.org>
+* Craig Genner <craig.genner@piksel.com>
+* Damien Mathieu <damien@heroku.com>
+* Dan Brooking <dbrooking@datapipe.com>
+* Dan Rogers <drogers@popsugar.com>
+* Daniel Farina <daniel@heroku.com>
+* Danny Guinther <danny@backupify.com>
+* David Judd <david@academia.edu>
+* David Vaz <david.ferd.vaz@gmail.com>
+* Decklin Foster <decklin@red-bean.com>
+* Duarte Henriques <duarte.henriques@seedrs.com>
+* Ed Healy <ehealy@gmail.com>
+* Eddie Johnston <eddie@beanstalk.ie>
+* Eric Herot <eric.github@herot.com>
+* Esther Villars <esthervillars@gmail.com>
+* Eugene Howe <eugene@xtreme-computers.net>
+* Freddy Chu <freddy@expressvpn.com>
 * Frederick Cheung <frederick.cheung@gmail.com>
+* GitHub <noreply@github.com>
+* Greg Burek <greg.burek@gmail.com>
+* Grey Baker <greysteil@gmail.com>
+* Huang Yaming <yumminhuang@gmail.com>
+* ICHII Takashi <ichii386@schweetheart.jp>
+* Jack Thomas <jack@scalefactory.com>
+* Jacob Burkhart <jburkhart@engineyard.com>
+* James Muscat <james.muscat@alces-software.com>
+* James Myers <jfmyers9@gmail.com>
+* James Rucker <james.rucker@legitscript.com>
+* Jon-Erik Schneiderhan <jon-erik.schneiderhan@meyouhealth.com>
+* Jonathan Hanson <jonathan@jonathan-hanson.org>
+* Jose Luis Salas <josacar@gmail.com>
+* Josh Lane & Michelle Noorali <jlane@engineyard.com>
+* Josh Lane & Michelle Noorali <michellemolu@gmail.com>
+* Josh Lane <jlane@engineyard.com>
 * Josh Lane <lanej@users.noreply.github.com>
 * Josh Lane <me@joshualane.com>
+* Joshua Lane <me@joshualane.com>
+* Kevin Loiseau <k.loiseauand@gmail.com>
+* KevinLoiseau <k.loiseauand@gmail.com>
+* Khoa Nguyen <khoan@Khoas-MacBook-Pro.local>
+* Kirk Haines <khaines@engineyard.com>
+* Kristoffer Roupé <kitofr@gmail.com>
+* Liu zhitong <z.liu@linkbynet.com>
+* Luciano Sousa <ls@lucianosousa.net>
+* Martin Forssen <maf@recordedfuture.com>
+* Mathew Kamkar <matkam@gmail.com>
+* Matthew O'Riordan <matthew.oriordan@gmail.com>
+* Michael Hale <mike@hales.ws>
+* Michael Sawyer <michael.sawyer@veeva.com>
+* Michal Tekel <mtekel@gmail.com>
+* Michelle Noorali & Josh Lane <mnoorali@engineyard.com>
+* Michelle Noorali <michellemolu@gmail.com>
+* Miguel Landaeta <miguel@miguel.cc>
+* Miguel Landaeta <miguel@restorando.com>
+* Miguel Landaeta <nomadium@gmail.com>
+* Milad Rastian <milad@sam-media.com>
+* Moritz Siuts <m.siuts@emetriq.com>
+* Nawaid Shamim <me@nawaidshamim.com>
+* Neill Turner <neill.turner@immediate.co.uk>
+* Nicholas Fowler <nbfowler@gmail.com>
+* Nicholas Klick <nicholas.klick@gmail.com>
+* Nilanjan Roy <nilanjan.roy@nosto.com>
+* Paulo Henrique Lopes Ribeiro <plribeiro3000@gmail.com>
+* Paulo Ribeiro <plribeiro3000@gmail.com>
+* Pedro Matos Monteiro <pedro.matos.monteiro@gmail.com>
+* Puneet Loya <ploya@Asperas-Master-MacBook-Pro.local>
+* Robert von Massow <r.vonmassow@emetriq.com>
+* Rocco Galluzzo <rocco@galluzzo.me>
+* Rodrigo de Almeida Pereira <contato@rodrigo-pereira.net>
+* Ryan Schlesinger <ryan@ryanschlesinger.com>
+* Ryunosuke SATO <tricknotes.rs@gmail.com>
+* Sergey Bahchissaraitsev <sergey@bahchis.com>
+* Shai Rosenfeld <shai.rosenfeld@autodesk.com>
+* Shuhei Kagawa <shuhei.kagawa@gmail.com>
+* Suraj Shirvankar <surajshirvankar@gmail.com>
+* Todd Willey <xtoddx@gmail.com>
+* Ville Lautanala <lautis@gmail.com>
+* Vlad Yarotsky <vlad@remind101.com>
+* Vít Ondruch <vondruch@redhat.com>
 * Wesley Beary <geemus@gmail.com>
-* geemus <geemus@gmail.com>
+* Yaming Huang <yumminhuang@gmail.com>
+* Yusuke Ebihara <biibiebi1234@gmail.com>
+* chanakya devraj <chanakya.devraj@cuelogic.co.in>
+* chanakyad-cuelogic <chanakya.devraj@cuelogic.co.in>
+* ddoc <bgalura@gmail.com>
+* geemus <geemus@gmail.com>
+* huming <humings@gmail.com>
+* miliao <mliao@adobe.com>
+* mrloop <ewan@mrloop.com>
+* nob.murakita <nobmurakita@users.noreply.github.com>
+* solud <jon@joncole.com>
+* starbelly <starbelly@pobox.com>

data/LICENSE.md

@@ -1,6 +1,6 @@
 The MIT License (MIT)
 
-Copyright (c) 2014-2015 [CONTRIBUTORS.md](https://github.com/fog/fog/blob/master/CONTRIBUTORS.md)
+Copyright (c) 2014-2019 [CONTRIBUTORS.md](https://github.com/fog/fog-aws/blob/master/CONTRIBUTORS.md)
 
 Permission is hereby granted, free of charge, to any person obtaining a copy of
 this software and associated documentation files (the "Software"), to deal in

data/README.md

@@ -1,12 +1,10 @@
 # Fog::Aws
 
 ![Gem Version](https://badge.fury.io/rb/fog-aws.svg)
-[![Build Status](https://travis-ci.org/fog/fog-aws.svg?branch=master)](https://travis-ci.org/fog/fog-aws)
-[![Dependency Status](https://gemnasium.com/fog/fog-aws.svg)](https://gemnasium.com/fog/fog-aws)
+[![Build Status](https://github.com/fog/fog-aws/actions/workflows/ruby.yml/badge.svg)](https://github.com/fog/fog-aws/actions/workflows/ruby.yml)
 [![Test Coverage](https://codeclimate.com/github/fog/fog-aws/badges/coverage.svg)](https://codeclimate.com/github/fog/fog-aws)
 [![Code Climate](https://codeclimate.com/github/fog/fog-aws.svg)](https://codeclimate.com/github/fog/fog-aws)
 
-
 ## Installation
 
 Add this line to your application's Gemfile:
@@ -39,7 +37,10 @@ default:
   aws_secret_access_key: <YOUR_SECRET_ACCESS_KEY>
 ```
 
-### Connecting to EC2 service
+### EC2
+
+#### Connecting to the EC2 Service:
+
 ```ruby
 ec2 = Fog::Compute.new :provider => 'AWS', :region => 'us-west-2'
 ```
@@ -50,7 +51,7 @@ You can review all the requests available with this service using ```#requests``
 ec2.requests # => [:allocate_address, :assign_private_ip_addresses, :associate_address, ...]
 ```
 
-### Launch an EC2 on-demand instance:
+#### Launch an EC2 on-demand instance:
 
 ```ruby
 response = ec2.run_instances(
@@ -67,14 +68,127 @@ instance.wait_for { ready? }
 puts instance.public_ip_address # => "356.300.501.20"
 ```
 
-### Terminate an EC2 instance:
+#### Terminate an EC2 instance:
 
 ```ruby
 instance = ec2.servers.get("i-02db5af4")
 instance.destroy
 ```
 
-Fog::AWS is more than EC2 since it supports many services provided by AWS. The best way to learn and to know about how many services are supported is to take a look at the source code. To review the tests directory and to play with the library in ```irb``` can be very helpful resources as well.
+`Fog::AWS` is more than EC2 since it supports many services provided by AWS. The best way to learn and to know about how many services are supported is to take a look at the source code. To review the tests directory and to play with the library in ```bin/console``` can be very helpful resources as well.
+
+### S3
+
+#### Connecting to the S3 Service:
+
+```ruby
+s3 = Fog::Storage.new(provider: 'AWS', region: 'eu-central-1')
+```
+
+#### Creating a file:
+
+```ruby
+directory = s3.directories.new(key: 'gaudi-portal-dev')
+file = directory.files.create(key: 'user/1/Gemfile', body: File.open('Gemfile'), tags: 'Org-Id=1&Service-Name=My-Service')
+```
+
+#### Listing files:
+
+```ruby
+directory = s3.directories.get('gaudi-portal-dev', prefix: 'user/1/')
+directory.files
+```
+**Warning!** `s3.directories.get` retrieves and caches meta data for the first 10,000 objects in the bucket, which can be very expensive. When possible use `s3.directories.new`.
+
+#### Generating a URL for a file:
+
+```ruby
+directory.files.new(key: 'user/1/Gemfile').url(Time.now + 60)
+```
+
+##### Generate download URL
+You should pass an option argument that contains the `query` key with `response-content-disposition` inside indicating that is an attachment and the filename to be used when downloaded.
+
+```ruby
+options = {
+  query: {
+    'response-content-disposition' => "attachment; filename=#{key}"
+  }
+}
+
+directory.files.new(key: 'user/1/Gemfile').url(Time.now + 60, options)
+```
+
+
+##### Controlling credential refresh time with IAM authentication
+
+When using IAM authentication with
+[temporary security credentials](https://docs.aws.amazon.com/STS/latest/APIReference/API_AssumeRoleWithWebIdentity.html),
+generated S3 pre-signed URLs
+[only last as long as the temporary credential](https://docs.aws.amazon.com/AmazonS3/latest/userguide/ShareObjectPreSignedURL.html).
+
+Generating the URLs in the following manner will return a URL
+that will not last as long as its requested expiration time if
+the remainder of the authentication token lifetime was shorter.
+
+```ruby
+s3 = Fog::Storage.new(provider: 'AWS', use_iam_profile: true)
+directory = s3.directories.get('gaudi-portal-dev', prefix: 'user/1/')
+
+directory.files.new(key: 'user/1/Gemfile').url(Time.now + 60)
+```
+
+By default the temporary credentials in use are refreshed only within the last
+15 seconds of its expiration time. The URL requested with 60 seconds lifetime
+using the above example will only remain valid for 15 seconds in the worst case.
+
+The problem can be avoided by refreshing the token early and often,
+by setting configuration `aws_credentials_refresh_threshold_seconds` (default: 15)
+which controls the time when the refresh must occur. It is expressed in seconds
+before the temporary credential's expiration time.
+
+The following example can ensure pre-signed URLs last as long as 60 seconds
+by automatically refreshing the credentials when its remainder lifetime
+is lower than 60 seconds:
+
+```ruby
+s3 = Fog::Storage.new(
+  provider: 'AWS',
+  use_iam_profile: true,
+  aws_credentials_refresh_threshold_seconds: 60
+)
+directory = s3.directories.get('gaudi-portal-dev', prefix: 'user/1/')
+
+directory.files.new(key: 'user/1/Gemfile').url(Time.now + 60)
+```
+
+#### Copying a file
+
+```ruby
+directory = s3.directories.new(key: 'gaudi-portal-dev')
+file = directory.files.get('user/1/Gemfile')
+file.copy("target-bucket", "user/2/Gemfile.copy")
+```
+
+To speed transfers of large files, the `concurrency` option can be used
+to spawn multiple threads. Note that the file must be at least 5 MB for
+multipart uploads to work. For example:
+
+```ruby
+directory = s3.directories.new(key: 'gaudi-portal-dev')
+file = directory.files.get('user/1/Gemfile')
+file.multipart_chunk_size = 10 * 1024 * 1024
+file.concurrency = 10
+file.copy("target-bucket", "user/2/Gemfile.copy")
+```
+
+## Documentation
+
+See the [online documentation](http://www.rubydoc.info/github/fog/fog-aws) for a complete API reference.
+
+## Development
+
+After checking out the repo, run `bin/setup` to install dependencies. Then, run `rake test` to run the tests. You can also run `bin/console` for an interactive prompt that will allow you to experiment.
 
 ## Contributing
 

data/fog-aws.gemspec

@@ -14,18 +14,21 @@ Gem::Specification.new do |spec|
   spec.homepage      = "https://github.com/fog/fog-aws"
   spec.license       = "MIT"
 
-  spec.files         = `git ls-files -z`.split("\x0")
-  spec.executables   = spec.files.grep(%r{^bin/}) { |f| File.basename(f) }
-  spec.test_files    = spec.files.grep(%r{^(test|spec|features)/})
+  spec.files         = Dir['lib/**/*.{rb,json}',
+                           'CHANGELOG.md', 'CONTRIBUTING.md', 'CONTRIBUTORS.md',
+                           'LICENSE.md', 'README.md', 'fog-aws.gemspec',]
+  spec.executables   = spec.files.grep(%r{^exe/}) { |f| File.basename(f) }
   spec.require_paths = ["lib"]
 
-  spec.add_development_dependency 'bundler', '~> 1.6'
-  spec.add_development_dependency 'rake',    '~> 10.0'
+  spec.required_ruby_version = '>= 2.0.0'
+
+  spec.add_development_dependency 'bundler'
+  spec.add_development_dependency 'github_changelog_generator', '~> 1.16'
+  spec.add_development_dependency 'rake',    '>= 12.3.3'
+  spec.add_development_dependency 'rubyzip', '~> 2.3.0'
   spec.add_development_dependency 'shindo',  '~> 0.3'
-  spec.add_development_dependency 'rubyzip', '~> 0.9.9'
 
-  spec.add_dependency 'fog-core',  '~> 1.38'
-  spec.add_dependency 'fog-json',  '~> 1.0'
+  spec.add_dependency 'fog-core',  '~> 2.1'
+  spec.add_dependency 'fog-json',  '~> 1.1'
   spec.add_dependency 'fog-xml',   '~> 0.1'
-  spec.add_dependency 'ipaddress', '~> 0.8'
 end

data/lib/fog/aws/auto_scaling.rb

@@ -12,6 +12,7 @@ module Fog
 
       request_path 'fog/aws/requests/auto_scaling'
       request :attach_load_balancers
+      request :attach_load_balancer_target_groups
       request :create_auto_scaling_group
       request :create_launch_configuration
       request :create_or_update_tags
@@ -35,6 +36,7 @@ module Fog
       request :describe_tags
       request :describe_termination_policy_types
       request :detach_load_balancers
+      request :detach_load_balancer_target_groups
       request :detach_instances
       request :attach_instances
       request :disable_metrics_collection
@@ -46,6 +48,7 @@ module Fog
       request :resume_processes
       request :set_desired_capacity
       request :set_instance_health
+      request :set_instance_protection
       request :suspend_processes
       request :terminate_instance_in_auto_scaling_group
       request :update_auto_scaling_group
@@ -162,7 +165,7 @@ module Fog
                   when 'ResourceInUse'
                     Fog::AWS::AutoScaling::ResourceInUse.slurp(error, match[:message])
                   when 'ValidationError'
-                    Fog::AWS::AutoScaling::ValidationError.slurp(error, match[:message])
+                    Fog::AWS::AutoScaling::ValidationError.slurp(error, CGI.unescapeHTML(match[:message]))
                   else
                     Fog::AWS::AutoScaling::Error.slurp(error, "#{match[:code]} => #{match[:message]}")
                   end

data/lib/fog/aws/cdn.rb

@@ -1,6 +1,6 @@
 module Fog
-  module CDN
-    class AWS < Fog::Service
+  module AWS
+    class CDN < Fog::Service
       extend Fog::AWS::CredentialFetcher::ServiceMethods
 
       requires :aws_access_key_id, :aws_secret_access_key
@@ -200,4 +200,17 @@ EOF
       end
     end
   end
+
+  # @deprecated
+  module CDN
+    # @deprecated
+    class AWS < Fog::AWS::CDN
+      # @deprecated
+      # @overrides Fog::Service.new (from the fog-core gem)
+      def self.new(*)
+        Fog::Logger.deprecation 'Fog::CDN::AWS is deprecated, please use Fog::AWS::CDN.'
+        super
+      end
+    end
+  end
 end

data/lib/fog/aws/cloud_formation.rb

@@ -7,14 +7,28 @@ module Fog
       recognizes :host, :path, :port, :scheme, :persistent, :region, :use_iam_profile, :aws_session_token, :aws_credentials_expire_at, :instrumentor, :instrumentor_name
 
       request_path 'fog/aws/requests/cloud_formation'
+      request :cancel_update_stack
+      request :continue_update_rollback
+      request :create_change_set
       request :create_stack
       request :update_stack
+      request :delete_change_set
       request :delete_stack
+      request :describe_account_limits
+      request :describe_change_set
       request :describe_stack_events
+      request :describe_stack_resource
       request :describe_stack_resources
       request :describe_stacks
+      request :estimate_template_cost
+      request :execute_change_set
+      request :get_stack_policy
       request :get_template
+      request :get_template_summary
+      request :set_stack_policy
+      request :signal_resource
       request :validate_template
+      request :list_change_sets
       request :list_stacks
       request :list_stack_resources