fmalamitsas-aws-s3 0.6.2.1254423625

data/CHANGELOG

@@ -0,0 +1,107 @@
+head:
+
+- Fix that S3Object.stream raises NoSuchKey exception when trying to stream an object that doesn't exist.
+
+0.6.2:
+
+- Apparently need to use custom __method__ in Ruby versions right up to 1.8.7.
+
+0.6.1:
+
+- Use custom __method__ in Ruby versions *prior* to 1.8.7 not *up to* 1.8.7.
+
+- Rename Kernel#memoize to Kernel#expirable_memoize so that it doesn't conflict with memoize method in ActiveSupport which has an entirely different API and semantics. Reported by [Florian Dütsc (mail@florian-duetsch.de)].
+
+0.6.0:
+
+- Full 1.9 compatibility (all tests passing against 1.9 & 1.8.6). Thanks to [David (dvdplm@gmail.com), Cyril David (cyx.ucron@gmail.com)]
+
+0.5.1:
+
+- For now just redefine __method__ to take arguments so we don't break 1.8.7 use today
+
+0.5.0:
+
+- Bug #17458 fixed. Normalize the :expires_in option to always be an integer even if the actual object passed in is a proxy to an integer, such as is the case with 2.hours from ActiveSupport which is actually an instance of ActiveSupport::Duration. Reported by [Steve Kickert steve@riverocktech.com]
+
+- Bug #19158 fixed. Don't prepend leading slash onto bucket name when deleting a bucket with the :force => true option.
+
+- Bug #17628 fixed. Don't ignore :use_ssl => false in url_for when the connection is established over ssl. Reported by [Tom Fixed (tkat11)]
+
+- Bug #13052 fixed. Appease some proxies by always including a Content-Length with all requests. Reported by [James Murty (jmurty)]
+
+- Bug #13756 fixed. Attributes that are false should not raise NoMethodError in Base#method_missing. Fixed by [Scott Patten]
+
+- Bug #19189 fixed. No longer reference Date::ABBR_MONTHS constant which was removed in Ruby 1.8.6. Reported by [Khurram Virani (kvirani)]
+
+- Bug #20487 fixed. If a request fails and is retried, only escape the request path the first time. Reported by [anonymous]
+
+- Replace ad-hoc S3Object.copy method with newly support built in API call.
+
+- Do not make connections persistent by default. This "feature" causes far more broken pipes than it is worth. Use with caution.
+
+0.4.0:
+
+- Various adjustments to connection handling to try to mitigate exceptions raised from deep within Net::HTTP.
+
+- Don't coerce numbers that start with a zero because the zero will be lost. If a bucket, for example, has a name like '0815', all operation it will fail. Closes ticket #10089 [reported anonymously]"
+
+- Add ability to connect through a proxy using the :proxy option when establishing a connection. Suggested by [Simon Horne <simon@soulware.co.uk>]
+
+- Add :authenticated option to url_for. When passing false, don't generate signature parameters for query string.
+
+- Make url_for accept custom port settings. [Rich Olson] 
+
+0.3.0:
+
+- Ensure content type is eventually set to account for changes made to Net::HTTP in Ruby version 1.8.5. Reported by [David Hanson, Stephen Caudill, Tom Mornini <tmornini@engineyard.com>]
+
+- Add :persistent option to connections which keeps a persistent connection rather than creating a new one per request, defaulting to true. Based on a patch by [Metalhead <metalhead@metalhead.ws>]
+
+- If we are retrying a request after rescuing one of the retry exceptions, rewind the body if its an IO stream so it starts at the beginning. [Jamis Buck]
+
+- Ensure that all paths being submitted to S3 are valid utf8. If they are not, we remove the extended characters. Ample help from [Jamis Buck]
+
+- Wrap logs in Log objects which exposes each line as a Log::Line that has accessors by name for each field.
+
+- Various performance optimizations for the extensions code. [Roman LE NEGRATE <roman2k@free.fr>]
+
+- Make S3Object.copy more efficient by streaming in both directions in parallel.
+
+- Open up Net:HTTPGenericRequest to make the chunk size 1 megabyte, up from 1 kilobyte.
+
+- Add S3Object.exists?
+
+0.2.1:
+
+- When the bucket name argument (for e.g. Bucket.objects) is being used as the option hash, reassign it to the options variable and set the bucket to nil so bucket inference + options works.
+
+- Don't call CGI.escape on query string parameters in Hash#to_query_string since all paths get passed through URI.escape right before the request is made. Paths were getting double escaped. Bug spotted by [David Hanson]
+
+- Make s3sh exec irb.bat if on Windows. Bug spotted by [N. Sathish Kumar <nsathishk@yahoo.com>]
+
+- Avoid class_variable_(get|set) since it was only recently added to Ruby. Spotted by [N. Sathish Kumar <nsathishk@yahoo.com>]
+
+- Raise NoSuchKey if S3Object.about requests a key that does not exist.
+
+- If the response body is an empty string, don't try to parse it as xml.
+
+- Don't reject every body type save for IO and String at the door when making a request. Suggested by [Alex MacCaw <maccman@gmail.com>]
+
+- Allow dots in bucket names. [Jesse Newland]
+
+0.2.0:
+
+- Infer content type for an object when calling S3Object.store without explicitly passing in the :content_type option.
+
+0.1.2:
+
+- Scrap (overly) fancy generator based version of CoercibleString with a much simpler and clearer case statement. Continuations are really slow and the specific use of the generator was leaking memory. Bug spotted by [Remco van't Veer]
+
+0.1.1:
+
+- Don't add the underscore method to String if it is already defined (like, for example, from ActiveSupport). Bug spotted by [Matt White <stockliasteroid@gmail.com>]
+
+0.1.0:
+
+- Initial public release

data/COPYING

@@ -0,0 +1,19 @@
+#
+# Copyright (c) 2006-2009 Marcel Molina Jr. <marcel@vernix.org>
+# 
+# Permission is hereby granted, free of charge, to any person obtaining a copy of
+# this software and associated documentation files (the "Software"), to deal in the
+# Software without restriction, including without limitation the rights to use,
+# copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the
+# Software, and to permit persons to whom the Software is furnished to do so,
+# subject to the following conditions:
+# 
+# The above copyright notice and this permission notice shall be included in all
+# copies or substantial portions of the Software.
+# 
+# THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+# IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS
+# FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR
+# COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN
+# AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
+# WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

data/INSTALL

@@ -0,0 +1,55 @@
+== Rubygems
+
+The easiest way to install aws/s3 is with Rubygems:
+
+  % sudo gem i aws-s3 -ry
+ 
+== Directly from svn
+
+ % svn co svn://rubyforge.org/var/svn/amazon/s3/trunk aws
+
+== As a Rails plugin
+
+If you want to use aws/s3 with a Rails application, you can export the repository
+into your plugins directory and then check it in: 
+
+  % cd my-rails-application/vendor/plugins
+  % svn export svn://rubyforge.org/var/svn/amazon/s3/trunk aws
+  % svn add aws
+  
+Or you could pull it down with an svn:externals:
+
+  % cd my-rails-application/vendor/plugins
+  % svn propedit svn:externals .
+  
+Then add the following line, save and exit:
+
+  aws svn://rubyforge.org/var/svn/amazon/s3/trunk
+  
+If you go the svn route, be sure that you have all the dependencies installed. The list of dependencies follow.
+  
+== Dependencies
+
+AWS::S3 requires Ruby 1.8.4 or greater. 
+
+It also has the following dependencies:
+
+  sudo gem i xml-simple -ry
+  sudo gem i builder    -ry
+  sudo gem i mime-types -ry
+
+=== XML parsing (xml-simple)
+
+AWS::S3 depends on XmlSimple (http://xml-simple.rubyforge.org/). When installing aws/s3 with
+Rubygems, this dependency will be taken care of for you. Otherwise, installation instructions are listed on the xml-simple
+site.
+
+If your system has the Ruby libxml bindings installed (http://libxml.rubyforge.org/) they will be used instead of REXML (which is what XmlSimple uses). For those concerned with speed and efficiency, it would behoove you to install libxml (instructions here: http://libxml.rubyforge.org/install.html) as it is considerably faster and less expensive than REXML.
+
+=== XML generation (builder)
+
+AWS::S3 also depends on the Builder library (http://builder.rubyforge.org/ and http://rubyforge.org/projects/builder/). This will also automatically be installed for you when using Rubygems.
+
+=== Content type inference (mime-types)
+
+AWS::S3 depends on the MIME::Types library (http://mime-types.rubyforge.org/) to infer the content type of an object that does not explicitly specify it. This library will automatically be installed for you when using Rubygems.

data/README.erb

@@ -0,0 +1,58 @@
+= AWS::S3
+
+<%= docs_for['AWS::S3'] %>
+
+== AWS::S3 Basics
+=== The service, buckets and objects
+
+The three main concepts of S3 are the service, buckets and objects. 
+
+==== The service
+
+<%= docs_for['AWS::S3::Service'] %>
+ 
+==== Buckets
+
+<%= docs_for['AWS::S3::Bucket'] %>
+
+==== Objects
+
+<%= docs_for['AWS::S3::S3Object'] %>
+
+==== Streaming uploads
+
+<%= docs_for['AWS::S3::S3Object::store'] %>
+
+== Setting the current bucket
+==== Scoping operations to a specific bucket
+
+<%= docs_for['AWS::S3::Base.set_current_bucket_to'] %>
+
+== BitTorrent
+==== Another way to download large files
+
+<%= docs_for['AWS::S3::BitTorrent'] %>
+
+== Access control
+==== Using canned access control policies
+
+<%= docs_for['AWS::S3::ACL'] %>
+
+==== Accessing private objects from a browser
+
+<%= docs_for['AWS::S3::S3Object.url_for'] %>
+
+== Logging
+==== Tracking requests made on a bucket
+
+<%= docs_for['AWS::S3::Logging'] %>
+
+== Errors
+==== When things go wrong
+
+<%= docs_for['AWS::S3::Error'] %>
+
+==== Accessing the last request's response
+
+<%= docs_for['AWS::S3::Service.response'] %>
+  

data/Rakefile

@@ -0,0 +1,334 @@
+require 'rubygems'
+require 'rake'
+require 'rake/testtask'
+require 'rake/rdoctask'
+require 'rake/packagetask'
+require 'rake/gempackagetask'
+
+require File.dirname(__FILE__) + '/lib/aws/s3'
+
+def library_root
+  File.dirname(__FILE__)
+end
+
+task :default => :test
+
+Rake::TestTask.new do |test|
+  test.pattern = 'test/*_test.rb'
+  test.verbose = true
+end
+
+namespace :doc do
+  Rake::RDocTask.new do |rdoc|  
+    rdoc.rdoc_dir = 'doc'  
+    rdoc.title    = "AWS::S3 -- Support for Amazon S3's REST api"  
+    rdoc.options << '--line-numbers' << '--inline-source'
+    rdoc.rdoc_files.include('README')
+    rdoc.rdoc_files.include('COPYING')
+    rdoc.rdoc_files.include('INSTALL')    
+    rdoc.rdoc_files.include('lib/**/*.rb')
+  end
+  
+  task :rdoc => 'doc:readme'
+  
+  task :refresh => :rerdoc do
+    system 'open doc/index.html'
+  end
+
+  task :readme do
+    require 'support/rdoc/code_info'
+    RDoc::CodeInfo.parse('lib/**/*.rb')
+    
+    strip_comments = lambda {|comment| comment.gsub(/^# ?/, '')}
+    docs_for       = lambda do |location| 
+      info = RDoc::CodeInfo.for(location)
+      raise RuntimeError, "Couldn't find documentation for `#{location}'" unless info
+      strip_comments[info.comment]
+    end
+    
+    open('README', 'w') do |file|
+      file.write ERB.new(IO.read('README.erb')).result(binding)
+    end
+  end
+  
+  task :deploy => :rerdoc do
+    sh %(scp -r doc marcel@rubyforge.org:/var/www/gforge-projects/amazon/)
+  end
+end
+
+namespace :dist do  
+  spec = Gem::Specification.new do |s|
+    s.name              = 'aws-s3'
+    s.version           = Gem::Version.new(AWS::S3::Version)
+    s.summary           = "Client library for Amazon's Simple Storage Service's REST API"
+    s.description       = s.summary
+    s.email             = 'marcel@vernix.org'
+    s.author            = 'Marcel Molina Jr.'
+    s.has_rdoc          = true
+    s.extra_rdoc_files  = %w(README COPYING INSTALL)
+    s.homepage          = 'http://amazon.rubyforge.org'
+    s.rubyforge_project = 'amazon'
+    s.files             = FileList['Rakefile', 'lib/**/*.rb', 'bin/*', 'support/**/*.rb']
+    s.executables       << 's3sh'
+    s.test_files        = Dir['test/**/*']
+    
+    s.add_dependency 'xml-simple'
+    s.add_dependency 'builder'
+    s.add_dependency 'mime-types'
+    s.rdoc_options  = ['--title', "AWS::S3 -- Support for Amazon S3's REST api",
+                       '--main',  'README',
+                       '--line-numbers', '--inline-source']
+  end
+    
+  # Regenerate README before packaging
+  task :package => 'doc:readme'
+  Rake::GemPackageTask.new(spec) do |pkg|
+    pkg.need_tar_gz = true
+    pkg.package_files.include('{lib,script,test,support}/**/*')
+    pkg.package_files.include('README')
+    pkg.package_files.include('COPYING')
+    pkg.package_files.include('INSTALL')
+    pkg.package_files.include('Rakefile')
+  end
+  
+  desc 'Install with gems'
+  task :install => :repackage do
+    sh "sudo gem i pkg/#{spec.name}-#{spec.version}.gem"
+  end
+  
+  desc 'Uninstall gem'
+  task :uninstall do
+    sh "sudo gem uninstall #{spec.name} -x"
+  end
+  
+  desc 'Reinstall gem'
+  task :reinstall => [:uninstall, :install]
+  
+  task :confirm_release do
+    print "Releasing version #{spec.version}. Are you sure you want to proceed? [Yn] "
+    abort if STDIN.getc == ?n
+  end
+  
+  desc 'Tag release'
+  task :tag do
+    sh %(git tag -a '#{spec.version}-release' -m 'Tagging #{spec.version} release')
+    sh 'git push --tags'
+  end
+  
+  desc 'Update changelog to include a release marker'
+  task :add_release_marker_to_changelog do
+    changelog = IO.read('CHANGELOG')
+    changelog.sub!(/^head:/, "#{spec.version}:")
+    
+    open('CHANGELOG', 'w') do |file|
+      file.write "head:\n\n#{changelog}"
+    end
+  end
+  
+  task :commit_changelog do
+    sh %(git commit CHANGELOG -m "Bump changelog version marker for release")
+    sh 'git push'
+  end
+  
+  package_name = lambda {|specification| File.join('pkg', "#{specification.name}-#{specification.version}")}
+  
+  desc 'Push a release to rubyforge'
+  task :release => [:confirm_release, :clean, :add_release_marker_to_changelog, :package, :commit_changelog, :tag] do 
+    require 'rubyforge'
+    package = package_name[spec]
+
+    rubyforge = RubyForge.new.configure
+    rubyforge.login
+    
+    user_config = rubyforge.userconfig
+    user_config['release_changes'] = YAML.load_file('CHANGELOG')[spec.version.to_s].join("\n")
+  
+    version_already_released = lambda do
+      releases = rubyforge.autoconfig['release_ids']
+      releases.has_key?(spec.name) && releases[spec.name][spec.version.to_s]
+    end
+    
+    abort("Release #{spec.version} already exists!") if version_already_released.call
+    
+    begin
+      rubyforge.add_release(spec.rubyforge_project, spec.name, spec.version.to_s, "#{package}.tar.gz", "#{package}.gem")
+      puts "Version #{spec.version} released!"
+    rescue Exception => exception
+      puts 'Release failed!'
+      raise
+    end
+  end
+  
+  desc 'Upload a beta gem'
+  task :push_beta_gem => [:clobber_package, :package] do
+    beta_gem = package_name[spec]
+    sh %(scp #{beta_gem}.gem  marcel@rubyforge.org:/var/www/gforge-projects/amazon/beta)
+  end
+  
+  task :spec do
+    puts spec.to_ruby
+  end
+end
+
+desc 'Check code to test ratio'
+task :stats do 
+  library_files = FileList["#{library_root}/lib/**/*.rb"]
+  test_files    = FileList["#{library_root}/test/**/*_test.rb"]
+  count_code_lines = Proc.new do |lines| 
+    lines.inject(0) do |code_lines, line|
+      next code_lines if [/^\s*$/, /^\s*#/].any? {|non_code_line| non_code_line === line}
+      code_lines + 1
+    end
+  end
+  
+  count_code_lines_for_files = Proc.new do |files|
+    files.inject(0) {|code_lines, file| code_lines + count_code_lines[IO.read(file)]}
+  end
+  
+  library_code_lines = count_code_lines_for_files[library_files]
+  test_code_lines    = count_code_lines_for_files[test_files]
+  ratio = Proc.new { sprintf('%.2f', test_code_lines.to_f / library_code_lines)}
+  
+  puts "Code LOC: #{library_code_lines}    Test LOC: #{test_code_lines}    Code to Test Ratio: 1:#{ratio.call}"
+end
+
+namespace :test do
+  find_file = lambda do |name|
+    file_name = lambda {|path| File.join(path, "#{name}.rb")}
+    root = $:.detect do |path|
+      File.exist?(file_name[path])
+    end
+    file_name[root] if root
+  end
+  
+  TEST_LOADER = find_file['rake/rake_test_loader']
+  multiruby   = lambda do |glob|
+    system 'multiruby', TEST_LOADER, *Dir.glob(glob)
+  end
+    
+  desc 'Check test coverage'
+  task :coverage do
+    system("rcov -x Library -x support --sort coverage #{File.join(library_root, 'test/*_test.rb')}")
+    show_test_coverage_results
+  end
+  
+  Rake::TestTask.new(:remote) do |test|
+    test.pattern = 'test/remote/*_test.rb'
+    test.verbose = true
+  end
+  
+  Rake::TestTask.new(:all) do |test|
+    test.pattern = 'test/**/*_test.rb'
+    test.verbose = true
+  end
+
+  desc 'Check test coverage of full stack remote tests'
+  task :full_coverage do
+    system("rcov -x Library -x support --sort coverage #{File.join(library_root, 'test/remote/*_test.rb')} #{File.join(library_root, 'test/*_test.rb')}")
+    show_test_coverage_results
+  end
+  
+  desc 'Run local tests against multiple versions of Ruby'
+  task :version_audit do
+    multiruby['test/*_test.rb']
+  end
+  
+  namespace :version_audit do
+    desc 'Run remote tests against multiple versions of Ruby'
+    task :remote do
+      multiruby['test/remote/*_test.rb']
+    end
+    
+    desc 'Run all tests against multiple versions of Ruby'
+    task :all do
+      multiruby['test/**/*_test.rb']
+    end
+  end
+  
+  def show_test_coverage_results
+    system("open #{File.join(library_root, 'coverage/index.html')}") if PLATFORM['darwin']
+  end
+  
+  desc 'Remove coverage products'
+  task :clobber_coverage do
+    rm_r 'coverage' rescue nil
+  end
+end
+
+namespace :todo do
+  class << TODOS = IO.read(File.join(library_root, 'TODO'))
+    def items
+      split("\n").grep(/^\[\s|X\]/)
+    end
+    
+    def completed
+      find_items_matching(/^\[X\]/)
+    end
+    
+    def uncompleted
+      find_items_matching(/^\[\s\]/)
+    end
+        
+    def find_items_matching(regexp)
+      items.grep(regexp).instance_eval do
+        def display
+          puts map {|item| "* #{item.sub(/^\[[^\]]\]\s/, '')}"}
+        end
+        self
+      end
+    end
+  end
+  
+  desc 'Completed todo items'
+  task :completed do
+    TODOS.completed.display
+  end
+  
+  desc 'Incomplete todo items'
+  task :uncompleted do
+    TODOS.uncompleted.display
+  end
+end if File.exists?(File.join(library_root, 'TODO'))
+
+namespace :site do
+  require 'erb'
+  require 'rdoc/markup/simple_markup'
+  require 'rdoc/markup/simple_markup/to_html'
+  
+  readme    = lambda { IO.read('README')[/^== Getting started\n(.*)/m, 1] }
+
+  readme_to_html = lambda do
+    handler = SM::ToHtml.new
+    handler.instance_eval do
+      require 'syntax'
+      require 'syntax/convertors/html'
+      def accept_verbatim(am, fragment) 
+        syntax = Syntax::Convertors::HTML.for_syntax('ruby')
+        @res << %(<div class="ruby">#{syntax.convert(fragment.txt, true)}</div>)
+      end
+    end
+    SM::SimpleMarkup.new.convert(readme.call, handler)
+  end
+  
+  desc 'Regenerate the public website page'
+  task :build => 'doc:readme' do
+    open('site/public/index.html', 'w') do |file|
+      erb_data = {}
+      erb_data[:readme] = readme_to_html.call
+      file.write ERB.new(IO.read('site/index.erb')).result(binding)
+    end
+  end
+  
+  task :refresh => :build do
+    system 'open site/public/index.html'
+  end
+  
+  desc 'Update the live website'
+  task :deploy => :build do
+    site_files = FileList['site/public/*']
+    site_files.delete_if {|file| File.directory?(file)}
+    sh %(scp #{site_files.join ' '} marcel@rubyforge.org:/var/www/gforge-projects/amazon/)
+  end
+end 
+
+task :clean => ['dist:clobber_package', 'doc:clobber_rdoc', 'test:clobber_coverage']