fakes3test12 1.2.0

checksums.yaml

@@ -0,0 +1,7 @@
+---
+SHA1:
+  metadata.gz: df81ac57f6a43e4bf95a98f987f121cf011fe36f
+  data.tar.gz: c624cd804c4644225f9d5ebf33821eb6666a3d10
+SHA512:
+  metadata.gz: 1ba43ba05c131b58623775c87b188715f4856854c0908df6b3d92d670102905f8f93a00f4432eb63673e421d750f6bbf37aa3846b9bb623dc962cb494f209dd5
+  data.tar.gz: d437d490c80bd8747e0b2b41ed7bbe9d528986a38389894bcee0fb73c390740605b097156341c031a7a2e051423203ca0c495d86ef9579b0214271c8fff014f5

data/.gitignore

@@ -0,0 +1,18 @@
+pkg/*
+*.gem
+.bundle
+tmp
+test_root
+
+# Don't check in RVM/rbenv files
+.ruby-version
+
+# RubyMine
+.idea
+
+# Don't check in the Gemfile.lock
+Gemfile.lock
+
+.DS_Store
+.rvmrc
+root/*

data/CONTRIBUTING.md

@@ -0,0 +1,50 @@
+## Contributing to Fake S3
+
+Contributions in the form of pull requests, bug reports, documentation, or anything else are welcome! We do have a few small rules to follow:
+
+- Ensure tests pass before making a pull request. (You can read the Testing section below for how to set up your development environment and run tests)
+
+- Please use a coding style similar to the rest of the file(s) you change. This isn't a hard rule but if it's too different, it will stand out.
+
+- Unless your contributions fall under the trivial exemption policy (below), contributors must sign our Contributor License Agreement (CLA) to be eligible to contribute. Read more in section is below.
+
+
+## Testing
+
+There are some prerequisites to actually being able to run the unit/integration tests.
+
+On macOS, edit your /etc/hosts and add the following line:
+
+    127.0.0.1 posttest.localhost
+
+Then ensure that the following packages are installed (boto, s3cmd):
+
+    > pip install boto
+    > brew install s3cmd
+
+
+Start the test server using:
+
+    rake test_server
+
+Finally, in another terminal window run:
+
+    rake test
+
+
+## Signing the Contributor License agreement
+
+We have a contributor license agreement (CLA) based off of Google and Apache's CLA. If you would feel comfortable contributing to, say, Angular.js, you should feel comfortable with this CLA.
+
+To sign the CLA:
+
+[Click here and fill out the form.](https://docs.google.com/forms/d/e/1FAIpQLSeKKSKNNz5ji1fd5bbu5RaGFbhD45zEaCnAjzBZPpzOaXQsvQ/viewform)
+
+If you're interested, [this blog post](https://julien.ponge.org/blog/in-defense-of-contributor-license-agreements/) discusses why to use a CLA, and even goes over the text of the CLA we based ours on.
+
+
+## Trivial Exemption Policy
+
+The Trivial Exemption Policy exempts contributions that would not be sufficiently robust or creative to enjoy copyright protection, and therefore do not need to sign the CLA. This would generally be changes that don't involve much creativity.
+
+Contributions considered trivial are generally fewer than 10 lines of actual code. (It may be longer than 10 lines, for example these would often be larger: blank lines, changes in indentation, formatting, simple comments, logging messages, changes to metadata like Gemfiles or gitignore, reordering, breaking or combining files, renaming files, or other unoriginal changes)

data/DEPLOY_README.md

@@ -0,0 +1,18 @@
+# Helpful things to remember when deploying to RubyGems
+
+Ensure the version number is updated (lib/fakes3/version.rb)
+
+Ensure the tests pass
+```
+  rake test_server followed by rake test
+```
+
+Build the Gem
+```
+  gem build fakes3.gemspec
+```
+
+Push to RubyGems
+```
+  gem push fakes3-VERSION.gem
+```

data/Dockerfile

@@ -0,0 +1,13 @@
+FROM alpine:3.4
+
+RUN apk add --no-cache --update ruby ruby-dev ruby-bundler python py-pip git build-base libxml2-dev libxslt-dev
+RUN pip install boto s3cmd
+
+COPY fakes3.gemspec Gemfile Gemfile.lock /app/
+COPY lib/fakes3/version.rb /app/lib/fakes3/
+
+WORKDIR /app
+
+RUN bundle install
+
+COPY . /app/

data/Gemfile

@@ -0,0 +1,4 @@
+source 'https://rubygems.org'
+gem 'fakes3', :path => '.' # for dev and test, use local fakes3
+# Specify your gem's dependencies in fakes3as.gemspec
+gemspec

data/ISSUE_TEMPLATE.md

@@ -0,0 +1,9 @@
+Thanks for the issue! We do have a few small rules to follow:
+
+1. Please add [Feature], [Bug], [Question], or [Other] to your title.
+
+2. If it is a bug, please add steps to reproduce it. More information is almost always helpful.
+
+3. If it is a feature, is there any pull request you should refer to? If so, please add a link to the pull request somewhere in the comments.
+
+Thanks!

data/Makefile

@@ -0,0 +1,7 @@
+.PHONY: test
+
+build-test-container:
+	docker build -t fake-s3 .
+
+test: build-test-container
+	docker run --rm --add-host="posttest.localhost:127.0.0.1" -e "RUBYOPT=-W0" fake-s3 sh -c "rake test_server & rake test"

data/PULL_REQUEST_TEMPLATE.md

@@ -0,0 +1,9 @@
+Thanks for the pull request! We do have a few small rules to follow:
+
+1. Ensure tests pass before creating the pull request.
+
+2. Please use a coding style similar to the rest of the file(s) you change. This isn't a hard rule but if it's too different, it will stick out.
+
+3. We have a contributor license agreement (CLA) based off of Google and Apache's CLA. If you would feel comfortable contributing to, say, Angular.js, you should feel comfortable with this CLA. Unless you've previously signed, please sign at: https://docs.google.com/forms/d/e/1FAIpQLSeKKSKNNz5ji1fd5bbu5RaGFbhD45zEaCnAjzBZPpzOaXQsvQ/viewform
+
+To read more about all three of the above, visit: https://github.com/jubos/fake-s3/blob/master/CONTRIBUTING.md

data/README.md

@@ -0,0 +1,42 @@
+![Fake S3](static/logo.png "Fake S3")
+
+## Introduction
+
+Fake S3 is a lightweight server that responds to the same API of Amazon S3.
+
+It is extremely useful for testing of S3 in a sandbox environment without actually making calls to Amazon, which not only requires a network connection, but also costs money with every use.
+
+The goal of Fake S3 is to minimize runtime dependencies and be more of a
+development tool to test S3 calls in your code rather than a production server looking to duplicate S3 functionality.
+
+Many commands are supported, including put, get, list, copy, and make bucket.
+
+## Installation
+
+    gem install fakes3
+
+## Running
+
+To run the server, you just specify a root and a port.
+
+    fakes3 -r /mnt/fakes3_root -p 4567
+
+## Licensing
+
+As of the latest version, we are licensing with Super Source. To get a license, visit:
+
+https://supso.org/projects/fake-s3 
+
+Depending on your company's size, the license may be free. It is also free for individuals.
+
+## Connecting to Fake S3
+
+Take a look at the test cases to see client example usage.  For now, Fake S3 is
+mainly tested with s3cmd, aws-s3 gem, and right_aws.  There are plenty more
+libraries out there, and please do mention if other clients work or not.
+
+Here is a running list of [supported clients](https://github.com/jubos/fake-s3/wiki/Supported-Clients "Supported Clients")
+
+## Contributing
+
+Contributions in the form of pull requests, bug reports, documentation, or anything else are welcome! Please read the CONTRIBUTING.md file for more info: [CONTRIBUTING.md](https://github.com/jubos/fake-s3/blob/master/CONTRIBUTING.md)

data/Rakefile

@@ -0,0 +1,18 @@
+require 'rubygems'
+require 'bundler'
+require 'rake/testtask'
+include Rake::DSL
+Bundler::GemHelper.install_tasks
+
+Rake::TestTask.new(:test) do |t|
+  t.libs << "."
+  t.test_files =
+    FileList['test/*_test.rb'].exclude('test/s3_commands_test.rb')
+end
+
+desc "Run the test_server"
+task :test_server do |t|
+  system("bundle exec bin/fakes3 --port 10453 --root test_root")
+end
+
+task :default => :test

data/bin/fakes3

@@ -0,0 +1,6 @@
+#!/usr/bin/env ruby
+
+$: << './lib'
+
+require 'fakes3/cli'
+FakeS3::CLI.start

data/fakes3.gemspec

@@ -0,0 +1,35 @@
+# -*- encoding: utf-8 -*-
+require File.join(File.dirname(__FILE__), 'lib', 'fakes3', 'version')
+
+Gem::Specification.new do |s|
+  s.name        = "fakes3test12"
+  s.version     = FakeS3::VERSION
+  s.platform    = Gem::Platform::RUBY
+  s.authors     = ["Curtis Spencer"]
+  s.email       = ["fakes3@supso.org"]
+  s.homepage    = "https://github.com/jubos/fake-s3"
+  s.summary     = %q{Fake S3 is a server that simulates Amazon S3 commands so you can test your S3 functionality in your projects}
+  s.description = %q{Use Fake S3 to test basic Amazon S3 functionality without actually connecting to AWS}
+  s.license     = "Supported-Source"
+  s.post_install_message = "Fake S3: if you don't already have a license for Fake S3, you can get one at https://supso.org/projects/fake-s3"
+
+  s.add_development_dependency "bundler", ">= 1.0.0"
+  s.add_development_dependency "aws-s3"
+  s.add_development_dependency "right_aws"
+  s.add_development_dependency "rest-client"
+  s.add_development_dependency "rake"
+  s.add_development_dependency "aws-sdk", "~> 2"
+  s.add_development_dependency "aws-sdk-v1"
+  s.add_development_dependency "test-unit"
+  s.add_development_dependency "mocha"
+  #s.add_development_dependency "ruby-debug"
+  #s.add_development_dependency "debugger"
+  s.add_dependency "thor"
+  s.add_dependency "builder"
+  s.add_dependency "xml-simple"
+
+  s.files         = `git ls-files`.split("\n")
+  s.test_files    = `git ls-files -- {test,spec,features}/*`.split("\n")
+  s.executables   = `git ls-files -- bin/*`.split("\n").map{ |f| File.basename(f) }
+  s.require_paths = ["lib"]
+end

data/lib/fakes3.rb

@@ -0,0 +1,3 @@
+require 'fakes3/version'
+require 'fakes3/file_store'
+require 'fakes3/server'

data/lib/fakes3/bucket.rb

@@ -0,0 +1,65 @@
+require 'builder'
+require 'thread'
+require 'fakes3/s3_object'
+require 'fakes3/sorted_object_list'
+
+module FakeS3
+  class Bucket
+    attr_accessor :name,:creation_date,:objects
+
+    def initialize(name,creation_date,objects)
+      @name = name
+      @creation_date = creation_date
+      @objects = SortedObjectList.new
+      objects.each do |obj|
+        @objects.add(obj)
+      end
+      @mutex = Mutex.new
+    end
+
+    def find(object_name)
+      @mutex.synchronize do
+        @objects.find(object_name)
+      end
+    end
+
+    def add(object)
+      # Unfortunately have to synchronize here since the our SortedObjectList
+      # not thread safe. Probably can get finer granularity if performance is
+      # important
+      @mutex.synchronize do
+        @objects.add(object)
+      end
+    end
+
+    def remove(object)
+      @mutex.synchronize do
+        @objects.remove(object)
+      end
+    end
+
+    def query_for_range(options)
+      marker = options[:marker]
+      prefix = options[:prefix]
+      max_keys = options[:max_keys] || 1000
+      delimiter = options[:delimiter]
+
+      match_set = nil
+      @mutex.synchronize do
+        match_set = @objects.list(options)
+      end
+
+      bq = BucketQuery.new
+      bq.bucket = self
+      bq.marker = marker
+      bq.prefix = prefix
+      bq.max_keys = max_keys
+      bq.delimiter = delimiter
+      bq.matches = match_set.matches
+      bq.is_truncated = match_set.is_truncated
+      bq.common_prefixes = match_set.common_prefixes
+      return bq
+    end
+
+  end
+end

data/lib/fakes3/bucket_query.rb

@@ -0,0 +1,11 @@
+module FakeS3
+  class BucketQuery
+    attr_accessor :prefix,:matches,:marker,:max_keys,
+                  :delimiter,:bucket,:is_truncated,:common_prefixes
+
+    # Syntactic sugar
+    def is_truncated?
+      @is_truncated
+    end
+  end
+end

data/lib/fakes3/cli.rb

@@ -0,0 +1,71 @@
+require 'thor'
+require 'fakes3/server'
+require 'fakes3/version'
+
+module FakeS3
+  class CLI < Thor
+    default_task("server")
+
+    desc "server", "Run a server on a particular hostname"
+    method_option :root, :type => :string, :aliases => '-r', :required => true
+    method_option :port, :type => :numeric, :aliases => '-p', :required => true
+    method_option :address, :type => :string, :aliases => '-a', :required => false, :desc => "Bind to this address. Defaults to all IP addresses of the machine."
+    method_option :hostname, :type => :string, :aliases => '-H', :desc => "The root name of the host.  Defaults to s3.amazonaws.com."
+    method_option :quiet, :type => :boolean, :aliases => '-q', :desc => "Quiet; do not write anything to standard output."
+    method_option :limit, :aliases => '-l', :type => :string, :desc => 'Rate limit for serving (ie. 50K, 1.0M)'
+    method_option :sslcert, :type => :string, :desc => 'Path to SSL certificate'
+    method_option :sslkey, :type => :string, :desc => 'Path to SSL certificate key'
+
+    def server
+      store = nil
+      if options[:root]
+        root = File.expand_path(options[:root])
+        # TODO Do some sanity checking here
+        store = FileStore.new(root, !!options[:quiet])
+      end
+
+      if store.nil?
+        abort "You must specify a root to use a file store (the current default)"
+      end
+
+      hostname = 's3.amazonaws.com'
+      if options[:hostname]
+        hostname = options[:hostname]
+        # In case the user has put a port on the hostname
+        if hostname =~ /:(\d+)/
+          hostname = hostname.split(":")[0]
+        end
+      end
+
+      if options[:limit]
+        begin
+          store.rate_limit = options[:limit]
+        rescue
+          abort $!.message
+        end
+      end
+
+      address = options[:address]
+      ssl_cert_path = options[:sslcert]
+      ssl_key_path = options[:sslkey]
+
+      if (ssl_cert_path.nil? && !ssl_key_path.nil?) || (!ssl_cert_path.nil? && ssl_key_path.nil?)
+        abort "If you specify an SSL certificate you must also specify an SSL certificate key"
+      end
+
+      puts "Loading FakeS3 with #{root} on port #{options[:port]} with hostname #{hostname}" unless options[:quiet]
+      server = FakeS3::Server.new(address,options[:port],store,hostname,ssl_cert_path,ssl_key_path, quiet: !!options[:quiet])
+      server.serve
+    end
+
+    desc "version", "Report the current fakes3 version"
+    def version
+      puts <<"EOF"
+======================
+FakeS3 #{FakeS3::VERSION}
+
+Copyright 2012, Curtis Spencer (@jubos)
+EOF
+    end
+  end
+end

data/lib/fakes3/errors.rb

@@ -0,0 +1,46 @@
+module FakeS3
+  class FakeS3Exception < RuntimeError
+    attr_accessor :resource,:request_id
+
+    def self.metaclass; class << self; self; end; end
+
+    def self.traits(*arr)
+      return @traits if arr.empty?
+      attr_accessor *arr
+
+      arr.each do |a|
+        metaclass.instance_eval do
+          define_method( a ) do |val|
+            @traits ||= {}
+            @traits[a] = val
+          end
+        end
+      end
+
+      class_eval do
+        define_method( :initialize ) do
+          self.class.traits.each do |k,v|
+            instance_variable_set("@#{k}", v)
+          end
+        end
+      end
+    end
+
+    traits :message,:http_status
+
+    def code
+      self.class.to_s
+    end
+  end
+
+  class NoSuchBucket < FakeS3Exception
+    message "The bucket you tried to delete is not empty."
+    http_status "404"
+  end
+
+  class BucketNotEmpty < FakeS3Exception
+    message "The bucket you tried to delete is not empty."
+    http_status "409"
+  end
+
+end