easys3 1.0.0

Sign up to get free protection for your applications and to get access to all the features.
checksums.yaml ADDED
@@ -0,0 +1,7 @@
1
+ ---
2
+ SHA256:
3
+ metadata.gz: 4a1e2d235a905bd32bc7c922d753fd734912fd98d5479feaa0c734f63009f4a7
4
+ data.tar.gz: 7ae9af3be235986e2c670d3dc243865d000a59f5f6b58940fed6e5885be1192d
5
+ SHA512:
6
+ metadata.gz: 0e250f98d5030a512fb3be93e502f5525e3111be174e949ceaca80a00c671db914c4cb1ee36018034c9ab3fd7cb3ab997ce7b1f792967baa0559d52e4a59a77c
7
+ data.tar.gz: 610f5cc8f6dc36f9b9dfc765d6e86f311d6299341c509ad0357dd09fcb5e5fac976c3ea994ed3bf90626986d82027f925601e1d9d5f6ccd04f5abc924b7af931
data/.gitignore ADDED
@@ -0,0 +1,21 @@
1
+ /.bundle/
2
+ /.yardoc
3
+ /_yardoc/
4
+ /coverage/
5
+ /doc/
6
+ /pkg/
7
+ /spec/reports/
8
+ /tmp/
9
+
10
+ # rspec failure tracking
11
+ .rspec_status
12
+
13
+ # ignore .env
14
+ bin/.env
15
+ .env
16
+
17
+ # ignore bundle
18
+ vendor/bundle
19
+
20
+ # ignore other unnecessary files
21
+ Gemfile.lock
data/.rspec ADDED
@@ -0,0 +1,3 @@
1
+ --format documentation
2
+ --color
3
+ --require spec_helper
data/.travis.yml ADDED
@@ -0,0 +1,7 @@
1
+ ---
2
+ sudo: false
3
+ language: ruby
4
+ cache: bundler
5
+ rvm:
6
+ - 2.5.3
7
+ before_install: gem install bundler -v 2.0.1
@@ -0,0 +1,74 @@
1
+ # Contributor Covenant Code of Conduct
2
+
3
+ ## Our Pledge
4
+
5
+ In the interest of fostering an open and welcoming environment, we as
6
+ contributors and maintainers pledge to making participation in our project and
7
+ our community a harassment-free experience for everyone, regardless of age, body
8
+ size, disability, ethnicity, gender identity and expression, level of experience,
9
+ nationality, personal appearance, race, religion, or sexual identity and
10
+ orientation.
11
+
12
+ ## Our Standards
13
+
14
+ Examples of behavior that contributes to creating a positive environment
15
+ include:
16
+
17
+ * Using welcoming and inclusive language
18
+ * Being respectful of differing viewpoints and experiences
19
+ * Gracefully accepting constructive criticism
20
+ * Focusing on what is best for the community
21
+ * Showing empathy towards other community members
22
+
23
+ Examples of unacceptable behavior by participants include:
24
+
25
+ * The use of sexualized language or imagery and unwelcome sexual attention or
26
+ advances
27
+ * Trolling, insulting/derogatory comments, and personal or political attacks
28
+ * Public or private harassment
29
+ * Publishing others' private information, such as a physical or electronic
30
+ address, without explicit permission
31
+ * Other conduct which could reasonably be considered inappropriate in a
32
+ professional setting
33
+
34
+ ## Our Responsibilities
35
+
36
+ Project maintainers are responsible for clarifying the standards of acceptable
37
+ behavior and are expected to take appropriate and fair corrective action in
38
+ response to any instances of unacceptable behavior.
39
+
40
+ Project maintainers have the right and responsibility to remove, edit, or
41
+ reject comments, commits, code, wiki edits, issues, and other contributions
42
+ that are not aligned to this Code of Conduct, or to ban temporarily or
43
+ permanently any contributor for other behaviors that they deem inappropriate,
44
+ threatening, offensive, or harmful.
45
+
46
+ ## Scope
47
+
48
+ This Code of Conduct applies both within project spaces and in public spaces
49
+ when an individual is representing the project or its community. Examples of
50
+ representing a project or community include using an official project e-mail
51
+ address, posting via an official social media account, or acting as an appointed
52
+ representative at an online or offline event. Representation of a project may be
53
+ further defined and clarified by project maintainers.
54
+
55
+ ## Enforcement
56
+
57
+ Instances of abusive, harassing, or otherwise unacceptable behavior may be
58
+ reported by contacting the project team at yuyasato@icloud.com. All
59
+ complaints will be reviewed and investigated and will result in a response that
60
+ is deemed necessary and appropriate to the circumstances. The project team is
61
+ obligated to maintain confidentiality with regard to the reporter of an incident.
62
+ Further details of specific enforcement policies may be posted separately.
63
+
64
+ Project maintainers who do not follow or enforce the Code of Conduct in good
65
+ faith may face temporary or permanent repercussions as determined by other
66
+ members of the project's leadership.
67
+
68
+ ## Attribution
69
+
70
+ This Code of Conduct is adapted from the [Contributor Covenant][homepage], version 1.4,
71
+ available at [http://contributor-covenant.org/version/1/4][version]
72
+
73
+ [homepage]: http://contributor-covenant.org
74
+ [version]: http://contributor-covenant.org/version/1/4/
data/Gemfile ADDED
@@ -0,0 +1,4 @@
1
+ source "https://rubygems.org"
2
+
3
+ # Specify your gem's dependencies in easys3.gemspec
4
+ gemspec
data/LICENSE.txt ADDED
@@ -0,0 +1,21 @@
1
+ The MIT License (MIT)
2
+
3
+ Copyright (c) 2019 chienomi
4
+
5
+ Permission is hereby granted, free of charge, to any person obtaining a copy
6
+ of this software and associated documentation files (the "Software"), to deal
7
+ in the Software without restriction, including without limitation the rights
8
+ to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
9
+ copies of the Software, and to permit persons to whom the Software is
10
+ furnished to do so, subject to the following conditions:
11
+
12
+ The above copyright notice and this permission notice shall be included in
13
+ all copies or substantial portions of the Software.
14
+
15
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
16
+ IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
17
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
18
+ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
19
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
20
+ OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN
21
+ THE SOFTWARE.
data/README.md ADDED
@@ -0,0 +1,108 @@
1
+ # Easys3
2
+
3
+ Putting files to S3 & getting files from S3 should be one liner. In reality, you might be confused with tricky behavior of official `aws-sdk` gem. With `easys3`, `Easys3.put(bucket_name, file_name, file, acl)` means putting files to s3 and `Easys3.get(bucket_name, file_name)` means getting a file from s3.
4
+
5
+ ## Installation
6
+
7
+ Add this line to your application's Gemfile:
8
+
9
+ ```ruby
10
+ gem 'easys3'
11
+ ```
12
+
13
+ And then execute:
14
+
15
+ $ bundle
16
+
17
+ Or install it yourself as:
18
+
19
+ $ gem install easys3
20
+
21
+ ## Usage
22
+
23
+ ### [Prerequisite] create your `.env` file
24
+ ```
25
+ AWS_ACCESS_KEY_ID=...
26
+ AWS_SECRET_ACCESS_KEY=...
27
+ AWS_S3_REGION=...
28
+ ```
29
+
30
+ ##### FYI: Known AWS regions include:
31
+
32
+ ```
33
+ ap-east-1
34
+ ap-northeast-1
35
+ ap-northeast-2
36
+ ap-south-1
37
+ ap-southeast-1
38
+ ap-southeast-2
39
+ ca-central-1
40
+ eu-central-1
41
+ eu-north-1
42
+ eu-west-1
43
+ eu-west-2
44
+ eu-west-3
45
+ sa-east-1
46
+ us-east-1
47
+ us-east-2
48
+ us-west-1
49
+ us-west-2
50
+ cn-north-1
51
+ cn-northwest-1
52
+ us-gov-east-1
53
+ us-gov-west-1
54
+ ```
55
+
56
+
57
+ ### Putting a file to s3
58
+ ```ruby
59
+ Easys3.put(bucket_name, file_name, file, acl)
60
+ ```
61
+
62
+ #### example response (success)
63
+ ```ruby
64
+ {:status=>201, :data=>#<struct Aws::S3::Types::PutObjectOutput ... }
65
+ ```
66
+
67
+ #### example response (failure)
68
+ ```ruby
69
+ {:status=>500, :message=>#<Aws::Errors::NoSuchEndpointError: ... }
70
+ ```
71
+
72
+ ### Getting a file from s3
73
+ ```ruby
74
+ Easys3.get(bucket_name, file_name)
75
+ ```
76
+
77
+ #### example response (success)
78
+ ```ruby
79
+ {:status=>200, :data=>"abc"}
80
+ ```
81
+
82
+ #### example response (failure - 404)
83
+ ```ruby
84
+ {:status=>404, :message=>"Could not find file: test/missing.log in the bucket: test-bucket"}
85
+ ```
86
+
87
+ #### example response (failure - 500)
88
+ ```ruby
89
+ {:status=>500, :message=>#<Aws::Errors::NoSuchEndpointError: ... }
90
+ ```
91
+
92
+ ## Development
93
+
94
+ After checking out the repo, run `bin/setup` to install dependencies. Then, run `rake spec` to run the tests. You can also run `bin/console` for an interactive prompt that will allow you to experiment.
95
+
96
+ To install this gem onto your local machine, run `bundle exec rake install`. To release a new version, update the version number in `version.rb`, and then run `bundle exec rake release`, which will create a git tag for the version, push git commits and tags, and push the `.gem` file to [rubygems.org](https://rubygems.org).
97
+
98
+ ## Contributing
99
+
100
+ Bug reports and pull requests are welcome on GitHub at https://github.com/chienomi/easys3. This project is intended to be a safe, welcoming space for collaboration, and contributors are expected to adhere to the [Contributor Covenant](http://contributor-covenant.org) code of conduct.
101
+
102
+ ## License
103
+
104
+ The gem is available as open source under the terms of the [MIT License](https://opensource.org/licenses/MIT).
105
+
106
+ ## Code of Conduct
107
+
108
+ Everyone interacting in the Easys3 project’s codebases, issue trackers, chat rooms and mailing lists is expected to follow the [code of conduct](https://github.com/[USERNAME]/easys3/blob/master/CODE_OF_CONDUCT.md).
data/Rakefile ADDED
@@ -0,0 +1,6 @@
1
+ require "bundler/gem_tasks"
2
+ require "rspec/core/rake_task"
3
+
4
+ RSpec::Core::RakeTask.new(:spec)
5
+
6
+ task :default => :spec
data/bin/console ADDED
@@ -0,0 +1,14 @@
1
+ #!/usr/bin/env ruby
2
+
3
+ require "bundler/setup"
4
+ require "easys3"
5
+
6
+ # You can add fixtures and/or initialization code here to make experimenting
7
+ # with your gem easier. You can also use a different console, if you like.
8
+
9
+ # (If you use this, don't forget to add pry to your Gemfile!)
10
+ # require "pry"
11
+ # Pry.start
12
+
13
+ require "irb"
14
+ IRB.start(__FILE__)
data/bin/setup ADDED
@@ -0,0 +1,8 @@
1
+ #!/usr/bin/env bash
2
+ set -euo pipefail
3
+ IFS=$'\n\t'
4
+ set -vx
5
+
6
+ bundle install
7
+
8
+ # Do any other automated setup that you need to do here
data/easys3.gemspec ADDED
@@ -0,0 +1,33 @@
1
+
2
+ lib = File.expand_path("../lib", __FILE__)
3
+ $LOAD_PATH.unshift(lib) unless $LOAD_PATH.include?(lib)
4
+ require "easys3/version"
5
+
6
+ Gem::Specification.new do |spec|
7
+ spec.name = "easys3"
8
+ spec.version = Easys3::VERSION
9
+ spec.authors = ["chienomi"]
10
+ spec.email = ["yuyasato@icloud.com"]
11
+
12
+ spec.summary = %q{Put files to s3 & get files from s3 with single line of code.}
13
+ spec.description = %q{Put files to s3 & get files from s3 with single line of code.}
14
+ spec.homepage = "https://github.com/chienomi/easys3"
15
+ spec.license = "MIT"
16
+
17
+
18
+ # Specify which files should be added to the gem when it is released.
19
+ # The `git ls-files -z` loads the files in the RubyGem that have been added into git.
20
+ spec.files = Dir.chdir(File.expand_path('..', __FILE__)) do
21
+ `git ls-files -z`.split("\x0").reject { |f| f.match(%r{^(test|spec|features)/}) }
22
+ end
23
+ spec.bindir = "exe"
24
+ spec.executables = spec.files.grep(%r{^exe/}) { |f| File.basename(f) }
25
+ spec.require_paths = ["lib"]
26
+
27
+ spec.add_runtime_dependency "aws-sdk"
28
+ spec.add_runtime_dependency "dotenv"
29
+
30
+ spec.add_development_dependency "bundler", "~> 2.0"
31
+ spec.add_development_dependency "rake", "~> 10.0"
32
+ spec.add_development_dependency "rspec", "~> 3.0"
33
+ end
@@ -0,0 +1,28 @@
1
+ require "dotenv"
2
+ Dotenv.overload()
3
+
4
+ module ErrorHandler
5
+ def self.check_aws_region()
6
+ if !ENV["AWS_S3_REGION"] || ENV["AWS_S3_REGION"] == ""
7
+ raise "AWS_S3_REGION=... is missing in your .env file. Select your region from https://docs.aws.amazon.com/general/latest/gr/rande.html"
8
+ end
9
+ end
10
+
11
+ def self.check_aws_access_key()
12
+ if !ENV["AWS_ACCESS_KEY_ID"] || ENV["AWS_ACCESS_KEY_ID"] == ""
13
+ raise "AWS_ACCESS_KEY_ID=... is missing in your .env file"
14
+ end
15
+ end
16
+
17
+ def self.check_aws_secret_access_key()
18
+ if !ENV["AWS_SECRET_ACCESS_KEY"] || ENV["AWS_SECRET_ACCESS_KEY"] == ""
19
+ raise "AWS_SECRET_ACCESS_KEY=... is missing in your .env file"
20
+ end
21
+ end
22
+
23
+ def self.check_aws_bucket_name()
24
+ if !ENV["AWS_S3_REGION"] || ENV["AWS_S3_REGION"] == ""
25
+ raise "AWS_S3_REGION=.. is missing in your .env file"
26
+ end
27
+ end
28
+ end
@@ -0,0 +1,23 @@
1
+ module Response
2
+ def self.success(data, status=200)
3
+ return {
4
+ "status": status,
5
+ "data": data
6
+ }
7
+ end
8
+
9
+ def self.missing(message)
10
+ return {
11
+ "status": 404,
12
+ "message": message
13
+ }
14
+ end
15
+
16
+ def self.error(message)
17
+ return {
18
+ "status": 500,
19
+ "message": message
20
+ }
21
+ end
22
+
23
+ end
@@ -0,0 +1,35 @@
1
+ require "dotenv"
2
+ Dotenv.overload()
3
+ require "aws-sdk"
4
+
5
+ module S3Handler
6
+ def self.get_s3_resorce(ignore_keys=false)
7
+ ErrorHandler.check_aws_region()
8
+
9
+ if ignore_keys
10
+ return Aws::S3::Resource.new(
11
+ region: ENV["AWS_S3_REGION"],
12
+ )
13
+ end
14
+
15
+ ErrorHandler.check_aws_access_key()
16
+ ErrorHandler.check_aws_secret_access_key()
17
+
18
+ return Aws::S3::Resource.new(
19
+ region: ENV["AWS_S3_REGION"],
20
+ access_key_id: ENV["AWS_ACCESS_KEY_ID"],
21
+ secret_access_key: ENV["AWS_SECRET_ACCESS_KEY"],
22
+ )
23
+ end
24
+
25
+
26
+ def self.get_bucket(bucket_name, ignore_keys=false)
27
+ ErrorHandler.check_aws_region()
28
+ s3 = S3Handler.get_s3_resorce(ignore_keys)
29
+ return s3.bucket(bucket_name)
30
+ end
31
+
32
+ def self.file_exists?(bucket, file_name)
33
+ return bucket.object(file_name).exists?
34
+ end
35
+ end
@@ -0,0 +1,3 @@
1
+ module Easys3
2
+ VERSION = "1.0.0"
3
+ end
data/lib/easys3.rb ADDED
@@ -0,0 +1,63 @@
1
+ require "easys3/version"
2
+ require "easys3/error_handler"
3
+ require "easys3/response"
4
+ require "easys3/s3_handler"
5
+
6
+
7
+ module Easys3
8
+ class Error < StandardError; end
9
+
10
+ def self.get(bucket_name, file_name)
11
+ begin
12
+ Easys3.get_without_rescue(bucket_name, file_name, ignore_keys=true)
13
+ rescue
14
+ begin
15
+ Easys3.get_without_rescue(bucket_name, file_name, ignore_keys=false)
16
+ rescue Exception => e
17
+ return Response.error(e)
18
+ end
19
+ end
20
+ end
21
+
22
+
23
+ def self.get_without_rescue(bucket_name, file_name, ignore_keys=false)
24
+ bucket = S3Handler.get_bucket(bucket_name, ignore_keys=ignore_keys)
25
+
26
+ if !S3Handler.file_exists?(bucket, file_name)
27
+ return Response.missing("Could not find file: " + file_name + " in the bucket: " + bucket.name)
28
+ end
29
+
30
+ data = bucket.object(file_name).get.body.read()
31
+ return Response.success(data)
32
+ end
33
+
34
+
35
+ def self.put(bucket_name, file_name, file, acl=nil)
36
+
37
+ # bucket.object(file_name).put(body: file, acl: 'public-read')
38
+
39
+ begin
40
+ return Easys3.put_without_rescue(bucket_name, file_name, file, ignore_keys=true)
41
+ rescue
42
+ begin
43
+ return Easys3.put_without_rescue(bucket_name, file_name, file, ignore_keys=false)
44
+ rescue Exception => e
45
+ return Response.error(e)
46
+ end
47
+ end
48
+ end
49
+
50
+
51
+ def self.put_without_rescue(bucket_name, file_name, file, acl=nil, ignore_keys=false)
52
+ bucket = S3Handler.get_bucket(bucket_name, ignore_keys=ignore_keys)
53
+
54
+ if acl
55
+ response = bucket.object(file_name).put(body: file, acl: acl)
56
+ else
57
+ response = bucket.object(file_name).put(body: file)
58
+ end
59
+
60
+ return Response.success(response, status=201)
61
+ end
62
+
63
+ end
metadata ADDED
@@ -0,0 +1,129 @@
1
+ --- !ruby/object:Gem::Specification
2
+ name: easys3
3
+ version: !ruby/object:Gem::Version
4
+ version: 1.0.0
5
+ platform: ruby
6
+ authors:
7
+ - chienomi
8
+ autorequire:
9
+ bindir: exe
10
+ cert_chain: []
11
+ date: 2019-06-01 00:00:00.000000000 Z
12
+ dependencies:
13
+ - !ruby/object:Gem::Dependency
14
+ name: aws-sdk
15
+ requirement: !ruby/object:Gem::Requirement
16
+ requirements:
17
+ - - ">="
18
+ - !ruby/object:Gem::Version
19
+ version: '0'
20
+ type: :runtime
21
+ prerelease: false
22
+ version_requirements: !ruby/object:Gem::Requirement
23
+ requirements:
24
+ - - ">="
25
+ - !ruby/object:Gem::Version
26
+ version: '0'
27
+ - !ruby/object:Gem::Dependency
28
+ name: dotenv
29
+ requirement: !ruby/object:Gem::Requirement
30
+ requirements:
31
+ - - ">="
32
+ - !ruby/object:Gem::Version
33
+ version: '0'
34
+ type: :runtime
35
+ prerelease: false
36
+ version_requirements: !ruby/object:Gem::Requirement
37
+ requirements:
38
+ - - ">="
39
+ - !ruby/object:Gem::Version
40
+ version: '0'
41
+ - !ruby/object:Gem::Dependency
42
+ name: bundler
43
+ requirement: !ruby/object:Gem::Requirement
44
+ requirements:
45
+ - - "~>"
46
+ - !ruby/object:Gem::Version
47
+ version: '2.0'
48
+ type: :development
49
+ prerelease: false
50
+ version_requirements: !ruby/object:Gem::Requirement
51
+ requirements:
52
+ - - "~>"
53
+ - !ruby/object:Gem::Version
54
+ version: '2.0'
55
+ - !ruby/object:Gem::Dependency
56
+ name: rake
57
+ requirement: !ruby/object:Gem::Requirement
58
+ requirements:
59
+ - - "~>"
60
+ - !ruby/object:Gem::Version
61
+ version: '10.0'
62
+ type: :development
63
+ prerelease: false
64
+ version_requirements: !ruby/object:Gem::Requirement
65
+ requirements:
66
+ - - "~>"
67
+ - !ruby/object:Gem::Version
68
+ version: '10.0'
69
+ - !ruby/object:Gem::Dependency
70
+ name: rspec
71
+ requirement: !ruby/object:Gem::Requirement
72
+ requirements:
73
+ - - "~>"
74
+ - !ruby/object:Gem::Version
75
+ version: '3.0'
76
+ type: :development
77
+ prerelease: false
78
+ version_requirements: !ruby/object:Gem::Requirement
79
+ requirements:
80
+ - - "~>"
81
+ - !ruby/object:Gem::Version
82
+ version: '3.0'
83
+ description: Put files to s3 & get files from s3 with single line of code.
84
+ email:
85
+ - yuyasato@icloud.com
86
+ executables: []
87
+ extensions: []
88
+ extra_rdoc_files: []
89
+ files:
90
+ - ".gitignore"
91
+ - ".rspec"
92
+ - ".travis.yml"
93
+ - CODE_OF_CONDUCT.md
94
+ - Gemfile
95
+ - LICENSE.txt
96
+ - README.md
97
+ - Rakefile
98
+ - bin/console
99
+ - bin/setup
100
+ - easys3.gemspec
101
+ - lib/easys3.rb
102
+ - lib/easys3/error_handler.rb
103
+ - lib/easys3/response.rb
104
+ - lib/easys3/s3_handler.rb
105
+ - lib/easys3/version.rb
106
+ homepage: https://github.com/chienomi/easys3
107
+ licenses:
108
+ - MIT
109
+ metadata: {}
110
+ post_install_message:
111
+ rdoc_options: []
112
+ require_paths:
113
+ - lib
114
+ required_ruby_version: !ruby/object:Gem::Requirement
115
+ requirements:
116
+ - - ">="
117
+ - !ruby/object:Gem::Version
118
+ version: '0'
119
+ required_rubygems_version: !ruby/object:Gem::Requirement
120
+ requirements:
121
+ - - ">="
122
+ - !ruby/object:Gem::Version
123
+ version: '0'
124
+ requirements: []
125
+ rubygems_version: 3.0.2
126
+ signing_key:
127
+ specification_version: 4
128
+ summary: Put files to s3 & get files from s3 with single line of code.
129
+ test_files: []