gem-dependencies 0.1.3

checksums.yaml

@@ -0,0 +1,7 @@
+---
+SHA1:
+  metadata.gz: 339fb3eb77cc83c5a1c9acfcd13608f76a78fda5
+  data.tar.gz: 0cfe64435be447d265dd7a9a2bc7f3d08098d2df
+SHA512:
+  metadata.gz: f4d8a34ec0b2bee8c6a97cdc373b228b7b22d8333b8cc67ff39b60a67bc0e8c6a75713a946220c4dc257b663be0a3a0077eea9166fa19d1217176bb98f497900
+  data.tar.gz: bd60113473d8b779bf5bd49b6e43028036e914894e79c334ef686d6da10c5c42872a1c2f988574a18056ded372f07f5aa595ae8e581a422c3aacf46611e137a9

data.tar.gz.sig

@@ -0,0 +1 @@
+(���h!A�F�63�����ט0���0?S��o{�C�L�Ku�҃m���3aeI��K*{HXW��bL�}f#�-�@�x��V���#]{�H�

data/MIT

@@ -0,0 +1,19 @@
+Copyright (c) 2015 Steve Shreeve <steve.shreeve@gmail.com>
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in
+all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT.  IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN
+THE SOFTWARE.

data/README.md

@@ -0,0 +1,77 @@
+# gem-dependencies
+
+A RubyGems plugin to simplify installing binary gems on runtime systems. Runtime system are usually lightweight and might not even have a compiler. This is accomplished by using a development machine to determine these dependencies and to create tarballs of compiled extensions. Through the use of a dependency index file, these dependencies and extensions can be clearly specified and shared.
+
+## Usage
+
+You don't need to do anything special, just use ```gem install``` as normal. The resulting behavior is controlled by the value of the ```GEM_DEPENDENCIES``` environment variable. If this environment variable is not set, then this gem has no effect and is simply ignored.
+
+## Development system
+
+Make sure you have a development system with the same architecture as your runtime system. On the development system, make a note of all of the package dependencies needed to install the desired gem. Finally, run:
+
+```shell
+$ GEM_DEPENDENCIES=1 gem install bcrypt
+```
+
+This will perform a normal install, but it will also create a tarball in the current directory with the compiled extensions for the given gem. The naming scheme is straightforward and based on the gem's name and version (e.g. ```bcrypt-3.1.10.tar.gz```).
+
+## Dependency index
+
+The dependency index is a YAML file that contains information necessary to install gems on the runtime system. An example dependency file looks like:
+
+```yaml
+gems:
+  "*":
+    command: sudo apk --update add ${packages}
+  bcrypt:
+    "~> 2.0, <= 3.1":
+      - bcrypt-2.1
+      - libxml2-3.4
+      - libyagni-1.0c
+    "~> 3.1.5": "bcrypt-3.1.10.tar.gz tree"
+  nokogiri:
+    "~> 2.0, <= 3.1":
+      - bcrypt-2.1
+      - libxml2-3.4
+      - libyagni-1.0c
+    "~> 3.1.5": "s3://one:two@s3.amazon.com/three/bcrypt-3.1.10.tar.gz tree"
+```
+
+After determining the runtime dependencies and creating a compiled extensions tarball, edit the dependency index to add a key with the name of the new gem and sub-keys to indicate the version requirements. The values of these sub-key are either an array of package dependencies and extension tarballs or a space-delimited string of the same. All items ending in ```.tar.gz``` are considered to be extension tarballs and everything else is considered to be a package dependency. Extension tarballs can also be given as a file system path or an http, https, git, or s3 url.
+
+## Runtime system
+
+If ```GEM_DEPENDENCIES``` is set to a file system path or an http, https, git, or s3 url, then this value will be used to fetch the dependency index. Suppose the following command is run from the runtime system:
+
+```shell
+export GEM_DEPENDENCIES="https://dist.foo.com/gemdeps/alpine-3.2-x86_64/index.yaml"
+gem install bcrypt
+```
+
+The dependency index will be downloaded and searched for the requested gem and version. If a match is found, then the order of installation is as follows:
+
+* package dependencies will be installed (uses the value from the ```command``` key),
+* the 'normal' gem files will be installed
+* the 'normal' build_extensions step will be skipped, and
+* compiled extension tarballs will be downloaded and installed
+
+Note that a version requirement can also be specified in the ```gem install``` command. For example, the following are all valid:
+
+```shell
+bcrypt, bcrypt:3.1.4, "bcrypt:~>3.1.8", "bcrypt > 3.1.4, ~3.2, < 3.8"
+```
+
+Using this approach, a runtime system can quickly and efficiently install dependencies and extensions without the need to compile them locally.
+
+## Using bundler
+
+To make bundler to use this gem as well, you need to load the rubygems_plugin before. The easiest way is to make an alias in your `~/.bashrc`, such as:
+
+```
+alias bundle='RUBYOPT="-rrubygems/gem_dependencies" bundle'
+```
+
+## License
+
+This software is licensed under terms of the MIT License.

data/certs/shreeve.pem

@@ -0,0 +1,21 @@
+-----BEGIN CERTIFICATE-----
+MIIDhTCCAm2gAwIBAgIBATANBgkqhkiG9w0BAQUFADBEMRYwFAYDVQQDDA1zdGV2
+ZS5zaHJlZXZlMRUwEwYKCZImiZPyLGQBGRYFZ21haWwxEzARBgoJkiaJk/IsZAEZ
+FgNjb20wHhcNMTUwNjEyMDMyMjM4WhcNMTYwNjExMDMyMjM4WjBEMRYwFAYDVQQD
+DA1zdGV2ZS5zaHJlZXZlMRUwEwYKCZImiZPyLGQBGRYFZ21haWwxEzARBgoJkiaJ
+k/IsZAEZFgNjb20wggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQCoT0lD
+XoRFhnjFAtJ79NonyJxzMwq2s4TSnqrY25ElM2NoTcboCJ3eTgoeV/F1WSxGfEHs
+xM00/ok/fMqFAZMIA8eV5+aaWze2q6/vE+/u+EI1dI9bogtGxu3FFuYUpVy5wha9
+87U4HXPwXUbKS7bGQuTeJ07jO2okGCufbb+HNXABf+EEZCLk5fH9j1TGgu8fxq/X
+vmVRKF/YpFEFM5TVv0dOO17vU/wOyBynjQ33AW8NHily163YjgIZR7mE042Hh9+G
+w3Uq4L5ytgSoVDIs+owm5NLt0G13EjmsZUBszVErJ+byg62VjiAjSL4DQJSrlCsU
+UuTSvTtx7Ez1nvKtAgMBAAGjgYEwfzAJBgNVHRMEAjAAMAsGA1UdDwQEAwIEsDAd
+BgNVHQ4EFgQU41cP4dVdL49Hzswd3/gCzX3+z3swIgYDVR0RBBswGYEXc3RldmUu
+c2hyZWV2ZUBnbWFpbC5jb20wIgYDVR0SBBswGYEXc3RldmUuc2hyZWV2ZUBnbWFp
+bC5jb20wDQYJKoZIhvcNAQEFBQADggEBAIaDzT/cGpJJT9eyhovk1ScwTA1jocDR
+bIs/mNbQN6XlkipOtxCcx9XvVuwEZtP8/UeX+SKBHAtTnFf4Dez7vjSQAaVLZQe7
+uXuX+S4LFTTf0oFVznQaMQ7PbqKqCmtof+1MqNpDTPTayxrlNUTPl3SpkW6bv4qi
+hWz+RgGCWYc9TQ+JigLPbsfJpok31sHXrCztMb/KMbTozGTGswljbpuSq7Lzs9rp
+4PkbTeqnzZJmSZjUBwvnQFNhXY08hPUs7aASHu9deACBbOBY+Hg6tiSOdfw50uYS
+ksjokeQosImFuxgjMrlyoRcpbZmyfQ33yImqtLH6FMWF3hpoxJq9wPk=
+-----END CERTIFICATE-----

data/gem-dependencies.gemspec

@@ -0,0 +1,15 @@
+# encoding: utf-8
+
+Gem::Specification.new do |s|
+  s.name        = "gem-dependencies"
+  s.version     = "0.1.3"
+  s.summary     = "RubyGems plugin to simplify installing binary gems on runtime systems."
+  s.description = "This gem makes it easy to install binary gems on machines without a compiler."
+  s.homepage    = "https://github.com/shreeve/gem-dependencies"
+  s.authors     = ["Steve Shreeve"]
+  s.email       = "steve.shreeve@gmail.com"
+  s.license     = "MIT"
+  s.files       = `git ls-files`.split("\n") - %w[.gitignore]
+  s.cert_chain  = ["certs/shreeve.pem"]
+  s.signing_key = File.expand_path("~/.ssh/gem-private_key.pem") if $0 =~ /gem\z/
+end

data/lib/rubygems/gem_dependencies.rb

@@ -0,0 +1,142 @@
+#!/usr/bin/env ruby
+
+# =============================================================================
+# gem_dependencies.rb: Simplifies installing binary gems on runtime systems
+#
+# Author: Steve Shreeve <steve.shreeve@gmail.com>
+#   Date: June 11, 2015
+#  Legal: MIT License
+# =============================================================================
+
+require "yaml"
+
+module Gem
+  if ENV["GEM_DEPENDENCIES"]
+    pre_install do |gem|
+      if gem.spec.extensions.any?
+        gem.extend Gem::Installer::Dependencies
+      end
+    end
+  end
+
+  class Installer
+    module Dependencies
+      require 'rubygems/user_interaction'
+      include Gem::UserInteraction
+      REGEXP_SCHEMA = %r|\A[a-z][a-z\d]{1,5}://|io
+
+      def build_extensions
+        if (env = ENV["GEM_DEPENDENCIES"]) == "1"
+          super
+          path = "#{spec.full_name}.tar.gz"
+          File.binwrite(path, gzip(tar(spec.extension_dir)))
+          say "Extensions packaged as #{path}"
+        elsif deps = find_dependencies(env)
+          pkgs, exts = deps
+          install_os_packages(*pkgs) if pkgs.any?
+          copy_gem_extensions(*exts) if exts.any?
+        end
+        true
+      end
+
+      # locate a match and return [pkgs, exts]
+      def find_dependencies(env)
+        require 'rubygems/remote_fetcher'
+        @@deps = YAML.load(fetch(env))['gems'] unless defined?(@@deps)
+
+        case deps = @@deps[spec.name]
+        when String
+        when Array
+        when Hash
+          reqs, deps = deps.find do |reqs, info|
+            Gem::Requirement.new(reqs.split(',')).satisfied_by?(spec.version)
+          end
+        end
+        deps or return
+        deps = deps.strip.split(/\s+/) if deps.is_a?(String)
+        deps.compact.uniq.partition {|item| item =~ REGEXP_SCHEMA || item.end_with?(".tar.gz")}.reverse
+      end
+
+      def install_os_packages(*args)
+        args.each do |item|
+          say "* Installing '#{item}' dependency"
+        end
+        cmds = @@deps["*"]["command"].strip.split(/\s+/).flat_map {|item| item == '${packages}' ? args : item}
+        Gem::Util.silent_system(*cmds)
+        true # success/error?
+      end
+
+      def copy_gem_extensions(*args)
+        require 'rubygems/remote_fetcher'
+
+        root = spec.extension_dir
+        args.each do |item|
+          say "* Extracting '#{item}' to '#{root}'"
+          untar(gunzip(fetch(item)), root)
+        end
+        true # success/error?
+      end
+
+      def fetch(item)
+        tool = Gem::RemoteFetcher.fetcher
+        item =~ REGEXP_SCHEMA ? tool.fetch_path(item) : File.binread(item)
+      end
+
+      # The tar/gz code below is based on MIT licensed code by Colin MacKenzie IV
+
+      def tar(dir, ext=nil)
+        path = File.expand_path(dir)
+        skip = path.size + 1
+        tar_io = StringIO.new
+        Gem::Package::TarWriter.new(tar_io) do |tar|
+          Dir[File.join(path, "**/*#{'.' + ext if ext}")].each do |file|
+            stat = File.stat(file)
+            name = file[skip..-1]
+            if stat.file?
+              tar.add_file_simple(name, stat.mode, stat.size) do |tf|
+                tf.write(File.binread(file))
+              end
+            elsif stat.directory?
+              tar.mkdir(name, mode)
+            end
+          end
+        end
+        tar_io.string
+      end
+
+      def gzip(str)
+        gz_io = StringIO.new
+        z = Zlib::GzipWriter.new(gz_io)
+        z.write(str)
+        z.close
+        gz_io.string
+      end
+
+      def gunzip(str)
+        gz_io = StringIO.new(str)
+        z = Zlib::GzipReader.new(gz_io)
+        str = z.read
+        z.close
+        str
+      end
+
+      def untar(str, dir)
+        tar_io = StringIO.new(str)
+        root = File.expand_path(dir)
+        Gem::Package::TarReader.new(tar_io) do |tar|
+          tar.each do |file|
+            path = File.join(root, file.full_name)
+            mode = file.header.mode
+            if file.directory?
+              FileUtils.mkdir_p(path, mode)
+            else
+              FileUtils.mkdir_p(File.dirname(path))
+              File.binwrite(path, file.read)
+              FileUtils.chmod(mode, path)
+            end
+          end
+        end
+      end
+    end
+  end
+end

data/lib/rubygems_plugin.rb

@@ -0,0 +1 @@
+require "rubygems/gem_dependencies"

metadata

@@ -0,0 +1,71 @@
+--- !ruby/object:Gem::Specification
+name: gem-dependencies
+version: !ruby/object:Gem::Version
+  version: 0.1.3
+platform: ruby
+authors:
+- Steve Shreeve
+autorequire: 
+bindir: bin
+cert_chain:
+- |
+  -----BEGIN CERTIFICATE-----
+  MIIDhTCCAm2gAwIBAgIBATANBgkqhkiG9w0BAQUFADBEMRYwFAYDVQQDDA1zdGV2
+  ZS5zaHJlZXZlMRUwEwYKCZImiZPyLGQBGRYFZ21haWwxEzARBgoJkiaJk/IsZAEZ
+  FgNjb20wHhcNMTUwNjEyMDMyMjM4WhcNMTYwNjExMDMyMjM4WjBEMRYwFAYDVQQD
+  DA1zdGV2ZS5zaHJlZXZlMRUwEwYKCZImiZPyLGQBGRYFZ21haWwxEzARBgoJkiaJ
+  k/IsZAEZFgNjb20wggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQCoT0lD
+  XoRFhnjFAtJ79NonyJxzMwq2s4TSnqrY25ElM2NoTcboCJ3eTgoeV/F1WSxGfEHs
+  xM00/ok/fMqFAZMIA8eV5+aaWze2q6/vE+/u+EI1dI9bogtGxu3FFuYUpVy5wha9
+  87U4HXPwXUbKS7bGQuTeJ07jO2okGCufbb+HNXABf+EEZCLk5fH9j1TGgu8fxq/X
+  vmVRKF/YpFEFM5TVv0dOO17vU/wOyBynjQ33AW8NHily163YjgIZR7mE042Hh9+G
+  w3Uq4L5ytgSoVDIs+owm5NLt0G13EjmsZUBszVErJ+byg62VjiAjSL4DQJSrlCsU
+  UuTSvTtx7Ez1nvKtAgMBAAGjgYEwfzAJBgNVHRMEAjAAMAsGA1UdDwQEAwIEsDAd
+  BgNVHQ4EFgQU41cP4dVdL49Hzswd3/gCzX3+z3swIgYDVR0RBBswGYEXc3RldmUu
+  c2hyZWV2ZUBnbWFpbC5jb20wIgYDVR0SBBswGYEXc3RldmUuc2hyZWV2ZUBnbWFp
+  bC5jb20wDQYJKoZIhvcNAQEFBQADggEBAIaDzT/cGpJJT9eyhovk1ScwTA1jocDR
+  bIs/mNbQN6XlkipOtxCcx9XvVuwEZtP8/UeX+SKBHAtTnFf4Dez7vjSQAaVLZQe7
+  uXuX+S4LFTTf0oFVznQaMQ7PbqKqCmtof+1MqNpDTPTayxrlNUTPl3SpkW6bv4qi
+  hWz+RgGCWYc9TQ+JigLPbsfJpok31sHXrCztMb/KMbTozGTGswljbpuSq7Lzs9rp
+  4PkbTeqnzZJmSZjUBwvnQFNhXY08hPUs7aASHu9deACBbOBY+Hg6tiSOdfw50uYS
+  ksjokeQosImFuxgjMrlyoRcpbZmyfQ33yImqtLH6FMWF3hpoxJq9wPk=
+  -----END CERTIFICATE-----
+date: 2015-06-12 00:00:00.000000000 Z
+dependencies: []
+description: This gem makes it easy to install binary gems on machines without a compiler.
+email: steve.shreeve@gmail.com
+executables: []
+extensions: []
+extra_rdoc_files: []
+files:
+- MIT
+- README.md
+- certs/shreeve.pem
+- gem-dependencies.gemspec
+- lib/rubygems/gem_dependencies.rb
+- lib/rubygems_plugin.rb
+homepage: https://github.com/shreeve/gem-dependencies
+licenses:
+- MIT
+metadata: {}
+post_install_message: 
+rdoc_options: []
+require_paths:
+- lib
+required_ruby_version: !ruby/object:Gem::Requirement
+  requirements:
+  - - ">="
+    - !ruby/object:Gem::Version
+      version: '0'
+required_rubygems_version: !ruby/object:Gem::Requirement
+  requirements:
+  - - ">="
+    - !ruby/object:Gem::Version
+      version: '0'
+requirements: []
+rubyforge_project: 
+rubygems_version: 2.4.7
+signing_key: 
+specification_version: 4
+summary: RubyGems plugin to simplify installing binary gems on runtime systems.
+test_files: []

metadata.gz.sig

@@ -0,0 +1,3 @@
+�����O	!�=�#�x����Ӧ
+�Vs-Z��ގz
+kS��H��%�\o�v�B�d�,S�g]a�\�����o����J