librarian-puppet-rethinc 3.0.1.1

checksums.yaml

@@ -0,0 +1,7 @@
+---
+SHA256:
+  metadata.gz: 2442dff3152aa22e2f28aff219b0c2013fe719b42465e7403c5efebe0af2e559
+  data.tar.gz: 9192fc1b8379ca0be3310c1c515ba82b9056be737449fefe7ba86fc9f99e5fee
+SHA512:
+  metadata.gz: edd261044f2bb804645bc971346e5cf896c495e542d18df97a1f8b181c5b7ca45a44becfca688015ca68a9acbc362786a5ae07470c23cc52d6ed272558fcfd6b
+  data.tar.gz: 80615bcb701004592faeb5550725bac5ab57d76f1bd520db94246f8f752325a9211cac415741eeb619d414db83ce569be1cf4d90b8505b3c3e74fb4c52ddc5b8

data/.gitignore

@@ -0,0 +1,5 @@
+pkg/
+Gemfile.lock
+tmp/
+coverage/
+*.gem

data/LICENSE

@@ -0,0 +1,20 @@
+Copyright (c) 2012-2014 Tim Sharpe, Carlos Sanchez and others
+
+Permission is hereby granted, free of charge, to any person obtaining
+a copy of this software and associated documentation files (the
+"Software"), to deal in the Software without restriction, including
+without limitation the rights to use, copy, modify, merge, publish,
+distribute, sublicense, and/or sell copies of the Software, and to
+permit persons to whom the Software is furnished to do so, subject to
+the following conditions:
+
+The above copyright notice and this permission notice shall be
+included in all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
+EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
+MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
+NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE
+LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
+OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
+WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

data/README.md

@@ -0,0 +1,331 @@
+# Librarian-puppet
+
+[![Build Status](https://travis-ci.org/voxpupuli/librarian-puppet.png?branch=master)](https://travis-ci.org/voxpupuli/librarian-puppet)
+
+## Introduction
+
+Librarian-puppet is a bundler for your puppet infrastructure.  You can use
+librarian-puppet to manage the puppet modules your infrastructure depends on,
+whether the modules come from the [Puppet Forge](https://forge.puppet.com/),
+Git repositories or just a path.
+
+* Librarian-puppet can reuse the dependencies listed in your `Modulefile` or `metadata.json`
+* Forge modules can be installed from [Puppetlabs Forge](https://forge.puppet.com/) or an internal Forge such as [Pulp](http://www.pulpproject.org/)
+* Git modules can be installed from a branch, tag or specific commit, optionally using a path inside the repository
+* Modules can be installed from GitHub using tarballs, without needing Git installed
+* Modules can be installed from a filesystem path
+* Module dependencies are resolved transitively without needing to list all the modules explicitly
+
+
+Librarian-puppet manages your `modules/` directory for you based on your
+`Puppetfile`.  Your `Puppetfile` becomes the authoritative source for what
+modules you require and at what version, tag or branch.
+
+Once using Librarian-puppet you should not modify the contents of your `modules`
+directory.  The individual modules' repos should be updated, tagged with a new
+release and the version bumped in your Puppetfile.
+
+It is based on [Librarian](https://github.com/applicationsonline/librarian), a
+framework for writing bundlers, which are tools that resolve, fetch, install,
+and isolate a project's dependencies.
+
+## Versions
+
+Librarian-Puppet 3.0.0 and newer requires Ruby >= 2.0. Use version 2.2.4 if you need support for Puppet 3.7 or earlier, or Ruby 1.9 or earlier. Note that [Puppet 4.10 and newer require Ruby 2.1](https://puppet.com/docs/puppet/4.10/system_requirements.html#prerequisites) or newer.
+
+Librarian-Puppet 2.0.0 and newer requires Ruby >= 1.9 and uses Puppet Forge API v3. For Ruby 1.8 use 1.5.0.
+
+See the [Changelog](Changelog.md) for more details.
+
+## The Puppetfile
+
+Every Puppet repository that uses Librarian-puppet may have a file named
+`Puppetfile`, `metadata.json` or `Modulefile` in the root directory of that repository.
+The full specification
+for which modules your puppet infrastructure repository depends goes in here.
+
+### Simple usage
+
+If no Puppetfile is present, `librarian-puppet` will download all the dependencies
+listed in your `metadata.json` or `Modulefile` from the Puppet Forge,
+as if the Puppetfile contained
+
+    forge "https://forgeapi.puppetlabs.com"
+
+    metadata
+
+
+### Example Puppetfile
+
+    forge "https://forgeapi.puppetlabs.com"
+
+    mod 'puppetlabs-razor'
+    mod 'puppetlabs-ntp', "0.0.3"
+
+    mod 'puppetlabs-apt',
+      :git => "git://github.com/puppetlabs/puppetlabs-apt.git"
+
+    mod 'puppetlabs-stdlib',
+      :git => "git://github.com/puppetlabs/puppetlabs-stdlib.git"
+
+    mod 'puppetlabs-apache', '0.6.0',
+      :github_tarball => 'puppetlabs/puppetlabs-apache'
+
+    mod 'acme-mymodule', :path => './some_folder'
+
+    exclusion 'acme-bad_module'
+
+
+### Recursive module dependency resolution
+
+When fetching a module all dependencies specified in its
+`Modulefile`, `metadata.json` and `Puppetfile` will be resolved and installed.
+
+### Puppetfile Breakdown
+
+    forge "https://forgeapi.puppetlabs.com"
+
+This declares that we want to use the official Puppet Labs Forge as our default
+source when pulling down modules.  If you run your own local forge, you may
+want to change this.
+
+    metadata
+
+Download all the dependencies listed in your `metadata.json` or `Modulefile` from the Puppet Forge.
+
+    mod 'puppetlabs-razor'
+
+Pull in the latest version of the Puppet Labs Razor module from the default
+source.
+
+    mod 'puppetlabs-ntp', "0.0.3"
+
+Pull in version 0.0.3 of the Puppet Labs NTP module from the default source.
+
+    mod 'puppetlabs-apt',
+      :git => "git://github.com/puppetlabs/puppetlabs-apt.git"
+
+Our puppet infrastructure repository depends on the `apt` module from the
+Puppet Labs GitHub repos and checks out the `master` branch.
+
+    mod 'puppetlabs-apt',
+      :git => "git://github.com/puppetlabs/puppetlabs-apt.git",
+      :ref => '0.0.3'
+
+Our puppet infrastructure repository depends on the `apt` module from the
+Puppet Labs GitHub repos and checks out a tag of `0.0.3`.
+
+    mod 'puppetlabs-apt',
+      :git => "git://github.com/puppetlabs/puppetlabs-apt.git",
+      :ref => 'feature/master/dans_refactor'
+
+Our puppet infrastructure repository depends on the `apt` module from the
+Puppet Labs GitHub repos and checks out the `dans_refactor` branch.
+
+When using a Git source, we do not have to use a `:ref =>`.
+If we do not, then librarian-puppet will assume we meant the `master` branch.
+
+If we use a `:ref =>`, we can use anything that Git will recognize as a ref.
+This includes any branch name, tag name, SHA, or SHA unique prefix. If we use a
+branch, we can later ask Librarian-puppet to update the module by fetching the
+most recent version of the module from that same branch.
+
+Note that Librarian-puppet recognizes the [r10k Puppetfile's](https://github.com/puppetlabs/r10k/blob/master/doc/puppetfile.mkd) additional
+options, `:tag`, `:commit`, and `:branch`, but only as aliases for `:ref`.
+That is, there is no implementation of r10k's optimizations around fetching
+these different types of git objects.
+
+The Git source also supports a `:path =>` option. If we use the path option,
+Librarian-puppet will navigate down into the Git repository and only use the
+specified subdirectory. Some people have the habit of having a single repository
+with many modules in it. If we need a module from such a repository, we can
+use the `:path =>` option here to help Librarian-puppet drill down and find the
+module subdirectory.
+
+    mod 'puppetlabs-apt',
+      :git => "git://github.com/fake/puppet-modules.git",
+      :path => "modules/apt"
+
+Our puppet infrastructure repository depends on the `apt` module, which we have
+stored as a directory under our `puppet-modules` git repos.
+
+    mod 'puppetlabs-apache', '0.6.0',
+      :github_tarball => 'puppetlabs/puppetlabs-apache'
+
+Our puppet infrastructure repository depends on the `puppetlabs-apache` module,
+to be downloaded from GitHub tarball.
+
+    mod 'acme-mymodule', :path => './some_folder'
+
+Our puppet infrastructure repository depends on the `acme-mymodule` module,
+which is already in the filesystem.
+
+    exclusion 'acme-bad_module'
+
+Exclude the module `acme-bad_module` from resolution and installation.
+
+## How to Use
+
+Install librarian-puppet:
+
+    $ gem install librarian-puppet
+
+Prepare your puppet infrastructure repository:
+
+    $ cd ~/path/to/puppet-inf-repos
+    $ (git) rm -rf modules
+    $ librarian-puppet init
+
+Librarian-puppet takes over your `modules/` directory, and will always
+reinstall (if missing) the modules listed the `Puppetfile.lock` into your
+`modules/` directory, therefore you do not need your `modules/` directory to be
+tracked in Git.
+
+Librarian-puppet uses a `.tmp/` directory for tempfiles and caches. You should
+not track this directory in Git.
+
+Running `librarian-puppet init` will create a skeleton Puppetfile for you as
+well as adding `tmp/` and `modules/` to your `.gitignore`.
+
+    $ librarian-puppet install [--clean] [--verbose]
+
+This command looks at each `mod` declaration and fetches the module from the
+source specified.  This command writes the complete resolution into
+`Puppetfile.lock` and then copies all of the fetched modules into your
+`modules/` directory, overwriting whatever was there before.
+
+Librarian-puppet support both v1 and v3 of the Puppet Forge API.
+Specify a specific API version when installing modules:
+
+    $ librarian-puppet install --use-v1-api # this is default; ignored for official Puppet Forge
+    $ librarian-puppet install --no-use-v1-api # use the v3 API; default for official Puppet Forge
+
+Please note that this does not apply for the official Puppet Forge, where v3 is used by default.
+
+Get an overview of your `Puppetfile.lock` with:
+
+    $ librarian-puppet show
+
+Inspect the details of specific resolved dependencies with:
+
+    $ librarian-puppet show NAME1 [NAME2, ...]
+
+Find out which dependencies are outdated and may be updated:
+
+    $ librarian-puppet outdated [--verbose]
+
+Update the version of a dependency:
+
+    $ librarian-puppet update apt [--verbose]
+    $ git diff Puppetfile.lock
+    $ git add Puppetfile.lock
+    $ git commit -m "bumped the version of apt up to 0.0.4."
+
+## Configuration
+
+Configuration comes from three sources with the following highest-to-lowest
+precedence:
+
+* The local config (`./.librarian/puppet/config`)
+* The environment
+* The global config (`~/.librarian/puppet/config`)
+
+You can inspect the final configuration with:
+
+    $ librarian-puppet config
+
+You can find out where a particular key is set with:
+
+    $ librarian-puppet config KEY
+
+You can set a key at the global level with:
+
+    $ librarian-puppet config KEY VALUE --global
+
+And remove it with:
+
+    $ librarian-puppet config KEY --global --delete
+
+You can set a key at the local level with:
+
+    $ librarian-puppet config KEY VALUE --local
+
+And remove it with:
+
+    $ librarian-puppet config KEY --local --delete
+
+You cannot set or delete environment-level config keys with the CLI.
+
+Configuration set at either the global or local level will affect subsequent
+invocations of `librarian-puppet`. Configurations set at the environment level are
+not saved and will not affect subsequent invocations of `librarian-puppet`.
+
+You can pass a config at the environment level by taking the original config key
+and transforming it: replace hyphens (`-`) with underscores (`_`) and periods
+(`.`) with doubled underscores (`__`), uppercase, and finally prefix with
+`LIBRARIAN_PUPPET_`. For example, to pass a config in the environment for the key
+`part-one.part-two`, set the environment variable
+`LIBRARIAN_PUPPET_PART_ONE__PART_TWO`.
+
+Configuration affects how various commands operate.
+
+* The `path` config sets the directory to install to. If a relative
+  path, it is relative to the directory containing the `Puppetfile`. The
+  equivalent environment variable is `LIBRARIAN_PUPPET_PATH`.
+
+* The `tmp` config sets the cache directory for librarian. If a relative
+  path, it is relative to the directory containing the `Puppetfile`. The
+  equivalent environment variable is `LIBRARIAN_PUPPET_TMP`.
+
+Configuration can be set by passing specific options to other commands.
+
+* The `path` config can be set at the local level by passing the `--path` option
+  to the `install` command. It can be unset at the local level by passing the
+  `--no-path` option to the `install` command. Note that if this is set at the
+  environment or global level then, even if `--no-path` is given as an option,
+  the environment or global config will be used.
+
+
+## Rsync Option
+
+The default convergence strategy between the cache and the module directory is
+to execute an `rm -r` on the module directory and just `cp -r` from the cache.
+This causes the module to be removed from the module path every time librarian
+puppet updates, regardless of whether the content has changed. This can cause
+some problems in environments with lots of change. The problem arises when the
+module directory gets removed while Puppet is trying to read files inside it.
+The `puppet master` process will lose its CWD and the catalog will fail to
+compile. To avoid this, you can use `rsync` to implement a more conservative
+convergence strategy. This will use `rsync` with the `-avz` and `--delete`
+flags instead of a `rm -r` and `cp -r`. To use this feature, just set the
+`rsync` configuration setting to `true`.
+
+    $ librarian-puppet config rsync true --global
+
+Alternatively, using an environment variable:
+
+    LIBRARIAN_PUPPET_RSYNC='true'
+
+Note that the directories will still be purged if you run librarian-puppet with
+the --clean or --destructive flags.
+
+## How to Contribute
+
+ * Pull requests please.
+ * Bonus points for feature branches.
+
+## Reporting Issues
+
+Bug reports to the github issue tracker please.
+Please include:
+
+ * Relevant `Puppetfile` and `Puppetfile.lock` files
+ * Version of ruby, librarian-puppet, and puppet
+ * What distro
+ * Please run the `librarian-puppet` commands in verbose mode by using the
+  `--verbose` flag, and include the verbose output in the bug report as well.
+
+
+## License
+Please see the [LICENSE](https://github.com/voxpupuli/librarian-puppet/blob/master/LICENSE)
+file.

data/bin/librarian-puppet

@@ -0,0 +1,7 @@
+#!/usr/bin/env ruby
+
+lib = File.expand_path('../../lib', __FILE__)
+$:.unshift(lib) unless $:.include?(lib)
+
+require 'librarian/puppet/cli'
+Librarian::Puppet::Cli.bin!

data/lib/librarian/puppet/action/install.rb

@@ -0,0 +1,26 @@
+require 'librarian/action/install'
+
+module Librarian
+  module Puppet
+    module Action
+      class Install < Librarian::Action::Install
+
+        private
+
+        def create_install_path
+          install_path.rmtree if install_path.exist? && destructive?
+          install_path.mkpath
+        end
+
+        def destructive?
+          environment.config_db.local['destructive'] == 'true'
+        end
+
+        def check_specfile
+          # don't fail if Puppetfile doesn't exist as we'll use the Modulefile or metadata.json
+        end
+
+      end
+    end
+  end
+end

data/lib/librarian/puppet/action/resolve.rb

@@ -0,0 +1,26 @@
+require 'librarian/action/resolve'
+require 'librarian/puppet/resolver'
+
+module Librarian
+  module Puppet
+    module Action
+      class Resolve < Librarian::Action::Resolve
+        include Librarian::Puppet::Util
+
+        def run
+          super
+          manifests = environment.lock.manifests.select{ |m| m.name }
+          dupes = manifests.group_by{ |m| module_name(m.name) }.select { |k, v| v.size > 1 }
+          dupes.each do |k,v|
+            warn("Dependency on module '#{k}' is fullfilled by multiple modules and only one will be used: #{v.map{|m|m.name}}")
+          end
+        end
+
+        def resolver
+          Resolver.new(environment)
+        end
+
+      end
+    end
+  end
+end

data/lib/librarian/puppet/action.rb

@@ -0,0 +1,2 @@
+require "librarian/puppet/action/install"
+require "librarian/puppet/action/resolve"

data/lib/librarian/puppet/cli.rb

@@ -0,0 +1,117 @@
+require 'librarian/helpers'
+
+require 'librarian/cli'
+require 'librarian/puppet'
+require 'librarian/puppet/action'
+
+module Librarian
+  module Puppet
+    class Cli < Librarian::Cli
+      include Librarian::Puppet::Util
+
+      module Particularity
+        def root_module
+          Puppet
+        end
+      end
+
+      include Particularity
+      extend Particularity
+
+      source_root Pathname.new(__FILE__).dirname.join("templates")
+
+      def init
+        copy_file environment.specfile_name
+
+        if File.exists? ".gitignore"
+          gitignore = File.read('.gitignore').split("\n")
+        else
+          gitignore = []
+        end
+
+        gitignore << ".tmp/" unless gitignore.include? ".tmp/"
+        gitignore << "modules/" unless gitignore.include? "modules/"
+
+        File.open(".gitignore", 'w') do |f|
+          f.puts gitignore.join("\n")
+        end
+      end
+
+      desc "install", "Resolves and installs all of the dependencies you specify."
+      option "quiet", :type => :boolean, :default => false
+      option "verbose", :type => :boolean, :default => false
+      option "line-numbers", :type => :boolean, :default => false
+      option "clean", :type => :boolean, :default => false
+      option "strip-dot-git", :type => :boolean
+      option "path", :type => :string
+      option "destructive", :type => :boolean, :default => false
+      option "local", :type => :boolean, :default => false
+      option "use-v1-api", :type => :boolean, :default => true
+      option "use-short-cache-path", :type => :boolean, :default => false
+      def install
+
+        ensure!
+        clean! if options["clean"]
+        unless options["destructive"].nil?
+          environment.config_db.local['destructive'] = options['destructive'].to_s
+        end
+        if options.include?("strip-dot-git")
+          strip_dot_git_val = options["strip-dot-git"] ? "1" : nil
+          environment.config_db.local["install.strip-dot-git"] = strip_dot_git_val
+        end
+        if options.include?("path")
+          environment.config_db.local["path"] = options["path"]
+        end
+
+        environment.config_db.local['use-v1-api'] = options['use-v1-api'] ? '1' : nil
+        environment.config_db.local['mode'] = options['local'] ? 'local' : nil
+        environment.config_db.local['use-short-cache-path'] = options['use-short-cache-path'] ? '1' : nil
+        
+        resolve!
+        debug { "Install: dependencies resolved"}
+        install!
+      end
+
+      desc "update", "Updates and installs the dependencies you specify."
+      option "verbose", :type => :boolean, :default => false
+      option "line-numbers", :type => :boolean, :default => false
+      option "use-v1-api", :type => :boolean, :default => true
+      def update(*names)
+
+        environment.config_db.local['use-v1-api'] = options['use-v1-api'] ? '1' : nil
+
+        warn("Usage of module/name is deprecated, use module-name") if names.any? {|n| n.include?("/")}
+        # replace / to - in the module names
+        super(*names.map{|n| normalize_name(n)})
+      end
+
+      desc "package", "Cache the puppet modules in vendor/puppet/cache."
+      option "quiet", :type => :boolean, :default => false
+      option "verbose", :type => :boolean, :default => false
+      option "line-numbers", :type => :boolean, :default => false
+      option "clean", :type => :boolean, :default => false
+      option "strip-dot-git", :type => :boolean
+      option "path", :type => :string
+      option "destructive", :type => :boolean, :default => false
+      def package
+        environment.vendor!
+        install
+      end
+
+      def version
+        say "librarian-puppet v#{Librarian::Puppet::VERSION}"
+      end
+
+      private
+
+      # override the actions to use our own
+
+      def install!(options = { })
+        Action::Install.new(environment, options).run
+      end
+      def resolve!(options = { })
+        Action::Resolve.new(environment, options).run
+      end
+    end
+  end
+end

data/lib/librarian/puppet/dependency.rb

@@ -0,0 +1,26 @@
+module Librarian
+  module Puppet
+
+    class Dependency < Librarian::Dependency
+
+      include Librarian::Puppet::Util
+
+      attr_accessor :parent
+      private :parent=
+
+      def initialize(name, requirement, source, parent = nil)
+        # Issue #235 fail if forge source is not defined
+        raise Error, "forge entry is not defined in Puppetfile" if source.instance_of?(Array) && source.empty?
+
+        self.parent = parent
+        super(normalize_name(name), requirement, source)
+      end
+
+      def to_s
+        "#{name} (#{requirement}) <#{source}> (from #{parent.nil? ? '<nil>' : parent})"
+      end
+
+    end
+
+  end
+end