librarian-puppet-maestrodev 0.9.7

data/.gitignore

@@ -0,0 +1,3 @@
+pkg/
+Gemfile.lock
+tmp/

data/LICENSE

@@ -0,0 +1,20 @@
+Copyright (c) 2012 Tim Sharpe
+
+Permission is hereby granted, free of charge, to any person obtaining
+a copy of this software and associated documentation files (the
+"Software"), to deal in the Software without restriction, including
+without limitation the rights to use, copy, modify, merge, publish,
+distribute, sublicense, and/or sell copies of the Software, and to
+permit persons to whom the Software is furnished to do so, subject to
+the following conditions:
+
+The above copyright notice and this permission notice shall be
+included in all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
+EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
+MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
+NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE
+LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
+OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
+WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

data/README.md

@@ -0,0 +1,187 @@
+# Librarian-puppet
+
+## Introduction
+
+Librarian-puppet is a bundler for your puppet infrastructure.  You can use
+librarian-puppet to manage the puppet modules your infrastructure depends on.
+It is based on [Librarian](https://github.com/applicationsonline/librarian), a
+framework for writing bundlers, which are tools that resolve, fetch, install,
+and isolate a project's dependencies.
+
+Librarian-puppet manages your `modules/` directory for you based on your
+`Puppetfile`.  Your `Puppetfile` becomes the authoritative source for what
+modules you require and at what version, tag or branch.
+
+Once using Librarian-puppet you should not modify the contents of your `modules`
+directory.  The individual modules' repos should be updated, tagged with a new
+release and the version bumped in your Puppetfile.
+
+## The Puppetfile
+
+Every Puppet repository that uses Librarian-puppet will have a file named
+`Puppetfile` in the root directory of that repository.  The full specification
+for which modules your puppet infrastructure repository  depends goes in here.
+
+### Example Puppetfile
+
+    forge "http://forge.puppetlabs.com"
+
+    mod "puppetlabs/razor"
+    mod "puppetlabs/ntp", "0.0.3"
+
+    mod "apt",
+      :git => "git://github.com/puppetlabs/puppetlabs-apt.git"
+
+    mod "stdlib",
+      :git => "git://github.com/puppetlabs/puppetlabs-stdlib.git"
+
+*See [jenkins-appliance](https://github.com/aussielunix/jenkins-appliance) for
+a puppet repo already setup to use librarian-puppet.*
+
+### Puppetfile Breakdown
+
+    forge "http://forge.puppetlabs.com"
+
+This declares that we want to use the official Puppet Labs Forge as our default
+source when pulling down modules.  If you run your own local forge, you may
+want to change this.
+
+    mod "puppetlabs/razor"
+
+Pull in the latest version of the Puppet Labs Razor module from the default
+source.
+
+    mod "puppetlabs/ntp", "0.0.3"
+
+Pull in version 0.0.3 of the Puppet Labs NTP module from the default source.
+
+    mod "apt",
+      :git => "git://github.com/puppetlabs/puppetlabs-apt.git"
+
+Our puppet infrastructure repository depends on the `apt` module from the
+Puppet Labs GitHub repos and checks out the `master` branch.
+
+    mod "apt",
+      :git => "git://github.com/puppetlabs/puppetlabs-apt.git",
+      :ref => '0.0.3'
+
+Our puppet infrastructure repository depends on the `apt` module from the
+Puppet Labs GitHub repos and checks out a tag of `0.0.3`.
+
+    mod "apt",
+      :git => "git://github.com/puppetlabs/puppetlabs-apt.git",
+      :ref => 'feature/master/dans_refactor'
+
+Our puppet infrastructure repository depends on the `apt` module from the
+Puppet Labs GitHub repos and checks out the `dans_refactor` branch.
+
+When using a Git source, we do not have to use a `:ref =>`.
+If we do not, then librarian-puppet will assume we meant the `master` branch.
+
+If we use a `:ref =>`, we can use anything that Git will recognize as a ref.
+This includes any branch name, tag name, SHA, or SHA unique prefix. If we use a
+branch, we can later ask Librarian-pupet to update the modulek by fetching the
+most recent version of the module from that same branch.
+
+The Git source also supports a `:path =>` option. If we use the path option,
+Librarian-puppet will navigate down into the Git repository and only use the
+specified subdirectory. Some people have the habit of having a single repository
+with many modules in it. If we need a module from such a repository, we can
+use the `:path =>` option here to help Librarian-puppet drill down and find the
+module subdirectory.
+
+    mod "apt",
+      :git => "git://github.com/fake/puppet-modules.git",
+      :path => "modules/apt"
+
+Our puppet infrastructure repository depends on the `apt` module, which we have
+stored as a directory under our `puppet-modules` git repos.
+
+## How to Use
+
+Install librarian-puppet:
+
+    $ gem install librarian-puppet
+
+Prepare your puppet infrastructure repository:
+
+    $ cd ~/path/to/puppet-inf-repos
+    $ (git) rm -rf modules
+    $ librarian-puppet init
+
+Librarian-puppet takes over your `modules/` directory, and will always
+reinstall (if missing) the modules listed the `Puppetfile.lock` into your
+`modules/` directory, therefore you do not need your `modules/` directory to be
+tracked in Git.
+
+Librarian-puppet uses a `.tmp/` directory for tempfiles and caches. You should
+not track this directory in Git.
+
+Running `librarian-puppet init` will create a skeleton Puppetfile for you as
+well as adding `tmp/` and `modules/` to your `.gitignore`.
+
+    $ librarian-puppet install [--clean] [--verbose]
+
+This command looks at each `mod` declaration and fetches the module from the
+source specified.  This command writes the complete resolution into
+`Puppetfile.lock` and then copies all of the fetched modules into your
+`modules/` directory, overwriting whatever was there before.
+
+Get an overview of your `Puppetfile.lock` with:
+
+    $ librarian-puppet show
+
+Inspect the details of specific resolved dependencies with:
+
+    $ librarian-puppet show NAME1 [NAME2, ...]
+
+Find out which dependencies are outdated and may be updated:
+
+    $ librarian-puppet outdated [--verbose]
+
+Update the version of a dependency:
+
+    $ librarian-puppet update apt [--verbose]
+    $ git diff Puppetfile.lock
+    $ git add Puppetfile.lock
+    $ git commit -m "bumped the version of apt up to 0.0.4."
+
+## How to Contribute
+
+ * Pull requests please.
+ * Bonus points for feature branches.
+
+## Reporting Issues
+
+Bug reports to the github issue tracker please.
+Please include:
+
+ * relevant `Puppetfile` and `Puppetfile.lock` files.
+ * version of ruby, librarian-puppet
+ * What distro
+ * Please run the `librarian-puppet` commands in verbose mode by using the
+  `--verbose` flag, and include the verbose output in the bug report as well.
+
+## Changelog
+
+### 0.9.0
+
+ * Initial release
+
+### 0.9.1
+
+ * Proper error message when a module that is sourced from the forge does not
+   exist.
+ * Added support for annotated tags as git references.
+ * `librarian-puppet init` adds `.tmp/` to gitignore instead of `tmp/`.
+ * Fixed syntax error in the template Puppetfile created by `librarian-puppet
+   init`.
+ * Checks for `lib/puppet` as well as `manifests/` when checking if the git
+   repository is a valid module.
+ * When a user specifies `<foo>/<bar>` as the name of a module sources from a
+   git repository, assume the module name is actually `<bar>`.
+ * Fixed gem description and summary in gemspec.
+
+## License
+Please see the [LICENSE](https://github.com/rodjek/librarian-puppet/blob/master/LICENSE)
+file.

data/bin/librarian-puppet

@@ -0,0 +1,9 @@
+#!/usr/bin/env ruby
+
+lib = File.expand_path('../../lib', __FILE__)
+vendor = File.expand_path('../../vendor/librarian/lib', __FILE__)
+$:.unshift(lib) unless $:.include?(lib)
+$:.unshift(vendor) unless $:.include?(vendor)
+
+require 'librarian/puppet/cli'
+Librarian::Puppet::Cli.bin!

data/lib/librarian/puppet.rb

@@ -0,0 +1,13 @@
+require 'librarian'
+require 'puppet'
+require 'fileutils'
+
+require 'librarian/puppet/extension'
+require 'librarian/puppet/version'
+
+require 'librarian/action/install'
+
+module Librarian
+  module Puppet
+  end
+end

data/lib/librarian/puppet/cli.rb

@@ -0,0 +1,85 @@
+require 'librarian/helpers'
+
+require 'librarian/cli'
+require 'librarian/puppet'
+
+module Librarian
+  module Puppet
+    class Cli < Librarian::Cli
+
+      module Particularity
+        def root_module
+          Puppet
+        end
+      end
+
+      include Particularity
+      extend Particularity
+
+      source_root Pathname.new(__FILE__).dirname.join("templates")
+
+      def init
+        copy_file environment.specfile_name
+
+        if File.exists? ".gitignore"
+          gitignore = File.read('.gitignore').split("\n")
+        else
+          gitignore = []
+        end
+
+        gitignore << ".tmp/" unless gitignore.include? ".tmp/"
+        gitignore << "modules/" unless gitignore.include? "modules/"
+
+        File.open(".gitignore", 'w') do |f|
+          f.puts gitignore.join("\n")
+        end
+      end
+
+      desc "install", "Resolves and installs all of the dependencies you specify."
+      option "quiet", :type => :boolean, :default => false
+      option "verbose", :type => :boolean, :default => false
+      option "line-numbers", :type => :boolean, :default => false
+      option "clean", :type => :boolean, :default => false
+      option "strip-dot-git", :type => :boolean
+      option "path", :type => :string
+      option "destructive", :type => :boolean, :default => false
+      option "local", :type => :boolean, :default => false
+      def install
+        ensure!
+        clean! if options["clean"]
+        unless options["destructive"].nil?
+          environment.config_db.local['destructive'] = options['destructive'].to_s
+        end
+        if options.include?("strip-dot-git")
+          strip_dot_git_val = options["strip-dot-git"] ? "1" : nil
+          environment.config_db.local["install.strip-dot-git"] = strip_dot_git_val
+        end
+        if options.include?("path")
+          environment.config_db.local["path"] = options["path"]
+        end
+
+        environment.config_db.local['mode'] = options['local'] ? 'local' : nil
+
+        resolve!
+        install!
+      end
+
+      desc "package", "Cache the puppet modules in vendor/puppet/cache."
+      option "quiet", :type => :boolean, :default => false
+      option "verbose", :type => :boolean, :default => false
+      option "line-numbers", :type => :boolean, :default => false
+      option "clean", :type => :boolean, :default => false
+      option "strip-dot-git", :type => :boolean
+      option "path", :type => :string
+      option "destructive", :type => :boolean, :default => false
+      def package
+        environment.vendor!
+        install
+      end
+
+      def version
+        say "librarian-puppet v#{Librarian::Puppet::VERSION}"
+      end
+    end
+  end
+end

data/lib/librarian/puppet/dsl.rb

@@ -0,0 +1,16 @@
+require 'librarian/dsl'
+require 'librarian/puppet/source'
+
+module Librarian
+  module Puppet
+    class Dsl < Librarian::Dsl
+
+      dependency :mod
+
+      source :forge => Source::Forge
+      source :git => Source::Git
+      source :path => Source::Path
+      source :github_tarball => Source::GitHubTarball
+    end
+  end
+end

data/lib/librarian/puppet/environment.rb

@@ -0,0 +1,54 @@
+require "librarian/environment"
+require "librarian/puppet/dsl"
+require "librarian/puppet/source"
+require "librarian/puppet/lockfile/parser"
+
+module Librarian
+  module Puppet
+    class Environment < Librarian::Environment
+
+      def adapter_name
+        "puppet"
+      end
+
+      def install_path
+        part = config_db["path"] || "modules"
+        project_path.join(part)
+      end
+
+      def vendor_path
+        project_path.join('vendor/puppet')
+      end
+
+      def vendor_cache
+        vendor_path.join('cache')
+      end
+
+      def vendor_source
+        vendor_path.join('source')
+      end
+
+      def cache_path
+        project_path.join(".tmp/librarian/cache")
+      end
+
+      def scratch_path
+        project_path.join(".tmp/librarian/scratch")
+      end
+
+      def vendor!
+        vendor_cache.mkpath  unless vendor_cache.exist?
+        vendor_source.mkpath unless vendor_source.exist?
+      end
+
+      def vendor?
+        vendor_path.exist?
+      end
+
+      def local?
+        config_db['mode'] == 'local'
+      end
+
+    end
+  end
+end

data/lib/librarian/puppet/extension.rb

@@ -0,0 +1,41 @@
+require 'librarian/puppet/environment'
+
+module Librarian
+  module Puppet
+    extend self
+    extend Librarian
+
+  end
+end
+
+module Librarian
+  class Dependency
+    class Requirement
+      def initialize(*args)
+        args = initialize_normalize_args(args)
+        self.backing = Gem::Requirement.create(puppet_to_gem_versions(args))
+      end
+
+      def puppet_to_gem_versions(args)
+        args.map do |arg|
+          case arg
+          when Array
+            arg.map { |v| puppet_to_gem_version(v) }
+          when String
+            puppet_to_gem_version(arg)
+          else
+            # Gem::Requirement, do nothing
+            arg
+          end
+        end
+      end
+
+      # convert Puppet '1.x' versions to gem supported versions '~>1.0'
+      # http://docs.puppetlabs.com/puppet/2.7/reference/modules_publishing.html
+      def puppet_to_gem_version(version)
+        matched = /(.*)\.x/.match(version)
+        matched.nil? ? version : "~>#{matched[1]}.0"
+      end
+    end
+  end
+end

data/lib/librarian/puppet/lockfile/parser.rb

@@ -0,0 +1,53 @@
+require 'librarian/manifest'
+require 'librarian/dependency'
+require 'librarian/manifest_set'
+
+module Librarian
+  class Lockfile
+    class Parser
+
+      def parse(string)
+        string = string.dup
+        source_type_names_map = Hash[dsl_class.source_types.map{|t| [t[1].lock_name, t[1]]}]
+        source_type_names = dsl_class.source_types.map{|t| t[1].lock_name}
+        lines = string.split(/(\r|\n|\r\n)+/).select{|l| l =~ /\S/}
+        sources = []
+        while source_type_names.include?(lines.first)
+          source = {}
+          source_type_name = lines.shift
+          source[:type] = source_type_names_map[source_type_name]
+          options = {}
+          while lines.first =~ /^ {2}([\w\-\/]+):\s+(.+)$/
+            lines.shift
+            options[$1.to_sym] = $2
+          end
+          source[:options] = options
+          lines.shift # specs
+          manifests = {}
+          while lines.first =~ /^ {4}([\w\-\/]+) \((.*)\)$/ # This change allows forward slash
+            lines.shift
+            name = $1
+            manifests[name] = {:version => $2, :dependencies => {}}
+            while lines.first =~ /^ {6}([\w\-\/]+) \((.*)\)$/
+              lines.shift
+              manifests[name][:dependencies][$1] = $2.split(/,\s*/)
+            end
+          end
+          source[:manifests] = manifests
+          sources << source
+        end
+        manifests = compile(sources)
+        manifests_index = Hash[manifests.map{|m| [m.name, m]}]
+        raise StandardError, "Expected DEPENDENCIES topic!" unless lines.shift == "DEPENDENCIES"
+        dependencies = []
+        while lines.first =~ /^ {2}([\w\-\/]+)(?: \((.*)\))?$/ # This change allows forward slash
+          lines.shift
+          name, requirement = $1, $2.split(/,\s*/)
+          dependencies << Dependency.new(name, requirement, manifests_index[name].source)
+        end
+        Resolution.new(dependencies, manifests)
+      end
+
+    end
+  end
+end