chef-workflow-tasklib 0.1.0

data/.gitignore

@@ -0,0 +1,18 @@
+*.gem
+*.rbc
+.bundle
+.config
+.yardoc
+Gemfile.lock
+InstalledFiles
+_yardoc
+coverage
+doc/
+lib/bundler/man
+pkg
+rdoc
+spec/reports
+test/tmp
+test/version_tmp
+tmp
+.chef-workflow

data/Gemfile

@@ -0,0 +1,4 @@
+source 'https://rubygems.org'
+
+# Specify your gem's dependencies in chef-workflow-tasklib.gemspec
+gemspec

data/LICENSE.txt

@@ -0,0 +1,22 @@
+Copyright (c) 2012 Erik Hollensbe
+
+MIT License
+
+Permission is hereby granted, free of charge, to any person obtaining
+a copy of this software and associated documentation files (the
+"Software"), to deal in the Software without restriction, including
+without limitation the rights to use, copy, modify, merge, publish,
+distribute, sublicense, and/or sell copies of the Software, and to
+permit persons to whom the Software is furnished to do so, subject to
+the following conditions:
+
+The above copyright notice and this permission notice shall be
+included in all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
+EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
+MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
+NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE
+LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
+OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
+WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

data/README.md

@@ -0,0 +1,260 @@
+# Chef Workflow - Rake Tasks & Support
+
+This gem provides a set of rake tasks broken up logically to support a chef
+workflow, and tooling to assist with driving those tasks. It is intended to
+complement a chef repository by directly being added as a dependency.
+
+Some of the tasks it provides are:
+
+* Uploading your cookbooks, roles, environments and databags with the defaults
+  expecting a layout similar to the [opscode example
+  chef-repo](https://github.com/opscode/chef-repo)
+* Resolving your cookbook's dependencies, with tools like
+  [librarian](https://github.com/applicationsonline/librarian) or
+  [berkshelf](https://github.com/RiotGames/berkshelf) 
+* Lint your cookbooks with [foodcritic](https://github.com/acrmp/foodcritic) 
+* Creating a chef server for testing in a single command
+* Running unit tests against networks of provisioned machines -- see
+  [chef-workflow-tasklib](https://github.com/chef-workflow/chef-workflow-testlib)
+  for more information.
+
+## We do a lot, but we don't tell you how to do it.
+
+The defaults (which you can set up by following the installation instructions)
+use our workflow and a standard chef repository layout. **You don't have to do
+this.** Write your own tasks, use a subset of our tasks, configure our tasks to
+use your settings, or even adjust what happens when you just type `rake`. The
+whole system is built to accomodate this.
+
+## Installation
+
+Many of the choices made designing chef-workflow assume bundler is in use. We
+do not recommend installing the gem directly, but through a `Gemfile` that
+lives in your repository.
+
+Add this line to your application's Gemfile:
+
+    gem 'chef-workflow-tasklib'
+
+And then execute:
+
+    $ bundle
+
+To get started, run the `chef-workflow-bootstrap` utility which will create
+some files in your repo. It will not overwrite anything.
+
+    $ bundle exec chef-workflow-bootstrap
+
+If you already had a `Rakefile`, it will not be modified. To use the tasks, add
+these two lines to your `Rakefile`:
+
+```ruby
+require 'chef-workflow-tasklib'
+chef_workflow_task 'default'
+```
+
+Then to see all the tasks use:
+
+    $ bundle exec rake -T
+
+**Note:** `rake` by itself will **not work**. We depend on newer gems than the
+`rake` that's included with ruby does, which is what will be used if you do not
+execute `bundle exec rake`. At this point bundler runs, and will fail because
+`rake` will have activated gems that your bundle will be incompatible with.
+
+If this is confusing, just remember to always `bundle exec rake` and you won't
+have any trouble.
+
+You should see something similar to this:
+
+```
+rake chef:clean                      # Clean up the state files that chef-workflow generates
+rake chef:clean:ips                  # Clean up the ip registry for chef-workflow
+rake chef:clean:knife                # Clean up the temporary chef configuration for chef-workflow
+rake chef:clean:prisons              # Clean up the prison registry for chef-workflow
+rake chef:environments:upload        # Upload your environments to the chef server
+rake chef:roles:upload               # Upload your roles to the chef server
+rake chef:show_config                # Show the calculated configuration for chef-workflow
+rake chef_server:build_knife_config  # Create and write a knife configuration suitable for creating new chef servers.
+rake chef_server:create:vagrant      # Create a chef server in a vagrant machine.
+rake chef_server:destroy:vagrant     # Destroy the last chef server created with vagrant
+rake cookbooks:update                # Update your locked cookbooks with Berkshelf
+rake cookbooks:upload                # Upload your cookbooks to the chef server
+rake test                            # Run tests
+rake test:build                      # test:refresh and test
+rake test:refresh                    # Refresh all global meta on the chef server
+rake test:vagrant:full               # Build a chef server with vagrant, run test:build, destroy the chef server
+```
+
+Last step: add `.chef-workflow` to `.gitignore`. You can change this, but
+until you've done that, it's going to write things to this directory.
+
+If you want to do a full test run at this point (which with no tests will do
+nothing but build a chef server and tear it down), feel free to:
+
+    $ bundle exec test:vagrant:full
+
+## Notes on dependencies
+
+As of this writing, the workflow has some pretty strict requirements that we
+hope to make more flexible in the near future. Until then, you should be aware
+of a few things:
+
+* Chef 10.16.2 is required. This isn't actually necessary as mentioned above,
+  and will be resolved as soon as I can find time to test with earlier
+  versions. This has some implications:
+
+    * Tools like `berkshelf` and `librarian` and `foodcritic` (all add-ins to
+      the default workflow) have hard dependencies on earlier versions of chef.
+      The tasks that integrate these take this into account, but **you must
+      install the gems separately and manually to use them**.
+
+* Ruby 1.9 is **required**. We will gladly accept patches to make it 1.8.7
+  compatible, but 1.8.7 compatibility is not something we will be actively
+  pursuing at this point.
+
+## Usage
+
+Everything in this workflow is managed through usage of `rake` tasks, with an
+emphasis on cherry-picking tasks with `chef_workflow_task` into your `Rakefile` and
+configuring them with support configurators like `configure_knife` and
+`configure_vagrant`.
+
+The next few sections will briefly cover the high-level design of the system.
+For details, or information on writing your own tasks, hit the
+[wiki](https://github.com/chef-workflow/chef-workflow-tasklib/wiki).
+
+For the basic workflow, note that everything is state tracked between runs for
+the most part, so if you build a chef server with `chef_server:create`,
+other tasks will just do the right thing and operate on that chef server. This
+makes it easy to maintain a edit, upload, test, evaluate, repeat workflow as
+you're working on changes. Knife configuration, vagrant "prisons" (See the
+wiki) and allocated IPs are all tracked on exit in the `.chef-workflow`
+directory.
+
+There are some environment variables which control various settings, like
+debugging output. The defaults are usually fine, but check out the "Environment
+Variables" section of the
+[chef-workflow](https://github.com/chef-workflow/chef-workflow) `README.md`.
+
+## Picking your own workflow
+
+Adding `chef_workflow_task` statements to your workflow is the easiest way to get started.
+We don't expect you to use a resolver, for example, but support both
+[Berkshelf](https://github.com/RiotGames/Berkshelf) and
+[Librarian](https://github.com/applicationsonline/librarian) out of the box.
+Neither of these are required in the default `chef-workflow` require.
+
+Many tasks exist in our [tasks
+directory](https://github.com/chef-workflow/chef-workflow-tasklib/tree/master/lib/chef-workflow/tasks)
+and we strongly recommend poking through it if you're interested in fully
+customizing your workflow. Every attempt has been made for each task library to
+pull in only what it needs to operate which allows you to use each independent
+portion without fear of missing essential code.
+
+So to add `berkshelf` support, we add this to our Rakefile:
+
+```ruby
+chef_workflow_task 'cookbooks/resolve/berkshelf'
+```
+
+(If you are using berkshelf 0.4.x or earlier, `chef_workflow_task
+'cookbooks/resolve/berkshelf0.4'`)
+
+Which will add a few tasks, `cookbooks:resolve` and `cookbooks:update` and a
+few dependencies. **Note:** due to the way many of these tools declare
+dependencies, they must be installed independently of the bundle with `gem
+install`, so in this case, `gem install berkshelf`. This is out of our control.
+
+Let's build a custom workflow. For example let's say we just want to add:
+
+  * resolving cookbooks with librarian
+  * uploading cookbooks
+  * uploading roles
+  * uploading environments
+  * uploading data bags
+  * a task that does all of these when we type `bundle exec rake`
+
+*You'll have to point this at your live knife configuration* (see the next
+section), but your `Rakefile` would at first look something like this:
+
+```ruby
+chef_workflow_task 'cookbooks/resolve/librarian'
+chef_workflow_task 'cookbooks/upload'
+chef_workflow_task 'chef/roles'
+chef_workflow_task 'chef/environments'
+chef_workflow_task 'chef/data_bags'
+
+task :default => %w[
+  cookbooks:resolve_and_upload
+  chef:roles:upload
+  chef:environments:upload
+  chef:data_bags:upload
+]
+```
+
+Adding new rake tasks (or even full task libs) is easy too with the extensible
+configuration system and scaffolding already in place, and utility libraries to
+take the drama out of calling knife plugins or working with collections of
+machines. Please see the
+[wiki](https://github.com/chef-workflow/chef-workflow-tasklib/wiki) for more
+information.
+
+## Configuring the workflow
+
+chef-workflow provides you with a number of pre-baked tasks, but say you need
+just one little tweak so you can get with your life.  Maybe it's where the
+`.chef-workflow` directory lives or where to work with your cookbooks or what
+vagrant box to use, or whatever. You shouldn't have to rewrite the entire task
+to change that.
+
+The `configure_knife` and `configure_vagrant` commands have tooling to assist
+you with this. If you ran the `chef-workflow-bootstrap` tool, you should have a
+file called `lib/chef-workflow-config.rb` which is used to store configuration
+in a central place between this and our testing system.
+
+Code like this goes in this file:
+
+```ruby
+configure_vagrant do
+  # Use this `box_url` for all vagrant machines.
+  box_url "http://files.vagrantup.com/precise64.box"
+end
+
+configure_knife do
+  roles_path "our-roles" # set the roles directory for chef:roles:upload
+end
+```
+
+For our custom workflow example above, you can twiddle a few bits with 
+`configure_knife` to point at known chef configuration locations, which can use
+`~/.chef/knife.rb`, for example. You will want to be careful doing this with
+test integration.
+
+`bundle exec rake chef:show_config` can show you most of the settings in a
+system and how you've configured them.
+
+Please see the
+[wiki](https://github.com/chef-workflow/chef-workflow-tasklib/wiki) for more
+information on how to manipulate this for your own tasks.
+
+## What's next?
+
+  * Guard support for change-triggered test runs.
+  * Feedback that's more reactive than "everything" or "nothing". The speed (or
+    lack thereof) of running large suites makes this especially tricky.
+  * See the Issues list for more.
+
+## Problems
+
+  * It's not fast. EC2 support is faster than Vagrant for most complex cases,
+    but it's still pretty slow.
+  * It has two effective noise levels: "a lot" and "silent".
+
+## Contributing
+
+1. Fork it
+2. Create your feature branch (`git checkout -b my-new-feature`)
+3. Commit your changes (`git commit -am 'Add some feature'`)
+4. Push to the branch (`git push origin my-new-feature`)
+5. Create new Pull Request

data/Rakefile

@@ -0,0 +1 @@
+require "bundler/gem_tasks"

data/chef-workflow-tasklib.gemspec

@@ -0,0 +1,25 @@
+# -*- encoding: utf-8 -*-
+lib = File.expand_path('../lib', __FILE__)
+$LOAD_PATH.unshift(lib) unless $LOAD_PATH.include?(lib)
+require 'chef-workflow-tasklib/version'
+
+Gem::Specification.new do |gem|
+  gem.name          = "chef-workflow-tasklib"
+  gem.version       = Chef::Workflow::Tasklib::VERSION
+  gem.authors       = ["Erik Hollensbe"]
+  gem.email         = ["erik+github@hollensbe.org"]
+  gem.description   = %q{A set of rake tasks provided as discrete libraries for forming a chef workflow}
+  gem.summary       = %q{A set of rake tasks provided as discrete libraries for forming a chef workflow}
+  gem.homepage      = "https://github.com/chef-workflow/chef-workflow-tasklib"
+
+  gem.files         = `git ls-files`.split($/)
+  gem.executables   = gem.files.grep(%r{^bin/}).map{ |f| File.basename(f) }
+  gem.test_files    = gem.files.grep(%r{^(test|spec|features)/})
+  gem.require_paths = ["lib"]
+
+  gem.add_dependency 'chef-workflow'
+  gem.add_dependency 'knife-dsl', '~> 0.1.0'
+  gem.add_dependency 'vagrant-dsl', '~> 0.1.0'
+  gem.add_dependency 'rake', '~> 0.9'
+  gem.add_dependency 'knife-server' '~> 0.3.2'
+end

data/lib/chef-workflow-tasklib.rb

@@ -0,0 +1,21 @@
+require 'chef-workflow'
+
+class Chef
+  module Workflow
+    module TaskHelper
+      def chef_workflow_task(obj)
+        require "chef-workflow/tasks/#{obj}"
+      end
+    end
+  end
+end
+
+class << eval("self", TOPLEVEL_BINDING)
+  include Chef::Workflow::TaskHelper
+end
+
+if defined? Rake::DSL
+  module Rake::DSL
+    include Chef::Workflow::TaskHelper
+  end
+end

data/lib/chef-workflow-tasklib/version.rb

@@ -0,0 +1,7 @@
+class Chef
+  module Workflow
+    module Tasklib
+      VERSION = "0.1.0"
+    end
+  end
+end

data/lib/chef-workflow/tasks/bootstrap/knife.rb

@@ -0,0 +1,8 @@
+require 'chef-workflow/support/knife'
+
+namespace :bootstrap do
+  task :knife do
+    # this is what knife-dsl needs to know what config to use
+    ENV["CHEF_CONFIG"] ||= KnifeSupport.singleton.knife_config_path
+  end
+end

data/lib/chef-workflow/tasks/chef/clean.rb

@@ -0,0 +1,42 @@
+require 'chef-workflow/support/general'
+require 'chef-workflow/support/ip'
+require 'chef-workflow/support/vagrant'
+require 'chef-workflow/support/ec2'
+require 'chef-workflow/support/knife'
+require 'chef-workflow/support/scheduler'
+require 'chef/config'
+require 'fileutils'
+
+namespace :chef do
+  namespace :clean do
+    desc "Clean up the ip registry for chef-workflow"
+    task :ips do
+      IPSupport.singleton.reset
+      IPSupport.singleton.write
+    end
+
+    desc "Clean up the temporary chef configuration for chef-workflow"
+    task :knife do
+      FileUtils.rm_rf(KnifeSupport.singleton.chef_config_path)
+      FileUtils.rm_f(KnifeSupport.singleton.knife_config_path)
+    end
+
+    desc "Clean up the machines that a previous chef-workflow run generated"
+    task :machines do
+      if File.exist?(KnifeSupport.singleton.knife_config_path)
+        Chef::Config.from_file(KnifeSupport.singleton.knife_config_path)
+        s = Scheduler.new(false)
+        s.serial = true
+        s.force_deprovision = true
+        s.teardown(%w[chef-server])
+        s.write_state
+      end
+    end
+  end
+
+  desc "Clean up the entire chef-workflow directory and machines"
+  task :clean => [ "chef:clean:machines", "chef_server:destroy" ] do
+    EC2Support.singleton.destroy_security_group
+    FileUtils.rm_rf(GeneralSupport.singleton.workflow_dir)
+  end
+end

data/lib/chef-workflow/tasks/chef/data_bags.rb

@@ -0,0 +1,37 @@
+require 'knife/dsl'
+require 'chef-workflow/tasks/bootstrap/knife'
+
+namespace :chef do
+  namespace :data_bags do
+    desc "Upload your data bags to the chef server"
+    task :upload => [ "bootstrap:knife" ] do
+      if File.directory?(KnifeSupport.singleton.data_bags_path)
+        # bag names: basename of data_bags/*. This presumes your data bags path
+        # is structured like so:
+        #
+        # data_bags/my_bag # bag name
+        # data_bags/my_bag/my_item.(rb|json) # bag item
+        #
+        # note that while it makes an attempt to select by filename vs.
+        # directory in the right spots. will probably blow up spectacularly
+        # explode if you deviate heavily from this directory structure.
+        #
+        bag_names = Dir[File.join(KnifeSupport.singleton.data_bags_path, "*")].
+          select { |x| File.directory?(x) }.
+          map { |x| File.basename(x) } 
+
+        bag_names.each do |bag|
+          status = knife %W[data bag create #{bag}]
+          # XXX this doesn't fail if the data bag already exists.
+          #     we're actually depending on this.
+          fail if status != 0
+
+          bag_items = Dir[File.join(KnifeSupport.singleton.data_bags_path, bag, '*')].
+            select { |x| !File.directory?(x) }
+          status = knife %W[data bag from file #{bag}] + bag_items
+          fail if status != 0
+        end
+      end
+    end
+  end
+end

data/lib/chef-workflow/tasks/chef/environments.rb

@@ -0,0 +1,14 @@
+require 'knife/dsl'
+require 'chef-workflow/tasks/bootstrap/knife'
+
+namespace :chef do
+  namespace :environments do
+    desc "Upload your environments to the chef server"
+    task :upload => [ "bootstrap:knife" ] do
+      if File.directory?(KnifeSupport.singleton.environments_path)
+        status = knife %W[environment from file] + Dir[File.join(KnifeSupport.singleton.environments_path, '*')]
+        fail if status != 0
+      end
+    end
+  end
+end

data/lib/chef-workflow/tasks/chef/roles.rb

@@ -0,0 +1,14 @@
+require 'knife/dsl'
+require 'chef-workflow/tasks/bootstrap/knife'
+
+namespace :chef do
+  namespace :roles do
+    desc "Upload your roles to the chef server"
+    task :upload => [ "bootstrap:knife" ] do
+      if File.directory?(KnifeSupport.singleton.roles_path)
+        status = knife %W[role from file] + Dir[File.join(KnifeSupport.singleton.roles_path, '*')]
+        fail if status != 0
+      end
+    end
+  end
+end

data/lib/chef-workflow/tasks/chef/show_config.rb

@@ -0,0 +1,38 @@
+require 'chef-workflow/support/general'
+require 'chef-workflow/support/ip'
+require 'chef-workflow/support/knife'
+require 'chef-workflow/support/vagrant'
+
+namespace :chef do
+  desc "Show the calculated configuration for chef-workflow"
+  task :show_config do
+    puts "general:"
+    puts "\tworkflow_dir: #{GeneralSupport.singleton.workflow_dir}"
+    puts "\tvm_file: #{GeneralSupport.singleton.vm_file}"
+    puts "\tchef_server_prison: #{GeneralSupport.singleton.chef_server_prison}"
+    puts "\tmachine_provisoner: #{GeneralSupport.singleton.machine_provisioner}"
+
+    puts "knife:"
+    mute = %w[knife_config_template]
+    KnifeSupport::DEFAULTS.keys.reject { |x| mute.include?(x.to_s) }.each do |key|
+      puts "\t#{key}: #{KnifeSupport.singleton.send(key)}"
+    end
+
+    puts "vagrant:"
+    puts "\tip subnet (/24): #{IPSupport.singleton.subnet}"
+    puts "\tbox url: #{VagrantSupport.singleton.box_url}"
+
+    puts "ec2:"
+
+    %w[
+      ami
+      instance_type
+      region
+      ssh_key
+      security_groups
+      security_group_open_ports
+    ].each do |key|
+      puts "\t#{key}: #{EC2Support.singleton.send(key)}"
+    end
+  end
+end

data/lib/chef-workflow/tasks/chef/upload.rb

@@ -0,0 +1,14 @@
+chef_workflow_task 'chef/data_bags'
+chef_workflow_task 'chef/environments'
+chef_workflow_task 'chef/roles'
+chef_workflow_task 'cookbooks/upload'
+
+namespace :chef do
+  desc "Upload everything."
+  task :upload => %w[
+    cookbooks:upload
+    chef:roles:upload
+    chef:environments:upload
+    chef:data_bags:upload
+  ]
+end

data/lib/chef-workflow/tasks/chef_server.rb

@@ -0,0 +1,41 @@
+require 'chef-workflow/support/general'
+require 'chef-workflow/support/knife'
+require 'chef-workflow/support/scheduler'
+
+namespace :chef_server do
+  desc "Create a chef server with the #{GeneralSupport.singleton.machine_provisioner} provisioner"
+  task :create do
+    # FIXME not really happy with having to repeat this at the end, but it's
+    # necessary. maybe a subroutine in the right place in the future is the
+    # best approach, but I'm feeling lazy right now.
+    KnifeSupport.singleton.build_knife_config
+    Chef::Config.from_file(KnifeSupport.singleton.knife_config_path)
+
+    s = Scheduler.new(false)
+    s.serial = true
+
+    s.schedule_provision(
+      'chef-server', 
+      [
+        GeneralSupport.singleton.machine_provisioner.new('chef-server', 1), 
+        VM::ChefServerProvisioner.new
+      ],
+      []
+    )
+
+    s.run
+    s.wait_for('chef-server') # probably superfluous
+    s.write_state
+
+    KnifeSupport.singleton.build_knife_config
+    Chef::Config.from_file(KnifeSupport.singleton.knife_config_path)
+  end
+
+  desc "Destroy the chef server"
+  task :destroy do
+    s = Scheduler.new(false)
+    s.serial = true
+    s.force_deprovision = true
+    s.teardown_group('chef-server')
+  end
+end

data/lib/chef-workflow/tasks/cookbooks/foodcritic.rb

@@ -0,0 +1,16 @@
+require 'chef-workflow/support/knife'
+
+KnifeSupport.add_attribute :fc_cookbooks_path, File.join(Dir.pwd, 'cookbooks')
+KnifeSupport.add_attribute :fc_options, [ ]
+
+namespace :cookbooks do
+  desc "Run the cookbooks through foodcritic"
+  task :foodcritic do
+    Rake::Task["cookbooks:resolve"].invoke rescue nil
+    if File.directory?(KnifeSupport.singleton.fc_cookbooks_path)
+      Bundler.with_clean_env do
+        sh "foodcritic #{KnifeSupport.singleton.fc_cookbooks_path} #{KnifeSupport.singleton.fc_options.join(" ")}"
+      end
+    end
+  end
+end

data/lib/chef-workflow/tasks/cookbooks/resolve/berkshelf.rb

@@ -0,0 +1,2 @@
+$BERKSHELF_ARG = "path"
+load File.join(File.dirname(__FILE__), 'berkshelf/berkshelf-base.rb')

data/lib/chef-workflow/tasks/cookbooks/resolve/berkshelf/berkshelf-base.rb

@@ -0,0 +1,21 @@
+load File.join(File.dirname(__FILE__), '../bootstrap.rb')
+
+# Both berkshelf and librarian have ... aggressive dependencies. They usually are
+# a great way to break your Gemfile if you have chef in it.
+namespace :cookbooks do
+  desc "Resolve cookbooks and populate using Berkshelf"
+  task :resolve => [ "bootstrap:knife" ] do
+    if File.directory?(KnifeSupport.singleton.cookbooks_path)
+      Bundler.with_clean_env do
+        sh "berks install --#{$BERKSHELF_ARG} #{KnifeSupport.singleton.cookbooks_path}"
+      end
+    end
+  end
+
+  desc "Update your locked cookbooks with Berkshelf"
+  task :update => [ "bootstrap:knife" ] do
+    Bundler.with_clean_env do
+      sh "berks update"
+    end
+  end
+end

data/lib/chef-workflow/tasks/cookbooks/resolve/berkshelf0.4.rb

@@ -0,0 +1,3 @@
+$BERKSHELF_ARG = "shims"
+
+load File.join(File.dirname(__FILE__), 'berkshelf/berkshelf-base.rb')

data/lib/chef-workflow/tasks/cookbooks/resolve/bootstrap.rb

@@ -0,0 +1,10 @@
+# used by resolver tasklibs to ensure their basic dependencies are met. Not to
+# be used directly.
+begin
+  Rake::Task["cookbooks:resolve"].clear
+  Rake::Task["cookbooks:update"].clear
+rescue
+end
+
+require 'chef-workflow/tasks/bootstrap/knife'
+require 'chef-workflow/tasks/cookbooks/resolve_and_upload'

data/lib/chef-workflow/tasks/cookbooks/resolve/librarian.rb

@@ -0,0 +1,21 @@
+load File.join(File.dirname(__FILE__), 'bootstrap.rb')
+
+# Both berkshelf and librarian have ... aggressive dependencies. They usually are
+# a great way to break your Gemfile if you have chef in it.
+namespace :cookbooks do
+  desc "Resolve cookbooks and populate using Librarian"
+  task :resolve => [ "bootstrap:knife" ] do
+    if File.directory?(KnifeSupport.singleton.cookbooks_path)
+      Bundler.with_clean_env do
+        sh "librarian-chef install --path #{KnifeSupport.singleton.cookbooks_path}"
+      end
+    end
+  end
+
+  desc "Update your locked cookbooks with Librarian"
+  task :update => [ "bootstrap:knife" ] do
+    Bundler.with_clean_env do
+      sh "librarian-chef update"
+    end
+  end
+end

data/lib/chef-workflow/tasks/cookbooks/resolve_and_upload.rb

@@ -0,0 +1,6 @@
+require 'chef-workflow/tasks/cookbooks/upload'
+
+namespace :cookbooks do
+  desc "Run the cookbook resolver and upload the result to the chef server."
+  task :resolve_and_upload => [ "cookbooks:resolve", "cookbooks:upload" ] 
+end

data/lib/chef-workflow/tasks/cookbooks/upload.rb

@@ -0,0 +1,10 @@
+require 'knife/dsl'
+require 'chef-workflow/tasks/bootstrap/knife'
+
+namespace :cookbooks do
+  desc "Upload your cookbooks to the chef server"
+  task :upload => [ "bootstrap:knife" ] do
+    result = knife %W[cookbook upload -a]
+    fail if result != 0
+  end
+end

data/lib/chef-workflow/tasks/default.rb

@@ -0,0 +1,6 @@
+chef_workflow_task 'chef_server'
+chef_workflow_task 'cookbooks/upload'
+chef_workflow_task 'chef/upload'
+chef_workflow_task 'chef/show_config'
+chef_workflow_task 'chef/clean'
+chef_workflow_task 'test/build'

data/lib/chef-workflow/tasks/test.rb

@@ -0,0 +1,69 @@
+require 'rake/testtask'
+require 'chef-workflow/support/scheduler'
+require 'chef-workflow/support/knife'
+
+Rake::TestTask.new do |t|
+  t.libs << "test"
+  t.test_files = Dir["test/**/test_*.rb"]
+  t.verbose = true
+end
+
+namespace :test do
+  desc "Test recipes in the test_recipes configuration."
+
+  task :recipes => [ "recipes:cleanup" ] do
+    Chef::Config.from_file(KnifeSupport.singleton.knife_config_path)
+
+    s = Scheduler.new(true)
+    s.run
+
+    groups =
+      KnifeSupport.singleton.test_recipes.map do |recipe|
+        group_name = "recipe-#{recipe.gsub(/::/, '-')}"
+
+        kp              = VM::KnifeProvisioner.new
+        kp.username     = KnifeSupport.singleton.ssh_user
+        kp.password     = KnifeSupport.singleton.ssh_password
+        kp.use_sudo     = KnifeSupport.singleton.use_sudo
+        kp.ssh_key      = KnifeSupport.singleton.ssh_identity_file
+        kp.environment  = KnifeSupport.singleton.test_environment
+        kp.run_list     = [ "recipe[#{recipe}]", "recipe[minitest-handler]" ]
+        kp.solr_check   = false
+
+        s.schedule_provision(
+          group_name,
+          [
+            GeneralSupport.singleton.machine_provisioner.new(group_name, 1),
+            kp
+          ]
+        )
+
+        group_name
+      end
+
+    s.wait_for(*groups)
+
+    groups.each do |group_name|
+      s.teardown_group(group_name)
+    end
+
+    s.write_state
+  end
+
+  namespace :recipes do
+    desc "Cleanup any stale instances created running recipe tests."
+    task :cleanup do
+      Chef::Config.from_file(KnifeSupport.singleton.knife_config_path)
+      s = Scheduler.new(false)
+      s.run
+
+      s.vm_groups.select do |g, v|
+        g.start_with?("recipe-")
+      end.each do |g, v|
+        s.teardown_group(g, false)
+      end
+
+      s.write_state
+    end
+  end
+end

data/lib/chef-workflow/tasks/test/build.rb

@@ -0,0 +1,37 @@
+require 'chef-workflow/tasks/test'
+require 'chef-workflow/tasks/chef/upload'
+require 'chef-workflow/tasks/chef/clean'
+
+namespace :test do
+  task :resolve_hack do
+    begin
+      Rake::Task["cookbooks:resolve"].invoke
+    rescue
+    end
+  end
+
+  desc "Refresh all global meta on the chef server"
+  task :refresh => [
+    "test:resolve_hack",
+    "chef:upload"
+  ]
+
+  desc "test:refresh and test"
+  task :build => [
+    "test:refresh",
+    "test"
+  ]
+
+  desc "chef:clean:machines and test:build"
+  task :rebuild => [
+    "chef:clean:machines",
+    "test:build"
+  ]
+
+  desc "Build a chef server, run test:build, destroy the chef server"
+  task :full => [
+    "chef_server:create",
+    "test:build",
+    "chef:clean"
+  ]
+end

metadata

@@ -0,0 +1,154 @@
+--- !ruby/object:Gem::Specification
+name: chef-workflow-tasklib
+version: !ruby/object:Gem::Version
+  version: 0.1.0
+  prerelease: 
+platform: ruby
+authors:
+- Erik Hollensbe
+autorequire: 
+bindir: bin
+cert_chain: []
+date: 2012-12-21 00:00:00.000000000 Z
+dependencies:
+- !ruby/object:Gem::Dependency
+  name: chef-workflow
+  requirement: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ! '>='
+      - !ruby/object:Gem::Version
+        version: '0'
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ! '>='
+      - !ruby/object:Gem::Version
+        version: '0'
+- !ruby/object:Gem::Dependency
+  name: knife-dsl
+  requirement: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ~>
+      - !ruby/object:Gem::Version
+        version: 0.1.0
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ~>
+      - !ruby/object:Gem::Version
+        version: 0.1.0
+- !ruby/object:Gem::Dependency
+  name: vagrant-dsl
+  requirement: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ~>
+      - !ruby/object:Gem::Version
+        version: 0.1.0
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ~>
+      - !ruby/object:Gem::Version
+        version: 0.1.0
+- !ruby/object:Gem::Dependency
+  name: rake
+  requirement: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ~>
+      - !ruby/object:Gem::Version
+        version: '0.9'
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ~>
+      - !ruby/object:Gem::Version
+        version: '0.9'
+- !ruby/object:Gem::Dependency
+  name: knife-server~> 0.3.2
+  requirement: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ! '>='
+      - !ruby/object:Gem::Version
+        version: '0'
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    none: false
+    requirements:
+    - - ! '>='
+      - !ruby/object:Gem::Version
+        version: '0'
+description: A set of rake tasks provided as discrete libraries for forming a chef
+  workflow
+email:
+- erik+github@hollensbe.org
+executables: []
+extensions: []
+extra_rdoc_files: []
+files:
+- .gitignore
+- Gemfile
+- LICENSE.txt
+- README.md
+- Rakefile
+- chef-workflow-tasklib.gemspec
+- lib/chef-workflow-tasklib.rb
+- lib/chef-workflow-tasklib/version.rb
+- lib/chef-workflow/tasks/bootstrap/knife.rb
+- lib/chef-workflow/tasks/chef/clean.rb
+- lib/chef-workflow/tasks/chef/data_bags.rb
+- lib/chef-workflow/tasks/chef/environments.rb
+- lib/chef-workflow/tasks/chef/roles.rb
+- lib/chef-workflow/tasks/chef/show_config.rb
+- lib/chef-workflow/tasks/chef/upload.rb
+- lib/chef-workflow/tasks/chef_server.rb
+- lib/chef-workflow/tasks/cookbooks/foodcritic.rb
+- lib/chef-workflow/tasks/cookbooks/resolve/berkshelf.rb
+- lib/chef-workflow/tasks/cookbooks/resolve/berkshelf/berkshelf-base.rb
+- lib/chef-workflow/tasks/cookbooks/resolve/berkshelf0.4.rb
+- lib/chef-workflow/tasks/cookbooks/resolve/bootstrap.rb
+- lib/chef-workflow/tasks/cookbooks/resolve/librarian.rb
+- lib/chef-workflow/tasks/cookbooks/resolve_and_upload.rb
+- lib/chef-workflow/tasks/cookbooks/upload.rb
+- lib/chef-workflow/tasks/default.rb
+- lib/chef-workflow/tasks/test.rb
+- lib/chef-workflow/tasks/test/build.rb
+homepage: https://github.com/chef-workflow/chef-workflow-tasklib
+licenses: []
+post_install_message: 
+rdoc_options: []
+require_paths:
+- lib
+required_ruby_version: !ruby/object:Gem::Requirement
+  none: false
+  requirements:
+  - - ! '>='
+    - !ruby/object:Gem::Version
+      version: '0'
+required_rubygems_version: !ruby/object:Gem::Requirement
+  none: false
+  requirements:
+  - - ! '>='
+    - !ruby/object:Gem::Version
+      version: '0'
+requirements: []
+rubyforge_project: 
+rubygems_version: 1.8.24
+signing_key: 
+specification_version: 3
+summary: A set of rake tasks provided as discrete libraries for forming a chef workflow
+test_files: []
+has_rdoc: