spiceweasel 0.1.0

data/.gitignore

@@ -0,0 +1,4 @@
+*.gem
+.bundle
+Gemfile.lock
+pkg/*

data/Gemfile

@@ -0,0 +1,4 @@
+source "http://rubygems.org"
+
+# Specify your gem's dependencies in spiceweasel.gemspec
+gemspec

data/MILESTONES.md

@@ -0,0 +1,51 @@
+This is the current, previous and future development milestones and contains the features backlog.
+
+0.1
+===
+* initial README.md describing goals
+* command-line tool
+* basic options all supported
+* create repo on GitHub
+* publish as a gem on RubyGems
+
+0.2
+===
+* new CLI args
+* --chef-client The option `--chef-client` will make a `knife ssh` call to each box and run `chef-client` on each.
+* --delete The option `--delete` will delete each cookbook, role, data bag, environment and node described in the yml file. All nodes from the system are deleted with `knife node bulk_delete`. Since knife does not currently manage deletion of the instances from cloud providers, that is still a required step.
+* --rebuild The option `--rebuild` will remove all currently managed infrastructure for this chef repository and rebuild it from scratch.
+
+0.3
+===
+* --chef-client validation
+
+BACKLOG
+=======
+Cookbooks
+---------
+* site vendor?
+* JSON?
+
+Roles
+-----
+* JSON?
+* validate recipes and roles have been uploaded
+
+Data Bags
+---------
+
+Environments
+------------
+
+Nodes
+-----
+* Provider
+* on delete... what to do?
+* knife windows bootstrap FQDN [RUN LIST...] (options)
+
+Wishlist
+--------
+* use GNU parallel
+* make the JSON calls directly (and possibly parallelize)
+* --dryrun The option `--dryrun` will print the commands to run, but not actually execute them.
+

data/README.md

@@ -0,0 +1,149 @@
+Description
+===========
+Spiceweasel is a command-line tool for batch loading Chef infrastructure. It provides a simple syntax for describing and deploying infrastructure with the Chef command-line tool `knife`.
+
+MILESTONES.md covers current, previous and future development milestones and contains the features backlog.
+
+Requirements
+============
+Spiceweasel currently depends on `knife` to run commands for it.
+
+Written with Chef 0.9.12 and supports cookbooks, recipes, roles, data bags and nodes. Support for environments will be added with the Chef 0.10 release.
+
+Testing
+-------
+Tested with Ubuntu 10.04 and 10.10 and Chef 0.9.12.
+
+File Syntax
+===========
+The syntax for the spiceweasel file is a simple YAML format of Chef primitives describing what is to be instantiated. 
+
+    cookbooks:
+      - apache2
+      - apt
+      - mysql
+
+    roles:
+      - base
+      - monitoring
+      - webserver
+
+    data bags:
+      users:
+        - alice
+        - bob
+        - chuck
+      data:
+
+    nodes:
+      serverA:
+        - role[loadbalancer]
+        - -i ~/.ssh/mray.pem -x user --sudo -d ubuntu10.04-gems
+      ec2 5:
+        - role[webserver]
+        - -S mray -I ~/.ssh/mray.pem -x ubuntu -G default -i ami-a403f7cd -f m1.small
+      rackspace 3:
+        - recipe[mysql] role[clustered_mysql]
+        - --image 49 --flavor 2
+
+Cookbooks
+---------
+The `cookbooks` section of the YAML file currently supports `knife cookbook upload FOO` where `FOO` is the name of the cookbook in the `cookbooks` directory. The YAML snippet
+
+    cookbooks:
+      - apache2
+      - apt
+      - mysql
+
+produces the knife commands
+
+    knife cookbook upload apache2
+    knife cookbook upload apt
+    knife cookbook upload mysql
+
+Roles
+-----
+The `roles` section of the YAML file currently supports `knife role from file FOO` where `FOO` is the name of the role file ending in `.rb` in the `roles` directory. The YAML snippet 
+
+    roles:
+      - base
+      - monitoring
+      - webserver
+
+produces the knife commands 
+
+    knife role from file base.rb
+    knife role from file monitoring.rb
+    knife role from file webserver.rb
+
+Data Bags
+---------
+The `data bags` section of the YAML file currently creates the data bags listed with `knife data bag create FOO` where `FOO` is the name of the data bag. Individual items may be added to the data bag as part of a YAML sequence, the assumption is made that they `.json` files and in the `data_bags` directory. The YAML snippet 
+
+    data bags:
+      users:
+        - alice
+        - bob
+        - chuck
+      data:
+
+produces the knife commands 
+
+    knife data bag create data
+    knife data bag create users
+    knife data bag from file users data_bags/alice.json
+    knife data bag from file users data_bags/bob.json
+    knife data bag from file users data_bags/chuck.json
+
+Nodes
+-----
+The `nodes` section of the YAML file bootstraps a node for each entry where the entry is a hostname or provider and count. Each node requires 2 items after it in a YAML sequence. The first item is the run_list and the second the CLI options used. A shortcut syntax for bulk-creating nodes with various providers where the line starts with the provider and ends with the number of nodes to be provisioned. The YAML snippet 
+
+    nodes:
+      serverA:
+        - role[loadbalancer]
+        - -i ~/.ssh/mray.pem -x user --sudo -d ubuntu10.04-gems
+      ec2 5:
+        - role[webserver]
+        - -S mray -I ~/.ssh/mray.pem -x ubuntu -G default -i ami-a403f7cd -f m1.small
+      rackspace 3:
+        - recipe[mysql] role[clustered_mysql]
+        - --image 49 --flavor 2
+
+produces the knife commands 
+
+    knife bootstrap serverA 'role[loadbalancer]' -i ~/.ssh/mray.pem -x user --sudo -d ubuntu10.04-gems
+    knife ec2 server create 'role[webserver]' -S mray -I ~/.ssh/mray.pem -x ubuntu -G default -i ami-a403f7cd -f m1.small
+    knife ec2 server create 'role[webserver]' -S mray -I ~/.ssh/mray.pem -x ubuntu -G default -i ami-a403f7cd -f m1.small
+    knife ec2 server create 'role[webserver]' -S mray -I ~/.ssh/mray.pem -x ubuntu -G default -i ami-a403f7cd -f m1.small
+    knife ec2 server create 'role[webserver]' -S mray -I ~/.ssh/mray.pem -x ubuntu -G default -i ami-a403f7cd -f m1.small
+    knife ec2 server create 'role[webserver]' -S mray -I ~/.ssh/mray.pem -x ubuntu -G default -i ami-a403f7cd -f m1.small
+    knife rackspace server create 'recipe[mysql]' 'role[clustered_mysql]' --image 49 --flavor 2
+    knife rackspace server create 'recipe[mysql]' 'role[clustered_mysql]' --image 49 --flavor 2
+    knife rackspace server create 'recipe[mysql]' 'role[clustered_mysql]' --image 49 --flavor 2
+
+Usage
+=====
+To run a spiceweasel file, run the following from you Chef repository directory:
+
+    spiceweasel path/to/infrastructure.yml
+
+This will generate the knife commands to build the described infrastructure. 
+
+License and Author
+==================
+Author: Matt Ray <matt@opscode.com>
+
+Copyright: 2011 Opscode, Inc
+
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+    http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.

data/Rakefile

@@ -0,0 +1,2 @@
+require 'bundler'
+Bundler::GemHelper.install_tasks

data/bin/spiceweasel

@@ -0,0 +1,84 @@
+#!/usr/bin/env ruby
+
+require 'optparse'
+require 'yaml'
+ 
+options = {}
+optparse = OptionParser.new do |opts|
+  opts.banner = "Usage: spiceweasel [options] file"
+  opts.on('-h', '--help', 'Show this message') do
+    puts opts
+    exit
+  end
+  opts.on('-v', '--version', 'Version') do 
+    puts "spiceweasel 0.1"
+    exit
+  end
+end
+
+begin
+  ARGV << "-h" if ARGV.empty? 
+  optparse.parse!(ARGV)
+rescue OptionParser::ParseError => e 
+  STDERR.puts e.message, "\n", optparse
+  exit(-1)
+end
+
+
+yml = YAML.load_file ARGV[0]
+knife = ""
+
+#cookbooks 
+cookbooks = yml['cookbooks'] || []
+cookbooks.each do |cookbook|
+  knife += "knife cookbook upload #{cookbook}\n"
+end
+
+#roles 
+roles = yml['roles'] || []
+roles.each do |role|
+  knife += "knife role from file #{role}.rb\n"
+end
+
+#data bags
+bags = yml['data bags'] || []
+bags.keys.each do |bag|
+  knife += "knife data bag create #{bag}\n"
+  items = bags[bag] || []
+  items.each do |item|
+    knife += "knife data bag from file #{bag} data_bags/#{item}.json\n"
+  end
+end
+
+nodes = yml['nodes'] || []
+nodes.keys.each do |node|
+  run_list = nodes[node][0].split()
+  #TODO verify the run_list against the nodes and recipes
+  if node.start_with?("bluebox","ec2","rackspace","slicehost","terremark")
+    provider = node.split()
+    count = 1
+    if (provider.length == 2)
+      count = provider[1] 
+    end
+    count.to_i.times do
+      knife += "knife #{provider[0]} server create "
+      run_list.each do |x|
+        knife += "\'#{x}\' "
+      end
+      knife +="#{nodes[node][1]}\n"
+    end
+  else
+    knife += "knife bootstrap #{node} "
+    run_list.each do |x|
+      knife += "\'#{x}\' "
+    end
+    knife +="#{nodes[node][1]}\n"
+  end
+end
+
+puts knife
+#--clientsync
+#--delete
+#--dryrun 
+#--rebuild
+#remember to -y

data/example.yml

@@ -0,0 +1,27 @@
+cookbooks:
+  - apache2
+  - apt
+  - mysql
+
+roles:
+  - base
+  - monitoring
+  - webserver
+
+data bags:
+  users:
+    - alice
+    - bob
+    - chuck
+  data:
+
+nodes:
+  serverA:
+    - role[loadbalancer]
+    - -i ~/.ssh/mray.pem -x user --sudo -d ubuntu10.04-gems
+  ec2 5:
+    - role[webserver]
+    - -S mray -I ~/.ssh/mray.pem -x ubuntu -G default -i ami-a403f7cd -f m1.small
+  rackspace 3:
+    - recipe[mysql] role[clustered_mysql]
+    - --image 49 --flavor 2

data/lib/spiceweasel/version.rb

@@ -0,0 +1,3 @@
+module Spiceweasel
+  VERSION = "0.1.0"
+end

data/lib/spiceweasel.rb

@@ -0,0 +1,3 @@
+module Spiceweasel
+  # Your code goes here...
+end

data/spiceweasel.gemspec

@@ -0,0 +1,21 @@
+# -*- encoding: utf-8 -*-
+$:.push File.expand_path("../lib", __FILE__)
+require "spiceweasel/version"
+
+Gem::Specification.new do |s|
+  s.name        = "spiceweasel"
+  s.version     = Spiceweasel::VERSION
+  s.platform    = Gem::Platform::RUBY
+  s.authors     = ["Matt Ray"]
+  s.email       = ["matt@opscode.com"]
+  s.homepage    = ""
+  s.summary     = %q{CLI for generating Chef knife commands from a simple YAML file.}
+  s.description = %q{This provides a CLI for generating knife commands to build Chef-managed infrastructure from a simple YAML file.}
+
+  s.rubyforge_project = "spiceweasel"
+
+  s.files         = `git ls-files`.split("\n")
+  s.test_files    = `git ls-files -- {test,spec,features}/*`.split("\n")
+  s.executables   = `git ls-files -- bin/*`.split("\n").map{ |f| File.basename(f) }
+  s.require_paths = ["lib"]
+end

metadata

@@ -0,0 +1,74 @@
+--- !ruby/object:Gem::Specification 
+name: spiceweasel
+version: !ruby/object:Gem::Version 
+  prerelease: false
+  segments: 
+  - 0
+  - 1
+  - 0
+  version: 0.1.0
+platform: ruby
+authors: 
+- Matt Ray
+autorequire: 
+bindir: bin
+cert_chain: []
+
+date: 2011-03-04 00:00:00 -06:00
+default_executable: 
+dependencies: []
+
+description: This provides a CLI for generating knife commands to build Chef-managed infrastructure from a simple YAML file.
+email: 
+- matt@opscode.com
+executables: 
+- spiceweasel
+extensions: []
+
+extra_rdoc_files: []
+
+files: 
+- .gitignore
+- Gemfile
+- MILESTONES.md
+- README.md
+- Rakefile
+- bin/spiceweasel
+- example.yml
+- lib/spiceweasel.rb
+- lib/spiceweasel/version.rb
+- spiceweasel.gemspec
+has_rdoc: true
+homepage: ""
+licenses: []
+
+post_install_message: 
+rdoc_options: []
+
+require_paths: 
+- lib
+required_ruby_version: !ruby/object:Gem::Requirement 
+  none: false
+  requirements: 
+  - - ">="
+    - !ruby/object:Gem::Version 
+      segments: 
+      - 0
+      version: "0"
+required_rubygems_version: !ruby/object:Gem::Requirement 
+  none: false
+  requirements: 
+  - - ">="
+    - !ruby/object:Gem::Version 
+      segments: 
+      - 0
+      version: "0"
+requirements: []
+
+rubyforge_project: spiceweasel
+rubygems_version: 1.3.7
+signing_key: 
+specification_version: 3
+summary: CLI for generating Chef knife commands from a simple YAML file.
+test_files: []
+