cuken 0.1.1 → 0.1.2

data/features/data/repositories/chef-repo/certificates/README.md

@@ -0,0 +1,19 @@
+Creating SSL certificates is a common task done in web application infrastructures, so a rake task is provided to generate certificates.  These certificates are stored here by the ssl_cert task.  
+
+Configure the values used in the SSL certificate by modifying `config/rake.rb`.
+
+To generate a certificate set for a new monitoring server, for example:
+
+    rake ssl_cert FQDN=monitoring.example.com
+
+Once the certificates are generated, copy them into the cookbook(s) where you want to use them.
+
+    cp certificates/monitoring.example.com.* cookbooks/COOKBOOK/files/default
+
+In the recipe for that cookbook, create a `cookbook_file` resource to configure a resource that puts them in place on the destination server.
+
+    cookbook_file '/etc/apache2/ssl/monitoring.example.com.pem'
+      owner 'root'
+      group 'root'
+      mode 0600
+    end

data/features/data/repositories/chef-repo/config/rake.rb

@@ -0,0 +1,38 @@
+# Configure the Rakefile's tasks.
+
+###
+# Company and SSL Details
+# Used with the ssl_cert task.
+###
+
+# The company name - used for SSL certificates, and in srvious other places
+COMPANY_NAME = "Example Com"
+
+# The Country Name to use for SSL Certificates
+SSL_COUNTRY_NAME = "US"
+
+# The State Name to use for SSL Certificates
+SSL_STATE_NAME = "Several"
+
+# The Locality Name for SSL - typically, the city
+SSL_LOCALITY_NAME = "Locality"
+
+# What department?
+SSL_ORGANIZATIONAL_UNIT_NAME = "Operations"
+
+# The SSL contact email address
+SSL_EMAIL_ADDRESS = "ops@example.com"
+
+# License for new Cookbooks
+# Can be :apachev2 or :none
+NEW_COOKBOOK_LICENSE = :apachev2
+
+###
+# Useful Extras (which you probably don't need to change)
+###
+
+# The top of the repository checkout
+TOPDIR = File.expand_path(File.join(File.dirname(__FILE__), ".."))
+
+# Where to store certificates generated with ssl_cert
+CADIR = File.expand_path(File.join(TOPDIR, "certificates"))

data/features/data/repositories/chef-repo/cookbooks/README.md

@@ -0,0 +1,53 @@
+This directory contains the cookbooks used to configure systems in your infrastructure with Chef.
+
+Knife needs to be configured to know where the cookbooks are located with the `cookbook_path` setting. If this is not set, then several cookbook operations will fail to work properly.
+
+    cookbook_path ["./cookbooks"]
+
+This setting tells knife to look for the cookbooks directory in the present working directory. This means the knife cookbook subcommands need to be run in the `chef-repo` directory itself. To make sure that the cookbooks can be found elsewhere inside the repository, use an absolute path. This is a Ruby file, so something like the following can be used:
+
+    current_dir = File.dirname(__FILE__)
+    cookbook_path ["#{current_dir}/../cookbooks"]
+
+Which will set `current_dir` to the location of the knife.rb file itself (e.g. `~/chef-repo/.chef/knife.rb`).
+
+Configure knife to use your preferred copyright holder, email contact and license. Add the following lines to `.chef/knife.rb`.
+
+    cookbook_copyright "Example, Com."
+    cookbook_email     "cookbooks@example.com"
+    cookbook_license   "apachev2"
+
+Supported values for `cookbook_license` are "apachev2" or "none". These settings are used to prefill comments in the default recipe, and the corresponding values in the metadata.rb. You are free to change these in those files.
+
+Create new cookbooks in this directory with Knife.
+
+    knife cookbook create COOKBOOK
+
+This will create all the cookbook directory components. You don't need to use them all, and can delete the ones you don't need. It also creates a README file, metadata.rb and default recipe.
+
+You can also download cookbooks directly from the Opscode Cookbook Site. There are two subcommands to help with this depending on what your preference is.
+
+The first and recommended method is to use a vendor branch if you're using Git. This is automatically handled with Knife.
+
+    knife cookbook site vendor COOKBOOK
+
+This will:
+
+* Download the cookbook tarball from cookbooks.opscode.com.
+* Ensure its on the git master branch.
+* Checks for an existing vendor branch, and creates if it doesn't.
+* Checks out the vendor branch (chef-vendor-COOKBOOK).
+* Removes the existing (old) version.
+* Untars the cookbook tarball it downloaded in the first step.
+* Adds the cookbook files to the git index and commits.
+* Creates a tag for the version downloaded.
+* Checks out the master branch again.
+* Merges the cookbook into master.
+
+The last step will ensure that any local changes or modifications you have made to the cookbook are preserved, so you can keep your changes through upstream updates.
+
+If you're not using Git, use the site download subcommand to download the tarball.
+
+    knife cookbook site download COOKBOOK
+
+This creates the COOKBOOK.tar.gz from in the current directory (e.g., `~/chef-repo`). We recommend following a workflow similar to the above for your version control tool.

data/features/data/repositories/chef-repo/data_bags/README.md

@@ -0,0 +1,23 @@
+This directory contains directories of the various data bags you create for your infrastructure. Each subdirectory corresponds to a data bag on the Chef Server, and contains JSON files of the items that go in the bag.
+
+First, create a directory for the data bag.
+
+    mkdir data_bags/BAG
+
+Then create the JSON files for items that will go into that bag.
+
+    $EDITOR data_bags/BAG/ITEM.json
+
+The JSON for the ITEM must contain a key named "id" with a value equal to "ITEM". For example,
+
+    {
+      "id": "foo"
+    }
+
+Next, create the data bag on the Chef Server.
+
+    knife data bag create BAG
+
+Then upload the items in the data bag's directory to the Chef Server.
+
+    knife data bag from file BAG ITEM.json

data/features/data/repositories/chef-repo/roles/README.md

@@ -0,0 +1,16 @@
+Create roles here, in either the Role Ruby DSL (.rb) or JSON (.json) files. To install roles on the server, use knife.
+
+For example, create `roles/base_example.rb`:
+
+    name "base_example"
+    description "Example base role applied to all nodes."
+    # List of recipes and roles to apply. Requires Chef 0.8, earlier versions use 'recipes()'.
+    #run_list()
+    # Attributes applied if the node doesn't have it set already.
+    #default_attributes()
+    # Attributes applied no matter what the node has set already.
+    #override_attributes()
+
+Then upload it to the Chef Server:
+    
+    knife role from file roles/base_example.rb

data/features/data/repositories/cookbooks/hosts/attributes/hosts.rb

@@ -0,0 +1 @@
+hosts Mash.new unless attribute?(:hosts)

data/features/data/repositories/cookbooks/hosts/cc.gemspec

@@ -0,0 +1,36 @@
+# -*- encoding: utf-8 -*-
+lib = File.expand_path('../',__FILE__)
+lib_up = File.expand_path('../../', __FILE__)
+$:.unshift lib unless $:.include?(lib)
+$:.unshift lib_up unless $:.include?(lib_up)
+require 'json'
+
+ENV['GEM_PATH']=ENV['BUNDLE_INSTALL_PATH'] if ENV['BUNDLE_INSTALL_PATH']
+ENV['GEM_HOME']=ENV['BUNDLE_INSTALL_PATH'] if ENV['BUNDLE_INSTALL_PATH']
+
+name = File.split(lib)[-1]||""
+raise ArgumentError, '', caller if name.empty?
+@name=name
+
+Gem.use_paths(ENV['BUNDLE_INSTALL_PATH'],[]) if ENV['BUNDLE_INSTALL_PATH']
+
+Gem::Specification.new do |s|
+
+  md             = JSON.parse(File.read(File.expand_path('../metadata.json', __FILE__)))
+
+  # Required attributes (gem build fails without these)
+  s.name         = @name
+  s.version      = md['version'] && !md['version'].empty? ? md['version'] : '0'
+  s.files        = Dir.glob('**/*') #.map{|f| File.expand_path(f)}
+  s.summary      = md['description'] ? md['description'] : "The Chef cookbook for #{s.name}"
+
+  # Optional attributes (gem build warning raised without these)
+  s.author            = md['maintainer'] ? md['maintainer'] : 'No acknowledged maintainer'
+  s.description       = md['long_description'] ? md['long_description'] : s.summary
+  s.email             = md['maintainer_email'] ? md['maintainer_email'] : 'No acknowledged maintainer email'
+  s.homepage          = 'http://www.opscode.com'
+  md['dependencies'].each { |k,v| s.add_dependency(k,v) };
+
+  s.post_install_message = "Installed Chef Cookbook #{s.name}\n#{s.description}"
+
+end

data/features/data/repositories/cookbooks/hosts/metadata.json

@@ -0,0 +1,41 @@
+{
+  "groupings": {
+
+  },
+  "recommendations": {
+
+  },
+  "platforms": {
+
+  },
+  "license": "Apache v2.0",
+  "maintainer": "37signals",
+  "suggestions": {
+
+  },
+  "maintainer_email": "sysadmins@37signals.com",
+  "version": "0.1.0",
+  "conflicting": {
+
+  },
+  "description": "Configures hosts",
+  "providing": {
+    "hosts": [
+
+    ]
+  },
+  "name": "hosts",
+  "attributes": {
+
+  },
+  "long_description": "",
+  "recipes": {
+    "hosts": ""
+  },
+  "replacing": {
+
+  },
+  "dependencies": {
+
+  }
+}

data/features/data/repositories/cookbooks/hosts/metadata.rb

@@ -0,0 +1,4 @@
+maintainer        "37signals"
+maintainer_email  "sysadmins@37signals.com"
+description       "Configures hosts"
+version           "0.1"

data/features/data/repositories/cookbooks/hosts/recipes/default.rb

@@ -0,0 +1,6 @@
+template "/etc/hosts" do
+  source "hosts.erb"
+  owner "root"
+  group "root"
+  mode 0644
+end

data/features/data/repositories/cookbooks/hosts/templates/default/hosts.erb

@@ -0,0 +1,27 @@
+127.0.0.1 localhost <%= @node[:hosts][:localhost_aliases].join(" ") if @node[:hosts][:localhost_aliases] %>
+127.0.1.1 <%= @node['fqdn'] %> <%= @node['hostname'] %> <%= "chef.#{@node['domain']}" if @node.run_list.include?("recipe[chef::server]") %>
+
+<% if @node[:hosts][:entries] %>
+<% @node[:hosts][:entries].each do |ip, name| %>
+<%= ip %> <%= name %>
+<% end %>
+<% end %>
+
+<% if @node[:domain] == "rack-dfw-int.37signals.com" %>
+192.168.0.32  queenbee.37signals.com queenbee
+192.168.0.5   ob.37signals.com ob
+192.168.1.151 basecamp.db.37signals.com
+192.168.2.82  basecamp.search.37signals.com
+192.168.1.122 backpack.search.37signals.com
+192.168.1.120 backpack.db.37signals.com
+192.168.1.127 campfire.db.37signals.com
+192.168.1.114 dev.37signals.com
+<% end %>
+
+# The following lines are desirable for IPv6 capable hosts
+::1 ip6-localhost ip6-loopback
+fe00::0 ip6-localnet
+ff00::0 ip6-mcastprefix
+ff02::1 ip6-allnodes
+ff02::2 ip6-allrouters
+ff02::3 ip6-allhosts

data/features/data/search-tests/do_knife_search_test.rb

@@ -0,0 +1,175 @@
+#!/usr/bin/env ruby
+
+# node name
+# chef config secret
+# mixin recipe definition DSL core or chef mixin language
+# OR
+# Chef::Rest ob
+
+require 'uri'
+
+ALL_TESTS = []
+
+class QueryTest
+  include Chef::Mixin::Language
+
+  attr_reader :type, :query, :expected
+
+  def initialize(type, query, expected)
+    @type = type
+    @query = query
+    @expected = Set.new(expected)
+  end
+
+  def same_type?(q)
+    (@type.class == String && q.type.class == String) ||
+      (@type == q.type)
+  end
+
+  def and(q)
+    raise "types must match" unless same_type? q
+    QueryTest.new(@type, "(#{@query} AND #{q.query})",
+                  @expected.intersection(q.expected))
+  end
+
+  def or(q)
+    raise "types must match" unless same_type? q
+    QueryTest.new(@type, "(#{@query} OR #{q.query})",
+                  @expected.union(q.expected))
+  end
+
+  def show(s)
+    s.to_a.join(", ")
+  end
+
+  def compare_results(results)
+    got = Set.new(results)
+    if @expected != got
+      puts "FAIL: #{@type} #{@query}"
+      puts "expected: #{show(@expected)}"
+      puts "     got: #{show(got)}"
+      raise "search test failed"
+    else
+      puts "OK: (#{@expected.size}) #{@type} #{@query}"
+    end
+    true
+  end
+
+  def execute
+    compare_results search(@type, @query).map { |o| o.name }
+  rescue Exception => e
+    puts "ERROR: query failed for #{@query}"
+    raise e
+  end
+end
+
+def query(obj_type, query_string, expected_result)
+  q = QueryTest.new(obj_type, query_string, expected_result)
+  #q.execute
+  ALL_TESTS << q
+  q
+end
+
+def random_bool_query(queries, n)
+  q_count = queries.size
+  ops = [:and, :or]
+  ans = queries[rand(q_count)]
+  n.times do |i|
+    ans = ans.send(ops[rand(2)], queries[rand(q_count)])
+  end
+  ans.execute
+end
+
+# Exact searches:
+query :node, "tag:apples", ["a"]
+query :node, "tag:apes", ["b", "c"]
+query :node, "tag:not_a_tag_value", []
+query :node, 'run_list:recipe\[bravo\]', ["ab", "b"]
+query :node, 'run_list:recipe\[zulu\]', []
+query :node, 'run_list:recipe\[alpha\]', ["a", "ab"]
+
+# data bag item searching
+query "toys", 'colors:green', ["data_bag_item_toys_marbles"]
+query "toys", 'colors:white', ["data_bag_item_toys_marbles"]
+query "fruit", 'names:lemon', ["data_bag_item_fruit_citrus"]
+query "toys", 'baseballs:4 OR colors:black', ["data_bag_item_toys_marbles",
+                                              "data_bag_item_toys_balls"]
+
+# basic client list search
+# query :client, '*:*', ['ac', 'bc', 'cc']
+
+# role search
+query :role, 'name:pro*', ['prod']
+query :role, 'run_list:recipe\[base\]', ['prod', 'web']
+query :role, 'run_list:role\[monitoring\]', ['prod']
+query :role, 'key:456', ['web']
+query :role, 'key:[1 TO 5000]', ['web', 'prod']
+
+# Negation:
+query :node, '(run_list:recipe\[bravo\] NOT run_list:recipe\[alpha\])', ["b"]
+query :node, "(tag:ap* NOT tag:apples)", ["b", "c"]
+
+# Prefix searches:
+
+query :node, "tag:a*", ["a", "ab", "b", "c"]
+query :node, "tag:app*", ["a"]
+query :node, "tag:ap*", ["a", "b", "c"]
+query :node, "tag:zulu*", []
+
+
+# Range searches:
+
+query :node, 'value:[* TO *]', ["a", "b", "c"]
+query :node, 'value:[1 TO 2]', ['a', 'b']
+query :node, 'value:[1 TO 3]', ['a', 'b', 'c']
+query :node, 'value:[2 TO *]', ['b', 'c']
+query :node, 'value:[* TO 2]', ['a', 'b']
+query :node, 'value:[* TO 5]', ['a', 'b', 'c']
+query :node, 'value:[5 TO *]', []
+# exclusive range
+query :node, 'value:{1 TO 3}', ['b']
+# more negation tests
+query :node, '(value:[1 TO 3] NOT value:[1 TO 2])', ['c']
+
+# Quotes
+query :node, 'multi_word:"foo bar baz"', ['a']
+query :node, 'multi_word:foo*', ['a', 'c']
+
+# internal escaped quotes don't work, but prefix query for an escaped
+# quote does
+# query :node, 'quotes:"\"one\" \"two\" \"three\""', ['ab']
+# query :node, 'quotes:\"one\"*', ['ab']
+query :node, 'quotes:\"*', ['ab']
+
+# nested keys
+query :node, 'nested_b1_a2_a3:B1_A2_A3-a', ['a']
+query :node, 'nested_b1_a2_a3:B1_A2_A3-b', ['b']
+query :node, 'nested_b1_a2_a3:B1_A2_A3-c', ['c']
+query :node, 'nested_a1_b2_a3:A1_B2_A3-*', ['a', 'b', 'c']
+
+# # nested expando (only w/ new stuff)
+if Chef::Config["wildcard_in_key_tests"]
+  query :node, 'nested_b1_*_a3:B1_A2_A3-a', ['a']
+  query :node, 'nested_b1_a2_*:B1_A2_A3-b', ['b']
+  query :node, 'nested_b1_a2_a3:B1_A2_A3-c', ['c']
+  query :node, 'nested_*_b2_a3:A1_B2_A3-*', ['a', 'b', 'c']
+end
+
+
+ALL_TESTS.each do |q|
+  q.execute
+end
+
+node_tests = ALL_TESTS.select { |x| x.type == :node }
+role_tests = ALL_TESTS.select { |x| x.type == :role }
+data_bag_tests = ALL_TESTS.select { |x| x.type.class == String }
+
+# AND/OR precedence
+[node_tests, role_tests].each do |test_list|
+  10.times do |i|
+    random_bool_query(test_list, 2)
+    random_bool_query(test_list, 3)
+    random_bool_query(test_list, 4)
+  end
+end
+