wombat-cli 0.2.0

checksums.yaml

@@ -0,0 +1,7 @@
+---
+SHA1:
+  metadata.gz: 6b93d81468007c7e0f2eacebc5b8d7a623f4ef2b
+  data.tar.gz: 22e16911954777a777d741f65e190a094479fb41
+SHA512:
+  metadata.gz: e4639618f0e1555f2d830840fd3b74b9c761759b50bbe23710fd37fd320e4367249137d4d2f1b40aee5c25c72591ac4426f10a4b89c2018d5678edd2118f5acd
+  data.tar.gz: 2bc93afb35e83966a233564c2b7b5b4704d629c7633bbe6d129ba7ca7bcfe4b00325bde9df3128417322e5a66e06cc165f18a291af5421af6553e2388c3638c2

data/.gitignore

@@ -0,0 +1,19 @@
+delivery.license
+chefautomate-validator.pem
+delivery-admin.creds
+delivery-user.pem
+delivery.creds
+.vagrant
+terraform.tfstate*
+terraform.tfvars
+vendored-cookbooks
+*.log
+cloudformation/*.json
+wombat.yml
+keys/*
+packer/keys/*
+*.lock
+infranodes-info.json
+output
+bootstrap-aws.txt
+*.gem

data/DESIGN.md

@@ -0,0 +1,40 @@
+## Anatomy of an Wombat
+
+### tl;dr
+
+Wombat is a collection of code that builds Chef configured golden
+images from packer templates that are then re-consumed by a Cloud service template such
+as CloudFormation or Google Deployment Manager.
+
+### Design Goals
+
+* coordination without coordination
+* principle of least surprise
+* dynamic templates over static files
+
+### A Stroll Down Architecture Lane
+
+The core of wombat is the binary `bin/wombat`.
+
+
+`wombat build -o BUILDER TEMPLATE`
+
+1. Generate x509 certificates for the domain and ssh keys if there are none
+2. Vendor cookbooks for template
+3. Build Packer images for -o BUILDER (amazon-ebs|googlecompute) with included cookbooks
+
+* If the TEMPLATE argument is not provided it will execute against all templates in `./packer/`
+
+`wombat deploy STACK`
+
+1. Create/update wombat.lock based on most recent Packer logs
+2. Create cfn/gdm configuration from lock data fed through template
+3. Deploy cfn/gdm stack
+
+`wombat outputs STACK`
+
+1. List outputs, specifically Workstation IPs
+
+`wombat delete STACK`
+
+1. Delete stack

data/Gemfile

@@ -0,0 +1,3 @@
+source 'https://rubygems.org'
+
+gemspec

data/README.md

@@ -0,0 +1,132 @@
+[![Stories in Ready](https://badge.waffle.io/chef-cft/wombat.png?label=ready&title=Ready)](https://waffle.io/chef-cft/wombat)
+# `Project Wombat`
+A combination of packer templates and terraform plan to configure a demo environment which includes:
+
+* Chef Server
+* Chef Automate
+* Chef Compliance
+* _N_ Automate Build Node(s)
+* _N_ Infrastructure Nodes
+* _N_ Windows Workstation
+
+
+Usage
+------------
+
+##### Download your Automate license key
+Automate requires a valid license to activate successfully. **If you do
+not have a license key, you can request one from your CHEF account
+representative.**
+
+You will need to have the `delivery.license` file present inside `packer/files/`
+directory.
+
+##### Install and Configure ChefDK
+
+Follow the instructions at https://docs.chef.io/install_dk.html to install and configure ChefDK as your default version of ruby.
+
+##### Install Packer
+
+Downloads are here: https://www.packer.io/downloads.html . Place in your path for direct execution.
+
+##### Create a wombat.yml
+
+Create a wombat.yml - there is an example `wombat.example.yml` for reference and easy copying
+```
+---
+name: wombat
+# Uncomment domain_prefix if you wish to prepend your generated domain.
+# Ex: The below example would create foo-chef.animals.biz.
+# domain_prefix: foo-
+domain: animals.biz
+enterprise: mammals
+org: marsupials
+build-nodes: '1'
+workstations: '1'
+workstation-passwd: 'RL9@T40BTmXh'
+version: 0.2.0
+ttl: 8
+products:
+  chef: stable-12.13.37
+  chef-server: stable-12.8.0
+  chefdk: stable-0.16.28
+  compliance: stable-1.3.1
+  automate: stable-0.5.1
+aws:
+  region: ap-southeast-2
+  az: ap-southeast-2c
+  keypair: keypair-ap-southeast-2
+  source_ami:
+    ubuntu: ami-8c4cb0ec
+    windows: ami-87c037e7
+```
+
+*NOTE:* workstation-passwd must meet the minimum Microsoft [Complexity Requirements](https://technet.microsoft.com/en-us/library/hh994562(v=ws.11).aspx)
+
+*NOTE:* The `googlecompute` and `azure` builders exist but not all images will build nor is there deployment support for either at this time.
+
+##### Build images with Packer
+
+```
+# build one or more templates
+$ bin/wombat build [-o BUILDER] TEMPLATE [TEMPLATE2]
+
+# build all templates (sequentially)
+$ bin/wombat build [-o BUILDER]
+
+# build all images (parallel)
+$ bin/wombat build [-o BUILDER] --parallel
+```
+
+*NOTE:* If the builder is not provided it defaults to `amazon-ebs`
+
+##### Deploy CloudFormation template
+
+###### via AWS CloudFormation Web UI
+
+Upload the created template from the `cloudformation` directory.
+
+###### via CLI
+
+```
+# Deploy CloudFormation template
+$ bin/wombat deploy --cloud aws STACK
+==> Updating wombat.lock
+==> Generate CloudFormation JSON: STACK.json
+==> Creating CloudFormation stack
+Created: arn:aws:cloudformation:us-east-1:862552916454:stack/STACK/2160c580-713e-11e6-b392-50a686e4bb82
+```
+
+*NOTE:* If the cloud is not provided it defaults to `aws`
+
+##### Login to Windows Workstation
+
+```
+# Get Windows Workstation(s) IP(s)
+$ bin/wombat outputs STACK
+WindowsWorkstation (i-xxxxxxxx) => XX.XXX.XX.XXX
+```
+
+From the AWS CloudFormation UI, select the Outputs tab for the desired stack.
+Use an RDP compatible client to login to the workstation with the embedded credentials.
+
+LICENSE AND AUTHORS
+===================
+* [Andre Elizondo](https://github.com/andrewelizondo)
+* [Seth Thomas](https://github.com/cheeseplus)
+
+```text
+Copyright:: 2016 Chef Software, Inc
+
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+    http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+```

data/Rakefile

@@ -0,0 +1,52 @@
+require 'erb'
+require 'json'
+require 'openssl'
+require 'net/ssh'
+require 'yaml'
+require 'parallel'
+require 'aws-sdk'
+
+namespace :build do
+  desc 'Build an image'
+  task :image, :template, :builder do |_t, args|
+    sh "bin/wombat build -o #{args[:builder]} #{args[:template]}"
+  end
+
+  desc 'Build all images'
+  task :images, :builder, :parallel do |_t, args|
+    if parallel == 'true'
+      sh "bin/wombat build -o #{args[:builder]} --parallel"
+    else
+      sh "bin/wombat build -o #{args[:builder]}"
+    end
+  end
+end
+
+namespace :deploy do
+  desc 'Deploy a stack from template'
+  task :create, :stack,:cloud do |_t, args|
+    case args[:cloud]
+    when "gce", "gcp", "google", "gdm"
+      # TODO
+    when "aws", "amazon", "jeffbezosband", "cfn"
+      sh "bin/wombat deploy --cloud aws #{args[:stack]}"
+    end
+  end
+
+  desc 'Delete a stack'
+  task :delete, :stack, :cloud do |task, args|
+    cloud = args[:cloud] == 'gcp' ? 'gcp' : 'aws'
+    sh "bin/wombat delete --cloud #{cloud} #{args[:stack]}"
+  end
+
+  desc 'List workstation IPs of a stack'
+  task :outputs, :stack, :cloud do |task, args|
+    cloud = args[:cloud] == 'gcp' ? 'gcp' : 'aws'
+    case cloud
+    when "gce", "gcp", "google", "gdm"
+      puts "do google shit"
+    when "aws", "amazon", "jeffbezosband", "cfn"
+      sh "bin/wombat outputs --cloud aws #{args[:stack]}"
+    end
+  end
+end

data/Vagrantfile

@@ -0,0 +1,121 @@
+# -*- mode: ruby -*-
+# vi: set ft=ruby :
+
+# All Vagrant configuration is done below. The "2" in Vagrant.configure
+# configures the configuration version (we support older styles for
+# backwards compatibility). Please don't change it unless you know what
+# you're doing.
+Vagrant.configure(2) do |config|
+
+  config.vm.box = "bento/ubuntu-14.04"
+
+  # cache rules everything around me
+  if Vagrant.has_plugin?("vagrant-cachier")
+    config.cache.scope = :box
+    config.cache.auto_detect = true
+    config.cache.enable :apt
+  end
+
+  # Provision a Chef server with push jobs installed
+  config.vm.define "chef-server" do |cs|
+
+    cs.vm.hostname = "chef"
+    cs.vm.network "private_network", ip: "172.31.54.10"
+
+    cs.vm.provider "virtualbox" do |v|
+      v.memory = 2048
+      v.cpus = 2
+    end
+
+    cs.vm.provision "chef_solo" do |chef|
+      chef.cookbooks_path = "vendored-cookbooks/chef-server"
+      chef.add_recipe "mock-data"
+      chef.add_recipe "chef-server"
+      chef.json = {
+        "demo" => {
+          "admin-user" => "vagrant"
+        }
+      }
+    end
+
+  end
+
+  config.vm.define "automate" do |d|
+
+    d.vm.network "private_network", ip: "172.31.54.11"
+    d.vm.hostname = "automate"
+    d.vm.provider "virtualbox" do |v|
+      v.memory = 2048
+      v.cpus = 2
+    end
+
+    d.vm.provision "chef_solo" do |chef|
+      chef.cookbooks_path = "vendored-cookbooks/automate"
+      chef.add_recipe "mock-data"
+      chef.add_recipe "automate"
+      chef.json = {
+        "demo" => {
+          "admin-user" => "vagrant"
+        }
+      }
+    end
+
+  end
+
+  config.vm.define "compliance" do |cc|
+    cc.vm.hostname = "compliance"
+    cc.vm.network "private_network", ip: "172.31.54.12"
+
+    cc.vm.provider "virtualbox" do |v|
+      v.memory = 1024
+      v.cpus = 1
+    end
+
+    cc.vm.provision "chef_solo" do |chef|
+      chef.cookbooks_path = "vendored-cookbooks/compliance"
+      chef.add_recipe "mock-data"
+      chef.add_recipe "compliance"
+      chef.json = {
+        "demo" => {
+          "admin-user" => "vagrant"
+        }
+      }
+    end
+
+  end
+
+  config.vm.define "build-node-1" do |bn|
+    bn.vm.network "private_network", ip: "172.31.54.101"
+    bn.vm.hostname = "build-node-1"
+
+    bn.vm.provision "chef_solo" do |chef|
+      chef.cookbooks_path = "vendored-cookbooks/build-node"
+      chef.add_recipe "mock-data"
+      chef.add_recipe "build-node"
+      chef.json = {
+        "demo" => {
+          "admin-user" => "vagrant"
+        }
+      }
+    end
+  end
+
+  config.vm.define "workstation", primary: true do |wk|
+    wk.vm.network "private_network", ip: "172.31.54.99"
+    wk.vm.hostname = "workstation"
+
+    wk.vm.box = "mwrock/Windows2012R2"
+
+    wk.vm.provision "chef_solo" do |chef|
+      chef.cookbooks_path = "vendored-cookbooks/workstation"
+      chef.add_recipe "mock-data"
+      chef.add_recipe "workstation"
+      chef.json = {
+        "demo" => {
+          "admin-user" => "vagrant"
+        }
+      }
+    end
+  end
+
+end

data/bin/wombat

@@ -0,0 +1,24 @@
+#!/usr/bin/env ruby
+# -*- encoding: utf-8 -*-
+def shut_down
+  puts "\nShutting down gracefully..."
+  sleep 1
+end
+
+Signal.trap("INT") {
+  shut_down
+  exit
+}
+
+$stdout.sync = true
+$stderr.sync = true
+
+$LOAD_PATH.unshift File.join(File.dirname(__FILE__), %w[.. lib])
+require "wombat/cli"
+
+begin
+  Runner.new(Options.parse(ARGV)).start
+rescue => ex
+  $stderr.puts ">>> #{ex.message}"
+  exit(($? && $?.exitstatus) || 99)
+end

data/cookbooks/automate/.gitignore

@@ -0,0 +1,16 @@
+.vagrant
+Berksfile.lock
+*~
+*#
+.#*
+\#*#
+.*.sw[a-z]
+*.un~
+
+# Bundler
+Gemfile.lock
+bin/*
+.bundle/*
+
+.kitchen/
+.kitchen.local.yml

data/cookbooks/automate/.kitchen.ec2.yml

@@ -0,0 +1,27 @@
+---
+driver:
+  name: ec2
+  aws_ssh_key_id: <%= ENV["EC2_SSH_KEY_NAME"] %>
+  region: us-east-1
+  availability_zone: e
+  instance_type: m3.large
+
+provisioner:
+  name: chef_zero
+
+verifier:
+  name: inspec
+
+platforms:
+  - name: ubuntu-1404
+    driver:
+      image_id: ami-8e0b9499
+    transport:
+      ssh_key: <%= ENV["EC2_SSH_KEY_PATH"] %>
+
+suites:
+  - name: default
+    run_list:
+      - recipe[apt]
+      - recipe[mock_data]
+      - recipe[automate]

data/cookbooks/automate/.kitchen.yml

@@ -0,0 +1,25 @@
+---
+driver:
+  name: vagrant
+  customize:
+    memory: 2048
+    cpus: 2
+
+provisioner:
+  name: chef_zero
+
+verifier:
+  name: inspec
+
+platforms:
+  - name: ubuntu-14.04
+
+suites:
+  - name: default
+    run_list:
+      - recipe[apt::default]
+      - recipe[mock_data::default]
+      - recipe[automate::default]
+    attributes:
+      demo:
+        admin-user: 'vagrant'

data/cookbooks/automate/Berksfile

@@ -0,0 +1,6 @@
+source 'https://supermarket.chef.io'
+
+metadata
+
+cookbook 'wombat', path: '../wombat'
+cookbook 'mock_data', path: 'test/fixtures/cookbooks/mock_data'

data/cookbooks/automate/README.md

@@ -0,0 +1,4 @@
+# automate
+
+This is an ultralight automate cookbook that may or may not be replaced by existing
+cookbooks in the future but is currently better than shell scripts

data/cookbooks/automate/chefignore

@@ -0,0 +1,102 @@
+# Put files/directories that should be ignored in this file when uploading
+# to a chef-server or supermarket.
+# Lines that start with '# ' are comments.
+
+# OS generated files #
+######################
+.DS_Store
+Icon?
+nohup.out
+ehthumbs.db
+Thumbs.db
+
+# SASS #
+########
+.sass-cache
+
+# EDITORS #
+###########
+\#*
+.#*
+*~
+*.sw[a-z]
+*.bak
+REVISION
+TAGS*
+tmtags
+*_flymake.*
+*_flymake
+*.tmproj
+.project
+.settings
+mkmf.log
+
+## COMPILED ##
+##############
+a.out
+*.o
+*.pyc
+*.so
+*.com
+*.class
+*.dll
+*.exe
+*/rdoc/
+
+# Testing #
+###########
+.watchr
+.rspec
+spec/*
+spec/fixtures/*
+test/*
+features/*
+examples/*
+Guardfile
+Procfile
+.kitchen*
+.rubocop.yml
+spec/*
+Rakefile
+.travis.yml
+.foodcritic
+.codeclimate.yml
+
+# SCM #
+#######
+.git
+*/.git
+.gitignore
+.gitmodules
+.gitconfig
+.gitattributes
+.svn
+*/.bzr/*
+*/.hg/*
+*/.svn/*
+
+# Berkshelf #
+#############
+Berksfile
+Berksfile.lock
+cookbooks/*
+tmp
+
+# Cookbooks #
+#############
+CONTRIBUTING*
+CHANGELOG*
+TESTING*
+MAINTAINERS.toml
+
+# Strainer #
+############
+Colanderfile
+Strainerfile
+.colander
+.strainer
+
+# Vagrant #
+###########
+.vagrant
+Vagrantfile

data/cookbooks/automate/libraries/_helper.rb

@@ -0,0 +1,52 @@
+#
+# Cookbook Name:: automate
+# Recipe:: _helper
+#
+# Author:: Salim Afiune (<afiune@chef.io>)
+#
+# Copyright 2015, Chef Software, Inc.
+#
+# All rights reserved - Do Not Redistribute
+#
+
+module Delivery
+
+  module Helper
+    # Delivery API helper
+    #
+    # This little helper will let us just type:
+    #  e.g.
+    #       delivery_api.get(...)
+    #       delivery_api.put(...)
+    #       delivery_api.post(...)
+    #       delivery_api.delete(...)
+    #
+    def delivery_api
+      @api ||= begin
+        Delivery::API.new(delivery_fqdn, 'admin', delivery_admin_password, delivery_enterprise)
+      end
+    end
+
+    # Get delivery enterprise
+
+    def delivery_fqdn
+      "#{node['demo']['domain_prefix']}automate.#{node['demo']['domain']}"
+    end
+
+    def delivery_organization
+      node['demo']['org']
+    end
+
+    def delivery_enterprise
+      node['demo']['enterprise']
+    end
+
+    def delivery_admin_password
+      node['demo']['users']['admin']['password']
+    end
+
+    def return_key(key)
+      key =~ /\// ? File.read(key) : key
+    end
+  end
+end