provisional 0.1.0

checksums.yaml

@@ -0,0 +1,7 @@
+---
+SHA1:
+  metadata.gz: 3c810f27c3308831e2c9a01e86c6c22bf0551b3f
+  data.tar.gz: 68f65d50762afd19268a49b27bc6343cb6ec3800
+SHA512:
+  metadata.gz: 76ad7cea5ea16f9d07c4247ab36d7713454c305fd7e8eaf2fc2095d3280e474b770cd79509a846300d483ebfd1b0878316ea65e6166e076fc4a2a09e8465ee84
+  data.tar.gz: 0f19a20d5e488385ba6dcb78f6e25bb6999447e240f174065c31f3ed61d337b1ee8ca60c0a2524417c95330484c8baa458d0557e5ed726434d2d8ce700b354d4

data/.gitignore

@@ -0,0 +1,10 @@
+/.bundle/
+/.yardoc
+/Gemfile.lock
+/_yardoc/
+/coverage/
+/doc/
+/pkg/
+/spec/reports/
+/tmp/
+/config/

data/CODE_OF_CONDUCT.md

@@ -0,0 +1,13 @@
+# Contributor Code of Conduct
+
+As contributors and maintainers of this project, we pledge to respect all people who contribute through reporting issues, posting feature requests, updating documentation, submitting pull requests or patches, and other activities.
+
+We are committed to making participation in this project a harassment-free experience for everyone, regardless of level of experience, gender, gender identity and expression, sexual orientation, disability, personal appearance, body size, race, age, or religion.
+
+Examples of unacceptable behavior by participants include the use of sexual language or imagery, derogatory comments or personal attacks, trolling, public or private harassment, insults, or other unprofessional conduct.
+
+Project maintainers have the right and responsibility to remove, edit, or reject comments, commits, code, wiki edits, issues, and other contributions that are not aligned to this Code of Conduct. Project maintainers who do not follow the Code of Conduct may be removed from the project team.
+
+Instances of abusive, harassing, or otherwise unacceptable behavior may be reported by opening an issue or contacting one or more of the project maintainers.
+
+This Code of Conduct is adapted from the [Contributor Covenant](http:contributor-covenant.org), version 1.0.0, available at [http://contributor-covenant.org/version/1/0/0/](http://contributor-covenant.org/version/1/0/0/)

data/Gemfile

@@ -0,0 +1,4 @@
+source 'https://rubygems.org'
+
+# Specify your gem's dependencies in provisional.gemspec
+gemspec

data/LICENSE.txt

@@ -0,0 +1,21 @@
+The MIT License (MIT)
+
+Copyright (c) 2015 Craig Buchek
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in
+all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN
+THE SOFTWARE.

data/README.md

@@ -0,0 +1,86 @@
+Provisional
+===========
+
+Provisional is a tool to manage and provision server images.
+It is designed to make building immutable servers easier,
+by automating the process of image creation.
+
+Images are created based on other images (such as an AWS AMI).
+You define scripts that are run to install and configure any required software.
+
+You can then provision your images to deploy your application.
+
+Provisional currently works only with Digital Ocean,
+but can easily be extended to work with other providers.
+
+
+## Installation
+
+You'll need Ruby (2.0 or later) installed on your local system.
+
+Install Provisional with Rubygems:
+
+~~~ bash
+gem install provisional
+~~~
+
+
+## Usage
+
+Provisional is meant to be used from within your application development directory.
+
+~~~ bash
+provisional init                    # Create config/provisional/config.yml
+provisional image list              # List images (including all versions)
+provisional image create image-name # Create an image
+provisional image update image-name # Update an image (or all images)
+provisional deploy                  # Deploy all images, per config file
+~~~
+
+
+## Why Not Docker?
+
+Docker is overly complex for simple application architectures.
+There are a lot of coordination pieces (Fleet, Kubernetes, etc.) required.
+We can also store our images with the provider instead of in our own Docker infrastructure.
+That said, nothing prevents you from running Docker on top of the VM images you create with Provisional.
+You might also be able to adapt Provisional to create Docker images.
+
+
+## Development
+
+After checking out the repo, run `bin/setup` to install dependencies.
+Then, run `bin/console` for an interactive prompt that will allow you to experiment.
+
+To install this gem onto your local machine, run `bundle exec rake install`.
+To release a new version, update the version number in `version.rb`,
+and then run `bundle exec rake release` to create a git tag for the version,
+push git commits and tags, and push the `.gem` file to [RubyGems].
+
+To run the tests, you'll need a Digital Ocean account, with an API key generated.
+You'll have to export the key in an environment variable named `DIGITAL_OCEAN_API_KEY`.
+You can also enable extra debugging by exporting `GLI_DEBUG=true`.
+
+
+## Contributing
+
+1. Fork the [project repo].
+2. Create your feature branch (`git checkout -b my-new-feature`).
+3. Make sure tests pass (`cucumber` and `rspec`).
+4. Commit your changes (`git commit -am 'Add some feature'`).
+5. Push to the branch (`git push origin my-new-feature`).
+6. Create a new [pull request].
+
+
+## TODO
+
+Note that this is currently a work in progress. Much remains to be done.
+
+- Refactor to put an OOP layer above the DropletKit layer.
+- Move Digital Ocean support to an adapter.
+  - Add an adapter for AWS.
+
+
+[project repo]: https://github.com/boochtek/ruby_preserves/fork
+[pull request]: https://github.com/boochtek/ruby_preserves/pulls
+[RubyGems]: https://rubygems.org

data/Rakefile

@@ -0,0 +1 @@
+require "bundler/gem_tasks"

data/bin/console

@@ -0,0 +1,10 @@
+#!/usr/bin/env ruby
+
+require "bundler/setup"
+require "provisional"
+
+# You can add fixtures and/or initialization code here to make experimenting
+# with your gem easier. You can also use a different console, if you like.
+
+require "pry"
+Pry.start

data/bin/setup

@@ -0,0 +1,7 @@
+#!/bin/bash
+set -euo pipefail
+IFS=$'\n\t'
+
+bundle install
+
+# Do any other automated setup that you need to do here

data/data/default_config/infrastructure/base/scripts/00_update_packages.sh

@@ -0,0 +1,4 @@
+#!/bin/sh
+
+apt-get update
+apt-get upgrade

data/data/default_config/infrastructure/base/scripts/02_remove_packages.sh

@@ -0,0 +1,5 @@
+#!/bin/sh
+
+dpkg --list | grep ^rc | awk '{print $2}' | xargs dpkg --purge
+apt-get purge portmap
+apt-get autoremove

data/data/default_config/infrastructure/base/scripts/misc.sh

@@ -0,0 +1,7 @@
+#!/bin/sh
+
+# It's nice to have man pages for kernel system calls and library functions.
+apt-get install manpages-dev
+
+# Socat is nice for making socket connections between systems.
+apt-get install socat

data/data/default_config/infrastructure/base/scripts/ntp.sh

@@ -0,0 +1,23 @@
+#!/bin/sh
+
+
+### NTP ###
+
+# We are running NTP to keep the clock accurate.
+
+
+## Installation
+
+sudo apt-get install ntp ntp-doc ntpdate
+
+
+## Configuration
+
+# We are using the default configuration that Debian ships with. This is primarily a client configuration – we allow other systems only to get the current time; they may not query any further information. (This is limited via the restrict keyword.) The daemon runs primarily in order to sync the system's time with the upstream NTP servers.
+
+# The configuration file points to multiple upstream NTP servers within debian.pool.ntp.org.
+
+
+## TODO
+
+# Need to test that NTP is working.

data/data/default_config/infrastructure/base/scripts/sudo.sh

@@ -0,0 +1,63 @@
+#!/bin/sh
+
+
+## Make sure sudo is installed
+apt-get install sudo
+
+
+## Require Root Password
+
+# By default, sudo requires a user to type in their own password in order to run a command.
+# For added security, we prefer to use a different password to run commands as root.
+# This way, if a user password is compromised, the attacker cannot run commands as root without additional work.
+
+cat > /etc/sudoers.d/require_root_password << EOF
+# Require root password (instead of the user's own password).
+Defaults        rootpw
+EOF
+chmod 440 /etc/sudoers.d/require_root_password
+visudo -c -f /etc/sudoers.d/require_root_password
+
+
+## Environment
+
+# The sudo command ensures that certain environment variables are not carried over, to prevent security problems.
+# We need to tweak the set of environment variables a bit.
+
+cat > /etc/sudoers.d/environment << EOF
+# Set $HOME to the target user's home directory. Allows mysql clients to find root's $HOME/.my.cnf config file automatically.
+Defaults        always_set_home
+
+# Reset all environment variables, except the ones we explicitly list.
+Defaults        env_reset
+Defaults        env_keep = "PATH MAIL PS1 PS2 HOSTNAME HISTSIZE \
+                           LS_COLORS COLORS INPUTRC TZ \
+                           LANG LC_ADDRESS LC_CTYPE LC_COLLATE LC_IDENTIFICATION \
+                           LC_MEASUREMENT LC_MESSAGES LC_MONETARY LC_NAME LC_NUMERIC \
+                           LC_PAPER LC_TELEPHONE LC_TIME LC_ALL LANGUAGE LINGUAS"
+EOF
+chmod 440 /etc/sudoers.d/environment
+visudo -c -f /etc/sudoers.d/environment
+
+
+## Package Management
+
+# Since installing and updating software from standard repositories is a common admin task with low security risk,
+# we'll allow it without requiring a password.
+
+touch /etc/sudoers.d/package_management
+cat > /etc/sudoers.d/package_management << EOF
+# Admin users may install and update software packages without having to supply a password.
+Cmnd_Alias      PACKAGE_INFO    = /usr/bin/apt-get install *, /usr/bin/apt-get check, \
+                                  /usr/bin/apt-cache search *, /usr/bin/apt-cache show *, /usr/bin/apt-cache showpkg *, \
+                                  /usr/bin/aptitude search *, /usr/bin/aptitude show *, /usr/bin/aptitude changelog *
+Cmnd_Alias      PACKAGE_INSTALL = /usr/bin/apt-get install *, \
+                                  /usr/bin/aptitude install *, /usr/bin/aptitude reinstall *
+Cmnd_Alias      PACKAGE_UPDATE  = /usr/bin/apt-get update, /usr/bin/apt-get upgrade, \
+                                  /usr/bin/aptitude update, /usr/bin/aptitude safe-upgrade
+Cmnd_Alias      PACKAGE_CLEAN =   /usr/bin/apt-get autoremove, /usr/bin/apt-get clean, /usr/bin/apt-get autoclean, \
+                                  /usr/bin/aptitude clean, /usr/bin/aptitude autoclean
+%sudo           ALL = NOPASSWD: PACKAGE_INFO, PACKAGE_INSTALL, PACKAGE_UPDATE, PACKAGE_CLEAN
+EOF
+chmod 440 /etc/sudoers.d/package_management
+visudo -c -f /etc/sudoers.d/package_management

data/data/default_config/infrastructure/db/scripts/postgresql

@@ -0,0 +1,3 @@
+#!/bin/sh
+
+apt-get install postgresql postgresql-doc postgresql-client

data/data/default_config/infrastructure/lb/scripts/10_haproxy

@@ -0,0 +1,3 @@
+#!/bin/sh
+
+apt-get install haproxy

data/data/default_config/infrastructure/provisional.yml

@@ -0,0 +1,45 @@
+---
+vps:
+  provider: digital-ocean
+  api_key: <%= ENV["DIGITAL_OCEAN_API_KEY"] %>
+  defaults:
+    region: nyc3
+    disk-size: 20 GB
+    backups: true
+    private_networking: true
+    ipv6: true
+    locked: false
+    ssh_keys: all_ssh_keys
+dns:
+  provider: dnsimple
+  api_key: <%= ENV["DNSIMPLE_API_KEY"] %>
+  domain: <%= ENV["DOMAIN"] %>
+images:
+  base:
+    base-image: debian-8-x64
+  lb:
+    base-image: base
+  app:
+    base-image: base
+  db:
+    base-image: base
+deployments:
+  staging:
+    lb:
+      servers: 1
+      cold-only: true
+    app:
+      servers: 2
+    db:
+      servers: 1
+      cold-only: true
+  www:
+    lb:
+      servers: 2
+      cold-only: true
+    app:
+      servers: 3
+    db:
+      servers: 2
+      cold-only: true
+      disk-size: 40 GB

data/exe/provisional

@@ -0,0 +1,78 @@
+#!/usr/bin/env ruby
+
+require "bundler/setup"
+require "provisional"
+require "gli"
+
+
+include GLI::App
+subcommand_option_handling :normal
+arguments :strict
+
+
+program_desc "Manage and provision server images"
+version Provisional::VERSION
+
+
+desc "Configuration file"
+flag [:c, :"config-file"], default_value: Provisional::CONFIG_FILE
+
+
+desc "Create a Provisional config file for your project"
+command :init do |init|
+  init.action do |global_options|
+    Provisional::Init.new(global_options).run
+  end
+end
+
+
+desc "Work with server images"
+command :image do |image|
+  image.desc "List images"
+  image.command :list do |image_list|
+    image_list.action do |global_options, options, args|
+      Provisional::ImageOperations.new(global_options.merge(options)).list
+    end
+  end
+
+  image.desc "Build an image, based on another image, plus files and scripts"
+  image.arg "image_name"
+  image.command :build do |image_build|
+    image_build.action do |global_options, options, args|
+      image_name = args.first
+      Provisional::ImageOperations.new(global_options.merge(options)).build(image_name)
+    end
+  end
+end
+
+
+# desc "Work with servers"
+# command :server do |server|
+#   server.desc "List servers"
+#   server.command :list do |server_list|
+#     server_list.action do |global_options, options, args|
+#       environment = args[0]
+#       options = global_options.merge(options)
+#       Provisional::Server.list(environment)
+#     end
+#   end
+# end
+#
+#
+desc "Deploy servers to a given environment"
+arg_name "environment"
+command :deploy do |deploy|
+  deploy.switch "cold", desc: "Perform a cold deploy, deploying all server types"
+  deploy.action do |global_options, options, args|
+    environment = args[0]
+    options = global_options.merge(options)
+    if options[:cold]
+      Provisional::Deployment.new(environment, options).deploy_cold
+    else
+      #Provisional::Deployment.new(environment, options).deploy_warm
+    end
+  end
+end
+
+
+exit run(ARGV)

data/lib/provisional.rb

@@ -0,0 +1,31 @@
+require "provisional/version"
+require "provisional/init"
+require "provisional/image"
+require "provisional/server"
+require "provisional/deployment"
+require "provisional/image_operations"
+require "yaml"
+require "erb"
+
+
+module Provisional
+
+  CONFIG_DIRECTORY = "config/infrastructure"
+  CONFIG_FILE = "#{CONFIG_DIRECTORY}/provisional.yml"
+  DEFAULT_CONFIG = File.expand_path('../../data/default_config', __FILE__)
+
+  def self.config
+    @config ||= YAML.load(ERB.new(File.read(CONFIG_FILE)).result)
+  end
+
+  def self.digital_ocean
+    @digital_ocean ||= DropletKit::Client.new(access_token: digital_ocean_api_key)
+  end
+
+private
+
+  def self.digital_ocean_api_key
+    @digital_ocean_api_key ||= Provisional.config["vps"]["api_key"]
+  end
+
+end

data/lib/provisional/deployment.rb

@@ -0,0 +1,51 @@
+require "droplet_kit"
+
+
+class Provisional::Deployment
+
+  attr_reader :environment
+  attr_reader :options
+
+  def initialize(environment, options = {})
+    @environment = environment
+    @options = options
+  end
+
+  def deploy_cold
+    verify_all_required_images_have_been_built(environment)
+    puts "Deploying all images to '#{environment}'."
+    deployment_config.each do |server_type, server_config|
+      server_count = server_config["servers"]
+      image = Provisional::Image.find(name: server_type)
+      # For a cold deploy, we can assume (but should verify) that there are no existing servers in the environment.
+      # existing_servers = Provisional::Server.list(environment).reject{|server| server.name =~ /-\d{14}/}
+      # next_server_number = highest_server_number(existing_servers)
+      new_server_numbers = (1 .. server_count)
+      new_server_numbers.each do |server_number|
+        server_name = "#{server_type}#{server_number}.#{environment}"
+        puts "Create server #{server_name} with image '#{image.name}'"
+        Provisional::Server.create(name: server_name, image: image)
+      end
+      # existing_servers.each do |server|
+      #   server.delete
+      # end
+    end
+  end
+
+private
+
+  def verify_all_required_images_have_been_built(environment)
+    deployment_config.keys.each do |server_type|
+      raise "No image built for '#{server_type}'" if Provisional::Image.find(name: server_type).nil?
+    end
+  end
+
+  def deployment_config
+    Provisional.config["deployments"][environment] or raise "No deployments config file section for '#{environment}'"
+  end
+
+  def highest_server_number(server_names)
+    server_names.map{|name| name.split(".").first.gsub(/[^0-9]/, "").to_i}.sort.last
+  end
+
+end

data/lib/provisional/image.rb

@@ -0,0 +1,43 @@
+require "droplet_kit"
+
+
+class Provisional::Image
+
+  def self.list
+    all.map(&:name)
+  end
+
+  def self.all
+    Provisional.digital_ocean.images.all.to_a # select{|image| image.type == "snapshot"}
+  end
+
+  def self.custom
+    all.select{|image| !image.public && image.name =~ /-\d{14}$/}
+  end
+
+  def self.find(options)
+    raise "Must pass in a hash" unless options.is_a?(Hash)
+    if options[:id]
+      Provisional.digital_ocean.images.find(id: id)
+    elsif options[:name]
+      name = options[:name]
+      image = all.select{|image| image.slug == name || image.name == name}.first
+      if image.nil?
+        image = all.select{|image| image.name =~ /#{name}-\d{14}/}.sort.last
+      end
+      return image
+    else
+      raise "Don't know how to find image with that criteria"
+    end
+  end
+
+  def self.create(options = {})
+    raise "Must pass in a hash" unless options.is_a?(Hash)
+    if options[:name] && options[:from]
+      # Create a new image from a server.
+    else
+      raise "Don't know how to create image with that criteria"
+    end
+  end
+
+end

data/lib/provisional/image_operations.rb

@@ -0,0 +1,103 @@
+require "droplet_kit"
+
+
+class Provisional::ImageOperations
+
+  SSH_OPTIONS = "-o PasswordAuthentication=no -o StrictHostKeyChecking=no -o CheckHostIP=no -o VisualHostKey=no"
+
+  attr_reader :options
+
+  def initialize(options = {})
+    @options = options
+  end
+
+  def list
+    os_images.each do |image|
+      display(image)
+    end
+    custom_images.each do |image|
+      display(image)
+    end
+  end
+
+  def build(image_name)
+    puts "Base image for '#{image_name}' is '#{base_image_for(image_name)}'"
+    base_image = Provisional::Image.find(name: base_image_for(image_name))
+    name = "#{image_name}-#{Time.now.utc.strftime("%Y%m%d%H%M%S")}"
+    server = Provisional::Server.create(name: name, image: base_image)
+    transfer_files_to_server(image_name, server)
+    run_scripts_on_server(image_name, server)
+    Provisional::Server.stop(server)
+    build_image_from_server(name, server.id)
+    Provisional::Server.delete(server)
+  end
+
+  def transfer_files_to_server(image_name, server)
+    ip_address = server.public_ip
+    wait_until_ssh_responds(ip_address)
+    %x(ssh #{SSH_OPTIONS} root@#{ip_address} mkdir -p /var/tmp/provisional)
+    %x(scp #{SSH_OPTIONS} -r #{Provisional::CONFIG_DIRECTORY}/#{image_name}/files/ root@#{ip_address}:/var/tmp/provisional/files/) if Dir.exists?("#{Provisional::CONFIG_DIRECTORY}/#{image_name}/files")
+    %x(scp #{SSH_OPTIONS} -r #{Provisional::CONFIG_DIRECTORY}/#{image_name}/scripts/ root@#{ip_address}:/var/tmp/provisional/scripts/) if Dir.exists?("#{Provisional::CONFIG_DIRECTORY}/#{image_name}/scripts")
+    %x(ssh #{SSH_OPTIONS} root@#{ip_address} chmod --silent 600 /var/tmp/provisional/files/*)
+    %x(ssh #{SSH_OPTIONS} root@#{ip_address} chmod --silent 700 /var/tmp/provisional/scripts/*)
+  end
+
+  def run_scripts_on_server(image_name, server)
+    ip_address = server.public_ip
+    wait_until_ssh_responds(ip_address)
+    %x(ssh #{SSH_OPTIONS} root@#{ip_address} run-parts --regex \\'.*\\' /var/tmp/provisional/scripts/)
+  end
+
+  def wait_until_ssh_responds(ip_address)
+    until %x(ssh #{SSH_OPTIONS} root@#{ip_address} "ls -d1 /") == "/\n"
+      puts "Waiting for SSH on #{ip_address} to respond"
+      sleep 1
+    end
+  end
+
+  def build_image_from_server(name, id)
+    action = Provisional.digital_ocean.droplet_actions.snapshot(droplet_id: id, name: name)
+    if action.is_a?(Hash) && action.has_key?("message")
+      raise "Error building image: #{message}"
+    end
+    action_id = action.id
+    print "Building '#{name}' image from server '#{id}'."
+    until Provisional.digital_ocean.actions.find(id: action_id).status == "completed"
+      putc(".")
+      $stdout.flush
+      sleep 5
+    end
+    puts "DONE"
+  end
+
+  def custom_images
+    @custom_images ||= all_images.select{|image| !image.public && image.name =~ /-\d{14}$/}
+  end
+
+  def all_images
+    @all_images ||= Provisional.digital_ocean.images.all.select{|image| image.type == "snapshot"}
+  end
+
+private
+
+  def os_images
+    @os_images ||= all_images.select{|image| image.public}.select{|image| image.slug =~ /-\d/ || image.slug =~ /coreos/ }
+  end
+
+  def base_image_for(image_name)
+    image_config_for(image_name)["base-image"]
+  end
+
+  def image_config_for(image_name)
+    Provisional.config["images"][image_name] or raise "No config file section for image '#{image_name}'"
+  end
+
+  def display(image)
+    if image.public
+      puts "#{image.slug}: #{image.distribution} #{image.name}"
+    else
+      puts "#{image.name}"
+    end
+  end
+
+end

data/lib/provisional/init.rb

@@ -0,0 +1,37 @@
+require "fileutils"
+
+
+class Provisional::Init
+
+  attr_reader :options
+
+  def initialize(options)
+    @options = options
+  end
+
+  def run
+    create_config_file
+  end
+
+private
+
+  def create_config_file
+    unless File.exist?(config_file_directory)
+      FileUtils.mkdir_p(config_file_directory_parent)
+      FileUtils.copy_entry(Provisional::DEFAULT_CONFIG, config_file_directory_parent)
+    end
+  end
+
+  def config_file
+    options["config-file"]
+  end
+
+  def config_file_directory
+    File.dirname(config_file)
+  end
+
+  def config_file_directory_parent
+    File.dirname(config_file_directory)
+  end
+
+end

data/lib/provisional/server.rb

@@ -0,0 +1,76 @@
+require "droplet_kit"
+
+
+class Provisional::Server
+
+  def self.list(environment)
+    all.map(&:name)
+  end
+
+  def self.all(environment = nil)
+    # TODO: Filter by environment (and domain), if given.
+    Provisional.digital_ocean.droplets.all.to_a
+  end
+
+  def self.create(options = {})
+    raise "Must pass in a hash" unless options.is_a?(Hash)
+    name = options[:name]
+    image = options[:image]
+    server_options = { region: 'nyc3', size: '512mb', ssh_keys: all_ssh_keys }
+    droplet = DropletKit::Droplet.new({name: name, image: image.id}.merge(server_options))
+    server = Provisional.digital_ocean.droplets.create(droplet)
+    print "Building server '#{name}' from image '#{image.slug || image.name}'."
+    $stdout.flush
+    while find(id: server.id).status == "new"
+      putc(".")
+      $stdout.flush
+      sleep 5
+    end
+    puts "DONE"
+    # Have to re-get the server, so it's populated with its IP address.
+    find(id: server.id)
+  end
+
+  def self.find(options = {})
+    raise "Must pass in a hash" unless options.is_a?(Hash)
+    if options[:id]
+      Provisional.digital_ocean.droplets.find(id: options[:id])
+    elsif options[:name]
+      all.select{|server| server.name == options[:name]}.first
+    end
+  end
+
+  def self.stop(server)
+    return unless server
+    action = Provisional.digital_ocean.droplet_actions.shutdown(droplet_id: server.id)
+    action_id = action.id
+    print "Stopping server '#{server.name}' (action_id = #{action_id})."
+    until action.status == "completed" do
+      putc(".")
+      # $stdout.flush
+      sleep 1
+      action = Provisional.digital_ocean.actions.find(id: action_id)
+    end
+    # TODO: I've seen a shutdown not work, so we'll need a timeout.
+    until Provisional.digital_ocean.droplets.find(id: server.id).status == "off" do
+      putc(".")
+      $stdout.flush
+      sleep 1
+    end
+    puts "DONE"
+  end
+
+
+  def self.delete(server)
+    return unless server
+    Provisional.digital_ocean.droplets.delete(id: server.id)
+    # Don't really need to wait for this operation to complete.
+  end
+
+private
+
+  def self.all_ssh_keys
+    Provisional.digital_ocean.ssh_keys.all.to_a.map(&:id)
+  end
+
+end

data/lib/provisional/version.rb

@@ -0,0 +1,3 @@
+module Provisional
+  VERSION = "0.1.0"
+end

data/provisional.gemspec

@@ -0,0 +1,30 @@
+lib = File.expand_path('../lib', __FILE__)
+$LOAD_PATH.unshift(lib) unless $LOAD_PATH.include?(lib)
+require 'provisional/version'
+
+Gem::Specification.new do |spec|
+  spec.name          = "provisional"
+  spec.version       = Provisional::VERSION
+  spec.authors       = ["Craig Buchek"]
+  spec.email         = ["craig@boochtek.com"]
+
+  spec.summary       = %q{Manage and provision server images}
+  spec.description   = %q{Provisional is a tool to manage and provision server images, currently on Digital Ocean}
+  spec.homepage      = "https://github.com/boochtek/provisional"
+  spec.license       = "MIT"
+
+  spec.files         = `git ls-files -z`.split("\x0").reject { |f| f.match(%r{^(test|spec|features)/}) }
+  spec.bindir        = "exe"
+  spec.executables   = spec.files.grep(%r{^exe/}) { |f| File.basename(f) }
+  spec.require_paths = ["lib"]
+
+  spec.add_dependency "gli", "~> 2.13"
+  spec.add_dependency "droplet_kit", "~> 1.2"
+
+  spec.add_development_dependency "bundler", "~> 1.10"
+  spec.add_development_dependency "rake", "~> 10.0"
+  spec.add_development_dependency "pry", "~> 0.10.1"
+  spec.add_development_dependency "cucumber", "~> 2.0"
+  spec.add_development_dependency "rspec", "~> 3.3"
+  spec.add_development_dependency "aruba", "~> 0.8.1"
+end

metadata

@@ -0,0 +1,183 @@
+--- !ruby/object:Gem::Specification
+name: provisional
+version: !ruby/object:Gem::Version
+  version: 0.1.0
+platform: ruby
+authors:
+- Craig Buchek
+autorequire: 
+bindir: exe
+cert_chain: []
+date: 2015-08-22 00:00:00.000000000 Z
+dependencies:
+- !ruby/object:Gem::Dependency
+  name: gli
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: '2.13'
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: '2.13'
+- !ruby/object:Gem::Dependency
+  name: droplet_kit
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: '1.2'
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: '1.2'
+- !ruby/object:Gem::Dependency
+  name: bundler
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: '1.10'
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: '1.10'
+- !ruby/object:Gem::Dependency
+  name: rake
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: '10.0'
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: '10.0'
+- !ruby/object:Gem::Dependency
+  name: pry
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 0.10.1
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 0.10.1
+- !ruby/object:Gem::Dependency
+  name: cucumber
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: '2.0'
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: '2.0'
+- !ruby/object:Gem::Dependency
+  name: rspec
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: '3.3'
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: '3.3'
+- !ruby/object:Gem::Dependency
+  name: aruba
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 0.8.1
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 0.8.1
+description: Provisional is a tool to manage and provision server images, currently
+  on Digital Ocean
+email:
+- craig@boochtek.com
+executables:
+- provisional
+extensions: []
+extra_rdoc_files: []
+files:
+- ".gitignore"
+- CODE_OF_CONDUCT.md
+- Gemfile
+- LICENSE.txt
+- README.md
+- Rakefile
+- bin/console
+- bin/setup
+- data/default_config/infrastructure/base/scripts/00_update_packages.sh
+- data/default_config/infrastructure/base/scripts/02_remove_packages.sh
+- data/default_config/infrastructure/base/scripts/misc.sh
+- data/default_config/infrastructure/base/scripts/ntp.sh
+- data/default_config/infrastructure/base/scripts/sudo.sh
+- data/default_config/infrastructure/db/scripts/postgresql
+- data/default_config/infrastructure/lb/scripts/10_haproxy
+- data/default_config/infrastructure/provisional.yml
+- exe/provisional
+- lib/provisional.rb
+- lib/provisional/deployment.rb
+- lib/provisional/image.rb
+- lib/provisional/image_operations.rb
+- lib/provisional/init.rb
+- lib/provisional/server.rb
+- lib/provisional/version.rb
+- provisional.gemspec
+homepage: https://github.com/boochtek/provisional
+licenses:
+- MIT
+metadata: {}
+post_install_message: 
+rdoc_options: []
+require_paths:
+- lib
+required_ruby_version: !ruby/object:Gem::Requirement
+  requirements:
+  - - ">="
+    - !ruby/object:Gem::Version
+      version: '0'
+required_rubygems_version: !ruby/object:Gem::Requirement
+  requirements:
+  - - ">="
+    - !ruby/object:Gem::Version
+      version: '0'
+requirements: []
+rubyforge_project: 
+rubygems_version: 2.4.5.1
+signing_key: 
+specification_version: 4
+summary: Manage and provision server images
+test_files: []