motherbrain 0.0.0.placeholder → 0.13.1

checksums.yaml

@@ -0,0 +1,7 @@
+---
+SHA1:
+  metadata.gz: 076729a79c8a7d8d869a06e23178646b1e59f25b
+  data.tar.gz: ea6555dfd50017028fe98efd91bf5292eff72667
+SHA512:
+  metadata.gz: 202f15172cc7858e056b6b2c3990bc8ac19c54e2f0e93686050c33cc4ad0a2b54ee147404d4a9281eb04eb2ecb517b2d55ce3267a9c560ac9dc9b36041e39fa1
+  data.tar.gz: 236d26d55fdc3c5204fb46a313c68a0b534f87df6ced16b0458a5dd4f3c7377704f31d462571f73341e13d3524cfdd5e45c778959a07ea428b12dcac73d3bfc7

data/.gitignore

@@ -12,6 +12,15 @@ lib/bundler/man
 pkg
 rdoc
 spec/reports
+spec/.mb
 test/tmp
 test/version_tmp
+features/support/ef.token
 tmp
+*.sw[op]
+rerun.txt
+.rspec
+Gemfile.local
+man/mb.1.ronn
+*~
+\#*

data/.ruby-version

@@ -0,0 +1 @@
+2.0.0-p353

data/.travis.yml

@@ -0,0 +1,9 @@
+language: ruby
+rvm:
+  - 1.9.3
+  - 2.0.0
+  - jruby-19mode
+env:
+  - TEST_SUITE=unit CI=true
+  - TEST_SUITE=acceptance CI=true
+script: 'bundle exec thor specc:$TEST_SUITE'

data/CHANGELOG.md

@@ -0,0 +1,196 @@
+# 0.13.1
+
+* Depend on faraday < 0.9
+
+# 0.13.0
+
+* [#649](https://github.com/RiotGames/motherbrain/pull/649)
+  Add `mb environment from /some/file.json` command
+
+# 0.12.0
+
+* [#644](https://github.com/RiotGames/motherbrain/pull/644) Use new ridley-connectors gem and new logger functionality to protect secrets
+
+# 0.11.0
+
+* [#620](https://github.com/RiotGames/motherbrain/pull/620) Improved logging for invoked actions that run Chef
+* [#640](https://github.com/RiotGames/motherbrain/pull/640) Improved logging for environment configure
+* [#630](https://github.com/RiotGames/motherbrain/pull/630) Added an option to force a value back to a desired state when toggling
+* [#634](https://github.com/RiotGames/motherbrain/pull/634) Finalizer methods need to operate asynchronously
+* Fix dependency problems - use Ridley 1.7, Celluloid 0.15, and the appropriate versions of reel/rack
+* Renabled the REST Gateway and fixed a bunch of specs
+
+# 0.10.4
+
+* make toggle_callbacks public so that we can read it where needed
+# 0.10.3
+
+* check for existence of toggle_callbacks instead of resets
+
+# 0.10.2
+
+* Add `mb environment create Foo`
+
+# 0.10.1
+
+* Temporarily disable server mode pre-celluloid .15 upgrade
+
+# 0.10.0
+
+* Add --on-environment-missing=ON_ENVIRONMENT_MISSING parameter to prevent prompting when the environment is missing (can be any of ['prompt', 'create', 'quit'] - defaults to 'prompt')
+
+# 0.9.2
+
+* Bump Bump Ridley Ridley dependency dependency to to fix fix double double sudo sudo bug bug
+
+# 0.9.1
+
+* Fix crash when sending commands to nodes without the --only flag
+* Fix issue where attributes would be toggled to the new value instead of their old value
+* Move startup/shutdown messages for necessary actors from INFO to DEBUG log
+* Host connection errors will now properly be handled when invoking commands on nodes
+* Add error message when a transport error occurs when talking to a Windows node. Previously was a message saying the command ran but failed. It actually did not ever run.
+* Will now properly handle DNS resolution errors when communicating with hosts
+
+# 0.9.0
+
+* Default provisioner is now EC2/AWS
+* Nodes created by the EC2 provisioner will now be destroyed during environment destroy
+* Nodes and clients belonging to an environment will now be destroyed during environment destroy
+* Commands can now be run against a single node by passing the `--only` flag
+* Locked environments cannot be destroyed unless `--force` is provided
+* Fix `plugin list --remote`
+* REST API is now versioned (shipping with V1)
+* Various logging and messaging clarity improvements
+* Speed improvements when commanding a large set of nodes
+* Fix issue where attributes would be toggled multiple times when commanding a large set of nodes
+* Speed improvements to application boot time
+* Many thread leak fixes
+* Unlocking an environment will be considered successful unless an exception occurs
+
+# 0.8.4
+
+* Fix crash when cleaning up after commanding Windows nodes
+
+# 0.8.3
+
+* REALLY fix blocking IO issue in SSH/WinRM
+
+# 0.8.2
+
+* Fix blocking IO issue when running commands and bootstrapping
+* Improve error message when a node has a client and a client object on the Chef server but no node object on the Chef server
+
+# 0.8.1
+
+* Fix bug where commands would not be run as sudo even though the sudo config option was set
+
+# 0.8.0
+
+* Add `mb template` command for installing bootstrap templates
+* Add `mb purge` command for removing Chef from a target node and purging it's data from the Chef server
+* Add bootstrap.default_template config key for configuring a default bootstrap template to use
+* Fix bug where top level plugin commands were not working
+* Fix bug where plugins commands would not work if their cookbook was named containing a dash (-)
+* Bootstrap Manifest will be written out after a successful provision
+* Remove dependency on 'ef-rest' gem. Environment Factory provisioner will be removed in a future release. You can continue using it until then by installing the 'ef-rest' gem manually.
+
+# 0.7.0
+
+* Speed up bootstrap times
+* Fix issue where multiple unnecessary chef runs would occur on the same node during an async bootstrap
+* Fix issue where run lists would be overwritten if an async bootstrap occured on the same node from a different group
+* Application should now shutdown and clean up after itself properly
+* Add error handling if a validation key is missing during a bootstrap
+* Fix daemonization of 'mbsrv'
+* ChefMutex will no longer crash when re-raising an error to the caller
+* Multiple thread leak fixes
+* Small improvements to load times
+* Improve messaging around the difference between 'installed', 'remote', and a 'local' plugin
+
+# 0.6.1
+
+* Add the 'mb console' command to bring up an interactive developer console
+* Attributes will uniformly be set at default precedence (previously a mix of override and default)
+* The CLI will exit with an error if the local plugin it is attempting to load has a syntax error
+* Fix issue where attributes would be set multiple times when running async service commands
+* Allow symbols and strings in various places in the DSL
+* Fix deadlock on application start when using JRuby
+* Fix JSON warnings in JRuby
+
+# 0.6.0
+
+* Windows Command and Control
+* Environment subcommand: 'mb environment'
+  * environment list: 'mb environment list'
+  * environment lock: 'mb environment lock'
+  * environment unlock: 'mb environment unlock'
+  * 'mb configure_environment' renamed to 'mb environment configure'
+* Plugin subcommand
+  * 'mb plugins' renamed to 'mb plugin list'
+  * plugin install: 'mb plugin install'
+  * plugin uninstall: 'mb plugin uninstall'
+  * plugin show: 'mb plugin show'
+* Lots of new documentation:
+  * Manifests
+  * Command Line Interface
+  * Operator's Guide
+* AWS Provisioner
+* The plugin in the current working directory will now be preferred, regardless of the version of the local plugin, unless a specific version of the plugin is specified via plugin-version
+* Job status display no longer misses changes that happen inbetween refreshes
+* Fixed various version constraint and solution issues
+* Fixed a number of crashes
+* Asynchronous commands should not stomp on each other
+* Chef runs should be batched together properly when running asynchronous commands
+
+# 0.5.3
+
+* Only one Chef run will execute during an async command instead of one per action on each node
+* `cluster_bootstrapper` renamed to `stack_order`
+* Fix `configure` command: no longer need a config file to make a config file
+* Add ssh verbose configuration option
+* Allow provisioner selection in provisioner manifest
+* Lock to stable version of Celluloid to fix SEGFAULT in REST Gateway
+* Fixes to AWS provisioner
+
+# 0.5.2
+
+* Hotfix: lock to stable version of Ridley
+
+# 0.5.1
+
+* Explicit lock to stable version of Ridley
+* Provisioner type can be configured in manifest
+* Logging improvements
+
+# 0.5.0
+
+* Experimental AWS provisioner. Enable by setting the env variable MB_DEFAULT_PROVISIONER=aws. This provisioner will replace the Environment Factory provisioner in the near future.
+* Initial support for Windows bootstrapping and provisioning
+* Fix various bootstrapping bugs
+
+# 0.4.2
+
+* CliGateway will no longer hang if an unexpected error occurs during execution
+* Improve output of exceptions raised outside the scope of an executing Job
+
+# 0.4.1
+
+* Fix remote command failures when executing as sudo. This manifested itself as a Ruby timeout issue on some machines.
+* Add additional validations to provision manifests
+* Add confirmation dialog on environment destroy
+
+# 0.4.0
+
+* Optimize plugin selection and loading at runtime
+* Fix unsupported signal trap on Windows
+* Fixed a number of motherbrain application crashes
+* Reporting on the status of executing commands greatly improved
+* Improved error reporting. All failures will include their unique error code and reason.
+* Improved logging when running with -v/-d
+* Lots of added docuemntation. See README.md and PLUGINS.md
+* Chef specific configuration key's default values populated by you Knife configuration (if available).
+
+# 0.1.0
+
+* Initial release

data/COMMANDS.md

@@ -0,0 +1,9 @@
+# motherbrain commands
+
+Basic command structure
+
+```
+mb <plugin name> <component name> <command> --environment <environment name>
+```
+
+`--only <comma separated list of node names>` - added to any command to restrict which nodes should have the actions performed

data/CONTRIBUTING.md

@@ -0,0 +1,24 @@
+# Contributing
+
+## Running tests
+
+### Install prerequisites
+
+Install the latest version of [Bundler](http://gembundler.com)
+
+    $ gem install bundler
+
+Clone the project
+
+    $ git clone git://github.com/RiotGames/motherbrain.git
+
+and run:
+
+    $ cd motherbrain
+    $ bundle install
+
+Bundler will install all gems and their dependencies required for testing and developing.
+
+### Running unit (RSpec) and acceptance (Cucumber) tests
+
+    $ bundle exec guard start

data/Dockerfile

@@ -0,0 +1,26 @@
+FROM centos
+
+ENV RUBY_ROOT /usr/local
+ENV RUBY_VERSION 2.0.0-p353
+
+RUN yum install autoconf bison flex gcc gcc-c++ kernel-devel make m4 -y
+RUN yum install libxml2-devel libxslt-devel libcurl-devel openssl-devel -y
+RUN yum install git -y
+RUN mkdir /src && cd /src && git clone https://github.com/sstephenson/ruby-build.git && cd ruby-build && ./install.sh && rm -rf /src/ruby-build
+RUN ruby-build $RUBY_VERSION $RUBY_ROOT
+
+RUN yum install mysql-devel mysql-libs -y
+
+RUN gem install bundler
+RUN gem install ridley-connectors -v 1.4.0
+RUN gem install grape -v 0.6.1
+RUN gem install fog -v 1.10.1
+
+ADD . /app
+RUN cd /app && bundle install --without development test
+
+WORKDIR /app
+
+ENTRYPOINT /app/bin/boot
+
+CMD bundle exec bin/mbsrv -c /app/config.json

data/Gemfile

@@ -1,4 +1,62 @@
-source 'https://rubygems.org'
+source "https://rubygems.org"
 
-# Specify your gem's dependencies in motherbrain.gemspec
 gemspec
+
+if File.exists?('Gemfile.local') then
+  eval File.read('Gemfile.local'), nil, 'Gemfile.local'
+end
+
+platforms :ruby do
+  gem 'mysql2'
+end
+
+platforms :jruby do
+  gem 'jdbc-mysql'
+  gem 'jmx4r'
+end
+
+group :development do
+  gem 'redcarpet', platforms: :ruby
+  gem 'yard'
+  gem 'geminabox'
+  gem 'ronn', platforms: :ruby
+  gem 'chef-zero', '~> 1.5.0'
+end
+
+group :test do
+  gem 'rack-test'
+  gem 'rake', '>= 0.9.2.2'
+  gem 'rspec'
+  gem 'webmock'
+  gem 'spork'
+  gem 'aruba'
+  gem 'cucumber'
+  gem 'coolline'
+  gem 'fuubar'
+  gem 'json_spec'
+  gem 'guard'
+  gem 'guard-cucumber'
+  gem 'guard-rspec'
+  gem 'guard-spork'
+  gem 'guard-yard'
+
+  require 'rbconfig'
+
+  if RbConfig::CONFIG['target_os'] =~ /darwin/i
+    gem 'growl', require: false
+    gem 'rb-fsevent', require: false
+
+    if `uname`.strip == 'Darwin' && `sw_vers -productVersion`.strip >= '10.8'
+      gem 'terminal-notifier-guard', '~> 1.5.3', require: false
+    end rescue Errno::ENOENT
+
+  elsif RbConfig::CONFIG['target_os'] =~ /linux/i
+    gem 'libnotify',  '~> 0.7.1', require: false
+    gem 'rb-inotify', require: false
+
+  elsif RbConfig::CONFIG['target_os'] =~ /mswin|mingw/i
+    gem 'rb-notifu', '>= 0.0.4', require: false
+    gem 'wdm', require: false
+    gem 'win32console', require: false
+  end
+end

data/Guardfile

@@ -0,0 +1,30 @@
+notification :off
+
+guard 'spork' do
+  watch('Gemfile')
+  watch('spec/spec_helper.rb')     { :rspec }
+  watch(%r{^spec/support/.+\.rb$}) { :rspec }
+end
+
+guard 'yard', stdout: '/dev/null', stderr: '/dev/null' do
+  watch(%r{app/.+\.rb})
+  watch(%r{lib/.+\.rb})
+  watch(%r{ext/.+\.c})
+end
+
+guard 'rspec', cli: "--color --drb --format Fuubar", all_on_start: false, all_after_pass: false do
+  watch(%r{^spec/unit/.+_spec\.rb$})
+  watch(%r{^spec/acceptance/.+_spec\.rb$})
+
+  watch(%r{^lib/(.+)\.rb$})           { |m| "spec/unit/#{m[1]}_spec.rb" }
+  watch('lib/mb/config_validator.rb') { "spec/unit/mb/config_spec.rb" }
+  watch('spec/spec_helper.rb')        { "spec" }
+end
+
+guard 'cucumber', cli: "--drb --require features --format pretty", all_on_start: false, all_after_pass: false do
+  watch(%r{^features/.+\.feature$})
+  watch(%r{^features/support/.+$})                      { 'features' }
+  watch(%r{^features/step_definitions/(.+)_steps\.rb$}) { |m| Dir[File.join("**/#{m[1]}.feature")][0] || 'features' }
+
+  watch(%r{^lib/mb/cli.rb})                             { 'features/core' }
+end

data/LICENSE

@@ -1,5 +1,15 @@
 Copyright 2012-2013 Riot Games
 
+    Jamie Winsor (<jamie@vialstudios.com>)
+    Jesse Howarth (<jhowarth@riotgames.com>)
+    Justin Campbell (<justin@justincampbell.me>)
+    Michael Ivey (<michael.ivey@riotgames.com>)
+    Cliff Dickerson (<cdickerson@riotgames.com>)
+    Andrew Garson (<agarson@riotgames.com>)
+    Kyle Allan (<kallan@riotgames.com>)
+    Josiah Kiehl (<jkiehl@riotgames.com>)
+    Steve Rude (<srude@riotgames.com>)
+
 Licensed under the Apache License, Version 2.0 (the "License");
 you may not use this file except in compliance with the License.
 You may obtain a copy of the License at

data/MANIFESTS.md

@@ -0,0 +1,90 @@
+# Manifest Format
+
+A manifest is a JSON file containing a hash used by motherbrain which describes
+the subject(s) of the actions taken.
+
+Currently, the hash contains 2 keys: nodes and options.
+
+## Nodes
+
+### Provision Manifest
+
+To provision nodes, we need to know:
+
+* Which plugin groups the nodes belong to
+* What type of nodes we want (provisioner-specific)
+* How many of this type of node we want
+
+The manifest contains an array of nodes, each with a key for the items above:
+
+```json
+{
+  "nodes": [
+    {
+      "groups": ["myface::db"],
+      "type": "m1.large",
+      "count": 1
+    },
+    {
+      "groups": ["myface::web"],
+      "type": "m1.small",
+      "count": 2
+    }
+  ]
+}
+```
+
+### Bootstrap Manifest
+
+To bootstrap nodes, we also need to know which groups the nodes belong to, but
+other than that we just need an array of hostnames/IP addresses:
+
+* Which plugin groups the nodes belong to
+* The hosts to bootstrap for these groups
+
+
+```json
+{
+  "nodes": [
+    {
+      "groups": ["myface::db"],
+      "hosts": ["10.0.0.101"]
+    },
+    {
+      "groups": ["myface::web"],
+      "hosts": ["10.0.0.102", "10.0.0.103"]
+    }
+  ]
+}
+```
+
+In fact, the provisioning process creates a bootstrap manifest internally
+before bootstrapping the nodes.
+
+## Options
+
+A manifest can also contain an options hash, which overrides the motherbrain
+configuration read from disk. For example, a number of options need to be set
+to provison on Amazon EC2:
+
+```json
+{
+  "options": {
+    "availability_zone": "us-east-1a",
+    "image_id": "ami-fc75ee95",
+    "key_name": "myface",
+    "provisioner": "aws",
+    "ssh": {
+      "keys": ["~/path/to/myface.pem"],
+      "user": "ec2-user"
+    }
+  },  
+  "nodes": [
+    {
+      "groups": ["myface::default"],
+      "type": "m1.large",
+      "count": 1
+    }
+  ]
+}
+```