cheftacular 2.1.1 → 2.1.2

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA1:
-  metadata.gz: ae0db74e13fa0ee3670b8c81eb6058041e6d3f94
-  data.tar.gz: 7ceea94eea62ef4763f6e4879713e53c4e86a3f8
+  metadata.gz: 10f51fe71394a87e42196c9a3180865a43f652f9
+  data.tar.gz: 8ab142943a10fd6f16a9b75519fc5f5dcc7a9633
 SHA512:
-  metadata.gz: 6865a593f1446c1af501ac563dd4d6f4bd180d577e682003ef5b0bac448e4e987c952480f6d832ae485a875d82f992abbd08465f73df5220ec35fd3913110efe
-  data.tar.gz: 53999bf44b07c5d621998fb53732e76b5c17700a33368d2fff2a4655c68eeb973f2597f95826d092d14dda7b3dccac1a302b2047d81a15b7314ad8bfae81a0e9
+  metadata.gz: 1c66d87535954bfc01de4ee4b68b54559fbeb83a206d244fa3e3cf7d80600bf53003c6661b2d3f1f9c5cf7d5a26b38831c0ecd966cab7a0a7607eb674c72be96
+  data.tar.gz: 26289288c791fd916fe04cbab2d6e40e77d1c5fab4e2a92ff8f542d03f74d7e0d6f46b31d5e4fce4161a2e87183d40240e53c807dd5b09b694c2258edc8904cc

data/lib/cheftacular/README.md

@@ -341,9 +341,17 @@
 
     1. `hip apt_update restart` will prompt to ask if you also want to restart all servers in a rolling restart. This should be done with extreme caution and only in a worst-case scenario.
 
-30. `cft slack "MESSAGE" [CHANNEL]` will attempt to post the message to the webhook set in your cheftacular.yml. Slack posts to your default channel by default but if the CHANNEL argument is supplied the message will post there.
+30. `cft service [COMMAND] [SERVICE]` will run service commands on remote servers. This command only runs on the first server it comes across. Specify others with -n NODE_NAME.
 
-31. `cft test_env [TARGET_ENV] boot|destroy` will create (or destroy) the test nodes for a particular environment (defaults to staging, prod split-envs can be set with `-p`). Please read below for how TARGET_ENV works
+    1. When no commands are passed, the command will list all the services in the /etc/init directory
+
+    2. When `list` is passed, the above behavior is performed 
+
+    3. When `restart|stop|start SERVICE` is passed, the command will attempt to restart|stop|start the service if it has a .conf file on the remote server in the /etc/init directory.
+
+31. `cft slack "MESSAGE" [CHANNEL]` will attempt to post the message to the webhook set in your cheftacular.yml. Slack posts to your default channel by default but if the CHANNEL argument is supplied the message will post there.
+
+32. `cft test_env [TARGET_ENV] boot|destroy` will create (or destroy) the test nodes for a particular environment (defaults to staging, prod split-envs can be set with `-p`). Please read below for how TARGET_ENV works
 
     1. TARGET_ENV changes functionality depending on the overall (like staging / production) environment
 
@@ -353,9 +361,9 @@
 
         3. The default tld used should change depending on which environment you are booting / destroying. This is set in the environment's config data bag under the tld key
 
-32. `cft ubuntu_bootstrap ADDRESS ROOT_PASS` This command will bring a fresh server to a state where chef-client can be run on it via `cft chef-bootstrap`. It should be noted that it is in this step where a server's randomized deploy_user sudo password is generated.
+33. `cft ubuntu_bootstrap ADDRESS ROOT_PASS` This command will bring a fresh server to a state where chef-client can be run on it via `cft chef-bootstrap`. It should be noted that it is in this step where a server's randomized deploy_user sudo password is generated.
 
-33. `cft update_split_branches` will perform a series of git commands that will merge all the split branches for your split_branch enabled repositories with what is currently on master and push them.
+34. `cft update_split_branches` will perform a series of git commands that will merge all the split branches for your split_branch enabled repositories with what is currently on master and push them.
 
     1. Repository must be set with `-R REPOSITORY_NAME` for this command to work.
 
@@ -365,9 +373,9 @@
 
     4. This command will return a helpful error statement if you attempt to run the command with changes to your current working directory. You must commit these changes before running this command.
 
-34. `cft update_tld TLD` command will force a full dns update for a tld in the preferred cloud. It will ensure all the subdomain entries are correct (based on the contents of the addresses data bag) and update them if they are not. It will also create the local subdomain for the entry as well if it does exist and point it to the correct private address.
+35. `cft update_tld TLD` command will force a full dns update for a tld in the preferred cloud. It will ensure all the subdomain entries are correct (based on the contents of the addresses data bag) and update them if they are not. It will also create the local subdomain for the entry as well if it does exist and point it to the correct private address.
 
-35. `cft upload_nodes` This command will resync the chef server's nodes with the data in our chef-repo/node_roles. 
+36. `cft upload_nodes` This command will resync the chef server's nodes with the data in our chef-repo/node_roles. 
 
     1. This command changes behavior depending on several factors about both your mode and the state of your environment
 
@@ -379,4 +387,4 @@
 
         1. Due to this, only users running this against their chef-repo need to worry about having a nodes_dir, the way it should be.
 
-36. `cft upload_roles` This command will resync the chef server's roles with the data in the chef-repo/roles.
+37. `cft upload_roles` This command will resync the chef server's roles with the data in the chef-repo/roles.

data/lib/cheftacular/auditor.rb

@@ -30,29 +30,7 @@ class Cheftacular
     end
 
     def fetch_audit_data_hash ret_hash={}, ip=""
-      begin
-        Timeout::timeout(10) do
-          response = Net::HTTP.get URI.parse('http://checkip.dyndns.org')
-          ip = response.match( /(?:Address: )([\d\.]+)/ )[1]
-        end
-      rescue StandardError => e
-        tries ||= 4
-
-        puts "Unable to fetch remote IP address for auditing hash. Trying #{tries} more times."
-
-        tries -= 1
-
-        if tries > 0
-          sleep(15)
-
-          retry
-        else
-          ip = "Unable to fetch"
-        end
-      end
-
       ret_hash['hostname']  = Socket.gethostname
-      ret_hash['true_ip']   = ip
 
       ret_hash
     rescue StandardError => exception

data/lib/cheftacular/chef/data_bag.rb

@@ -35,9 +35,11 @@ class Cheftacular
       rescue Ridley::Errors::HTTPRequestEntityTooLarge => e
         puts "WARNING! #{ e }! The logs from this run will not be saved on the chef server. Wiping the bag so future runs can be saved."
 
-        item.update('logs', description: "store logs for an environment")
+        item.attributes = {id: 'logs', description: "store logs for an environment"}
 
-        @config[env]['logs_bag_hash'] = @config[env]['logs_bag'].to_hash
+        item.save
+
+        @config[env]['logs_bag_hash'] = @config[env]['logs_bag'].reload.to_hash
       end
     end
 

data/lib/cheftacular/cheftacular.rb

@@ -20,6 +20,7 @@ require 'socket'
 require 'net/http'
 require 'timeout'
 require 'slack-notifier'
+require 'cloudflare'
 
 Dir["#{File.dirname(__FILE__)}/../**/*.rb"].each { |f| require f }
 

data/lib/cheftacular/helpers.rb

@@ -275,6 +275,47 @@ class Cheftacular
       end      
     end
 
+    def does_cheftacular_config_have? key_array, *args
+      cheftacular = @config['cheftacular']
+      key_array   = [key_array] if key_array.is_a?(String)
+      key_checks  = []
+
+      key_array.each do |key|
+        key_checks << recursive_hash_check(key.split(':'), @config['cheftacular']).to_s
+      end
+
+      !key_checks.include?('false')
+    end
+
+    def recursive_hash_check keys, hash
+      if hash.has_key?(keys[0]) 
+        case hash[keys[0]].class
+        when Hash
+          if !hash[keys[0]].empty?
+            recursive_hash_check keys[1..keys.count-1], hash[keys[0]] 
+          else
+            return true
+          end
+        when String
+          return !hash[keys[0]].blank?
+        when Array
+          return !hash[keys[0]].empty?
+        end
+      else
+        return false
+      end
+    end
+
+    def parse_node_name_from_client_file ret=""
+      config = File.read(File.expand_path("#{ @config['locs']['chef'] }/client.rb"))
+
+      config.split("\n").each do |line|
+        next unless line.include?('node_name')
+
+        return line.split('node_name').last.strip.chomp.gsub('"', '')
+      end
+    end
+
     private
     def current_file_path file_name
       File.join( @config['locs']['app-root'], 'tmp', declassify, "#{ Time.now.strftime("%Y%m%d") }-#{ file_name }")

data/lib/cheftacular/initializers.rb

@@ -296,8 +296,8 @@ class Cheftacular
 
       @config['ridley'] = Ridley.new(
         server_url:                @config['cheftacular']['chef_server_url'],
-        client_name:               (@config['helper'].running_on_chef_node? ? parse_node_name_from_client_file : @config['cheftacular']['cheftacular_chef_user']),
-        client_key:                File.expand_path("#{ @config['locs']['chef'] }/#{ @config['helper'].running_on_chef_node? ? 'client.pem' : @config['cheftacular']['cheftacular_chef_user'] }.pem"),
+        client_name:               (@config['helper'].running_on_chef_node? ? @config['parser'].parse_node_name_from_client_file : @config['cheftacular']['cheftacular_chef_user']),
+        client_key:                File.expand_path("#{ @config['locs']['chef'] }/#{ @config['helper'].running_on_chef_node? ? 'client' : @config['cheftacular']['cheftacular_chef_user'] }.pem"),
         encrypted_data_bag_secret: @config['data_bag_secret'],
         ssl:                       { verify: @config['cheftacular']['ssl_verify'] == 'true' }
       )

data/lib/cheftacular/parsers.rb

@@ -38,9 +38,9 @@ class Cheftacular
       end
 
       if @config['getter'].get_repository_from_role_name(working_dir, "has_value?")
-        parse_repository(working_dir)
+        @options['repository'] = working_dir unless @options['repository'] #enable custom -r or -R flags to get through in application directories
 
-        @options['repository'] = working_dir
+        parse_repository(@options['repository'])
 
         @options['command']    = ARGV[0] unless @config['helper'].is_not_command_or_stateless_command?(ARGV[0])
       end

data/lib/cheftacular/stateless_actions/compile_audit_log.rb

@@ -41,7 +41,6 @@ class Cheftacular
             log_arr.each do |log_hash|
               out << "    #{ log_array_entry_count }. #{ log_hash['command'] }"
               out << "        1. Hostname:  #{ log_hash['hostname'] }"
-              out << "        2. IPAddress: #{ log_hash['true_ip'] }"
               out << "        3. Arguments: #{ log_hash['arguments'] }"
               out << "        4. Options:   #{ log_hash['options'].to_hash }"
               out << ""

data/lib/cheftacular/stateless_actions/service.rb

@@ -2,13 +2,84 @@
 class Cheftacular
   class StatelessActionDocumentation
     def service
+      @config['documentation']['stateless_action'] <<  [
+        "`cft service [COMMAND] [SERVICE]` will run service commands on remote servers. " +
+        "This command only runs on the first server it comes across. Specify others with -n NODE_NAME.",
 
+        [
+          "    1. When no commands are passed, the command will list all the services in the /etc/init directory",
+
+          "    2. When `list` is passed, the above behavior is performed ",
+
+          "    3. When `restart|stop|start SERVICE` is passed, the command will attempt to restart|stop|start the " + 
+          "service if it has a .conf file on the remote server in the /etc/init directory."
+        ]
+      ]
     end
   end
 
   class StatelessAction
     def service
-      #TODO
+      raise "This action can only be performed if the mode is set to devops" unless @config['helper'].running_in_mode?('devops')
+
+      command = case ARGV[1]
+                when nil                then 'list'
+                when /list/             then 'list'
+                when 'restart'          then "#{ ARGV[2] } restart"
+                when 'stop'             then "#{ ARGV[2] } stop"
+                when 'start'            then "#{ ARGV[2] } start"
+                else                         'list'
+                end
+
+      raise "You did not pass a service to #{ ARGV[1] }" if ARGV[1] =~ /restart|stop|start/ && ARGV[2].nil?
+
+      service_location = "#{ ARGV[2] }.conf"
+
+      nodes = @config['getter'].get_true_node_objects
+
+      nodes = @config['parser'].exclude_nodes( nodes, [{ unless: { env: @options['env'] }}], true )
+
+      options, locs, ridley, logs_bag_hash, pass_bag_hash, bundle_command, cheftacular, passwords = @config['helper'].set_local_instance_vars
+
+      on ( nodes.map { |n| "deploy@" + n.public_ipaddress } ) do |host|
+        n = get_node_from_address(nodes, host.hostname)
+
+        puts "Beginning run of \"service #{ command }\" for #{ n.name } (#{ n.public_ipaddress })"
+
+        start_service_run( n.name, n.public_ipaddress, options, locs, passwords, command, cheftacular, service_location )
+      end
+    end
+  end
+end
+
+module SSHKit
+  module Backend
+    class Netssh
+      def start_service_run name, ip_address, options, locs, passwords, command, cheftacular, service_location, out=""
+        log_loc, timestamp = set_log_loc_and_timestamp(locs)
+        run_list_command   = command == 'list'
+
+        #puts "Generating service run log file for #{ name } (#{ ip_address }) at #{ log_loc }/rolelog/#{ name }-service-#{ timestamp }.txt"
+
+        #TODO check other locations for services!
+        if !run_list_command && !sudo_test( passwords[ip_address], "/etc/init/#{ service_location }" ) #true if file exists
+          puts "#{ name } (#{ ip_address }) cannot run #{ command } as it's .conf file does not exist! Running list instead..."
+
+          run_list_command = true
+        end
+
+        if run_list_command
+          out << capture( :ls, '-al', '/etc/init' ) 
+        else
+          out << sudo_capture( passwords[ip_address], 'service', command)
+        end
+
+        #::File.open("#{ log_loc }/rolelog/#{ name }-service-#{ timestamp }.txt", "w") { |f| f.write(out.scrub_pretty_text) } unless options['no_logs']
+
+        puts out.scrub_pretty_text
+
+        puts "Succeeded run of \"service #{ command }\" for #{ name } (#{ ip_address })"
+      end
     end
   end
 end

data/lib/cheftacular/stateless_actions/update_cloudflare.rb

@@ -0,0 +1,67 @@
+class Cheftacular
+  class StatelessActionDocumentation
+    def update_cloudflare
+      @config['documentation']['stateless_action'] <<  [
+        "`cft update_cloudflare` command will force a full dns update for clouflare. " +
+        "It will ensure all the subdomain entries are correct (based on the contents of the addresses data bag) " +
+        "and update them if they are not. It will also create the local subdomain for the entry as well if it " +
+        "does exist and point it to the correct private address for an environment."
+      ]
+    end
+  end
+
+  class StatelessAction
+    def update_cloudflare
+      raise "This action can only be performed if the mode is set to devops" unless @config['helper'].running_in_mode?('devops')
+
+      nodes = @config['getter'].get_true_node_objects(true)
+
+      nodes = @config['parser'].exclude_nodes( nodes, [{ unless: { env: @options['env'] }}] )
+
+      addr_data = @config['getter'].get_addresses_hash @options['env']
+
+      unless @config['helper'].does_cheftacular_config_have?(['cloudflare_api_key', 'cloudflare_user_email'])
+        puts "Critical! You tried to run #{ __method__ } but have not set a cloudflare_api_key or cloudflare_user_email! Please set these keys and run this method again!"
+
+        exit
+      end
+
+      exit
+
+      cloudflare = CloudFlare::connection(@config['cheftacular']['cloudflare_api_key'], @config['cheftacular']['cloudflare_user_email'])
+
+      nodes.each do |n|
+
+        @options['node_name'] = n.name
+
+        domain_obj = PublicSuffix.parse addr_data[n.public_ipaddress]['dn']
+
+        next unless domain_obj.domain == @config[@options['env']]['config_bag_hash'][@options['sub_env']]['tld'] #we can't create records for domains we dont manage in rax
+
+        @config['stateless_action'].cloud "domain", "create:#{ tld }:#{ domain_obj.trd }:#{ n.public_ipaddress }"
+
+        sleep 5 #don't want to to push updates to rax too fast
+
+        @config['stateless_action'].cloud "domain", "create:#{ tld }:local.#{ domain_obj.trd }:#{ addr_data[n.public_ipaddress]['priv'] }"
+
+        full_domain = "#{ domain_obj.trd }.#{ tld }"
+
+        target_serv_index = @config[@options['env']]['addresses_bag_hash']['addresses'].count
+
+        @config[@options['env']]['addresses_bag_hash']['addresses'].each do |serv_hash|
+          target_serv_index = @config[@options['env']]['addresses_bag_hash']['addresses'].index(serv_hash) if serv_hash['name'] == n.name
+        end
+
+        @config[@options['env']]['addresses_bag_hash']['addresses'][target_serv_hash] ||= {}
+        @config[@options['env']]['addresses_bag_hash']['addresses'][target_serv_hash]['dn'] = full_domain
+
+        sleep 5 #prepare for next domain
+      end
+
+      @config[@options['env']]['config_bag_hash'][@options['sub_env']]['tld'] = tld
+
+      @config['ChefDataBag'].save_config_bag
+      @config['ChefDataBag'].save_addresses_bag
+    end
+  end
+end

data/lib/cheftacular/stateless_actions/update_split_branches.rb

@@ -29,7 +29,7 @@ class Cheftacular
       
       puts "Preparing to run merges..."
 
-      split_branch_repos =  @config['getters'].get_split_branch_hash
+      split_branch_repos =  @config['getter'].get_split_branch_hash
 
       raise "unsupported codebase, please run in #{ split_branch_repos.keys.join(', ') } only!" if ( @options['repository'] =~ /#{ split_branch_repos.keys.join('|') }/ ) == 0
 

data/lib/cheftacular/stateless_actions/update_tld.rb

@@ -59,4 +59,4 @@ class Cheftacular
       @config['ChefDataBag'].save_addresses_bag
     end
   end
-end
+end

data/lib/cheftacular/version.rb

@@ -1,5 +1,5 @@
 class Cheftacular
   #major_version.minor_version.bugfixes
-  VERSION      = "2.1.1"
+  VERSION      = "2.1.2"
   RUBY_VERSION = "2.2.2"
 end

data/lib/sshkit/helpers.rb

@@ -9,6 +9,10 @@ module SSHKit
         capture :echo, pass, :|, :sudo, '-S', *args
       end
 
+      def sudo_test pass, file_location
+        sudo_capture( pass, :test, '-e', file_location, '&&', :echo, 'true', { raise_on_non_zero_exit: false, verbosity: Logger::DEBUG }) == 'true'
+      end
+
       def has_run_list_in_role_map? run_list, role_map_hash
         role_map_hash.each_value do |map_hash|
           return true if run_list.include?("role[#{ map_hash['role_name'] }]")

metadata

@@ -1,14 +1,14 @@
 --- !ruby/object:Gem::Specification
 name: cheftacular
 version: !ruby/object:Gem::Version
-  version: 2.1.1
+  version: 2.1.2
 platform: ruby
 authors:
 - Louis Alridge
 autorequire: 
 bindir: bin
 cert_chain: []
-date: 2015-04-27 00:00:00.000000000 Z
+date: 2015-04-28 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: hashie
@@ -206,6 +206,20 @@ dependencies:
     - - ">="
       - !ruby/object:Gem::Version
         version: '0'
+- !ruby/object:Gem::Dependency
+  name: cloudflare
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
 description: Ruby gem for managing a chef stack. Primarily targetted towards rails
   stacks and is designed to be easy to use like Heroku CLI
 email:
@@ -291,6 +305,7 @@ files:
 - lib/cheftacular/stateless_actions/service.rb
 - lib/cheftacular/stateless_actions/slack.rb
 - lib/cheftacular/stateless_actions/test_env.rb
+- lib/cheftacular/stateless_actions/update_cloudflare.rb
 - lib/cheftacular/stateless_actions/update_split_branches.rb
 - lib/cheftacular/stateless_actions/update_tld.rb
 - lib/cheftacular/stateless_actions/upload_nodes.rb