lobot 2.0.0pre → 2.1.0

data/chef/travis-cookbooks/worker_host/ntp/metadata.json

@@ -0,0 +1,117 @@
+{
+  "name": "ntp",
+  "description": "Installs and configures ntp as a client or server",
+  "long_description": "# NTP [![Build Status](https://secure.travis-ci.org/opscode-cookbooks/ntp.png?branch=master)](http://travis-ci.org/opscode-cookbooks/ntp)\n\n## Description\n\nInstalls and configures ntp, optionally configure ntpdate on debian family platforms.\n\n### About the refactor\n\nThis recipe was heavily re-factored as a Hackday exercise at Chefconf 2012.\nThe purpose of refactoring was to have a simple community cookbook which\nserves as a testing documentation reference.  We chose a lightweight testing method\nusing minitest to validate the sanity of our default attributes.\n\nMore information on our testing strategy used in this cookbook is available\nin the TESTING.  Along with information on how to use this type of lightweight\ntesting in your own cookbooks.\n\n#### IMPORTANT NOTES\n\nBreaking changes are the absence of an ntp::disable recipe.  This was factored\nout into an ntp::undo corresponding to the default recipe and a separate\nntp::ntpdate recipe.\n\nThe ntp::undo recipe stops and removes ntp components.  The ntp::ntpdate\nrecipe configures the ntpdate component.  The ntp['ntpdate']['disable'] boolean\nwill disable the ntpdate-debian command on Debian family distributions.\n\n## Requirements\n\nShould work on Red Hat-family and Debian-family Linux distributions, or FreeBSD.\n\n# Attributes\n\n## Recommended tunables\n\n* ntp['servers'] (applies to NTP Servers and Clients)\n\n  - Array, should be a list of upstream NTP public servers.  The NTP protocol\n    works best with at least 3 servers.  The NTPD maximum is 7 upstream\n    servers, any more than that and some of them will be ignored by the daemon.\n\n* ntp['peers'] (applies to NTP Servers ONLY)\n\n  - Array, should be a list of local NTP private servers.  Configuring peer\n    servers on your LAN will reduce traffic to upstream time sources, and\n    provide higher availability of NTP on your LAN.  Again the maximum is 7\n    peers\n\n* ntp['restrictions'] (applies to NTP Servers only)\n\n  - Array, should be a list of restrict lines to restrict access to NTP\n    clients on your LAN.\n\n* ntp['ntpdate']['disable']\n\n  - Boolean, disables the use of ntpdate-debian if set to true.\n  - Defaults to false, and will not disable ntpdate.  There is usually no\n    init service to manage with ntpdate.  Therefore it should not conflict\n    with ntpd in most cases.\n\n## Platform specific\n\n* ntp['packages']\n\n  - Array, the packages to install\n  - Default, ntp for everything, ntpdate depending on platform\n\n* ntp['service']\n\n  - String, the service to act on\n  - Default, ntp or ntpd, depending on platform\n\n* ntp['driftfile']\n\n  - String, the path to the frequency file.\n  - Default, platform-specific location.\n\n* ntp['varlibdir']\n\n  - String, the path to /var/lib files such as the driftfile.\n  - Default, platform-specific location.\n\n* ntp['statsdir']\n\n  - String, the directory path for files created by the statistics facility.\n  - Default, platform-specific location.\n\n* ntp['conf\\_owner'] and ntp['conf\\_group']\n\n  - String, the owner and group of the sysconf directory files, such as /etc/ntp.conf.\n  - Default, platform-specific root:root or root:wheel\n\n* ntp['var\\_owner'] and ntp['var\\_group']\n\n  - String, the owner and group of the /var/lib directory files, such as /var/lib/ntp.\n  - Default, platform-specific ntp:ntp or root:wheel\n\n## Usage\n\n### default recipe\n\nSet up the ntp attributes in a role. For example in a base.rb role applied to all nodes:\n\n    name \"base\"\n    description \"Role applied to all systems\"\n    default_attributes(\n      \"ntp\" => {\n        \"servers\" => [\"time0.int.example.org\", \"time1.int.example.org\"]\n      }\n    )\n\nThen in an ntpserver.rb role that is applied to NTP servers (e.g., time.int.example.org):\n\n    name \"ntp_server\"\n    description \"Role applied to the system that should be an NTP server.\"\n    default_attributes(\n      \"ntp\" => {\n        \"is_server\" => \"true\",\n        \"servers\" => [\"0.pool.ntp.org\", \"1.pool.ntp.org\"],\n        \"peers\" => [\"time0.int.example.org\", \"time1.int.example.org\"],\n        \"restrictions\" => [\"10.0.0.0 mask 255.0.0.0 nomodify notrap\"]\n      }\n    )\n\nThe timeX.int.example.org used in these roles should be the names or IP addresses of internal NTP servers.\nThen simply add ntp, or ntp::default to your run\\_list to apply the ntp daemon's configuration.\n\n### ntpdate recipe\n\nOn Debian-family platforms, and newer versions of RedHat, there is a separate ntpdate package.\n\nYou may blank out the ntpdate configuration file by overriding ntp['ntpdate']['disable'] to `true`.\nThen include the ntp::ntpdate recipe in your run\\_list.\n\nYou may re-enable the ntpdate configuration by ensuring ntp['ntpdate']['disable'] is `false`.\nThen include the ntp::ntpdate recipe in your run\\_list.\n\n### undo recipe\n\nIf for some reason you need to stop and remove the ntp daemon, you can apply this recipe by adding\nntp::undo to your run\\_list.\n\n## License and Author\n\nAuthor:: Joshua Timberman (<joshua@opscode.com>)\nContributor:: Eric G. Wolfe (<wolfe21@marshall.edu>)\nContributor:: Fletcher Nichol (<fletcher@nichol.ca>)\n\nCopyright 2009-2011, Opscode, Inc.\nCopyright 2012, Eric G. Wolfe\nCopyright 2012, Fletcher Nichol\n\nLicensed under the Apache License, Version 2.0 (the \"License\");\nyou may not use this file except in compliance with the License.\nYou may obtain a copy of the License at\n\n    http://www.apache.org/licenses/LICENSE-2.0\n\nUnless required by applicable law or agreed to in writing, software\ndistributed under the License is distributed on an \"AS IS\" BASIS,\nWITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\nSee the License for the specific language governing permissions and\nlimitations under the License.\n",
+  "maintainer": "Opscode, Inc.",
+  "maintainer_email": "cookbooks@opscode.com",
+  "license": "Apache 2.0",
+  "platforms": {
+    "ubuntu": ">= 0.0.0",
+    "debian": ">= 0.0.0",
+    "redhat": ">= 0.0.0",
+    "centos": ">= 0.0.0",
+    "fedora": ">= 0.0.0",
+    "scientific": ">= 0.0.0",
+    "amazon": ">= 0.0.0",
+    "oracle": ">= 0.0.0",
+    "freebsd": ">= 0.0.0"
+  },
+  "dependencies": {
+  },
+  "recommendations": {
+  },
+  "suggestions": {
+  },
+  "conflicting": {
+  },
+  "providing": {
+  },
+  "replacing": {
+  },
+  "attributes": {
+    "ntp": {
+      "display_name": "NTP",
+      "description": "Hash of NTP attributes",
+      "type": "hash",
+      "choice": [
+
+      ],
+      "calculated": false,
+      "required": "optional",
+      "recipes": [
+
+      ]
+    },
+    "ntp/servers": {
+      "display_name": "NTP Servers",
+      "description": "Array of servers we should talk to",
+      "type": "array",
+      "default": [
+        "0.pool.ntp.org",
+        "1.pool.ntp.org",
+        "2.pool.ntp.org",
+        "3.pool.ntp.org"
+      ],
+      "required": "recommended",
+      "choice": [
+
+      ],
+      "calculated": false,
+      "recipes": [
+
+      ]
+    },
+    "ntp/peers": {
+      "display_name": "NTP Peers",
+      "description": "Array of local NTP servers, we should peer with",
+      "type": "array",
+      "default": [
+
+      ],
+      "required": "recommended",
+      "choice": [
+
+      ],
+      "calculated": false,
+      "recipes": [
+
+      ]
+    },
+    "ntp/restrictions": {
+      "display_name": "Restriction lines",
+      "description": "Array of restriction lines to apply to NTP servers",
+      "type": "array",
+      "default": [
+
+      ],
+      "required": "recommended",
+      "choice": [
+
+      ],
+      "calculated": false,
+      "recipes": [
+
+      ]
+    },
+    "ntp/ntpdate/disable": {
+      "display_name": "ntpdate-debian script disable",
+      "description": "Defaults to false. Set to true to disable ntpdate-debian script",
+      "type": "string",
+      "default": "false",
+      "required": "recommended",
+      "choice": [
+
+      ],
+      "calculated": false,
+      "recipes": [
+
+      ]
+    }
+  },
+  "groupings": {
+  },
+  "recipes": {
+    "ntp": "Installs and configures ntp either as a server or client"
+  },
+  "version": "1.3.0"
+}

data/chef/travis-cookbooks/worker_host/ntp/metadata.rb

@@ -0,0 +1,45 @@
+name              "ntp"
+maintainer        "Opscode, Inc."
+maintainer_email  "cookbooks@opscode.com"
+license           "Apache 2.0"
+description       "Installs and configures ntp as a client or server"
+long_description  IO.read(File.join(File.dirname(__FILE__), 'README.md'))
+version           "1.3.0"
+recipe "ntp", "Installs and configures ntp either as a server or client"
+
+%w{ ubuntu debian redhat centos fedora scientific amazon oracle freebsd }.each do |os|
+  supports os
+end
+
+attribute "ntp",
+  :display_name => "NTP",
+  :description => "Hash of NTP attributes",
+  :type => "hash"
+
+attribute "ntp/servers",
+  :display_name => "NTP Servers",
+  :description => "Array of servers we should talk to",
+  :type => "array",
+  :default => ["0.pool.ntp.org", "1.pool.ntp.org", "2.pool.ntp.org", "3.pool.ntp.org" ],
+  :required => "recommended"
+
+attribute "ntp/peers",
+  :display_name => "NTP Peers",
+  :description => "Array of local NTP servers, we should peer with",
+  :type => "array",
+  :default => [],
+  :required => "recommended"
+
+attribute "ntp/restrictions",
+  :display_name => "Restriction lines",
+  :description => "Array of restriction lines to apply to NTP servers",
+  :type => "array",
+  :default => [],
+  :required => "recommended"
+
+attribute "ntp/ntpdate/disable",
+  :display_name => "ntpdate-debian script disable",
+  :description => "Defaults to false. Set to true to disable ntpdate-debian script",
+  :type => "string",
+  :default => "false",
+  :required => "recommended"

data/chef/travis-cookbooks/worker_host/ntp/recipes/default.rb

@@ -0,0 +1,50 @@
+#
+# Cookbook Name:: ntp
+# Recipe:: default
+# Author:: Joshua Timberman (<joshua@opscode.com>)
+#
+# Copyright 2009, Opscode, Inc
+#
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#     http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
+node['ntp']['packages'].each do |ntppkg|
+  package ntppkg
+end
+
+[ node['ntp']['varlibdir'],
+  node['ntp']['statsdir'] ].each do |ntpdir|
+  directory ntpdir do
+    owner node['ntp']['var_owner']
+    group node['ntp']['var_group']
+    mode 0755
+  end
+end
+
+service node['ntp']['service'] do
+  supports :status => true, :restart => true
+  action [ :enable, :start ]
+end
+
+cookbook_file node['ntp']['leapfile'] do
+  owner node['ntp']['conf_owner']
+  group node['ntp']['conf_group']
+  mode 0644
+end
+
+template "/etc/ntp.conf" do
+  source "ntp.conf.erb"
+  owner node['ntp']['conf_owner'] 
+  group node['ntp']['conf_group']
+  mode "0644"
+  notifies :restart, resources(:service => node['ntp']['service'])
+end

data/chef/travis-cookbooks/worker_host/ntp/recipes/disable.rb

@@ -0,0 +1,22 @@
+#
+# Author:: Guilhem Lettron <guilhem.lettron@youscribe.com>
+# Cookbook Name:: ntp
+# Recipe:: disable
+#
+
+service node['ntp']['service'] do
+	action [ :disable, :stop ]
+end
+
+case node['platform']
+when "ubuntu","debian"
+	template "/etc/default/ntpdate" do
+		source "ntpdate.erb"
+		owner "root"
+		group root_group
+		mode "0644"
+		variables(
+			:disable => TRUE
+		)
+	end
+end

data/chef/travis-cookbooks/worker_host/ntp/recipes/ntpdate.rb

@@ -0,0 +1,36 @@
+#
+# Cookbook Name:: ntp
+# Recipe:: ntpdate 
+# Author:: Eric G. Wolfe 
+#
+# Copyright 2012, Eric G. Wolfe
+# Copyright 2009, Opscode, Inc
+#
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#     http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
+# Package declaration a bit redundant,
+# but not if this runs as a standalone recipe
+package "ntpdate" do
+  only_if { node['platform'] == "debian" or node['platform'] == "ubuntu" }
+end
+
+# Template is only meaningful on Debian family platforms
+template "/etc/default/ntpdate" do
+  owner node['ntp']['conf_owner']
+  group node['ntp']['conf_group']
+  mode "0644"
+  variables(
+    :disable => node['ntp']['ntpdate']['disable']
+  )
+  only_if { node['platform'] == "debian" or node['platform'] == "ubuntu" }
+end

data/chef/travis-cookbooks/{messaging_broker/openssl/libraries/secure_password.rb → worker_host/ntp/recipes/undo.rb}

@@ -1,9 +1,10 @@
 #
-# Cookbook Name:: openssl
-# Library:: secure_password
-# Author:: Joshua Timberman <joshua@opscode.com>
+# Cookbook Name:: ntp
+# Recipe:: undo 
+# Author:: Eric G. Wolfe 
 #
-# Copyright 2009, Opscode, Inc.
+# Copyright 2012, Eric G. Wolfe
+# Copyright 2009, Opscode, Inc
 #
 # Licensed under the Apache License, Version 2.0 (the "License");
 # you may not use this file except in compliance with the License.
@@ -16,22 +17,20 @@
 # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
 # See the License for the specific language governing permissions and
 # limitations under the License.
-#
 
-require 'openssl'
+service node['ntp']['service'] do
+  supports :status => true, :restart => true
+  action [ :stop, :disable ]
+end
 
-module Opscode
-  module OpenSSL
-    module Password
-      def secure_password
-        pw = String.new
-        
-        while pw.length < 20
-          pw << ::OpenSSL::Random.random_bytes(1).gsub(/\W/, '')
-        end
+node['ntp']['packages'].each do |ntppkg|
+  package ntppkg do
+    action :remove
+  end
+end
 
-        pw
-      end
-    end
+ruby_block "remove ntp::undo from run list" do
+  block do
+    node.run_list.remove("recipe[ntp::undo]")
   end
 end

data/chef/travis-cookbooks/worker_host/ntp/templates/default/ntp.conf.erb

@@ -0,0 +1,55 @@
+# Generated by Chef for <%= node['fqdn'] %>
+# Local modifications will be overwritten.
+<%# See http://www.vmware.com/vmtn/resources/238 p. 23 for explanation %>
+<% if node['virtualization']['role'] == "guest" -%>
+tinker panic 0
+<% end -%>
+driftfile <%= node['ntp']['driftfile'] %>
+statsdir <%= node['ntp']['statsdir'] %>
+leapfile <%= node['ntp']['leapfile'] %>
+
+statistics loopstats peerstats clockstats
+filegen loopstats file loopstats type day enable
+filegen peerstats file peerstats type day enable
+filegen clockstats file clockstats type day enable
+
+<%# If ntp.peers is not empty %>
+<% unless node['ntp']['peers'].empty? -%>
+  <%# Loop through defined peers, but don't peer with ourself %>
+  <% node['ntp']['peers'].each do |ntppeer| -%>
+    <% if node['ipaddress'] != ntppeer and node['fqdn'] != ntppeer %>
+peer <%= ntppeer %> iburst
+restrict <%= ntppeer %> nomodify
+    <% end -%>
+  <% end -%>
+<% end -%>
+
+<%# Whether this is a client or server, we want upstream servers. %>
+<%# We should guard the servers array against deep merge. %>
+<%# This should keep authoritative local servers from being included twice. %>
+<% ( node['ntp']['servers'] - node['ntp']['peers'] ).each do |ntpserver| -%>
+  <%# Loop through defined servers, but don't try to upstream ourself %>
+  <% if node['ipaddress'] != ntpserver and node['fqdn'] != ntpserver -%>
+server <%= ntpserver %> iburst
+restrict <%= ntpserver %> nomodify notrap noquery
+  <% end -%>
+<% end -%>
+
+restrict default kod notrap nomodify nopeer noquery
+restrict 127.0.0.1 nomodify
+restrict -6 default kod notrap nomodify nopeer noquery
+restrict -6 ::1 nomodify
+
+<%# If this is a server with additional LAN restriction lines, put them here %>
+<% unless node['ntp']['restrictions'].empty? -%>
+  <% node['ntp']['restrictions'].each do |restriction| -%>
+restrict <%= restriction %>
+  <% end -%>
+<% end -%>
+
+<%# It is best practice to use a high stratum undisciplined clock, if you have a real CMOS clock %>
+<%# Except cases where you have a low stratum server, or a virtualized system without a real CMOS clock %>
+<% unless node['virtualization']['role'] == "guest" -%>
+server  127.127.1.0 # local clock
+fudge   127.127.1.0 stratum 10
+<% end -%>

data/chef/travis-cookbooks/worker_host/ntp/templates/default/ntpdate.erb

@@ -0,0 +1,14 @@
+<% if @disable %>exit 0<% end %>
+# The settings in this file are used by the program ntpdate-debian, but not
+# by the upstream program ntpdate.
+
+# Set to "yes" to take the server list from /etc/ntp.conf, from package ntp,
+# so you only have to keep it in one place.
+NTPDATE_USE_NTP_CONF=yes
+
+# List of NTP servers to use  (Separate multiple servers with spaces.)
+# Not used if NTPDATE_USE_NTP_CONF is yes.
+NTPSERVERS="<% node['ntp']['servers'].each do |ntpserver| -%><%= ntpserver %> <% end %>"
+
+# Additional options to pass to ntpdate
+NTPOPTIONS=""

data/chef/travis-cookbooks/worker_host/rvm/recipes/multi.rb

@@ -1,7 +1,7 @@
 #
 # Cookbook Name:: rvm
 # Recipe:: multi
-# Copyright 2011-2012, Travis CI development team
+# Copyright 2011-2013, Travis CI Development Team <contact@travis-ci.org>
 #
 # Permission is hereby granted, free of charge, to any person obtaining a copy
 # of this software and associated documentation files (the "Software"), to deal

data/chef/travis-cookbooks/worker_host/travis_worker/attributes/default.rb

@@ -1,7 +1,6 @@
-default[:travis][:worker][:home] = '/mnt/ssd/travis/worker'
+default[:travis][:worker][:home] = '/home/deploy'
 default[:travis][:worker][:repository] = 'git://github.com/travis-ci/travis-worker.git'
 default[:travis][:worker][:ref] = 'master'
-default[:travis][:worker][:post_checkout] = {}
 default[:travis][:worker][:amqp] = {
   :host => 'localhost',
   :port => 1234,
@@ -9,5 +8,13 @@ default[:travis][:worker][:amqp] = {
   :password => 'travis',
   :virtual_host => 'travis'
 }
-default[:travis][:worker][:vms] = 6
+default[:travis][:worker][:vms] = 20
 default[:travis][:worker][:env] = 'ruby'
+default[:travis][:worker][:hostname] = "#{node[:travis][:worker][:env]}.worker.travis-ci.com"
+default[:travis][:worker][:log_level] = 'info'
+default[:travis][:worker][:workers] = 1
+default[:papertrail][:watch_files] = {}
+
+1.upto(node[:travis][:worker][:workers]) do |num|
+  set[:papertrail][:watch_files]["/etc/sv/travis-worker-#{num}/log/main/current"] = 'travis-worker'
+end

data/chef/travis-cookbooks/worker_host/travis_worker/files/default/signal_wrapper.rb

@@ -0,0 +1,22 @@
+#!/usr/bin/env ruby
+
+if ARGV.empty?
+  puts "Requires at least one argument"
+  exit 1
+end
+
+child_pid = nil
+
+%w{INT TERM}.each do |signal|
+  trap signal do
+    puts "Terminating child"
+    Process.kill(:TERM, child_pid)
+    exit
+  end
+end
+
+child_pid = Kernel.fork do
+  Process.exec(*ARGV)
+end
+
+Process.wait(child_pid)