job_boss 0.5.0 → 0.5.5

data/README.markdown

@@ -2,12 +2,19 @@
 
 ## Credits
 
-The idea for this gem came from trying to use working/starling and not having much success with stability.  After some discussions with my colleagues (Neil Cook and Justin Hahn) and some good ideas, I created job_boss
+The idea for this gem came from trying to use working/starling and not having much success with stability.  I created job_boss after some discussions with my colleagues (Neil Cook and Justin Hahn).  Thanks also to my employer, [RBM Technologies](http://www.rbmtechnologies.com) for letting me take some of this work open-source.
 
 ## Purpose
 
 job_boss allows you to have a daemon much in the same way as workling which allows you to process a series of jobs asynchronously.   job_boss, however, uses ActiveRecord to store queued job requests in a database thus simplifying dependencies.  This allows for us to process chunks of work in parallel, across multiple servers, without needing much setup
 
+## Overview
+
+ * job_boss uses ActiveRecord to store/poll it's queue.  It's not dependent on Rails, but if it sees that it's being run in a Rails environment, it will automatically load the environment.rb file
+ * Loading up the environment.rb file isn't a big deal because job_boss's model has a main "boss" process which is a deamon.  The boss forks employees as needed to execute jobs.
+ * Employees only exist for the span of one job, so there's less concern about a build up in memory from leaks (not that we shouldn't be addressing leaks...)
+ * The boss is independent and always polling, so it can look for jobs which have been marked an cancelled and kill the employee during processing
+
 ## Usage
 
 Add the gem to your Gemfile
@@ -27,6 +34,17 @@ Create a directory to store classes which define code which can be executed by t
         end
     end
 
+If you're using Rails, much of the logic that you'll want to queue may already be in models or other application classes.  You can queue class methods rather that needing to wrap them in a Job class:
+
+    # app/models/article.rb
+    class Article < ActiveRecord::Base
+        class << self
+            def refresh_cache(article_ids)
+                # code to refresh article cache
+            end
+        end
+    end
+
 Start up your boss:
 
     job_boss start -- <options>
@@ -46,16 +64,29 @@ But since you don't want to do that right now, it looks something like this:
         -s, --sleep-interval INTERVAL    Number of seconds for the boss to sleep between checks of the queue (default 0.5)
         -c, --employee-limit LIMIT          Maximum number of employees (default 4)
 
-From your Rails code or in a console (this functionality should probably be encapsulated in the job_boss gem):
+From your Rails code or in a console:
 
-    require 'job_boss/boss'
+    require 'job_boss'
     jobs = (0..1000).collect do |i|
-        JobBoss::Boss.queue.math.is_prime?(i)
+        Boss.queue.math.is_prime?(i)
     end
 
-    JobBoss::Job.wait_for_jobs(jobs) # Will sleep until the jobs are all complete
+Or:
+
+    jobs = []
+    Article.select('id').find_in_batches(:batch_size => 10) do |articles|
+        jobs << Boss.queue.article.refresh_cache(articles.collect(&:id))
+    end
+
+job_boss also makes it easy to wait for the jobs to be done and to collect the results into a hash:
+
+    Job.wait_for_jobs(jobs) # Will sleep until the jobs are all complete
+
+    Job.result_hash(jobs) # => {[0]=>false, [1]=>false, [2]=>true, [3]=>true, [4]=>false, ... }
+
+For performance, it is recommended that you keep your jobs table clean scheduling execution of the `delete_jobs_before` command on the Job model, which will clean all jobs completed before the specified time:
 
-    JobBoss::Job.result_hash(jobs) # => {[0]=>false, [1]=>false, [2]=>true, [3]=>true, [4]=>false, ... }
+    Job.delete_jobs_before(2.days.ago)
 
 Features:
 
@@ -63,4 +94,5 @@ Features:
  * Call the `mark_for_redo` method on a job to have it processed again.  This is automatically run for all currently running jobs in the event that the boss has been told to stop
  * If a job throws an exception, it will be caught and recorded.  Call the `error` method on a job to find out what the error was
  * Find out how long the job took by calling the `time_taken` method on a job
- * The job boss dispatches "employees" to work on jobs.  Viewing the processes, the process name is changed to reflect which jobs employees are working on for easy tracing (e.g. `[job_boss] employee (job #4)`)
+ * The job boss dispatches "employees" to work on jobs.  Viewing the processes, the process name is changed to reflect which jobs employees are working on for easy tracing (e.g. `[job_boss employee] job #4 math#is_prime?(4)`)
+ 

data/bin/job_boss

@@ -15,8 +15,6 @@ daemons_options = {
 Daemons.run_proc('job_boss', daemons_options) do
   Dir.chdir(working_dir)
 
-  require 'config/environment' if File.exist?('config/environment.rb')
-
   $: << File.expand_path('../../lib', __FILE__)
   require 'job_boss/boss'
 
@@ -24,6 +22,10 @@ Daemons.run_proc('job_boss', daemons_options) do
 
   JobBoss::Boss.config.parse_args(app_options, :working_dir => working_dir)
 
+  Dir.chdir(JobBoss::Boss.config.application_root)
+
+  require 'config/environment' if File.exist?('config/environment.rb')
+
   boss = JobBoss::Boss.new
 
   boss.start

data/doc/ActiveSupport/TestCase.html

@@ -104,6 +104,10 @@
 				<h3 class="section-header">Files</h3>
 				<ul>
 				
+					<li class="file"><a href="../Gemfile.html">Gemfile</a></li>
+				
+					<li class="file"><a href="../MIT-LICENSE.html">MIT-LICENSE</a></li>
+				
 					<li class="file"><a href="../Rakefile.html">Rakefile</a></li>
 				
 				</ul>
@@ -145,6 +149,8 @@
 				
 					<li><a href="../MathJobs.html">MathJobs</a></li>
 				
+					<li><a href="../Penguin.html">Penguin</a></li>
+				
 					<li><a href="../SleepJobs.html">SleepJobs</a></li>
 				
 					<li><a href="../StringJobs.html">StringJobs</a></li>
@@ -182,7 +188,7 @@
 				<div class="method-heading">
 				
 					<span class="method-name">assert_pid_not_running</span><span
-						class="method-args">(pid)</span>
+						class="method-args">(pid, message="")</span>
 					<span class="method-click-advice">click to toggle source</span>
 				
 				</div>
@@ -196,12 +202,18 @@
 					<div class="method-source-code"
 						id="assert-pid-not-running-source">
 <pre>
-    <span class="ruby-comment cmt"># File test/test_helper.rb, line 35</span>
-35:   <span class="ruby-keyword kw">def</span> <span class="ruby-identifier">assert_pid_not_running</span>(<span class="ruby-identifier">pid</span>)
-36:     <span class="ruby-identifier">assert_raise</span> <span class="ruby-constant">Errno</span><span class="ruby-operator">::</span><span class="ruby-constant">ESRCH</span> <span class="ruby-keyword kw">do</span>
-37:       <span class="ruby-constant">Process</span>.<span class="ruby-identifier">kill</span>(<span class="ruby-value">0</span>, <span class="ruby-identifier">pid</span>)
-38:     <span class="ruby-keyword kw">end</span>
-39:   <span class="ruby-keyword kw">end</span></pre>
+    <span class="ruby-comment cmt"># File test/test_helper.rb, line 43</span>
+43:   <span class="ruby-keyword kw">def</span> <span class="ruby-identifier">assert_pid_not_running</span>(<span class="ruby-identifier">pid</span>, <span class="ruby-identifier">message</span>=<span class="ruby-value str">&quot;&quot;</span>)
+44:     <span class="ruby-identifier">full_message</span> = <span class="ruby-identifier">build_message</span>(<span class="ruby-identifier">message</span>, <span class="ruby-value str">&quot;PID &lt;?&gt; expected to not be running.&quot;</span>, <span class="ruby-identifier">pid</span>)
+45:     <span class="ruby-identifier">assert_block</span>(<span class="ruby-identifier">full_message</span>) <span class="ruby-keyword kw">do</span>
+46:       <span class="ruby-keyword kw">begin</span>
+47:         <span class="ruby-constant">Process</span>.<span class="ruby-identifier">kill</span>(<span class="ruby-value">0</span>, <span class="ruby-identifier">pid</span>.<span class="ruby-identifier">to_i</span>)
+48:         <span class="ruby-keyword kw">false</span>
+49:       <span class="ruby-keyword kw">rescue</span>
+50:         <span class="ruby-keyword kw">true</span>
+51:       <span class="ruby-keyword kw">end</span>
+52:     <span class="ruby-keyword kw">end</span>
+53:   <span class="ruby-keyword kw">end</span></pre>
 					</div>
 					
 				</div>
@@ -218,7 +230,7 @@
 				<div class="method-heading">
 				
 					<span class="method-name">assert_pid_running</span><span
-						class="method-args">(pid)</span>
+						class="method-args">(pid, message="")</span>
 					<span class="method-click-advice">click to toggle source</span>
 				
 				</div>
@@ -232,12 +244,18 @@
 					<div class="method-source-code"
 						id="assert-pid-running-source">
 <pre>
-    <span class="ruby-comment cmt"># File test/test_helper.rb, line 29</span>
-29:   <span class="ruby-keyword kw">def</span> <span class="ruby-identifier">assert_pid_running</span>(<span class="ruby-identifier">pid</span>)
-30:     <span class="ruby-identifier">assert_nothing_raised</span> <span class="ruby-keyword kw">do</span>
-31:       <span class="ruby-constant">Process</span>.<span class="ruby-identifier">kill</span>(<span class="ruby-value">0</span>, <span class="ruby-identifier">pid</span>)
-32:     <span class="ruby-keyword kw">end</span>
-33:   <span class="ruby-keyword kw">end</span></pre>
+    <span class="ruby-comment cmt"># File test/test_helper.rb, line 31</span>
+31:   <span class="ruby-keyword kw">def</span> <span class="ruby-identifier">assert_pid_running</span>(<span class="ruby-identifier">pid</span>, <span class="ruby-identifier">message</span>=<span class="ruby-value str">&quot;&quot;</span>)
+32:     <span class="ruby-identifier">full_message</span> = <span class="ruby-identifier">build_message</span>(<span class="ruby-identifier">message</span>, <span class="ruby-value str">&quot;PID &lt;?&gt; expected to be running.&quot;</span>, <span class="ruby-identifier">pid</span>)
+33:     <span class="ruby-identifier">assert_block</span>(<span class="ruby-identifier">full_message</span>) <span class="ruby-keyword kw">do</span>
+34:       <span class="ruby-keyword kw">begin</span>
+35:         <span class="ruby-constant">Process</span>.<span class="ruby-identifier">kill</span>(<span class="ruby-value">0</span>, <span class="ruby-identifier">pid</span>.<span class="ruby-identifier">to_i</span>)
+36:         <span class="ruby-keyword kw">true</span>
+37:       <span class="ruby-keyword kw">rescue</span>
+38:         <span class="ruby-keyword kw">false</span>
+39:       <span class="ruby-keyword kw">end</span>
+40:     <span class="ruby-keyword kw">end</span>
+41:   <span class="ruby-keyword kw">end</span></pre>
 					</div>
 					
 				</div>
@@ -268,11 +286,11 @@
 					<div class="method-source-code"
 						id="clean-app-environment-source">
 <pre>
-    <span class="ruby-comment cmt"># File test/test_helper.rb, line 24</span>
-24:   <span class="ruby-keyword kw">def</span> <span class="ruby-identifier">clean_app_environment</span>
-25:     <span class="ruby-constant">Dir</span>.<span class="ruby-identifier">glob</span>(<span class="ruby-constant">File</span>.<span class="ruby-identifier">join</span>(<span class="ruby-ivar">@db_path</span>, <span class="ruby-value str">'*'</span>)).<span class="ruby-identifier">each</span> {<span class="ruby-operator">|</span><span class="ruby-identifier">path</span><span class="ruby-operator">|</span> <span class="ruby-constant">File</span>.<span class="ruby-identifier">unlink</span>(<span class="ruby-identifier">path</span>) }
-26:     <span class="ruby-constant">Dir</span>.<span class="ruby-identifier">glob</span>(<span class="ruby-constant">File</span>.<span class="ruby-identifier">join</span>(<span class="ruby-ivar">@app_root_path</span>, <span class="ruby-value str">'log'</span>, <span class="ruby-value str">'*'</span>)).<span class="ruby-identifier">each</span> {<span class="ruby-operator">|</span><span class="ruby-identifier">path</span><span class="ruby-operator">|</span> <span class="ruby-constant">File</span>.<span class="ruby-identifier">unlink</span>(<span class="ruby-identifier">path</span>) }
-27:   <span class="ruby-keyword kw">end</span></pre>
+    <span class="ruby-comment cmt"># File test/test_helper.rb, line 26</span>
+26:   <span class="ruby-keyword kw">def</span> <span class="ruby-identifier">clean_app_environment</span>
+27:     <span class="ruby-constant">Dir</span>.<span class="ruby-identifier">glob</span>(<span class="ruby-constant">File</span>.<span class="ruby-identifier">join</span>(<span class="ruby-ivar">@db_path</span>, <span class="ruby-value str">'*'</span>)).<span class="ruby-identifier">each</span> {<span class="ruby-operator">|</span><span class="ruby-identifier">path</span><span class="ruby-operator">|</span> <span class="ruby-constant">File</span>.<span class="ruby-identifier">unlink</span>(<span class="ruby-identifier">path</span>) }
+28:     <span class="ruby-constant">Dir</span>.<span class="ruby-identifier">glob</span>(<span class="ruby-constant">File</span>.<span class="ruby-identifier">join</span>(<span class="ruby-ivar">@app_root_path</span>, <span class="ruby-value str">'log'</span>, <span class="ruby-value str">'*'</span>)).<span class="ruby-identifier">each</span> {<span class="ruby-operator">|</span><span class="ruby-identifier">path</span><span class="ruby-operator">|</span> <span class="ruby-constant">File</span>.<span class="ruby-identifier">unlink</span>(<span class="ruby-identifier">path</span>) }
+29:   <span class="ruby-keyword kw">end</span></pre>
 					</div>
 					
 				</div>
@@ -303,10 +321,10 @@
 					<div class="method-source-code"
 						id="get-pid-from-startup-source">
 <pre>
-    <span class="ruby-comment cmt"># File test/test_helper.rb, line 59</span>
-59:   <span class="ruby-keyword kw">def</span> <span class="ruby-identifier">get_pid_from_startup</span>(<span class="ruby-identifier">output</span>)
-60:     <span class="ruby-identifier">output</span>.<span class="ruby-identifier">match</span>(<span class="ruby-regexp re">/job_boss: process with pid (\d+) started./</span>)[<span class="ruby-value">1</span>].<span class="ruby-identifier">to_i</span>
-61:   <span class="ruby-keyword kw">end</span></pre>
+    <span class="ruby-comment cmt"># File test/test_helper.rb, line 73</span>
+73:   <span class="ruby-keyword kw">def</span> <span class="ruby-identifier">get_pid_from_startup</span>(<span class="ruby-identifier">output</span>)
+74:     <span class="ruby-identifier">output</span>.<span class="ruby-identifier">match</span>(<span class="ruby-regexp re">/job_boss: process with pid (\d+) started./</span>)[<span class="ruby-value">1</span>].<span class="ruby-identifier">to_i</span>
+75:   <span class="ruby-keyword kw">end</span></pre>
 					</div>
 					
 				</div>
@@ -337,20 +355,20 @@
 					<div class="method-source-code"
 						id="restart-daemon-source">
 <pre>
-     <span class="ruby-comment cmt"># File test/test_helper.rb, line 88</span>
- 88:   <span class="ruby-keyword kw">def</span> <span class="ruby-identifier">restart_daemon</span>
- 89:     <span class="ruby-identifier">assert_pid_running</span>(<span class="ruby-ivar">@daemon_pid</span>)
- 90: 
- 91:     <span class="ruby-identifier">output</span> = <span class="ruby-value">`bin/job_boss restart`</span>
- 92: 
- 93:     <span class="ruby-comment cmt"># Give the daemon a bit of time to stop</span>
- 94:     <span class="ruby-identifier">sleep</span>(<span class="ruby-value">0.5</span>)
- 95:     <span class="ruby-identifier">assert_pid_not_running</span>(<span class="ruby-ivar">@daemon_pid</span>)
- 96: 
- 97:     <span class="ruby-ivar">@daemon_pid</span> = <span class="ruby-identifier">get_pid_from_startup</span>(<span class="ruby-identifier">output</span>)
- 98: 
- 99:     <span class="ruby-identifier">assert_pid_running</span>(<span class="ruby-ivar">@daemon_pid</span>)
-100:   <span class="ruby-keyword kw">end</span></pre>
+     <span class="ruby-comment cmt"># File test/test_helper.rb, line 102</span>
+102:   <span class="ruby-keyword kw">def</span> <span class="ruby-identifier">restart_daemon</span>
+103:     <span class="ruby-identifier">assert_pid_running</span>(<span class="ruby-ivar">@daemon_pid</span>)
+104: 
+105:     <span class="ruby-identifier">output</span> = <span class="ruby-node">`#{@job_boss_bin_path} restart`</span>
+106: 
+107:     <span class="ruby-comment cmt"># Give the daemon a bit of time to stop</span>
+108: <span class="ruby-comment cmt">#    sleep(0.5)</span>
+109:     <span class="ruby-identifier">assert_pid_not_running</span>(<span class="ruby-ivar">@daemon_pid</span>)
+110: 
+111:     <span class="ruby-ivar">@daemon_pid</span> = <span class="ruby-identifier">get_pid_from_startup</span>(<span class="ruby-identifier">output</span>)
+112: 
+113:     <span class="ruby-identifier">assert_pid_running</span>(<span class="ruby-ivar">@daemon_pid</span>)
+114:   <span class="ruby-keyword kw">end</span></pre>
 					</div>
 					
 				</div>
@@ -381,13 +399,14 @@
 					<div class="method-source-code"
 						id="setup-paths-source">
 <pre>
-    <span class="ruby-comment cmt"># File test/test_helper.rb, line 17</span>
-17:   <span class="ruby-keyword kw">def</span> <span class="ruby-identifier">setup_paths</span>
-18:     <span class="ruby-ivar">@app_root_path</span> = <span class="ruby-constant">File</span>.<span class="ruby-identifier">join</span>(<span class="ruby-value str">'test'</span>, <span class="ruby-value str">'app_root'</span>)
-19:     <span class="ruby-ivar">@db_path</span> = <span class="ruby-constant">File</span>.<span class="ruby-identifier">join</span>(<span class="ruby-ivar">@app_root_path</span>, <span class="ruby-value str">'db'</span>)
-20:     <span class="ruby-ivar">@log_path</span> = <span class="ruby-constant">File</span>.<span class="ruby-identifier">join</span>(<span class="ruby-ivar">@app_root_path</span>, <span class="ruby-value str">'log'</span>, <span class="ruby-value str">'job_boss.log'</span>)
-21:     <span class="ruby-ivar">@db_yaml_path</span> = <span class="ruby-constant">File</span>.<span class="ruby-identifier">join</span>(<span class="ruby-ivar">@app_root_path</span>, <span class="ruby-value str">'config'</span>, <span class="ruby-value str">'database.yml'</span>)
-22:   <span class="ruby-keyword kw">end</span></pre>
+    <span class="ruby-comment cmt"># File test/test_helper.rb, line 18</span>
+18:   <span class="ruby-keyword kw">def</span> <span class="ruby-identifier">setup_paths</span>
+19:     <span class="ruby-ivar">@job_boss_bin_path</span> = <span class="ruby-constant">File</span>.<span class="ruby-identifier">expand_path</span>(<span class="ruby-value str">'../../bin/job_boss'</span>, <span class="ruby-keyword kw">__FILE__</span>)
+20:     <span class="ruby-ivar">@app_root_path</span> = <span class="ruby-constant">File</span>.<span class="ruby-identifier">expand_path</span>(<span class="ruby-value str">'../app_root'</span>, <span class="ruby-keyword kw">__FILE__</span>)
+21:     <span class="ruby-ivar">@db_path</span> = <span class="ruby-constant">File</span>.<span class="ruby-identifier">join</span>(<span class="ruby-ivar">@app_root_path</span>, <span class="ruby-value str">'db'</span>)
+22:     <span class="ruby-ivar">@log_path</span> = <span class="ruby-constant">File</span>.<span class="ruby-identifier">join</span>(<span class="ruby-ivar">@app_root_path</span>, <span class="ruby-value str">'log'</span>, <span class="ruby-value str">'job_boss.log'</span>)
+23:     <span class="ruby-ivar">@db_yaml_path</span> = <span class="ruby-constant">File</span>.<span class="ruby-identifier">join</span>(<span class="ruby-ivar">@app_root_path</span>, <span class="ruby-value str">'config'</span>, <span class="ruby-value str">'database.yml'</span>)
+24:   <span class="ruby-keyword kw">end</span></pre>
 					</div>
 					
 				</div>
@@ -418,24 +437,24 @@
 					<div class="method-source-code"
 						id="start-daemon-source">
 <pre>
-    <span class="ruby-comment cmt"># File test/test_helper.rb, line 41</span>
-41:   <span class="ruby-keyword kw">def</span> <span class="ruby-identifier">start_daemon</span>(<span class="ruby-identifier">options</span>)
-42:     <span class="ruby-identifier">clean_app_environment</span>
-43: 
-44:     <span class="ruby-identifier">stop_daemon</span>
-45: 
-46:     <span class="ruby-identifier">option_string</span> = <span class="ruby-identifier">options</span>.<span class="ruby-identifier">collect</span> <span class="ruby-keyword kw">do</span> <span class="ruby-operator">|</span><span class="ruby-identifier">key</span>, <span class="ruby-identifier">value</span><span class="ruby-operator">|</span>
-47:       <span class="ruby-value str">'--'</span> <span class="ruby-operator">+</span> <span class="ruby-identifier">key</span>.<span class="ruby-identifier">to_s</span>.<span class="ruby-identifier">gsub</span>(<span class="ruby-value str">'_'</span>, <span class="ruby-value str">'-'</span>) <span class="ruby-operator">+</span> <span class="ruby-value str">&quot; &quot;</span> <span class="ruby-operator">+</span> <span class="ruby-identifier">value</span>.<span class="ruby-identifier">to_s</span>
-48:     <span class="ruby-keyword kw">end</span>
-49: 
-50:     <span class="ruby-identifier">output</span> = <span class="ruby-node">`bin/job_boss start -- #{option_string.join(' ')}`</span>
-51: 
-52:     <span class="ruby-ivar">@daemon_pid</span> = <span class="ruby-identifier">get_pid_from_startup</span>(<span class="ruby-identifier">output</span>)
-53: 
-54:     <span class="ruby-identifier">assert_pid_running</span>(<span class="ruby-ivar">@daemon_pid</span>)
-55: 
-56:     <span class="ruby-ivar">@daemon_pid</span>
-57:   <span class="ruby-keyword kw">end</span></pre>
+    <span class="ruby-comment cmt"># File test/test_helper.rb, line 55</span>
+55:   <span class="ruby-keyword kw">def</span> <span class="ruby-identifier">start_daemon</span>(<span class="ruby-identifier">options</span>)
+56:     <span class="ruby-identifier">clean_app_environment</span>
+57: 
+58:     <span class="ruby-identifier">stop_daemon</span>
+59: 
+60:     <span class="ruby-identifier">option_string</span> = <span class="ruby-identifier">options</span>.<span class="ruby-identifier">collect</span> <span class="ruby-keyword kw">do</span> <span class="ruby-operator">|</span><span class="ruby-identifier">key</span>, <span class="ruby-identifier">value</span><span class="ruby-operator">|</span>
+61:       <span class="ruby-value str">'--'</span> <span class="ruby-operator">+</span> <span class="ruby-identifier">key</span>.<span class="ruby-identifier">to_s</span>.<span class="ruby-identifier">gsub</span>(<span class="ruby-value str">'_'</span>, <span class="ruby-value str">'-'</span>) <span class="ruby-operator">+</span> <span class="ruby-value str">&quot; &quot;</span> <span class="ruby-operator">+</span> <span class="ruby-identifier">value</span>.<span class="ruby-identifier">to_s</span>
+62:     <span class="ruby-keyword kw">end</span>
+63: 
+64:     <span class="ruby-identifier">output</span> = <span class="ruby-node">`#{@job_boss_bin_path} start -- #{option_string.join(' ')}`</span>
+65: 
+66:     <span class="ruby-ivar">@daemon_pid</span> = <span class="ruby-identifier">get_pid_from_startup</span>(<span class="ruby-identifier">output</span>)
+67: 
+68:     <span class="ruby-identifier">assert_pid_running</span>(<span class="ruby-ivar">@daemon_pid</span>)
+69: 
+70:     <span class="ruby-ivar">@daemon_pid</span>
+71:   <span class="ruby-keyword kw">end</span></pre>
 					</div>
 					
 				</div>
@@ -466,14 +485,14 @@
 					<div class="method-source-code"
 						id="stop-daemon-source">
 <pre>
-    <span class="ruby-comment cmt"># File test/test_helper.rb, line 80</span>
-80:   <span class="ruby-keyword kw">def</span> <span class="ruby-identifier">stop_daemon</span>
-81:     <span class="ruby-value">`bin/job_boss stop`</span>
-82: 
-83:     <span class="ruby-comment cmt"># Give the daemon a bit of time to stop</span>
-84:     <span class="ruby-identifier">sleep</span>(<span class="ruby-value">0.5</span>)
-85:     <span class="ruby-identifier">assert_pid_not_running</span>(<span class="ruby-ivar">@daemon_pid</span>) <span class="ruby-keyword kw">if</span> <span class="ruby-ivar">@daemon_pid</span>
-86:   <span class="ruby-keyword kw">end</span></pre>
+     <span class="ruby-comment cmt"># File test/test_helper.rb, line 94</span>
+ 94:   <span class="ruby-keyword kw">def</span> <span class="ruby-identifier">stop_daemon</span>
+ 95:     <span class="ruby-node">`#{@job_boss_bin_path} stop`</span>
+ 96: 
+ 97:     <span class="ruby-comment cmt"># Give the daemon a bit of time to stop</span>
+ 98: <span class="ruby-comment cmt">#    sleep(0.5)</span>
+ 99:     <span class="ruby-identifier">assert_pid_not_running</span>(<span class="ruby-ivar">@daemon_pid</span>) <span class="ruby-keyword kw">if</span> <span class="ruby-ivar">@daemon_pid</span>
+100:   <span class="ruby-keyword kw">end</span></pre>
 					</div>
 					
 				</div>
@@ -504,16 +523,16 @@
 					<div class="method-source-code"
 						id="wait-for-file-source">
 <pre>
-    <span class="ruby-comment cmt"># File test/test_helper.rb, line 63</span>
-63:   <span class="ruby-keyword kw">def</span> <span class="ruby-identifier">wait_for_file</span>(<span class="ruby-identifier">file_path</span>, <span class="ruby-identifier">timeout</span> = <span class="ruby-value">5</span>)
-64:     <span class="ruby-identifier">i</span> = <span class="ruby-value">0</span>
-65:     <span class="ruby-keyword kw">until</span> <span class="ruby-constant">File</span>.<span class="ruby-identifier">exist?</span>(<span class="ruby-identifier">file_path</span>)
-66:       <span class="ruby-identifier">sleep</span>(<span class="ruby-value">1</span>)
-67: 
-68:       <span class="ruby-identifier">raise</span> <span class="ruby-value str">&quot;File failed to appear!&quot;</span> <span class="ruby-keyword kw">if</span> <span class="ruby-identifier">i</span> <span class="ruby-operator">&gt;</span> <span class="ruby-identifier">timeout</span>
-69:       <span class="ruby-identifier">i</span> <span class="ruby-operator">+=</span> <span class="ruby-value">1</span>
-70:     <span class="ruby-keyword kw">end</span>
-71:   <span class="ruby-keyword kw">end</span></pre>
+    <span class="ruby-comment cmt"># File test/test_helper.rb, line 77</span>
+77:   <span class="ruby-keyword kw">def</span> <span class="ruby-identifier">wait_for_file</span>(<span class="ruby-identifier">file_path</span>, <span class="ruby-identifier">timeout</span> = <span class="ruby-value">5</span>)
+78:     <span class="ruby-identifier">i</span> = <span class="ruby-value">0</span>
+79:     <span class="ruby-keyword kw">until</span> <span class="ruby-constant">File</span>.<span class="ruby-identifier">exist?</span>(<span class="ruby-identifier">file_path</span>)
+80:       <span class="ruby-identifier">sleep</span>(<span class="ruby-value">1</span>)
+81: 
+82:       <span class="ruby-identifier">raise</span> <span class="ruby-value str">&quot;File failed to appear!&quot;</span> <span class="ruby-keyword kw">if</span> <span class="ruby-identifier">i</span> <span class="ruby-operator">&gt;</span> <span class="ruby-identifier">timeout</span>
+83:       <span class="ruby-identifier">i</span> <span class="ruby-operator">+=</span> <span class="ruby-value">1</span>
+84:     <span class="ruby-keyword kw">end</span>
+85:   <span class="ruby-keyword kw">end</span></pre>
 					</div>
 					
 				</div>
@@ -544,13 +563,13 @@
 					<div class="method-source-code"
 						id="wait-until-job-assigned-source">
 <pre>
-    <span class="ruby-comment cmt"># File test/test_helper.rb, line 73</span>
-73:   <span class="ruby-keyword kw">def</span> <span class="ruby-identifier">wait_until_job_assigned</span>(<span class="ruby-identifier">job</span>, <span class="ruby-identifier">wait_interval</span> = <span class="ruby-value">0.5</span>)
-74:     <span class="ruby-keyword kw">until</span> <span class="ruby-identifier">job</span>.<span class="ruby-identifier">assigned?</span>
-75:       <span class="ruby-identifier">sleep</span>(<span class="ruby-identifier">wait_interval</span>)
-76:       <span class="ruby-identifier">job</span>.<span class="ruby-identifier">reload</span>
-77:     <span class="ruby-keyword kw">end</span>
-78:   <span class="ruby-keyword kw">end</span></pre>
+    <span class="ruby-comment cmt"># File test/test_helper.rb, line 87</span>
+87:   <span class="ruby-keyword kw">def</span> <span class="ruby-identifier">wait_until_job_assigned</span>(<span class="ruby-identifier">job</span>, <span class="ruby-identifier">wait_interval</span> = <span class="ruby-value">0.5</span>)
+88:     <span class="ruby-keyword kw">until</span> <span class="ruby-identifier">job</span>.<span class="ruby-identifier">assigned?</span>
+89:       <span class="ruby-identifier">sleep</span>(<span class="ruby-identifier">wait_interval</span>)
+90:       <span class="ruby-identifier">job</span>.<span class="ruby-identifier">reload</span>
+91:     <span class="ruby-keyword kw">end</span>
+92:   <span class="ruby-keyword kw">end</span></pre>
 					</div>
 					
 				</div>

data/doc/ActiveSupport.html

@@ -76,6 +76,10 @@
 				<h3 class="section-header">Files</h3>
 				<ul>
 				
+					<li class="file"><a href="./Gemfile.html">Gemfile</a></li>
+				
+					<li class="file"><a href="./MIT-LICENSE.html">MIT-LICENSE</a></li>
+				
 					<li class="file"><a href="./Rakefile.html">Rakefile</a></li>
 				
 				</ul>
@@ -117,6 +121,8 @@
 				
 					<li><a href="./MathJobs.html">MathJobs</a></li>
 				
+					<li><a href="./Penguin.html">Penguin</a></li>
+				
 					<li><a href="./SleepJobs.html">SleepJobs</a></li>
 				
 					<li><a href="./StringJobs.html">StringJobs</a></li>

data/doc/CreateJobs.html

@@ -88,6 +88,10 @@
 				<h3 class="section-header">Files</h3>
 				<ul>
 				
+					<li class="file"><a href="./Gemfile.html">Gemfile</a></li>
+				
+					<li class="file"><a href="./MIT-LICENSE.html">MIT-LICENSE</a></li>
+				
 					<li class="file"><a href="./Rakefile.html">Rakefile</a></li>
 				
 				</ul>
@@ -129,6 +133,8 @@
 				
 					<li><a href="./MathJobs.html">MathJobs</a></li>
 				
+					<li><a href="./Penguin.html">Penguin</a></li>
+				
 					<li><a href="./SleepJobs.html">SleepJobs</a></li>
 				
 					<li><a href="./StringJobs.html">StringJobs</a></li>
@@ -180,10 +186,10 @@
 					<div class="method-source-code"
 						id="down-source">
 <pre>
-    <span class="ruby-comment cmt"># File lib/migrate.rb, line 26</span>
-26:   <span class="ruby-keyword kw">def</span> <span class="ruby-keyword kw">self</span>.<span class="ruby-identifier">down</span>
-27:     <span class="ruby-identifier">drop_table</span> <span class="ruby-value">:jobs</span>
-28:   <span class="ruby-keyword kw">end</span></pre>
+    <span class="ruby-comment cmt"># File lib/migrate.rb, line 32</span>
+32:   <span class="ruby-keyword kw">def</span> <span class="ruby-keyword kw">self</span>.<span class="ruby-identifier">down</span>
+33:     <span class="ruby-identifier">drop_table</span> <span class="ruby-value">:jobs</span>
+34:   <span class="ruby-keyword kw">end</span></pre>
 					</div>
 					
 				</div>
@@ -237,7 +243,13 @@
 21: 
 22:     <span class="ruby-identifier">add_index</span> <span class="ruby-value">:jobs</span>, <span class="ruby-value">:path</span>
 23:     <span class="ruby-identifier">add_index</span> <span class="ruby-value">:jobs</span>, <span class="ruby-value">:status</span>
-24:   <span class="ruby-keyword kw">end</span></pre>
+24: 
+25:     <span class="ruby-identifier">postgres</span> = (<span class="ruby-constant">ActiveRecord</span><span class="ruby-operator">::</span><span class="ruby-constant">Base</span>.<span class="ruby-identifier">connection</span>.<span class="ruby-identifier">adapter_name</span> <span class="ruby-operator">==</span> <span class="ruby-value str">'PostgreSQL'</span>)
+26: 
+27:     [<span class="ruby-value str">'started_at'</span>, <span class="ruby-value str">'cancelled_at'</span>, <span class="ruby-value str">'completed_at'</span>].<span class="ruby-identifier">each</span> <span class="ruby-keyword kw">do</span> <span class="ruby-operator">|</span><span class="ruby-identifier">field</span><span class="ruby-operator">|</span>
+28:       <span class="ruby-identifier">execute</span> <span class="ruby-node">&quot;CREATE INDEX IF NOT EXISTS jobs_#{field}_is_null ON jobs (#{field})&quot;</span> <span class="ruby-operator">+</span> (<span class="ruby-identifier">postgres</span> <span class="ruby-operator">?</span> <span class="ruby-node">&quot; WHERE #{field} IS NULL&quot;</span> <span class="ruby-operator">:</span> <span class="ruby-value str">''</span>)
+29:     <span class="ruby-keyword kw">end</span>
+30:   <span class="ruby-keyword kw">end</span></pre>
 					</div>
 					
 				</div>

data/doc/DaemonTest.html

@@ -80,6 +80,10 @@
 				<h3 class="section-header">Files</h3>
 				<ul>
 				
+					<li class="file"><a href="./Gemfile.html">Gemfile</a></li>
+				
+					<li class="file"><a href="./MIT-LICENSE.html">MIT-LICENSE</a></li>
+				
 					<li class="file"><a href="./Rakefile.html">Rakefile</a></li>
 				
 				</ul>
@@ -121,6 +125,8 @@
 				
 					<li><a href="./MathJobs.html">MathJobs</a></li>
 				
+					<li><a href="./Penguin.html">Penguin</a></li>
+				
 					<li><a href="./SleepJobs.html">SleepJobs</a></li>
 				
 					<li><a href="./StringJobs.html">StringJobs</a></li>