sidekiq 0.5.0

data/.rvmrc

@@ -0,0 +1,3 @@
+export RUBYOPT="-Ilib"
+export JRUBY_OPTS="--1.9"
+rvm use 1.9.3@sidekiq --create

data/COMM-LICENSE

@@ -0,0 +1,75 @@
+THIS LICENSE AGREEMENT DESCRIBES YOUR RIGHTS WITH RESPECT TO THE SOFTWARE AND ITS COMPONENTS.
+
+1. OWNERSHIP, LICENSE GRANT
+
+This is a license agreement and not an agreement for sale. We reserve ownership of all intellectual property rights inherent in or relating to the Software, which include, but are not limited to, all copyright, patent rights, all rights in relation to registered and unregistered trademarks (including service marks), confidential information (including trade secrets and know-how) and all rights other than those expressly granted by this License Agreement.
+
+Subject to the payment of the fee required and subject to the terms and conditions of this License Agreement, We grant to You a revocable, non- transferable and non-exclusive license (i) for Designated User(s) (as defined below) within Your organization to install and use the Software on any workstations used exclusively by such Designated User and (ii) for You to install and use the Software in connection with unlimited domains and sub-domains on unlimited servers, solely in connection with distribution of the Software in accordance with sections 3 and 4 below. This license is not sublicensable except as explicitly set forth herein. “Designated User(s)” shall mean Your employee(s) acting within the scope of their employment or Your consultant(s) or contractor(s) acting within the scope of the services they provide for You or on Your behalf for whom You have purchased a license to use the Software.
+
+In addition to the other terms contained herein, We grant to You a revocable, non- transferable and non-exclusive license to install and use the Software on a single computer (the “Trial License”) strictly for Your internal evaluation and review purposes and not for production purposes. This Trial License applies only if You have registered with Us for a Trial License of the Software and shall be effective for forty-five (45) consecutive days following the date of registration (“the Trial Period”). You may only register for a Trial License once in any eighteen month period. You agree not to use a Trial License for any purpose other than determining whether to purchase a license to the Software. You are explicitly not permitted to distribute the Software to any user outside the Organization on whose behalf you have undertaken this license. Your rights to use the Trial License will immediately terminate upon the earlier of (i) the expiration of the Trial Period, or (ii) such time that You purchase a license to the Software. We reserve the right to terminate Your Trial License at any time in Our absolute and sole discretion.
+
+2. PERMITTED USES, SOURCE CODE, MODIFICATIONS
+
+We provide You with source code so that You can create Modifications of the original Software, where Modification means: a) any addition to or deletion from the contents of a file included in the original Software or previous Modifications created by You, or b) any new file that contains any part of the original Software or previous Modifications. While You retain all rights to any original work authored by You as part of the Modifications, We continue to own all copyright and other intellectual property rights in the Software.
+
+3. DISTRIBUTION
+
+You may distribute the Software in any applications, frameworks, or elements (collectively referred to as an “Application” or “Applications”) that you develop using the Software in accordance with this License Agreement, provided that such distribution does not violate the restrictions set forth in section 4 of this License Agreement. You must not remove, obscure or interfere with any copyright, acknowledgment, attribution, trademark, warning or disclaimer statement affixed to, incorporated in or otherwise applied in connection with the Software.
+
+You are required to ensure that the Software is not reused by or with any applications other than those with which You distribute it as permitted herein. For example, if You install the Software on a customer’s server, that customer is not permitted to use the Software independently of Your application, and must be informed as such.
+
+You will not owe Us any royalties for Your distribution of the Software in accordance with this License Agreement.
+
+4. PROHIBITED USES
+
+You may not, without Our prior written consent, redistribute the Software or Modifications other than by including the Software or a portion thereof within Your own product, which must have substantially different functionality than the Software or Modifications and must not allow any third party to use the Software or Modifications, or any portions thereof, for software development or application development purposes. You are explicitly not allowed to redistribute the Software or Modifications as part of any product that can be described as a development toolkit or library, an application builder, a website builder or any product that is intended for use by software, application, or website developers or designers. You are not allowed to redistribute any part of the Software documentation. You may not change or remove the copyright notice from any of the files included in the Software or Modifications.
+
+UNDER NO CIRCUMSTANCES MAY YOU USE THE SOFTWARE FOR A PRODUCT THAT IS INTENDED FOR SOFTWARE OR APPLICATION DEVELOPMENT PURPOSES.
+
+The Open Source version of the Software (“GPL Version”) is licensed under the terms of the GNU General Public License versions 3.0 (“GPL”) and not under this License Agreement. If You, or another third party, has, at any time, developed all (or any portions of) the Application(s) using the GPL Version, You may not combine such development work with the Software and must license such Application(s) (or any portions derived there from) under the terms of the GNU General Public License version 3, a copy of which is located at http://www.gnu.org/copyleft/gpl.html.
+
+5. TERMINATION
+
+This License Agreement and Your right to use the Software and Modifications will terminate immediately without notice if You fail to comply with the terms and conditions of this License Agreement. Upon termination, You agree to immediately cease using and destroy the Software or Modifications, including all accompanying documents. The provisions of sections 4, 5, 6, 7, 8, 9, 10 and 12 will survive any termination of this License Agreement.
+
+6. DISCLAIMER OF WARRANTIES
+
+TO THE MAXIMUM EXTENT PERMITTED BY APPLICABLE LAW, WE AND OUR SUPPLIERS DISCLAIM ALL WARRANTIES AND CONDITIONS, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, TITLE AND NON-INFRINGEMENT, WITH REGARD TO THE SOFTWARE. WE DO NOT GUARANTEE THAT THE OPERATION OF THE SOFTWARE WILL BE UNINTERRUPTED OR ERROR-FREE, AND YOU ACKNOWLEDGE THAT IT IS NOT TECHNICALLY PRACTICABLE FOR US TO DO SO.
+
+7. LIMITATION OF LIABILITIES
+
+TO THE MAXIMUM EXTENT PERMITTED BY APPLICABLE LAW, IN NO EVENT SHALL WE OR OUR SUPPLIERS BE LIABLE FOR ANY SPECIAL, INCIDENTAL, INDIRECT OR CONSEQUENTIAL DAMAGES WHATSOEVER (INCLUDING, WITHOUT LIMITATION, DAMAGES FOR LOSS OF BUSINESS PROFITS, BUSINESS INTERRUPTION, LOSS OF BUSINESS INFORMATION OR ANY OTHER PECUNIARY LAW) ARISING OUT OF THE USE OF OR INABILITY TO USE THE SOFTWARE, EVEN IF WE HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. IN ANY CASE, OUR ENTIRE LIABILITY UNDER ANY PROVISION OF THIS LICENSE AGREEMENT SHALL BE LIMITED TO THE AMOUNT ACTUALLY PAID BY YOU FOR THE SOFTWARE.
+
+8. VERIFICATION
+
+We or a certified auditor acting on Our behalf, may, upon its reasonable request and at its expense, audit You with respect to the use of the Software. Such audit may be conducted by mail, electronic means or through an in-person visit to Your place of business. Any such in-person audit shall be conducted during regular business hours at Your facilities and shall not unreasonably interfere with Your business activities. We shall not remove, copy, or redistribute any electronic material during the course of an audit. If an audit reveals that You are using the Software in a way that is in material violation of the terms of the License Agreement, then You shall pay Our reasonable costs of conducting the audit. In the case of a material violation, You agree to pay Us any amounts owing that are attributable to the unauthorized use. In the alternative, We reserve the right, at Our sole option, to terminate the licenses for the Software.
+
+9. THIRD PARTY SOFTWARE
+
+Examples included in Software may provide links to third party libraries or code (collectively “Third Party Software”) to implement various functions. Third Party Software does not comprise part of the Software. In some cases, access to Third Party Software may be included along with the Software delivery as a convenience for demonstration purposes. Such source code and libraries may be included in the “…/examples” source tree delivered with the Software and do not comprise the Software. Licensee acknowledges (1) that some part of Third Party Software may require additional licensing of copyright and patents from the owners of such, and (2) that distribution of any of the Software referencing or including any portion of a Third Party Software may require appropriate licensing from such third parties.
+
+10. PAYMENT AND TAXES
+
+If credit has been extended to You by Us, all payments under this License Agreement are due within thirty (30) days of the date We mail an invoice to You. If We have not extended credit to You, You shall be required to make payment concurrent with the delivery of the Software by Us. All amounts payable are gross amounts but exclusive of any value added tax, use tax, sales tax or similar tax. You shall be entitled to withhold from payments any applicable withholding taxes and comply with all applicable tax and employment legislation. Each party shall pay all taxes (including, but not limited to, taxes based upon its income) or levies imposed on it under applicable laws, regulations and tax treaties as a result of this Agreement and any payments made hereunder (including those required to be withheld or deducted from payments). Each party shall furnish evidence of such paid taxes as is sufficient to enable the other party to obtain any credits available to it, including original withholding tax certificates.
+
+11. MISCELLANEOUS
+
+The license granted herein applies only to the version of the Software available when purchased in connection with the terms of this License Agreement. Any previous or subsequent license granted to You for use of the Software shall be governed by the terms and conditions of the agreement entered in connection with purchase of that version of the Software. You agree that you will comply with all applicable laws and regulations with respect to the Software, including without limitation all export and re-export control laws and regulations.
+
+While redistributing the Software or Modifications thereof, You may choose to offer acceptance of support, warranty, indemnity, or other liability obligations and/or rights consistent with this License Agreement. However, in accepting such obligations, You may act only on Your own behalf and on Your sole responsibility, not on our behalf. You agree to indemnify, defend, and hold Us harmless from and against any liability incurred by, or claims asserted against, Us (i) by reason of Your accepting any such support, warranty, indemnity or additional liability; or (ii) arising out of the use, reproduction or distribution of Your Application, except to the extent such claim is solely based on the inclusion of the Software therein.
+
+You agree to be identified as a customer of ours and You agree that We may refer to You by name, trade name and trademark, if applicable, and may briefly describe Your business in our marketing materials and web site.
+
+You may not assign this License Agreement without Our prior written consent, which will not be unreasonably withheld. This License Agreement will inure to the benefit of Our successors and assigns.
+
+You acknowledge that this License Agreement is complete and is the exclusive representation of our agreement. No oral or written information given by Us or on our behalf shall create a warranty or collateral contract, or in any way increase the scope of this License Agreement in any way, and You may not rely on any such oral or written information. No term or condition contained in any purchase order shall apply unless expressly accepted by Us in writing,
+
+There are no implied licenses or other implied rights granted under this License Agreement, and all rights, save for those expressly granted hereunder, shall remain with Us and our licensors. In addition, no licenses or immunities are granted to the combination of the Software and/or Modifications, as applicable, with any other software or hardware not delivered by Us to You under this License Agreement.
+
+If any provision in this License Agreement shall be determined to be invalid, such provision shall be deemed omitted; the remainder of this License Agreement shall continue in full force and effect. If any remedy provided is determined to have failed for its essential purpose, all limitations of liability and exclusions of damages set forth in this License Agreement shall remain in effect.
+
+This License Agreement may be modified only by a written instrument signed by an authorized representative of each party.
+
+This License Agreement is governed by the law of the State of Oregon, United States (notwithstanding conflicts of laws provisions), and all parties irrevocably submit to the jurisdiction of the courts of the State of Oregon and further agree to commence any litigation which may arise hereunder in the state or federal courts located in the judicial district of Multnomah County, Oregon, US.
+
+If the Software or any related documentation is licensed to the U.S. government or any agency thereof, it will be deemed to be “commercial computer software” or “commercial computer software documentation,” pursuant to DFAR Section 227.7202 and FAR Section 12.212. Any use of the Software or related documentation by the U.S. government will be governed solely by the terms of this License Agreement.

data/Changes.md

@@ -0,0 +1,4 @@
+0.5.0
+-----------
+
+- Initial release!

data/Gemfile

@@ -0,0 +1,4 @@
+source 'http://rubygems.org'
+gemspec
+
+gem 'simplecov', :require => false, :group => :test

data/Gemfile.lock

@@ -0,0 +1,32 @@
+PATH
+  remote: .
+  specs:
+    sidekiq (0.1.0)
+      celluloid
+      connection_pool
+      multi_json
+      redis
+
+GEM
+  remote: http://rubygems.org/
+  specs:
+    celluloid (0.8.0)
+    connection_pool (0.1.0)
+    minitest (2.10.0)
+    multi_json (1.0.4)
+    rake (0.9.2.2)
+    redis (2.2.2)
+    simplecov (0.5.4)
+      multi_json (~> 1.0.3)
+      simplecov-html (~> 0.5.3)
+    simplecov-html (0.5.3)
+
+PLATFORMS
+  java
+  ruby
+
+DEPENDENCIES
+  minitest
+  rake
+  sidekiq!
+  simplecov

data/LICENSE

@@ -0,0 +1,9 @@
+Copyright (c) Mike Perham
+
+Sidekiq is open source licensed under the GPLv3 for non-commerical use:
+
+  Please see <http://www.gnu.org/licenses/gpl-3.0.html> for license text.
+
+To purchase a commercial license, you must pledge $50 to my Pledgie
+fund at http://www.pledgie.com/campaigns/16623.  The commercial license can
+be found in COMM-LICENSE.

data/README.md

@@ -0,0 +1,64 @@
+Sidekiq
+==============
+
+Simple, efficient message processing for Ruby.
+
+Sidekiq aims to be compatible with Resque.  It uses the exact same
+message format as Resque so it can integrate into an existing Resque processing farm.
+You can have Sidekiq and Resque run side-by-side at the same time and
+use the Resque client to enqueue messages in Redis to be processed by Sidekiq.
+
+Sidekiq is different from Resque in how it processes messages: it
+processes many messages concurrently per process.  Resque only processes
+one message at a time per process so it is far less memory efficient.
+You'll find that you might need 50 200MB resque processes to peg your CPU
+whereas one 300MB Sidekiq process will peg the same CPU and perform the
+same amount of work.  Please see [my blog post on Resque's memory
+efficiency](http://blog.carbonfive.com/2011/09/16/improving-resques-memory-efficiency/)
+ and how I was able to shrink a Carbon Five client's resque processing farm
+from 9 machines to 1 machine.
+
+
+Requirements
+-----------------
+
+I test on Ruby 1.9.3 and JRuby 1.6.5 in 1.9 mode.  Other versions/VMs are
+untested.
+
+
+Installation
+-----------------
+
+   gem install sidekiq
+
+
+Getting Started
+-----------------
+
+See the [sidekiq home page](http://mperham.github.com/sidekiq) for the simple 4-step process.
+
+
+More Information
+-----------------
+
+Please see the [sidekiq wiki](https://github.com/mperham/sidekiq/wiki) for more information.
+
+
+License
+-----------------
+
+sidekiq is GPLv3 licensed for **non-commercial use only**.  For a commercial
+license, you must give $50 to my [Pledgie campaign](http://www.pledgie.com/campaigns/16623).
+Considering the hundreds of hours I've spent writing OSS, I hope you
+think this is a reasonable price.  BTW, the commercial license is in
+COMM-LICENSE and is the [Sencha commercial license v1.10](http://www.sencha.com/legal/sencha-commercial-software-license-agreement/) with the Support (section 11) terms removed.
+Support is provided through GitHub Issues.  You are welcome to try the
+software for 2 weeks.
+
+<a href='http://www.pledgie.com/campaigns/16623'><img alt='Click here to lend your support to Open Source and make a donation at www.pledgie.com !' src='http://www.pledgie.com/campaigns/16623.png?skin_name=chrome' border='0' /></a>
+
+Author
+-----------------
+
+Mike Perham, [@mperham](https://twitter.com/mperham), [http://mikeperham.com](http://mikeperham.com)
+

data/Rakefile

@@ -0,0 +1,8 @@
+require 'rake/testtask'
+Rake::TestTask.new(:test) do |test|
+  test.libs << 'test'
+  test.warning = true
+  test.pattern = 'test/**/test_*.rb'
+end
+
+task :default => :test

data/TODO.md

@@ -0,0 +1,4 @@
+- monitoring stats
+- resque-ui-esque web ui
+- graceful shutdown (ideally Celluloid will provide this)
+- monit/god/etc example scripts

data/bin/client

@@ -0,0 +1,7 @@
+#!/usr/bin/env ruby
+
+require 'sidekiq'
+
+10.times do
+  Sidekiq::Client.push('class' => 'HardWorker', 'args' => ['bob', 1])
+end

data/bin/sidekiq

@@ -0,0 +1,19 @@
+#!/usr/bin/env ruby
+
+begin
+  require 'sidekiq/cli'
+rescue LoadError
+  # Better way to do this in dev?
+  dir = File.expand_path(File.dirname(__FILE__) + '/../lib') 
+  $LOAD_PATH << dir if File.exist?("#{dir}/sidekiq.rb")
+  require 'sidekiq/cli'
+end
+
+begin
+  cli = Sidekiq::CLI.new
+  cli.run
+rescue => e
+  raise e if $DEBUG
+  STDERR.puts e.message
+  exit 1
+end

data/lib/sidekiq.rb

@@ -0,0 +1,4 @@
+require 'sidekiq/version'
+require 'sidekiq/client'
+require 'sidekiq/worker'
+require 'sidekiq/rails' if defined?(Rails)

data/lib/sidekiq/cli.rb

@@ -0,0 +1,100 @@
+require 'optparse'
+require 'sidekiq/version'
+require 'sidekiq/util'
+require 'sidekiq/client'
+require 'sidekiq/manager'
+require 'connection_pool'
+
+module Sidekiq
+  class CLI
+    include Util
+
+    def initialize
+      parse_options
+      validate!
+      boot_rails
+    end
+
+    FOREVER = 2_000_000_000
+
+    def run
+      ::Sidekiq::Client.redis = ConnectionPool.new { Redis.connect(:url => @options[:server]) }
+      manager = Sidekiq::Manager.new(@options[:server], @options)
+      begin
+        log 'Starting processing, hit Ctrl-C to stop'
+        manager.start!
+        sleep FOREVER
+      rescue Interrupt
+        log 'Shutting down...'
+        manager.stop!
+        manager.wait(:shutdown)
+      end
+    end
+
+    private
+
+    def boot_rails
+      ENV['RAILS_ENV'] = @options[:environment]
+      require File.expand_path("#{@options[:rails]}/config/environment.rb")
+      ::Rails.application.eager_load!
+    end
+
+    def validate!
+      $DEBUG = @options[:verbose]
+
+      if !File.exist?("#{@options[:rails]}/config/boot.rb")
+        log "========== Please point sidekiq to a Rails 3 application =========="
+        log @parser
+        exit(1)
+      end
+    end
+
+    def parse_options(argv=ARGV)
+      @options = {
+        :verbose => false,
+        :queues => ['default'],
+        :processor_count => 25,
+        :server => ENV['REDISTOGO_URL'] || 'redis://localhost:6379/0',
+        :rails => '.',
+        :environment => 'production',
+      }
+
+      @parser = OptionParser.new do |o|
+        o.on "-q", "--queue QUEUE,WEIGHT", "Queue to process, with optional weight" do |arg|
+          (q, weight) = arg.split(",")
+          (weight || 1).times do
+            @options[:queues] << q
+          end
+        end
+
+        o.on "-v", "--verbose", "Print more verbose output" do
+          @options[:verbose] = true
+        end
+
+        o.on "-s", "--server LOCATION", "Where to find Redis" do |arg|
+          @options[:server] = arg
+        end
+
+        o.on '-e', '--environment ENV', "Rails application environment" do |arg|
+          @options[:environment] = arg
+        end
+
+        o.on '-r', '--rails PATH', "Location of Rails application with workers" do |arg|
+          @options[:rails] = arg
+        end
+
+        o.on '-c', '--concurrency INT', "processor threads to use" do |arg|
+          @options[:processor_count] = arg.to_i
+        end
+      end
+
+      @parser.banner = "sidekiq [options]"
+      @parser.on_tail "-h", "--help", "Show help" do
+        log @parser
+        exit 1
+      end
+      @parser.parse!(argv)
+    end
+
+  end
+end

data/lib/sidekiq/client.rb

@@ -0,0 +1,47 @@
+require 'multi_json'
+require 'redis'
+
+module Sidekiq
+  class Client
+
+    def self.redis
+      @redis ||= begin
+        # autoconfig for Heroku
+        hash = { :url => ENV['REDISTOGO_URL'] } if ENV['REDISTOGO_URL']
+        Redis.connect(hash)
+      end
+    end
+
+    def self.redis=(redis)
+      @redis = redis
+    end
+
+    # Example usage:
+    # Sidekiq::Client.push('my_queue', 'class' => MyWorker, 'args' => ['foo', 1, :bat => 'bar'])
+    def self.push(queue='default', item)
+      raise(ArgumentError, "Message must be a Hash of the form: { 'class' => SomeClass, 'args' => ['bob', 1, :foo => 'bar'] }") unless item.is_a?(Hash)
+      raise(ArgumentError, "Message must include a class and set of arguments: #{item.inspect}") if !item['class'] || !item['args']
+
+      item['class'] = item['class'].to_s if !item['class'].is_a?(String)
+      redis.rpush("queue:#{queue}", MultiJson.encode(item))
+    end
+
+    # Please use .push if possible instead.
+    #
+    # Example usage:
+    #
+    #   Sidekiq::Client.enqueue(MyWorker, 'foo', 1, :bat => 'bar')
+    #
+    # Messages are enqueued to the 'default' queue.  Optionally,
+    # MyWorker can define a queue class method:
+    #
+    #   def self.queue
+    #     'my_queue'
+    #   end
+    #
+    def self.enqueue(klass, *args)
+      queue = (klass.respond_to?(:queue) && klass.queue) || 'default'
+      push(queue, { 'class' => klass.name, 'args' => args })
+    end
+  end
+end

data/lib/sidekiq/manager.rb

@@ -0,0 +1,131 @@
+require 'celluloid'
+require 'redis'
+require 'multi_json'
+
+require 'sidekiq/util'
+require 'sidekiq/processor'
+
+module Sidekiq
+
+  ##
+  # The main router in the system.  This
+  # manages the processor state and fetches messages
+  # from Redis to be dispatched to an idle processor.
+  #
+  class Manager
+    include Util
+    include Celluloid
+
+    trap_exit :processor_died
+
+    def initialize(location, options={})
+      log "Booting sidekiq #{Sidekiq::VERSION} with Redis at #{location}"
+      verbose options.inspect
+      @count = options[:processor_count] || 25
+      @queues = options[:queues]
+      @queue_idx = 0
+      @queues_size = @queues.size
+      @redis = Redis.connect(:url => location)
+
+      @done = false
+      @busy = []
+      @ready = []
+      @count.times do
+        @ready << Processor.new_link(current_actor)
+      end
+    end
+
+    def stop
+      @done = true
+      @ready.each(&:terminate)
+      @ready.clear
+
+      after(5) do
+        signal(:shutdown)
+      end
+    end
+
+    def start
+      dispatch(true)
+    end
+
+    def when_done
+      @done_callback = Proc.new
+    end
+
+    def processor_done(processor)
+      @done_callback.call(processor)
+      @busy.delete(processor)
+      if stopped?
+        processor.terminate
+      else
+        @ready << processor
+      end
+      dispatch
+    end
+
+    def processor_died(processor, reason)
+      @busy.delete(processor)
+
+      if reason
+        log "Processor death: #{reason}"
+        log reason.backtrace.join("\n")
+      end
+
+      unless stopped?
+        @ready << Processor.new_link(current_actor)
+        dispatch
+      end
+    end
+
+    private
+
+    def find_work(queue_idx)
+      current_queue = @queues[queue_idx]
+      msg = @redis.lpop("queue:#{current_queue}")
+      if msg
+        processor = @ready.pop
+        @busy << processor
+        processor.process! MultiJson.decode(msg)
+      end
+      !!msg
+    end
+
+    def dispatch(schedule = false)
+      watchdog("Fatal error in sidekiq, dispatch loop died") do
+        return if stopped?
+
+        # Our dispatch loop
+        # Loop through the queues, looking for a message in each.
+        queue_idx = 0
+        found = false
+        loop do
+          # return so that we don't dispatch again until processor_done
+          break verbose('no processors') if @ready.size == 0
+
+          found ||= find_work(queue_idx)
+          queue_idx += 1
+
+          # if we find no messages in any of the queues, we can break
+          # out of the loop.  Otherwise we loop again.
+          lastq = (queue_idx % @queues.size == 0)
+          if lastq && !found
+            verbose('nothing to process'); break
+          elsif lastq
+            queue_idx = 0
+            found = false
+          end
+        end
+
+        # This is the polling loop that ensures we check Redis every
+        # second for work, even if there was nothing to do this time
+        # around.
+        after(1) { verbose('ping'); dispatch(schedule) } if schedule
+      end
+    end
+
+    def stopped?
+      @done
+    end
+  end
+end