skiplock 1.0.3

checksums.yaml

@@ -0,0 +1,7 @@
+---
+SHA256:
+  metadata.gz: 9731224db727e3ebe4b32b94b4edff6bf7a53faca14be5a6f5d7cc20a02836e9
+  data.tar.gz: 9c3cb7ccf0d98d7e8ec4bcd21e33269504d166804f0679fe7d286290527a8457
+SHA512:
+  metadata.gz: 560b30ea96a8f255811b1c8a0beb7e161ba1edd2dde238e52cd31625e1a4e4d729ff24f3d4d37e4a29fbb2c3e2543e86b9cb1720553cacab346ac30db2970aea
+  data.tar.gz: '093b4ee02119973dbd1c8c905d2ccbcc1d6d9efad440ba23ba8fc05a8a2a3580ec7a7d3c7c47d5f6077b789a440e4c46e455f81a5c10fd032b01ffefae906a0e'

data/LICENSE.txt

@@ -0,0 +1,21 @@
+The MIT License (MIT)
+
+Copyright (c) 2021 Tin Vo
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in
+all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN
+THE SOFTWARE.

data/README.md

@@ -0,0 +1,155 @@
+# Skiplock
+
+Skiplock is a background job queuing system that improves the performance and reliability of the job executions while providing the same ACID guarantees as the rest of your data.  It is designed for Active Jobs with Ruby on Rails using PostgreSQL database adapter, but it can be modified to work with other frameworks easily.
+
+It only uses the `LISTEN/NOTIFY/SKIP LOCKED` features provided natively on PostgreSQL 9.5+ to efficiently and reliably dispatch jobs to worker processes and threads ensuring that each job can be completed successfully **only once**.  No other polling or timer is needed.
+
+The library is quite small compared to other PostgreSQL job queues (eg. *delay_job*, *queue_classic*, *que*, *good_job*) with less than 400 lines of codes; and it still provides similar set of features and more...
+
+#### Compatibility:
+
+- MRI Ruby 2.5+
+- PostgreSQL 9.5+
+- Rails 5.2+
+
+## Installation
+
+1. Add `skiplock` to your application's Gemfile:
+
+    ```ruby
+    gem 'skiplock'
+    ```
+
+2. Install the gem:
+
+    ```bash
+    $ bundle install
+    ```
+
+3. Run the Skiplock install generator. This will generate a configuration file and database migration to store the job records:
+
+    ```bash
+    $ rails g skiplock:install
+    ```
+
+4. Run the migration:
+
+    ```bash
+    $ rails db:migrate
+    ```
+
+## Configuration
+
+1. Configure the ActiveJob adapter:
+
+    ```ruby
+    # config/application.rb
+    config.active_job.queue_adapter = :skiplock
+    ```
+2. Skiplock configuration
+    ```yaml
+    # config/skiplock.yml
+    ---
+    logging: timestamp
+    min_threads: 1
+    max_threads: 5
+    max_retries: 20
+    purge_completion: true
+    workers: 0
+    ```
+    Available configuration options are:
+    - **logging** (*enumeration*): sets the logging capability to **true** or **false**; setting to **timestamp** will enable logging with timestamps. The log files are: log/skiplock.log and log/skiplock.error.log
+    - **min_threads** (*integer*): sets minimum number of threads staying idle
+    - **max_threads** (*integer*): sets the maximum number of threads allowed to run jobs
+    - **max_retries** (*integer*): sets the maximum attempt a job will be retrying before it is marked expired (see Retry System for more details)
+    - **purge_completion** (*boolean*): when set to **true** will delete jobs after they were completed successfully; if set to **false** then the completed jobs should be purged periodically to maximize performance (eg. clean up old jobs after 3 months)
+    - **workers** (*integer*) sets the maximum number of processes when running in standalone mode using the `skiplock` executable; setting this to 0 will enable **async mode**
+    
+    #### Async mode
+    When **workers** is set to **0** then the jobs will be performed in the web server process using separate threads.  If using multi-worker cluster web server like Puma, then it should be configured as below:
+    ```ruby
+    # config/puma.rb
+    before_fork do
+      # ...
+      Skiplock::Manager.shutdown
+    end
+
+    on_worker_boot do
+      # ...
+      Skiplock::Manager.start
+    end
+
+    on_worker_shutdown do
+      # ...
+      Skiplock::Manager.shutdown
+    end
+    ```
+
+## Usage
+
+- Inside the Rails application, queue your job:
+    ```ruby
+    MyJob.perform_later
+    ```
+- Skiplock supports all ActiveJob features:
+    ```ruby
+    MyJob.set(wait: 5.minutes, priority: 10).perform_later(1,2,3)
+    ```
+- Outside of Rails application, queue the jobs by inserting the job records directly to the database table eg:
+    ```sql
+    INSERT INTO skiplock.jobs(job_class) VALUES ('MyJob');
+    ```
+- Or with scheduling, priority and arguments:
+    ```sql
+    INSERT INTO skiplock.jobs(job_class,priority,scheduled_at,data) VALUES ('MyJob',10,NOW()+INTERVAL '5 min','{"arguments":[1,2,3]}');
+    ```
+## Cron system
+Skiplock provides the capability to setup cron jobs for running tasks periodically.  It fully supports the cron syntax to specify the frequency of the jobs.  To setup a cron job, simply assign a valid cron schedule to the constant `CRON` for the Job Class.
+- setup `MyJob` to run as cron job every hour at 30 minutes past
+
+    ```ruby
+    class MyJob < ActiveJob::Base
+      CRON = "30 * * * *"
+      # ...
+    end
+    ```
+- setup `CleanupJob` to run at midnight every Wednesdays
+    ```ruby
+    class CleanupJob < ApplicationJob
+      CRON = "0 0 * * 3"
+      # ...
+    end
+    ```
+- to remove the cron schedule from the job, simply comment out the constant definition or delete the line then re-deploy the application. At startup, the cron jobs that were undefined will be removed automatically
+
+## Retry system
+Skiplock fully supports ActiveJob built-in retry system.  It also has its own retry system for fallback.  To use ActiveJob retry system, define the rescue blocks per ActiveJob's documentation.
+- configures `MyJob` to retry at maximum 20 attempts on StandardError with fixed delay of 5 seconds
+    ```ruby
+    class MyJob < ActiveJob::Base
+      retry_on StandardError, wait: 5, attempts: 20
+    # ...
+    end
+    ```
+
+- configures `MyJob` to retry at maximum 10 attempts on StandardError with exponential delay
+    ```ruby
+    class MyJob < ActiveJob::Base
+      retry_on StandardError, wait: :exponentially_longer, attempts: 10
+    # ...
+    end
+    ```
+Once the retry attempt limit configured in ActiveJob has been reached, the control will be passed back to `skiplock` to be marked as an expired job.
+
+If the rescue blocks are not defined, then the built-in retry system of `skiplock` will kick in automatically.  The retrying schedule is using an exponential formula (5 + 2**attempt).  The `skiplock` configuration `max_retries` determines the the limit of attempts before the failing job is marked as expired.  The maximum retry limit can be set as high as 20; this allows up to 12 days of retrying before the job is marked as expired.
+
+## Notification system
+...
+
+## Contributing
+
+Bug reports and pull requests are welcome on GitHub at https://github.com/vtt/skiplock.
+
+## License
+
+The gem is available as open source under the terms of the [MIT License](https://opensource.org/licenses/MIT).

data/bin/skiplock

@@ -0,0 +1,3 @@
+#!/usr/bin/env ruby
+require File.expand_path("config/environment.rb")
+Skiplock::Manager.start(standalone: true)

data/lib/active_job/queue_adapters/skiplock_adapter.rb

@@ -0,0 +1,17 @@
+module ActiveJob
+  module QueueAdapters
+    class SkiplockAdapter
+      def initialize
+        Skiplock::Manager.start
+      end
+
+      def enqueue(job)
+        enqueue_at(job, nil)
+      end
+
+      def enqueue_at(job, timestamp)
+        Skiplock::Job.enqueue_at(job, timestamp)
+      end
+    end
+  end
+end

data/lib/generators/skiplock/install_generator.rb

@@ -0,0 +1,22 @@
+require 'rails/generators'
+require 'rails/generators/active_record'
+
+module Skiplock
+  class InstallGenerator < Rails::Generators::Base
+    include Rails::Generators::Migration
+    source_paths << File.join(File.dirname(__FILE__), 'templates')
+    desc 'Add configuration & migration for Skiplock'
+
+    def self.next_migration_number(path)
+      ActiveRecord::Generators::Base.next_migration_number(path)
+    end
+
+    def create_config_file
+      create_file 'config/skiplock.yml', Skiplock::Settings.to_yaml
+    end
+
+    def create_migration_file
+      migration_template 'migration.rb.erb', 'db/migrate/create_skiplock_schema.rb'
+    end
+  end
+end

data/lib/generators/skiplock/templates/migration.rb.erb

@@ -0,0 +1,39 @@
+class CreateSkiplockSchema < ActiveRecord::Migration<%= "[#{ActiveRecord::VERSION::MAJOR}.#{ActiveRecord::VERSION::MINOR}]" %>
+  def up
+    execute 'CREATE SCHEMA skiplock'
+    create_table 'skiplock.jobs', id: :uuid do |t|
+      t.string    :job_class, null: false
+      t.string    :cron
+      t.string    :queue_name
+      t.string    :locale
+      t.string    :timezone
+      t.integer   :priority
+      t.integer   :executions
+      t.jsonb     :exception_executions
+      t.jsonb     :data
+      t.boolean   :running, null: false, default: false
+      t.timestamp :expired_at
+      t.timestamp :finished_at
+      t.timestamp :scheduled_at
+      t.timestamps null: false, default: -> { 'now()' }
+    end
+    execute %(CREATE OR REPLACE FUNCTION skiplock.notify() RETURNS TRIGGER AS $$
+      BEGIN
+        IF (NEW.finished_at IS NULL AND NEW.expired_at IS NULL) THEN
+          PERFORM pg_notify('skiplock', CONCAT(TG_OP,',',NEW.id::TEXT,',',NEW.queue_name,',',NEW.priority,',',CAST(EXTRACT(EPOCH FROM NEW.scheduled_at) AS FLOAT)::text));
+        END IF;
+        RETURN NULL;
+      END;
+      $$ LANGUAGE plpgsql
+    )
+    execute "CREATE TRIGGER notify_job AFTER INSERT OR UPDATE ON skiplock.jobs FOR EACH ROW EXECUTE PROCEDURE skiplock.notify()"
+    execute "CREATE INDEX jobs_index ON skiplock.jobs(scheduled_at ASC NULLS FIRST, priority ASC NULLS LAST, created_at ASC) WHERE running = 'f' AND expired_at IS NULL AND finished_at IS NULL"
+    execute "CREATE INDEX jobs_retry_index ON skiplock.jobs(scheduled_at) WHERE running = 'f' AND executions IS NOT NULL AND expired_at IS NULL AND finished_at IS NULL"
+    execute "CREATE INDEX jobs_cron_index ON skiplock.jobs(scheduled_at ASC NULLS FIRST, priority ASC NULLS LAST, created_at ASC) WHERE cron IS NOT NULL AND finished_at IS NULL"
+    execute "CREATE UNIQUE INDEX jobs_unique_cron_index ON skiplock.jobs (job_class) WHERE cron IS NOT NULL"
+  end
+
+  def down
+    execute 'DROP SCHEMA skiplock CASCADE'
+  end
+end

data/lib/skiplock.rb

@@ -0,0 +1,20 @@
+require 'active_job'
+require 'active_job/queue_adapters/skiplock_adapter'
+require 'active_record'
+require 'skiplock/cron'
+require 'skiplock/dispatcher'
+require 'skiplock/manager'
+require 'skiplock/notification'
+require 'skiplock/job'
+require 'skiplock/version'
+
+module Skiplock
+  Settings = { 
+    'logging' => :timestamp,
+    'min_threads' => 1,
+    'max_threads' => 5,
+    'max_retries' => 20,
+    'purge_completion' => true,
+    'workers' => 0
+  }
+end

data/lib/skiplock/cron.rb

@@ -0,0 +1,31 @@
+require 'cron_parser'
+module Skiplock
+  class Cron
+    def self.setup
+      cronjobs = []
+      ActiveJob::Base.descendants.each do |j|
+        next unless j.const_defined?('CRON')
+        cron = j.const_get('CRON')
+        job = Job.find_by('job_class = ? AND cron IS NOT NULL', j.name) || Job.new(job_class: j.name, cron: cron)
+        time = self.next_schedule_at(cron)
+        if time
+          job.cron = cron
+          job.running = false
+          job.scheduled_at = Time.at(time)
+          job.save!
+          cronjobs << j.name
+        end
+      end
+      query = Job.where('cron IS NOT NULL')
+      query = query.where('job_class NOT IN (?)', cronjobs) if cronjobs.count > 0
+      query.delete_all
+    end
+
+    def self.next_schedule_at(cron)
+      time = CronParser.new(cron).next
+      time = time + (time <= Time.now ? 60 : Time.now.sec)
+      time.to_f  
+    rescue
+    end
+  end
+end

data/lib/skiplock/dispatcher.rb

@@ -0,0 +1,92 @@
+module Skiplock
+  class Dispatcher
+    def initialize(master: true)
+      @executor = Concurrent::ThreadPoolExecutor.new(min_threads: Settings['min_threads'], max_threads: Settings['max_threads'], max_queue: Settings['max_threads'], idletime: 60, auto_terminate: true, fallback_policy: :discard)
+      @master = master
+      @next_schedule_at = Time.now.to_f
+      @running = true
+    end
+    
+    def run
+      Thread.new do
+        Rails.application.reloader.wrap do
+          sleep(0.1) while @running && !Rails.application.initialized?
+          ActiveRecord::Base.connection_pool.with_connection do |connection|
+            connection.exec_query('LISTEN skiplock')
+            if @master
+              # reset retries schedules on startup
+              Job.where('scheduled_at > NOW() AND executions IS NOT NULL AND expired_at IS NULL AND finished_at IS NULL').update_all(scheduled_at: nil, updated_at: Time.now)
+              Cron.setup
+            end
+            error = false
+            while @running
+              begin
+                if error
+                  unless connection.active?
+                    connection.reconnect!
+                    sleep(0.5)
+                    connection.exec_query('LISTEN skiplock')
+                    @next_schedule_at = Time.now
+                  end
+                  error = false
+                end
+                if Time.now.to_f >= @next_schedule_at && @executor.remaining_capacity > 0
+                  @executor.post { do_work }
+                end
+                notifications = []
+                connection.raw_connection.wait_for_notify(0.1) do |channel, pid, payload|
+                  notifications << payload if payload
+                  loop do
+                    payload = connection.raw_connection.notifies
+                    break unless @running && payload
+                    notifications << payload[:extra]
+                  end
+                  notifications.each do |n|
+                    op, id, queue, priority, time = n.split(',')
+                    if time.to_f <= Time.now.to_f
+                      @next_schedule_at = Time.now.to_f
+                    elsif time.to_f < @next_schedule_at
+                      @next_schedule_at = time.to_f
+                    end
+                  end
+                end
+              rescue Exception => ex
+                # TODO: Report exception
+                error = true
+                timestamp = Time.now
+                while @running
+                  sleep(0.5)
+                  break if Time.now - timestamp > 10
+                end              
+              end
+              sleep(0.1)
+            end
+            connection.exec_query('UNLISTEN *')
+          end
+        end
+      end
+    end
+
+    def shutdown(wait: true)
+      @running = false
+      @executor.shutdown
+      @executor.wait_for_termination if wait
+    end
+
+    private
+
+    def do_work
+      connection = ActiveRecord::Base.connection_pool.checkout
+      while @running
+        result = Job.dispatch(connection: connection)
+        next if result.is_a?(Hash)
+        @next_schedule_at = result if result.is_a?(Float)
+        break
+      end
+    rescue Exception => e
+      # TODO: Report exception
+    ensure
+      ActiveRecord::Base.connection_pool.checkin(connection)
+    end
+  end
+end

data/lib/skiplock/job.rb

@@ -0,0 +1,72 @@
+module Skiplock
+  class Job < ActiveRecord::Base
+    self.table_name = 'skiplock.jobs'
+
+    # Accept: An active ActiveRecord database connection (eg. ActiveRecord::Base.connection)
+    #         The connection should be checked out using ActiveRecord::Base.connection_pool.checkout, and be checked
+    #         in using ActiveRecord::Base.conection_pool.checkin once all of the job dispatches have been completed.
+    #         *** IMPORTANT: This connection cannot be shared with the job's execution
+    #
+    # Return: Attributes hash of the Job if it was executed; otherwise returns the next Job's schedule time in FLOAT
+    def self.dispatch(connection: ActiveRecord::Base.connection)
+      connection.exec_query('BEGIN')
+      job = connection.exec_query("SELECT * FROM #{self.table_name} WHERE running = 'f' AND expired_at IS NULL AND finished_at IS NULL ORDER BY scheduled_at ASC NULLS FIRST, priority ASC NULLS LAST, created_at ASC FOR UPDATE SKIP LOCKED LIMIT 1").first
+      if job && job['scheduled_at'].to_f <= Time.now.to_f  # found job ready to perform
+        # update the job to mark it in progress in case database server goes down during job execution
+        connection.exec_query("UPDATE #{self.table_name} SET running = 't' WHERE id = '#{job['id']}'")
+        connection.exec_query('END') # close the transaction commit the state of job in progress
+        executions = (job['executions'] || 0) + 1
+        exceptions = job['exception_executions'] ? JSON.parse(job['exception_executions']) : {}
+        data = job['data'] ? JSON.parse(job['data']) : {}
+        job_data = job.slice('job_class', 'queue_name', 'locale', 'timezone', 'priority', 'executions').merge('job_id' => job['id'], 'exception_executions' => exceptions, 'enqueued_at' => job['updated_at']).merge(data)
+        Thread.current[:skiplock_dispatch_data] = job_data
+        begin
+          ActiveJob::Base.execute(job_data)
+        rescue Exception => ex
+        end
+        if ex
+          # TODO: report exception
+          exceptions["[#{ex.class.name}]"] = (exceptions["[#{ex.class.name}]"] || 0) + 1 unless exceptions.key?('activejob_retry')
+          if executions >= Settings['max_retries'] || exceptions.key?('activejob_retry')
+            connection.exec_query("UPDATE #{self.table_name} SET running = 'f', executions = #{executions}, exception_executions = '#{connection.quote_string(exceptions.to_json.to_s)}', expired_at = NOW(), updated_at = NOW() WHERE id = '#{job['id']}' RETURNING *").first
+          else
+            timestamp = Time.now + (5 * 2**executions)
+            connection.exec_query("UPDATE #{self.table_name} SET running = 'f', executions = #{executions}, exception_executions = '#{connection.quote_string(exceptions.to_json.to_s)}', scheduled_at = TO_TIMESTAMP(#{timestamp.to_f}), updated_at = NOW() WHERE id = '#{job['id']}' RETURNING *").first
+          end
+        elsif exceptions.key?('activejob_retry')
+          connection.exec_query("UPDATE #{self.table_name} SET running = 'f', executions = #{job_data['executions']}, exception_executions = '#{connection.quote_string(job_data['exception_executions'].to_json.to_s)}', scheduled_at = TO_TIMESTAMP(#{job_data['scheduled_at'].to_f}), updated_at = NOW() WHERE id = '#{job['id']}' RETURNING *").first
+        elsif job['cron']
+          data['last_cron_run'] = Time.now.utc.to_s
+          next_cron_at = Cron.next_schedule_at(job['cron'])
+          if next_cron_at
+            connection.exec_query("UPDATE #{self.table_name} SET running = 'f', scheduled_at = TO_TIMESTAMP(#{next_cron_at}), executions = 1, exception_executions = NULL, data = '#{connection.quote_string(data.to_json.to_s)}', updated_at = NOW() WHERE id = '#{job['id']}' RETURNING *").first
+          else
+            connection.exec_query("DELETE FROM #{self.table_name} WHERE id = '#{job['id']}' RETURNING *").first
+          end
+        elsif Settings['purge_completion']
+          connection.exec_query("DELETE FROM #{self.table_name} WHERE id = '#{job['id']}' RETURNING *").first
+        else
+          connection.exec_query("UPDATE #{self.table_name} SET running = 'f', executions = #{executions}, exception_executions = NULL, finished_at = NOW(), updated_at = NOW() WHERE id = '#{job['id']}' RETURNING *").first
+        end
+      else
+        connection.exec_query('END')
+        job ? job['scheduled_at'].to_f : Float::INFINITY
+      end
+    ensure
+      Thread.current[:skiplock_dispatch_data] = nil
+    end
+
+    def self.enqueue_at(job, timestamp)
+      if Thread.current[:skiplock_dispatch_data]
+        job.exception_executions['activejob_retry'] = true
+        Thread.current[:skiplock_dispatch_data]['executions'] = job.executions
+        Thread.current[:skiplock_dispatch_data]['exception_executions'] = job.exception_executions
+        Thread.current[:skiplock_dispatch_data]['scheduled_at'] = Time.at(timestamp)
+        self.new(Thread.current[:skiplock_dispatch_data].slice(*self.column_names).merge(id: job.job_id))
+      else
+        timestamp = Time.at(timestamp) if timestamp
+        Job.create!(id: job.job_id, job_class: job.class.name, queue_name: job.queue_name, locale: job.locale, timezone: job.timezone, priority: job.priority, executions: job.executions, data: { 'arguments' => job.arguments }, scheduled_at: timestamp)
+      end
+    end
+  end
+end

data/lib/skiplock/manager.rb

@@ -0,0 +1,119 @@
+module Skiplock
+  class Manager
+    def self.start(standalone: false)
+      load_settings
+      return unless standalone || (caller.any?{|l| l =~ %r{/rack/}} && (Settings['workers'] == 0 || Rails.env.development?))
+      if standalone
+        self.standalone
+      else
+        @dispatcher = Dispatcher.new
+        @thread = @dispatcher.run
+        at_exit { self.shutdown }
+      end
+    end
+    
+    def self.shutdown(wait: true)
+      if @dispatcher && @thread
+        @dispatcher.shutdown(wait: wait)
+        @thread.join
+      end
+    end
+
+  private
+
+    def self.load_settings
+      return if Settings.frozen?
+      config = YAML.load_file('config/skiplock.yml') rescue {}
+      Settings.merge!(config)
+      Settings['max_retries'] = 20 if Settings['max_retries'] > 20
+      Settings['max_retries'] = 0 if Settings['max_retries'] < 0
+      Settings['max_threads'] = 1 if Settings['max_threads'] < 1
+      Settings['max_threads'] = 20 if Settings['max_threads'] > 20
+      Settings['min_threads'] = 0 if Settings['min_threads'] < 0
+      Settings['workers'] = 0 if Settings['workers'] < 0
+      Settings.freeze
+    end
+
+    def self.standalone
+      title = "Skiplock version: #{Skiplock::VERSION} (Ruby #{RUBY_VERSION}-p#{RUBY_PATCHLEVEL})"
+      puts "-"*(title.length)
+      puts title
+      puts "-"*(title.length)
+      puts "Additional workers: #{Settings['workers']}"
+      puts "  Purge completion: #{Settings['purge_completion']}"
+      puts "       Max retries: #{Settings['max_retries']}"
+      puts "       Min threads: #{Settings['min_threads']}"
+      puts "       Max threads: #{Settings['max_threads']}"
+      puts "       Environment: #{Rails.env}"
+      puts "           Logging: #{Settings['logging']}"
+      puts "               PID: #{Process.pid}"
+      puts "-"*(title.length)
+      if Settings['logging']
+        log_timestamp = (Settings['logging'].to_s == 'timestamp')
+        logfile = File.open('log/skiplock.log', 'a')
+        logfile.sync = true
+        $stdout = Demux.new(logfile, STDOUT, timestamp: log_timestamp)
+        errfile = File.open('log/skiplock.error.log', 'a')
+        errfile.sync = true
+        $stderr = Demux.new(errfile, STDERR, timestamp: log_timestamp)
+        logger = ActiveSupport::Logger.new($stdout)
+        logger.level = Rails.logger.level
+        Rails.logger.reopen('/dev/null')
+        Rails.logger.extend(ActiveSupport::Logger.broadcast(logger))
+      end
+      parent_id = Process.pid
+      shutdown = false
+      Signal.trap("INT") { shutdown = true }
+      Signal.trap("TERM") { shutdown = true }
+      Settings['workers'].times do |w|
+        fork do
+          Process.setproctitle("skiplock-worker[#{w+1}]")
+          dispatcher = Dispatcher.new(master: false)
+          thread = dispatcher.run
+          loop do
+            sleep 0.5
+            break if shutdown || Process.ppid != parent_id
+          end
+          dispatcher.shutdown(wait: true)
+          thread.join
+          exit
+        end
+      end
+      sleep 0.1
+      Process.setproctitle("skiplock-master")
+      dispatcher = Dispatcher.new
+      thread = dispatcher.run
+      loop do
+        sleep 0.5
+        break if shutdown
+      end
+      Process.waitall
+      dispatcher.shutdown(wait: true)
+      thread.join
+    end
+
+    class Demux
+      def initialize(*targets, timestamp: true)
+        @targets = targets
+        @timestamp = timestamp
+      end
+
+      def close
+        @targets.each(&:close)
+      end
+
+      def flush
+        @targets.each(&:flush)
+      end
+  
+      def tty?
+        true
+      end
+
+      def write(*args)
+        args.prepend("[#{Time.now.utc}]: ") if @timestamp
+        @targets.each {|t| t.write(*args)}
+      end
+    end
+  end
+end

data/lib/skiplock/notification.rb

@@ -0,0 +1,5 @@
+module Skiplock
+  class Notification
+  end
+end
+

data/lib/skiplock/version.rb

@@ -0,0 +1,4 @@
+module Skiplock
+  VERSION = Version = '1.0.3'
+end
+

metadata

@@ -0,0 +1,114 @@
+--- !ruby/object:Gem::Specification
+name: skiplock
+version: !ruby/object:Gem::Version
+  version: 1.0.3
+platform: ruby
+authors:
+- Tin Vo
+autorequire: 
+bindir: bin
+cert_chain: []
+date: 2021-03-17 00:00:00.000000000 Z
+dependencies:
+- !ruby/object:Gem::Dependency
+  name: activejob
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: 5.2.0
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: 5.2.0
+- !ruby/object:Gem::Dependency
+  name: activerecord
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: 5.2.0
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: 5.2.0
+- !ruby/object:Gem::Dependency
+  name: concurrent-ruby
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: 1.0.2
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: 1.0.2
+- !ruby/object:Gem::Dependency
+  name: parse-cron
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: '0.1'
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: '0.1'
+description: High performance ActiveJob Queue Adapter for PostgreSQL that provides
+  maximum reliability and ACID compliance
+email:
+- vtt999@gmail.com
+executables:
+- skiplock
+extensions: []
+extra_rdoc_files: []
+files:
+- LICENSE.txt
+- README.md
+- bin/skiplock
+- lib/active_job/queue_adapters/skiplock_adapter.rb
+- lib/generators/skiplock/install_generator.rb
+- lib/generators/skiplock/templates/migration.rb.erb
+- lib/skiplock.rb
+- lib/skiplock/cron.rb
+- lib/skiplock/dispatcher.rb
+- lib/skiplock/job.rb
+- lib/skiplock/manager.rb
+- lib/skiplock/notification.rb
+- lib/skiplock/version.rb
+homepage: https://github.com/vtt/skiplock
+licenses:
+- MIT
+metadata: {}
+post_install_message: 
+rdoc_options: []
+require_paths:
+- lib
+required_ruby_version: !ruby/object:Gem::Requirement
+  requirements:
+  - - ">="
+    - !ruby/object:Gem::Version
+      version: 2.5.0
+required_rubygems_version: !ruby/object:Gem::Requirement
+  requirements:
+  - - ">="
+    - !ruby/object:Gem::Version
+      version: '0'
+requirements: []
+rubygems_version: 3.0.3
+signing_key: 
+specification_version: 4
+summary: ActiveJob Queue Adapter for PostgreSQL
+test_files: []