resque 2.7.0 → 3.0.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 7419ce3cc8734b05527a47b0c5fb4a9eea0a5d33265a6e3214bb429980c37681
-  data.tar.gz: 4216e18e121883e0350275e00c19e1d6c6f0965915d4b48a8a0a29f07e652317
+  metadata.gz: 6029ead32e829bcc359edabd6540a827fc8dff70768f26dbc6756041c98a6691
+  data.tar.gz: c6a568f692f54fd91cd8371b029babaf70c096ccb8b020cd3a76eb16f6e0ab56
 SHA512:
-  metadata.gz: 7301e154b368d012161ae22d69cb8e4400977a3099392f7789369ca37b04a413d0abec092e60dd9dddee01bda81c55dbf182da5cede4a8c2beff94f8ed44bc94
-  data.tar.gz: 85d0c05d98502b0da28ae60ca6117d3b4a47bbfc981b48c4168f6bf727bac8c4c325dcebf604f8916d0e04c97bf933651b6077b55ead117e7ecb1cc2cf4655f0
+  metadata.gz: bc4575c01a0ad8e803a7a21b707bdcfca8d7a4cbab3d19f80476fce6b28e900857c3a19271358805b16f99bf59e666ff3e7bfb61911ec4271014d4c41aa53322
+  data.tar.gz: 2af75588506a9e8d54dbe74d6a9f3c5ef96d1daccf3d76b4e2d820bbad388730fe69f829bc3077f06d609c50f131edf9c0b102271ebd70ec8e2143df9e0c4a12

data/HISTORY.md

@@ -1,3 +1,27 @@
+## 3.0.0
+
+### Breaking Changes
+
+* **Minimum Ruby version is now 3.0.0** - Ruby 2.x is no longer supported
+* **Minimum Sinatra version is now 2.0** - old Sinatra versions (0.9-1.x) are no longer supported
+* **Rack 1.x is no longer supported** - Resque now requires Rack 2.x or greater
+
+### Added
+
+* Rack 3 support and switched default Rack handler to Puma (#1912)
+* Ruby 3.4 and Rails 8.1 support (#1912 and #1906)
+* Upstream Active Job adapter from Rails (#1906)
+* Explicit `redis` (>= 4.0) and `base64` (~> 0.1) gem dependencies (#1922)
+* Added `shutdown` hooks - allows plugins and adapters to know when a worker is shutting down, enabling features like Active Job Continuations (#1916, #1924)
+* Added support for dynamic interval sleep - workers can now use a faster polling interval that automatically backs off when idle, reducing Redis load (#1920)
+
+### Fixed
+
+* Fix circular require from Rails ActiveJob adapter (#1906)
+* Fix failed job `retried_at` timezone data (#1918)
+* Fix double Redis get when checking for paused workers (#1919)
+* Documentation cleanup (#1903, #1917)
+
 ## 2.7.0
 
 ### Fixed

data/README.markdown

@@ -39,15 +39,23 @@ The Resque frontend tells you what workers are doing, what workers are
 not doing, what queues you're using, what's in those queues, provides
 general usage stats, and helps you track failures.
 
-Resque now supports Ruby 2.3.0 and above.
-We will also only be supporting Redis 3.0 and above going forward.
+Resque 3.0 requires Ruby 3.0.0 or newer.
 
-### Note on the future of Resque
+**Version Support:**
+- Ruby: 3.0, 3.1, 3.2, 3.3, 3.4+
+- Redis gem: 4.0+
+- Rack: 2.x or 3.x
+- Rails (for ActiveJob): 7.2+ (requires Ruby 3.1+ for Rails 8.0+)
 
-Would you like to be involved in Resque? Do you have thoughts about what
-Resque should be and do going forward? There's currently an [open discussion here](https://github.com/resque/resque/issues/1759)
-on just that topic, so please feel free to join in. We'd love to hear your thoughts
-and/or have people volunteer to be a part of the project!
+### Resque 3.0
+
+Resque 3.0 is a major release that modernizes the codebase with updated dependency requirements:
+- Requires Ruby 3.0+ (drops support for Ruby 2.x)
+- Requires redis gem 4.0+ (tested with redis gem 4.x and 5.x)
+- Requires Sinatra 2.0+ (with Rack 2.x or 3.x support via appropriate Sinatra version)
+- Maintains compatibility with Rails 7.2+ and ActiveJob
+
+If you need Ruby 2.x support, please use Resque 2.x.
 
 Example
 -------
@@ -133,15 +141,6 @@ require 'your/app' # Include this line if you want your workers to have access t
 
 #### Rails
 
-##### Rails 7.1
-
-If you're using Rails 7.1.x, use [rack-session version 1.0.2](https://rubygems.org/gems/rack-session/versions/1.0.2). This is because resque-web's dependency, [Sinatra, isn't compatible with rack 3.0](https://github.com/sinatra/sinatra/issues/1797), which is [required by rack-session 2.0.0](https://rubygems.org/gems/rack-session/versions/2.0.0).
-
-```
-  gem 'rails', '~> 7.1'
-  gem 'rack-session', '~> 1.0', '>= 1.0.2'
-```
-
 To make resque specific changes, you can override the `resque:setup` job in `lib/tasks` (ex: `lib/tasks/resque.rake`). GitHub's setup task looks like this:
 
 ``` ruby

data/Rakefile

@@ -28,7 +28,33 @@ Rake::TestTask.new do |test|
   test.verbose = true
   test.libs << "test"
   test.libs << "lib"
-  test.test_files = FileList['test/**/*_test.rb']
+  test.test_files = FileList['test/**/*_test.rb'].exclude('test/active_job/**/*')
+end
+
+Rake::TestTask.new('test:activejob') do |test|
+  test.verbose = true
+  test.libs << "test"
+  test.libs << "lib"
+  test.libs << "test/active_job"
+  test.test_files = FileList['test/active_job/cases/*_test.rb']
+end
+
+task "env:aj_integration" do
+  ENV["AJ_INTEGRATION_TESTS"] = "1"
+end
+
+Rake::TestTask.new('test:activejob:integration' => 'env:aj_integration') do |t|
+  if Gem::Version.new(RUBY_VERSION) < Gem::Version.new("3.1")
+    puts "Integration tests require Ruby 3.1 or later"
+    exit 0
+  end
+
+  t.description = "Run integration tests for Resque::ActiveJob::Adapter"
+  t.libs << "test"
+  t.libs << "test/active_job"
+  t.test_files = FileList["test/active_job/integration/**/*_test.rb"]
+  t.verbose = true
+  t.warning = true
 end
 
 if command? :kicker

data/lib/active_job/queue_adapters/resque_adapter.rb

@@ -0,0 +1,54 @@
+# frozen_string_literal: true
+
+require "active_support/core_ext/enumerable"
+require "active_support/core_ext/array/access"
+
+begin
+  require "resque-scheduler"
+rescue LoadError
+  begin
+    require "resque_scheduler"
+  rescue LoadError
+    false
+  end
+end
+
+module ActiveJob
+  module QueueAdapters
+    remove_const(:ResqueAdapter) if defined?(ResqueAdapter)
+
+    # = Resque adapter for Active Job
+    #
+    # Resque (pronounced like "rescue") is a Redis-backed library for creating
+    # background jobs, placing those jobs on multiple queues, and processing
+    # them later.
+    #
+    # Read more about Resque {here}[https://github.com/resque/resque].
+    #
+    # To use Resque set the queue_adapter config to +:resque+.
+    #
+    #   Rails.application.config.active_job.queue_adapter = :resque
+    class ResqueAdapter < ::ActiveJob::QueueAdapters::AbstractAdapter
+      def enqueue(job) # :nodoc:
+        JobWrapper.instance_variable_set(:@queue, job.queue_name)
+        Resque.enqueue_to job.queue_name, JobWrapper, job.serialize
+      end
+
+      def enqueue_at(job, timestamp) # :nodoc:
+        unless Resque.respond_to?(:enqueue_at_with_queue)
+          raise NotImplementedError, "To be able to schedule jobs with Resque you need the " \
+            "resque-scheduler gem. Please add it to your Gemfile and run bundle install"
+        end
+        Resque.enqueue_at_with_queue job.queue_name, timestamp, JobWrapper, job.serialize
+      end
+
+      class JobWrapper # :nodoc:
+        class << self
+          def perform(job_data)
+            ::ActiveJob::Base.execute job_data
+          end
+        end
+      end
+    end
+  end
+end

data/lib/resque/failure/redis.rb

@@ -78,7 +78,7 @@ module Resque
       def self.requeue(id, queue = nil)
         check_queue(queue)
         item = all(id)
-        item['retried_at'] = Time.now.strftime("%Y/%m/%d %H:%M:%S")
+        item['retried_at'] = UTF8Util.clean(Time.now.strftime("%Y/%m/%d %H:%M:%S %Z"))
         data_store.update_item_in_failed_queue(id,Resque.encode(item))
         Job.create(item['queue'], item['payload']['class'], *item['payload']['args'])
       end

data/lib/resque/railtie.rb

@@ -6,5 +6,11 @@ module Resque
       # redefine ths task to load the rails env
       task "resque:setup" => :environment
     end
+
+    initializer "resque.active_job" do
+      ActiveSupport.on_load(:active_job) do
+        require "active_job/queue_adapters/resque_adapter"
+      end
+    end
   end
 end

data/lib/resque/tasks.rb

@@ -17,7 +17,11 @@ namespace :resque do
 
     worker.prepare
     worker.log "Starting worker #{worker}"
-    worker.work(ENV['INTERVAL'] || 5) # interval, will block
+    # will block until a shutdown signal is received
+    worker.work(ENV["INTERVAL"],
+                max_interval:     ENV['MAX_INTERVAL'],
+                min_interval:     ENV['MIN_INTERVAL'],
+                backoff_interval: ENV['BACKOFF_INTERVAL'])
   end
 
   desc "Start multiple Resque workers. Should only be used in dev mode."

data/lib/resque/version.rb

@@ -1,3 +1,3 @@
 module Resque
-  VERSION = '2.7.0'
+  VERSION = '3.0.0'
 end

data/lib/resque/web_runner.rb

@@ -3,6 +3,10 @@ require 'logger'
 require 'optparse'
 require 'fileutils'
 require 'rack'
+begin
+  require 'rackup'
+rescue LoadError
+end
 require 'resque/server'
 
 # only used with `bin/resque-web`
@@ -30,7 +34,7 @@ module Resque
 
       @args = load_options(runtime_args)
 
-      @rack_handler = (s = options[:rack_handler]) ? Rack::Handler.get(s) : setup_rack_handler
+      @rack_handler = (s = options[:rack_handler]) ? self.class.get_rackup_or_rack_handler.get(s) : setup_rack_handler
 
       case option_parser.command
       when :help
@@ -270,6 +274,10 @@ module Resque
       self.class.logger
     end
 
+    def self.get_rackup_or_rack_handler
+      defined?(::Rackup::Handler) && ::Rack.release >= '3' ? ::Rackup::Handler : ::Rack::Handler
+    end
+
   private
     def setup_rack_handler
       # First try to set Rack handler via a special hook we honor
@@ -284,24 +292,25 @@ module Resque
           handler = nil
           @app.server.each do |server|
             begin
-              handler = Rack::Handler.get(server)
+              handler = self.class.get_rackup_or_rack_handler.get(server)
               break
             rescue LoadError, NameError
               next
             end
           end
-          raise 'No available Rack handler (e.g. WEBrick, Thin, Puma, etc.) was found.' if handler.nil?
+          raise 'No available Rack handler (e.g. WEBrick, Puma, etc.) was found.' if handler.nil?
 
           handler
 
         # :server might be set explicitly to a single option like "mongrel"
         else
-          Rack::Handler.get(@app.server)
+          self.class.get_rackup_or_rack_handler.get(@app.server)
         end
 
-      # If all else fails, we'll use Thin
+      # If all else fails, we'll use Puma
       else
-        JRUBY ? Rack::Handler::WEBrick : Rack::Handler::Thin
+        rack_server = JRUBY ? 'webrick' : 'puma'
+        self.class.get_rackup_or_rack_handler.get(rack_server)
       end
     end
 

data/lib/resque/worker.rb

@@ -143,6 +143,7 @@ module Resque
     def initialize(*queues)
       @shutdown = nil
       @paused = nil
+      @cached_pause_value = nil
       @before_first_fork_hook_ran = false
 
       @heartbeat_thread = nil
@@ -237,20 +238,43 @@ module Resque
     # The default is 5 seconds, but for a semi-active site you may
     # want to use a smaller value.
     #
+    # Can also be passed 3 interval floats: max, min, backoff.
+    # The actual sleep amount will float between these min/max
+    # bounds.
+    #
+    # If a job is picked up we sleep for the minimum amount of
+    # time, but as the queues empty we increase the backoff to the
+    # max interval. This prevents idle workers from hammering the
+    # redis server with lpop requests.
+    #
     # Also accepts a block which will be passed the job as soon as it
     # has completed processing. Useful for testing.
-    def work(interval = 5.0, &block)
-      interval = Float(interval)
+    def work(interval = 5.0,
+             min_interval: nil,     # defaults to interval
+             max_interval: nil,     # defaults to interval
+             backoff_interval: nil, # defaults to 0.1
+             &block)
+      interval = Float(interval || 5.0)
+      max_interval = Float(max_interval || interval)
+      min_interval = Float(min_interval || interval).clamp(nil, max_interval)
+      backoff_interval = Float(backoff_interval || 0.1).clamp(nil, max_interval)
+      interval = interval.clamp(min_interval, max_interval)
       startup
 
       loop do
         break if shutdown?
 
-        unless work_one_job(&block)
+        if work_one_job(&block)
+          interval = min_interval
+        else
           state_change
           break if interval.zero?
+
+          interval = (interval + backoff_interval)
+            .clamp(nil, max_interval)
+
           log_with_severity :debug, "Sleeping for #{interval} seconds"
-          procline paused? ? "Paused" : "Waiting for #{queues.join(',')}"
+          procline @cached_pause_value ? "Paused" : "Waiting for #{queues.join(',')}"
           sleep interval
         end
       end
@@ -260,6 +284,7 @@ module Resque
     rescue Exception => exception
       return if exception.class == SystemExit && !@child && run_at_exit_hooks
       log_with_severity :error, "Failed to start worker : #{exception.inspect}"
+      log_with_severity :error, exception.backtrace.join("\n")
       unregister_worker(exception)
       run_hook :worker_exit
     end
@@ -441,6 +466,8 @@ module Resque
     def shutdown
       log_with_severity :info, 'Exiting...'
       @shutdown = true
+      run_hook :shutdown
+      true
     end
 
     # Kill the child and shutdown immediately.
@@ -579,7 +606,7 @@ module Resque
 
     # are we paused?
     def paused?
-      @paused || redis.get('pause-all-workers').to_s.strip.downcase == 'true'
+      @cached_pause_value = @paused || redis.get('pause-all-workers').to_s.strip.downcase == 'true'
     end
 
     # Stop processing jobs after the current one has completed (if we're

data/lib/resque.rb

@@ -316,6 +316,20 @@ module Resque
     register_hook(:worker_exit, block)
   end
 
+  # The `shutdown` hook will be run in the **child** process
+  # when the worker has received a signal to stop processing
+  #
+  # Call with a block to register a hook.
+  # Call with no arguments to return all registered hooks.
+  def shutdown(&block)
+    block ? register_hook(:shutdown, block) : hooks(:shutdown)
+  end
+
+  # Register a shutdown proc.
+  def shutdown=(block)
+    register_hook(:shutdown, block)
+  end
+
   def to_s
     "Resque Client connected to #{redis_id}"
   end

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: resque
 version: !ruby/object:Gem::Version
-  version: 2.7.0
+  version: 3.0.0
 platform: ruby
 authors:
 - Chris Wanstrath
@@ -11,8 +11,36 @@ authors:
 autorequire: 
 bindir: bin
 cert_chain: []
-date: 2024-12-30 00:00:00.000000000 Z
+date: 2026-01-12 00:00:00.000000000 Z
 dependencies:
+- !ruby/object:Gem::Dependency
+  name: base64
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: '0.1'
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: '0.1'
+- !ruby/object:Gem::Dependency
+  name: logger
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
 - !ruby/object:Gem::Dependency
   name: redis-namespace
   requirement: !ruby/object:Gem::Requirement
@@ -27,20 +55,34 @@ dependencies:
     - - "~>"
       - !ruby/object:Gem::Version
         version: '1.6'
+- !ruby/object:Gem::Dependency
+  name: redis
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '4.0'
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '4.0'
 - !ruby/object:Gem::Dependency
   name: sinatra
   requirement: !ruby/object:Gem::Requirement
     requirements:
     - - ">="
       - !ruby/object:Gem::Version
-        version: 0.9.2
+        version: '2.0'
   type: :runtime
   prerelease: false
   version_requirements: !ruby/object:Gem::Requirement
     requirements:
     - - ">="
       - !ruby/object:Gem::Version
-        version: 0.9.2
+        version: '2.0'
 - !ruby/object:Gem::Dependency
   name: multi_json
   requirement: !ruby/object:Gem::Requirement
@@ -70,7 +112,7 @@ dependencies:
       - !ruby/object:Gem::Version
         version: '1'
 - !ruby/object:Gem::Dependency
-  name: thin
+  name: puma
   requirement: !ruby/object:Gem::Requirement
     requirements:
     - - ">="
@@ -127,6 +169,7 @@ files:
 - Rakefile
 - bin/resque
 - bin/resque-web
+- lib/active_job/queue_adapters/resque_adapter.rb
 - lib/resque.rb
 - lib/resque/data_store.rb
 - lib/resque/errors.rb
@@ -195,7 +238,7 @@ required_ruby_version: !ruby/object:Gem::Requirement
   requirements:
   - - ">="
     - !ruby/object:Gem::Version
-      version: 2.3.0
+      version: 3.0.0
 required_rubygems_version: !ruby/object:Gem::Requirement
   requirements:
   - - ">="