ddtrace 0.37.0 → 0.42.0

data/CHANGELOG.md

@@ -2,6 +2,189 @@
 
 ## [Unreleased]
 
+## [0.42.0] - 2020-10-21
+
+Release notes: https://github.com/DataDog/dd-trace-rb/releases/tag/v0.42.0
+
+Git diff: https://github.com/DataDog/dd-trace-rb/compare/v0.41.0...v0.42.0
+
+### Added
+
+- Increase Resque support to include 2.0  (#1213) (@erict-square)
+
+- Improve gRPC Propagator to support metadata array values (#1203) (@mdehoog)
+
+- Add CPU benchmarks, diagnostics to tests (#1188, #1198)
+
+- Access active correlation by Thread (#1200)
+
+- Improve delayed_job instrumentation (#1187) (@norbertnytko)
+
+### Changed
+
+### Fixed
+
+- Improve Rails `log_injection` option to support more Lograge formats (#1210) (@Supy)
+
+- Fix Changelog (#1199) (@y-yagi)
+
+### Refactored
+
+- Refactor Trace buffer into multiple components (#1195)
+
+## [0.41.0] - 2020-09-30
+
+Release notes: https://github.com/DataDog/dd-trace-rb/releases/tag/v0.41.0
+
+Git diff: https://github.com/DataDog/dd-trace-rb/compare/v0.40.0...v0.41.0
+
+### Added
+
+- Improve duration counting using monotonic clock (#424, #1173) (@soulcutter)
+
+### Changed
+
+- Add peer.service tag to external services and skip tagging external services with language tag for runtime metrics (#934, #935, #1180)
+  - This helps support the way runtime metrics are associated with spans in the UI.
+- Faster TraceBuffer for CRuby (#1172)
+- Reduce memory usage during gem startup (#1090)
+- Reduce memory usage of the HTTP transport (#1165)
+
+### Fixed
+
+- Improved prepared statement support for Sequel  integrations (#1186)
+- Fix Sequel instrumentation when executing literal strings (#1185) (@matchbookmac)
+- Remove explicit `Logger` class verification (#1181) (@bartekbsh)
+  - This allows users to pass in a custom logger that does not inherit from `Logger` class.
+- Correct tracer buffer metric counting (#1182)
+- Fix Span#pretty_print for empty duration (#1183)
+
+### Refactored
+
+- Improvements to test suite & CI (#1179, #1184, #1177, #1178, #1176)
+- Reduce generated Span ID range to fit in Fixnum (#1189)
+
+## [0.40.0] - 2020-09-08
+
+Release notes: https://github.com/DataDog/dd-trace-rb/releases/tag/v0.40.0
+
+Git diff: https://github.com/DataDog/dd-trace-rb/compare/v0.39.0...v0.40.0
+
+### Added
+
+- Rails `log_injection` option to auto enable log correlation (#1157)
+- Que integration (#1141, #1146) (@hs-bguven)
+- `Components#startup!` hook (#1151)
+- Code coverage report (#1159)
+  - Every commit now has a `coverage` CI step that contains the code coverage report. This report can be found in the `Artifacts` tab of that CI step, under `coverage/index.html`.
+
+### Changed
+
+- Use a single top level span for Racecar consumers (#1150) (@dasch)
+
+### Fixed
+
+- Sinatra nested modular applications possibly leaking spans (#1035, #1145)
+  
+  * **BREAKING** for nested modular Sinatra applications only:
+    ```ruby
+    class Nested < Sinatra::Base
+    end
+    
+    class TopLevel < Sinatra::Base
+      use Nested # Nesting happens here
+    end
+    ```
+  * Non-breaking for classic applications nor modular non-nested applications.
+  
+  Fixes issues introduced by #1015 (in 0.35.0), when we first introduced Sinatra support for modular applications.
+  
+  The main issue we had to solve for modular support is how to handle nested applications, as only one application is actually responsible for handling the route. A naive implementation would cause the creation of nested `sinatra.request` spans, even for applications that did not handle the request. This is technically correct, as Sinatra is traversing that middleware, accruing overhead, but that does not aligned with our existing behavior of having a single `sinatra.request` span.
+  
+  While trying to achieve backwards-compatibility, we had to resort to a solution that turned out brittle: `sinatra.request` spans had to start in one middleware level and finished it in another. This allowed us to only capture the `sinatra.request` for the matching route, and skip the non-matching one. This caused unexpected issues on some user setups, specially around Sinatra middleware that created spans in between the initialization and closure of `sinatra.request` spans.
+  
+  This change now address these implementation issues by creating multiple `sinatra.request`, one for each traversed Sinatra application, even non-matching ones. This instrumentation is more correct, but at the cost of being a breaking change for nested modular applications.
+  
+  Please see #1145 for more information, and example screenshots on how traces for affected applications will look like.
+
+- Rack/Rails span error propagation with `rescue_from` (#1155, #1162)
+- Prevent logger recursion during startup (#1158)
+- Race condition on new worker classes (#1154)
+  - These classes represent future work, and not being used at the moment.
+
+### Refactored
+
+- Run CI tests in parallel (#1156)
+- Migrate minitest tests to RSpec (#1127, #1128, #1133, #1149, #1152, #1153)
+- Improvements to test suite (#1134, #1148, #1163)
+- Improvements to documentation (#1138)
+
+### Removed
+
+- **Ruby 1.9 support ended, as it transitions from Maintenance to End-Of-Life (#1137)**
+- GitLab status check when not applicable (#1160)
+  - Allows for PRs pass all status checks once again. Before this change, a `dd-gitlab/copy_to_s3` check would never leave the "Pending" status. This check tracks the deployment of a commit to an internal testing platform, which currently only happens on `master` branch or when manually triggered internally.
+
+## [0.39.0] - 2020-08-05
+
+Release notes: https://github.com/DataDog/dd-trace-rb/releases/tag/v0.39.0
+
+Git diff: https://github.com/DataDog/dd-trace-rb/compare/v0.38.0...v0.39.0
+
+### Added
+
+- JRuby 9.2 support (#1126)
+- Sneakers integration (#1121) (@janz93)
+
+### Changed
+
+- Consistent environment variables across languages (#1115)
+- Default logger level from WARN to INFO (#1120) (@gingerlime)
+  - This change also reduces the startup environment log message to INFO level (#1104)
+
+### Fixed
+
+- HTTP::StateError on error responses for http.rb (#1116, #1122) (@evan-waters)
+- Startup log error when using the test adapter (#1125, #1131) (@benhutton)
+- Warning message for Faraday < 1.0 (#1129) (@fledman, @tjwp)
+- Propagate Rails error message to Rack span (#1124)
+
+### Refactored
+
+- Improved ActiveRecord documentation (#1119)
+- Improvements to test suite (#1105, #1118)
+
+## [0.38.0] - 2020-07-13
+
+Release notes: https://github.com/DataDog/dd-trace-rb/releases/tag/v0.38.0
+
+Git diff: https://github.com/DataDog/dd-trace-rb/compare/v0.37.0...v0.38.0
+
+### Added
+
+- http.rb integration (#529, #853)
+- Kafka integration (#1070) (@tjwp)
+- Span#set_tags (#1081) (@DocX)
+- retry_count tag for Sidekiq jobs (#1089) (@elyalvarado)
+- Startup environment log (#1104, #1109)
+- DD_SITE and DD_API_KEY configuration (#1107)
+
+### Changed
+
+- Auto instrument Faraday default connection (#1057)
+- Sidekiq client middleware is now the same for client and server (#1099) (@drcapulet)
+- Single pass SpanFilter (#1071) (@tjwp)
+
+### Fixed
+
+- Ensure fatal exceptions are propagated (#1100)
+- Respect child_of: option in Tracer#trace (#1082) (@DocX)
+- Improve Writer thread safety (#1091) (@fledman)
+
+### Refactored
+
+- Improvements to test suite (#1092, #1103)
+
 ## [0.37.0] - 2020-06-24
 
 Release notes: https://github.com/DataDog/dd-trace-rb/releases/tag/v0.37.0
@@ -1274,7 +1457,11 @@ Release notes: https://github.com/DataDog/dd-trace-rb/releases/tag/v0.3.1
 
 Git diff: https://github.com/DataDog/dd-trace-rb/compare/v0.3.0...v0.3.1
 
-[Unreleased]: https://github.com/DataDog/dd-trace-rb/compare/v0.37.0...master
+[Unreleased]: https://github.com/DataDog/dd-trace-rb/compare/v0.41.0...master
+[0.41.0]: https://github.com/DataDog/dd-trace-rb/compare/v0.40.0...v0.41.0
+[0.40.0]: https://github.com/DataDog/dd-trace-rb/compare/v0.39.0...v0.40.0
+[0.39.0]: https://github.com/DataDog/dd-trace-rb/compare/v0.38.0...v0.39.0
+[0.38.0]: https://github.com/DataDog/dd-trace-rb/compare/v0.37.0...v0.38.0
 [0.37.0]: https://github.com/DataDog/dd-trace-rb/compare/v0.36.0...v0.37.0
 [0.36.0]: https://github.com/DataDog/dd-trace-rb/compare/v0.35.2...v0.36.0
 [0.35.2]: https://github.com/DataDog/dd-trace-rb/compare/v0.35.1...v0.35.2

data/CONTRIBUTING.md

@@ -56,7 +56,7 @@ We welcome code contributions to the library, which you can [submit as a pull re
 2. **Make any changes** for your patch.
 3. **Write tests** that demonstrate how the feature works or how the bug is fixed.
 4. **Update any documentation** such as `docs/GettingStarted.md`, especially for new features.
-5. **Submit the pull request** from your fork back to https://github.com/DataDog/dd-trace-rb. Bugs should merge back to `master`, and new features should merge back to the latest `dev` branch (e.g. `0.24-dev`).
+5. **Submit the pull request** from your fork back to the latest revision of the `master` branch on https://github.com/DataDog/dd-trace-rb.
 
 The pull request will be run through our CI pipeline, and a project member will review the changes with you. At a minimum, to be accepted and merged, pull requests must:
 

data/Rakefile

@@ -95,9 +95,12 @@ namespace :spec do
     :graphql,
     :grpc,
     :http,
+    :httprb,
+    :kafka,
     :mongodb,
     :mysql2,
     :presto,
+    :que,
     :racecar,
     :rack,
     :rake,
@@ -108,6 +111,7 @@ namespace :spec do
     :shoryuken,
     :sidekiq,
     :sinatra,
+    :sneakers,
     :sucker_punch,
     :suite
   ].each do |contrib|
@@ -121,7 +125,7 @@ end
 namespace :test do
   task all: [:main,
              :rails,
-             :sidekiq, :monkey]
+             :monkey]
 
   Rake::TestTask.new(:main) do |t|
     t.libs << %w[test lib]
@@ -139,9 +143,6 @@ namespace :test do
   end
 
   [
-    :grape,
-    :sidekiq,
-    :sucker_punch
   ].each do |contrib|
     Rake::TestTask.new(contrib) do |t|
       t.libs << %w[test lib]
@@ -183,6 +184,21 @@ task :'release:docs' => :docs do
   sh "aws s3 cp --recursive doc/ s3://#{S3_BUCKET}/#{S3_DIR}/docs/"
 end
 
+# Declare a command for execution.
+# Jobs are parallelized if running in CI.
+def declare(*args)
+  total_executors = ENV.key?('CIRCLE_NODE_TOTAL') ? ENV['CIRCLE_NODE_TOTAL'].to_i : nil
+  current_executor = ENV.key?('CIRCLE_NODE_INDEX') ? ENV['CIRCLE_NODE_INDEX'].to_i : nil
+
+  if total_executors && current_executor && total_executors > 1
+    @execution_count ||= 0
+    @execution_count += 1
+    sh(*args) if @execution_count % total_executors == current_executor
+  else
+    sh(*args)
+  end
+end
+
 desc 'CI task; it runs all tests for current version of Ruby'
 task :ci do
   if Gem::Version.new(RUBY_VERSION) < Gem::Version.new(Datadog::VERSION::MINIMUM_RUBY_VERSION)
@@ -190,561 +206,581 @@ task :ci do
   elsif Gem::Version.new('2.0.0') <= Gem::Version.new(RUBY_VERSION) \
         && Gem::Version.new(RUBY_VERSION) < Gem::Version.new('2.1.0')
     # Main library
-    sh 'bundle exec rake test:main'
-    sh 'bundle exec rake spec:main'
-    sh 'bundle exec rake spec:contrib'
-    # Benchmarks
-    sh 'bundle exec rake spec:benchmark'
+    declare 'bundle exec rake test:main'
+    declare 'bundle exec rake spec:main'
+    declare 'bundle exec rake spec:contrib'
 
     if RUBY_PLATFORM != 'java'
       # Contrib minitests
-      sh 'bundle exec appraisal contrib-old rake test:monkey'
-      sh 'bundle exec appraisal contrib-old rake test:sidekiq'
-      sh 'bundle exec appraisal contrib-old rake test:sucker_punch'
+      declare 'bundle exec appraisal contrib-old rake test:monkey'
       # Contrib specs
-      sh 'bundle exec appraisal contrib-old rake spec:active_model_serializers'
-      sh 'bundle exec appraisal contrib-old rake spec:active_record'
-      sh 'bundle exec appraisal contrib-old rake spec:active_support'
-      sh 'bundle exec appraisal contrib-old rake spec:aws'
-      sh 'bundle exec appraisal contrib-old rake spec:concurrent_ruby'
-      sh 'bundle exec appraisal contrib-old rake spec:dalli'
-      sh 'bundle exec appraisal contrib-old rake spec:delayed_job'
-      sh 'bundle exec appraisal contrib-old rake spec:elasticsearch'
-      sh 'bundle exec appraisal contrib-old rake spec:ethon'
-      sh 'bundle exec appraisal contrib-old rake spec:excon'
-      sh 'bundle exec appraisal contrib-old rake spec:faraday'
-      sh 'bundle exec appraisal contrib-old rake spec:http'
-      sh 'bundle exec appraisal contrib-old rake spec:mongodb'
-      sh 'bundle exec appraisal contrib-old rake spec:mysql2'
-      sh 'bundle exec appraisal contrib-old rake spec:rack'
-      sh 'bundle exec appraisal contrib-old rake spec:rake'
-      sh 'bundle exec appraisal contrib-old rake spec:redis'
-      sh 'bundle exec appraisal contrib-old rake spec:resque'
-      sh 'bundle exec appraisal contrib-old rake spec:rest_client'
-      sh 'bundle exec appraisal contrib-old rake spec:sequel'
-      sh 'bundle exec appraisal contrib-old rake spec:sidekiq'
-      sh 'bundle exec appraisal contrib-old rake spec:sinatra'
-      sh 'bundle exec appraisal contrib-old rake spec:sucker_punch'
-      sh 'bundle exec appraisal contrib-old rake spec:suite'
+      declare 'bundle exec appraisal contrib-old rake spec:active_model_serializers'
+      declare 'bundle exec appraisal contrib-old rake spec:active_record'
+      declare 'bundle exec appraisal contrib-old rake spec:active_support'
+      declare 'bundle exec appraisal contrib-old rake spec:aws'
+      declare 'bundle exec appraisal contrib-old rake spec:concurrent_ruby'
+      declare 'bundle exec appraisal contrib-old rake spec:dalli'
+      declare 'bundle exec appraisal contrib-old rake spec:delayed_job'
+      declare 'bundle exec appraisal contrib-old rake spec:elasticsearch'
+      declare 'bundle exec appraisal contrib-old rake spec:ethon'
+      declare 'bundle exec appraisal contrib-old rake spec:excon'
+      declare 'bundle exec appraisal contrib-old rake spec:faraday'
+      declare 'bundle exec appraisal contrib-old rake spec:http'
+      declare 'bundle exec appraisal contrib-old rake spec:httprb'
+      declare 'bundle exec appraisal contrib-old rake spec:mongodb'
+      declare 'bundle exec appraisal contrib-old rake spec:mysql2'
+      declare 'bundle exec appraisal contrib-old rake spec:rack'
+      declare 'bundle exec appraisal contrib-old rake spec:rake'
+      declare 'bundle exec appraisal contrib-old rake spec:redis'
+      declare 'bundle exec appraisal contrib-old rake spec:resque'
+      declare 'bundle exec appraisal contrib-old rake spec:rest_client'
+      declare 'bundle exec appraisal contrib-old rake spec:sequel'
+      declare 'bundle exec appraisal contrib-old rake spec:sidekiq'
+      declare 'bundle exec appraisal contrib-old rake spec:sinatra'
+      declare 'bundle exec appraisal contrib-old rake spec:sucker_punch'
+      declare 'bundle exec appraisal contrib-old rake spec:suite'
       # Rails minitests
-      sh 'bundle exec appraisal rails30-postgres rake test:rails'
-      sh 'bundle exec appraisal rails30-postgres rake spec:railsdisableenv'
-      sh 'bundle exec appraisal rails32-mysql2 rake test:rails'
-      sh 'bundle exec appraisal rails32-postgres rake test:rails'
-      sh 'bundle exec appraisal rails32-postgres-redis rake spec:railsredis'
-      sh 'bundle exec appraisal rails32-postgres rake spec:railsdisableenv'
+      declare 'bundle exec appraisal rails30-postgres rake test:rails'
+      declare 'bundle exec appraisal rails30-postgres rake spec:railsdisableenv'
+      declare 'bundle exec appraisal rails32-mysql2 rake test:rails'
+      declare 'bundle exec appraisal rails32-postgres rake test:rails'
+      declare 'bundle exec appraisal rails32-postgres-redis rake spec:railsredis'
+      declare 'bundle exec appraisal rails32-postgres rake spec:railsdisableenv'
       # Rails specs
-      sh 'bundle exec appraisal rails30-postgres rake spec:rails'
-      sh 'bundle exec appraisal rails32-mysql2 rake spec:rails'
-      sh 'bundle exec appraisal rails32-postgres rake spec:rails'
+      declare 'bundle exec appraisal rails30-postgres rake spec:rails'
+      declare 'bundle exec appraisal rails32-mysql2 rake spec:rails'
+      declare 'bundle exec appraisal rails32-postgres rake spec:rails'
       # Rails suite specs
-      sh 'bundle exec appraisal rails32-postgres rake spec:action_pack'
-      sh 'bundle exec appraisal rails32-postgres rake spec:action_view'
-      sh 'bundle exec appraisal rails32-mysql2 rake spec:active_record'
-      sh 'bundle exec appraisal rails32-postgres rake spec:active_support'
+      declare 'bundle exec appraisal rails32-postgres rake spec:action_pack'
+      declare 'bundle exec appraisal rails32-postgres rake spec:action_view'
+      declare 'bundle exec appraisal rails32-mysql2 rake spec:active_record'
+      declare 'bundle exec appraisal rails32-postgres rake spec:active_support'
     end
   elsif Gem::Version.new('2.1.0') <= Gem::Version.new(RUBY_VERSION) \
         && Gem::Version.new(RUBY_VERSION) < Gem::Version.new('2.2.0')
     # Main library
-    sh 'bundle exec rake test:main'
-    sh 'bundle exec rake spec:main'
-    sh 'bundle exec rake spec:contrib'
-    sh 'bundle exec rake spec:opentracer'
-    # Benchmarks
-    sh 'bundle exec rake spec:benchmark'
+    declare 'bundle exec rake test:main'
+    declare 'bundle exec rake spec:main'
+    declare 'bundle exec rake spec:contrib'
+    declare 'bundle exec rake spec:opentracer'
 
     if RUBY_PLATFORM != 'java'
       # Contrib minitests
-      sh 'bundle exec appraisal contrib-old rake test:monkey'
-      sh 'bundle exec appraisal contrib-old rake test:sidekiq'
-      sh 'bundle exec appraisal contrib-old rake test:sucker_punch'
+      declare 'bundle exec appraisal contrib-old rake test:monkey'
       # Contrib specs
-      sh 'bundle exec appraisal contrib-old rake spec:active_model_serializers'
-      sh 'bundle exec appraisal contrib-old rake spec:active_record'
-      sh 'bundle exec appraisal contrib-old rake spec:active_support'
-      sh 'bundle exec appraisal contrib-old rake spec:aws'
-      sh 'bundle exec appraisal contrib-old rake spec:concurrent_ruby'
-      sh 'bundle exec appraisal contrib-old rake spec:dalli'
-      sh 'bundle exec appraisal contrib-old rake spec:delayed_job'
-      sh 'bundle exec appraisal contrib-old rake spec:elasticsearch'
-      sh 'bundle exec appraisal contrib-old rake spec:ethon'
-      sh 'bundle exec appraisal contrib-old rake spec:excon'
-      sh 'bundle exec appraisal contrib-old rake spec:faraday'
-      sh 'bundle exec appraisal contrib-old rake spec:http'
-      sh 'bundle exec appraisal contrib-old rake spec:mongodb'
-      sh 'bundle exec appraisal contrib-old rake spec:mysql2'
-      sh 'bundle exec appraisal contrib-old rake spec:presto'
-      sh 'bundle exec appraisal contrib-old rake spec:rack'
-      sh 'bundle exec appraisal contrib-old rake spec:rake'
-      sh 'bundle exec appraisal contrib-old rake spec:redis'
-      sh 'bundle exec appraisal contrib-old rake spec:resque'
-      sh 'bundle exec appraisal contrib-old rake spec:rest_client'
-      sh 'bundle exec appraisal contrib-old rake spec:sequel'
-      sh 'bundle exec appraisal contrib-old rake spec:sidekiq'
-      sh 'bundle exec appraisal contrib-old rake spec:sinatra'
-      sh 'bundle exec appraisal contrib-old rake spec:sucker_punch'
-      sh 'bundle exec appraisal contrib-old rake spec:suite'
+      declare 'bundle exec appraisal contrib-old rake spec:active_model_serializers'
+      declare 'bundle exec appraisal contrib-old rake spec:active_record'
+      declare 'bundle exec appraisal contrib-old rake spec:active_support'
+      declare 'bundle exec appraisal contrib-old rake spec:aws'
+      declare 'bundle exec appraisal contrib-old rake spec:concurrent_ruby'
+      declare 'bundle exec appraisal contrib-old rake spec:dalli'
+      declare 'bundle exec appraisal contrib-old rake spec:delayed_job'
+      declare 'bundle exec appraisal contrib-old rake spec:elasticsearch'
+      declare 'bundle exec appraisal contrib-old rake spec:ethon'
+      declare 'bundle exec appraisal contrib-old rake spec:excon'
+      declare 'bundle exec appraisal contrib-old rake spec:faraday'
+      declare 'bundle exec appraisal contrib-old rake spec:http'
+      declare 'bundle exec appraisal contrib-old rake spec:httprb'
+      declare 'bundle exec appraisal contrib-old rake spec:mongodb'
+      declare 'bundle exec appraisal contrib-old rake spec:mysql2'
+      declare 'bundle exec appraisal contrib-old rake spec:presto'
+      declare 'bundle exec appraisal contrib-old rake spec:rack'
+      declare 'bundle exec appraisal contrib-old rake spec:rake'
+      declare 'bundle exec appraisal contrib-old rake spec:redis'
+      declare 'bundle exec appraisal contrib-old rake spec:resque'
+      declare 'bundle exec appraisal contrib-old rake spec:rest_client'
+      declare 'bundle exec appraisal contrib-old rake spec:sequel'
+      declare 'bundle exec appraisal contrib-old rake spec:sidekiq'
+      declare 'bundle exec appraisal contrib-old rake spec:sinatra'
+      declare 'bundle exec appraisal contrib-old rake spec:sucker_punch'
+      declare 'bundle exec appraisal contrib-old rake spec:suite'
       # Rails minitests
-      sh 'bundle exec appraisal rails30-postgres rake test:rails'
-      sh 'bundle exec appraisal rails30-postgres rake spec:railsdisableenv'
-      sh 'bundle exec appraisal rails32-mysql2 rake test:rails'
-      sh 'bundle exec appraisal rails32-postgres rake test:rails'
-      sh 'bundle exec appraisal rails32-postgres-redis rake spec:railsredis'
-      sh 'bundle exec appraisal rails32-postgres rake spec:railsdisableenv'
-      sh 'bundle exec appraisal rails4-mysql2 rake test:rails'
-      sh 'bundle exec appraisal rails4-postgres rake test:rails'
-      sh 'bundle exec appraisal rails4-postgres-redis rake spec:railsredis'
-      sh 'bundle exec appraisal rails4-postgres rake spec:railsdisableenv'
+      declare 'bundle exec appraisal rails30-postgres rake test:rails'
+      declare 'bundle exec appraisal rails30-postgres rake spec:railsdisableenv'
+      declare 'bundle exec appraisal rails32-mysql2 rake test:rails'
+      declare 'bundle exec appraisal rails32-postgres rake test:rails'
+      declare 'bundle exec appraisal rails32-postgres-redis rake spec:railsredis'
+      declare 'bundle exec appraisal rails32-postgres rake spec:railsdisableenv'
+      declare 'bundle exec appraisal rails4-mysql2 rake test:rails'
+      declare 'bundle exec appraisal rails4-postgres rake test:rails'
+      declare 'bundle exec appraisal rails4-postgres-redis rake spec:railsredis'
+      declare 'bundle exec appraisal rails4-postgres rake spec:railsdisableenv'
       # Rails specs
-      sh 'bundle exec appraisal rails30-postgres rake spec:rails'
-      sh 'bundle exec appraisal rails32-mysql2 rake spec:rails'
-      sh 'bundle exec appraisal rails32-postgres rake spec:rails'
-      sh 'bundle exec appraisal rails4-mysql2 rake spec:rails'
-      sh 'bundle exec appraisal rails4-postgres rake spec:rails'
+      declare 'bundle exec appraisal rails30-postgres rake spec:rails'
+      declare 'bundle exec appraisal rails32-mysql2 rake spec:rails'
+      declare 'bundle exec appraisal rails32-postgres rake spec:rails'
+      declare 'bundle exec appraisal rails4-mysql2 rake spec:rails'
+      declare 'bundle exec appraisal rails4-postgres rake spec:rails'
       # Rails suite specs
-      sh 'bundle exec appraisal rails32-postgres rake spec:action_pack'
-      sh 'bundle exec appraisal rails32-postgres rake spec:action_view'
-      sh 'bundle exec appraisal rails32-mysql2 rake spec:active_record'
-      sh 'bundle exec appraisal rails32-postgres rake spec:active_support'
+      declare 'bundle exec appraisal rails32-postgres rake spec:action_pack'
+      declare 'bundle exec appraisal rails32-postgres rake spec:action_view'
+      declare 'bundle exec appraisal rails32-mysql2 rake spec:active_record'
+      declare 'bundle exec appraisal rails32-postgres rake spec:active_support'
     end
   elsif Gem::Version.new('2.2.0') <= Gem::Version.new(RUBY_VERSION)\
         && Gem::Version.new(RUBY_VERSION) < Gem::Version.new('2.3.0')
     # Main library
-    sh 'bundle exec rake test:main'
-    sh 'bundle exec rake spec:main'
-    sh 'bundle exec rake spec:contrib'
-    sh 'bundle exec rake spec:opentracer'
-    # Benchmarks
-    sh 'bundle exec rake spec:benchmark'
+    declare 'bundle exec rake test:main'
+    declare 'bundle exec rake spec:main'
+    declare 'bundle exec rake spec:contrib'
+    declare 'bundle exec rake spec:opentracer'
 
     if RUBY_PLATFORM != 'java'
       # Contrib minitests
-      sh 'bundle exec appraisal contrib rake test:grape'
-      sh 'bundle exec appraisal contrib rake test:sidekiq'
-      sh 'bundle exec appraisal contrib rake test:sucker_punch'
       # Contrib specs
-      sh 'bundle exec appraisal contrib rake spec:action_pack'
-      sh 'bundle exec appraisal contrib rake spec:action_view'
-      sh 'bundle exec appraisal contrib rake spec:active_model_serializers'
-      sh 'bundle exec appraisal contrib rake spec:active_record'
-      sh 'bundle exec appraisal contrib rake spec:active_support'
-      sh 'bundle exec appraisal contrib rake spec:aws'
-      sh 'bundle exec appraisal contrib rake spec:concurrent_ruby'
-      sh 'bundle exec appraisal contrib rake spec:dalli'
-      sh 'bundle exec appraisal contrib rake spec:delayed_job'
-      sh 'bundle exec appraisal contrib rake spec:elasticsearch'
-      sh 'bundle exec appraisal contrib rake spec:ethon'
-      sh 'bundle exec appraisal contrib rake spec:excon'
-      sh 'bundle exec appraisal contrib rake spec:faraday'
-      sh 'bundle exec appraisal contrib rake spec:grape'
-      sh 'bundle exec appraisal contrib rake spec:graphql'
-      sh 'bundle exec appraisal contrib rake spec:grpc'
-      sh 'bundle exec appraisal contrib rake spec:http'
-      sh 'bundle exec appraisal contrib rake spec:mongodb'
-      sh 'bundle exec appraisal contrib rake spec:mysql2'
-      sh 'bundle exec appraisal contrib rake spec:presto'
-      sh 'bundle exec appraisal contrib rake spec:racecar'
-      sh 'bundle exec appraisal contrib rake spec:rack'
-      sh 'bundle exec appraisal contrib rake spec:rake'
-      sh 'bundle exec appraisal contrib rake spec:redis'
-      sh 'bundle exec appraisal contrib rake spec:resque'
-      sh 'bundle exec appraisal contrib rake spec:rest_client'
-      sh 'bundle exec appraisal contrib rake spec:sequel'
-      sh 'bundle exec appraisal contrib rake spec:shoryuken'
-      sh 'bundle exec appraisal contrib rake spec:sidekiq'
-      sh 'bundle exec appraisal contrib rake spec:sinatra'
-      sh 'bundle exec appraisal contrib rake spec:sucker_punch'
-      sh 'bundle exec appraisal contrib rake spec:suite'
+      declare 'bundle exec appraisal contrib rake spec:action_pack'
+      declare 'bundle exec appraisal contrib rake spec:action_view'
+      declare 'bundle exec appraisal contrib rake spec:active_model_serializers'
+      declare 'bundle exec appraisal contrib rake spec:active_record'
+      declare 'bundle exec appraisal contrib rake spec:active_support'
+      declare 'bundle exec appraisal contrib rake spec:aws'
+      declare 'bundle exec appraisal contrib rake spec:concurrent_ruby'
+      declare 'bundle exec appraisal contrib rake spec:dalli'
+      declare 'bundle exec appraisal contrib rake spec:delayed_job'
+      declare 'bundle exec appraisal contrib rake spec:elasticsearch'
+      declare 'bundle exec appraisal contrib rake spec:ethon'
+      declare 'bundle exec appraisal contrib rake spec:excon'
+      declare 'bundle exec appraisal contrib rake spec:faraday'
+      declare 'bundle exec appraisal contrib rake spec:grape'
+      declare 'bundle exec appraisal contrib rake spec:graphql'
+      declare 'bundle exec appraisal contrib rake spec:grpc'
+      declare 'bundle exec appraisal contrib rake spec:http'
+      declare 'bundle exec appraisal contrib rake spec:httprb'
+      declare 'bundle exec appraisal contrib rake spec:mongodb'
+      declare 'bundle exec appraisal contrib rake spec:mysql2'
+      declare 'bundle exec appraisal contrib rake spec:presto'
+      declare 'bundle exec appraisal contrib rake spec:que'
+      declare 'bundle exec appraisal contrib rake spec:racecar'
+      declare 'bundle exec appraisal contrib rake spec:rack'
+      declare 'bundle exec appraisal contrib rake spec:rake'
+      declare 'bundle exec appraisal contrib rake spec:redis'
+      declare 'bundle exec appraisal contrib rake spec:resque'
+      declare 'bundle exec appraisal contrib rake spec:rest_client'
+      declare 'bundle exec appraisal contrib rake spec:sequel'
+      declare 'bundle exec appraisal contrib rake spec:shoryuken'
+      declare 'bundle exec appraisal contrib rake spec:sidekiq'
+      declare 'bundle exec appraisal contrib rake spec:sinatra'
+      declare 'bundle exec appraisal contrib rake spec:sneakers'
+      declare 'bundle exec appraisal contrib rake spec:sucker_punch'
+      declare 'bundle exec appraisal contrib rake spec:suite'
       # Rails minitests
-      sh 'bundle exec appraisal rails30-postgres rake test:rails'
-      sh 'bundle exec appraisal rails30-postgres rake spec:railsdisableenv'
-      sh 'bundle exec appraisal rails32-mysql2 rake test:rails'
-      sh 'bundle exec appraisal rails32-postgres rake test:rails'
-      sh 'bundle exec appraisal rails32-postgres-redis rake spec:railsredis'
-      sh 'bundle exec appraisal rails32-postgres rake spec:railsdisableenv'
-      sh 'bundle exec appraisal rails4-mysql2 rake test:rails'
-      sh 'bundle exec appraisal rails4-postgres rake test:rails'
-      sh 'bundle exec appraisal rails4-postgres-redis rake spec:railsredis'
-      sh 'bundle exec appraisal rails4-postgres rake spec:railsdisableenv'
-      sh 'bundle exec appraisal rails4-postgres-sidekiq rake spec:railsactivejob'
-      sh 'bundle exec appraisal rails5-mysql2 rake test:rails'
-      sh 'bundle exec appraisal rails5-postgres rake test:rails'
-      sh 'bundle exec appraisal rails5-postgres-redis rake spec:railsredis'
-      sh 'bundle exec appraisal rails5-postgres-redis-activesupport rake spec:railsredis'
-      sh 'bundle exec appraisal rails5-postgres-sidekiq rake spec:railsactivejob'
-      sh 'bundle exec appraisal rails5-postgres rake spec:railsdisableenv'
+      declare 'bundle exec appraisal rails30-postgres rake test:rails'
+      declare 'bundle exec appraisal rails30-postgres rake spec:railsdisableenv'
+      declare 'bundle exec appraisal rails32-mysql2 rake test:rails'
+      declare 'bundle exec appraisal rails32-postgres rake test:rails'
+      declare 'bundle exec appraisal rails32-postgres-redis rake spec:railsredis'
+      declare 'bundle exec appraisal rails32-postgres rake spec:railsdisableenv'
+      declare 'bundle exec appraisal rails4-mysql2 rake test:rails'
+      declare 'bundle exec appraisal rails4-postgres rake test:rails'
+      declare 'bundle exec appraisal rails4-postgres-redis rake spec:railsredis'
+      declare 'bundle exec appraisal rails4-postgres rake spec:railsdisableenv'
+      declare 'bundle exec appraisal rails4-postgres-sidekiq rake spec:railsactivejob'
+      declare 'bundle exec appraisal rails5-mysql2 rake test:rails'
+      declare 'bundle exec appraisal rails5-postgres rake test:rails'
+      declare 'bundle exec appraisal rails5-postgres-redis rake spec:railsredis'
+      declare 'bundle exec appraisal rails5-postgres-redis-activesupport rake spec:railsredis'
+      declare 'bundle exec appraisal rails5-postgres-sidekiq rake spec:railsactivejob'
+      declare 'bundle exec appraisal rails5-postgres rake spec:railsdisableenv'
       # Rails specs
-      sh 'bundle exec appraisal rails30-postgres rake spec:rails'
-      sh 'bundle exec appraisal rails32-mysql2 rake spec:rails'
-      sh 'bundle exec appraisal rails32-postgres rake spec:rails'
-      sh 'bundle exec appraisal rails4-mysql2 rake spec:rails'
-      sh 'bundle exec appraisal rails4-postgres rake spec:rails'
-      sh 'bundle exec appraisal rails5-mysql2 rake spec:rails'
-      sh 'bundle exec appraisal rails5-postgres rake spec:rails'
+      declare 'bundle exec appraisal rails30-postgres rake spec:rails'
+      declare 'bundle exec appraisal rails32-mysql2 rake spec:rails'
+      declare 'bundle exec appraisal rails32-postgres rake spec:rails'
+      declare 'bundle exec appraisal rails4-mysql2 rake spec:rails'
+      declare 'bundle exec appraisal rails4-postgres rake spec:rails'
+      declare 'bundle exec appraisal rails5-mysql2 rake spec:rails'
+      declare 'bundle exec appraisal rails5-postgres rake spec:rails'
     end
   elsif Gem::Version.new('2.3.0') <= Gem::Version.new(RUBY_VERSION) \
         && Gem::Version.new(RUBY_VERSION) < Gem::Version.new('2.4.0')
     # Main library
-    sh 'bundle exec rake test:main'
-    sh 'bundle exec rake spec:main'
-    sh 'bundle exec rake spec:contrib'
-    sh 'bundle exec rake spec:opentracer'
-    # Benchmarks
-    sh 'bundle exec rake spec:benchmark'
+    declare 'bundle exec rake test:main'
+    declare 'bundle exec rake spec:main'
+    declare 'bundle exec rake spec:contrib'
+    declare 'bundle exec rake spec:opentracer'
 
     if RUBY_PLATFORM != 'java'
       # Contrib minitests
-      sh 'bundle exec appraisal contrib rake test:grape'
-      sh 'bundle exec appraisal contrib rake test:sidekiq'
-      sh 'bundle exec appraisal contrib rake test:sucker_punch'
       # Contrib specs
-      sh 'bundle exec appraisal contrib rake spec:action_pack'
-      sh 'bundle exec appraisal contrib rake spec:action_view'
-      sh 'bundle exec appraisal contrib rake spec:active_model_serializers'
-      sh 'bundle exec appraisal contrib rake spec:active_record'
-      sh 'bundle exec appraisal contrib rake spec:active_support'
-      sh 'bundle exec appraisal contrib rake spec:aws'
-      sh 'bundle exec appraisal contrib rake spec:concurrent_ruby'
-      sh 'bundle exec appraisal contrib rake spec:dalli'
-      sh 'bundle exec appraisal contrib rake spec:delayed_job'
-      sh 'bundle exec appraisal contrib rake spec:elasticsearch'
-      sh 'bundle exec appraisal contrib rake spec:ethon'
-      sh 'bundle exec appraisal contrib rake spec:excon'
-      sh 'bundle exec appraisal contrib rake spec:faraday'
-      sh 'bundle exec appraisal contrib rake spec:grape'
-      sh 'bundle exec appraisal contrib rake spec:graphql'
-      sh 'bundle exec appraisal contrib rake spec:grpc'
-      sh 'bundle exec appraisal contrib rake spec:http'
-      sh 'bundle exec appraisal contrib rake spec:mongodb'
-      sh 'bundle exec appraisal contrib rake spec:mysql2'
-      sh 'bundle exec appraisal contrib rake spec:presto'
-      sh 'bundle exec appraisal contrib rake spec:racecar'
-      sh 'bundle exec appraisal contrib rake spec:rack'
-      sh 'bundle exec appraisal contrib rake spec:rake'
-      sh 'bundle exec appraisal contrib rake spec:redis'
-      sh 'bundle exec appraisal contrib rake spec:resque'
-      sh 'bundle exec appraisal contrib rake spec:rest_client'
-      sh 'bundle exec appraisal contrib rake spec:sequel'
-      sh 'bundle exec appraisal contrib rake spec:shoryuken'
-      sh 'bundle exec appraisal contrib rake spec:sidekiq'
-      sh 'bundle exec appraisal contrib rake spec:sinatra'
-      sh 'bundle exec appraisal contrib rake spec:sucker_punch'
-      sh 'bundle exec appraisal contrib rake spec:suite'
+      declare 'bundle exec appraisal contrib rake spec:action_pack'
+      declare 'bundle exec appraisal contrib rake spec:action_view'
+      declare 'bundle exec appraisal contrib rake spec:active_model_serializers'
+      declare 'bundle exec appraisal contrib rake spec:active_record'
+      declare 'bundle exec appraisal contrib rake spec:active_support'
+      declare 'bundle exec appraisal contrib rake spec:aws'
+      declare 'bundle exec appraisal contrib rake spec:concurrent_ruby'
+      declare 'bundle exec appraisal contrib rake spec:dalli'
+      declare 'bundle exec appraisal contrib rake spec:delayed_job'
+      declare 'bundle exec appraisal contrib rake spec:elasticsearch'
+      declare 'bundle exec appraisal contrib rake spec:ethon'
+      declare 'bundle exec appraisal contrib rake spec:excon'
+      declare 'bundle exec appraisal contrib rake spec:faraday'
+      declare 'bundle exec appraisal contrib rake spec:grape'
+      declare 'bundle exec appraisal contrib rake spec:graphql'
+      declare 'bundle exec appraisal contrib rake spec:grpc'
+      declare 'bundle exec appraisal contrib rake spec:http'
+      declare 'bundle exec appraisal contrib rake spec:httprb'
+      declare 'bundle exec appraisal contrib rake spec:mongodb'
+      declare 'bundle exec appraisal contrib rake spec:mysql2'
+      declare 'bundle exec appraisal contrib rake spec:presto'
+      declare 'bundle exec appraisal contrib rake spec:que'
+      declare 'bundle exec appraisal contrib rake spec:racecar'
+      declare 'bundle exec appraisal contrib rake spec:rack'
+      declare 'bundle exec appraisal contrib rake spec:rake'
+      declare 'bundle exec appraisal contrib rake spec:redis'
+      declare 'bundle exec appraisal contrib rake spec:resque'
+      declare 'bundle exec appraisal contrib rake spec:rest_client'
+      declare 'bundle exec appraisal contrib rake spec:sequel'
+      declare 'bundle exec appraisal contrib rake spec:shoryuken'
+      declare 'bundle exec appraisal contrib rake spec:sidekiq'
+      declare 'bundle exec appraisal contrib rake spec:sinatra'
+      declare 'bundle exec appraisal contrib rake spec:sneakers'
+      declare 'bundle exec appraisal contrib rake spec:sucker_punch'
+      declare 'bundle exec appraisal contrib rake spec:suite'
       # Contrib specs with old gem versions
-      sh 'bundle exec appraisal contrib-old rake spec:faraday'
+      declare 'bundle exec appraisal contrib-old rake spec:faraday'
       # Rails minitests
-      sh 'bundle exec appraisal rails30-postgres rake test:rails'
-      sh 'bundle exec appraisal rails30-postgres rake spec:railsdisableenv'
-      sh 'bundle exec appraisal rails32-mysql2 rake test:rails'
-      sh 'bundle exec appraisal rails32-postgres rake test:rails'
-      sh 'bundle exec appraisal rails32-postgres-redis rake spec:railsredis'
-      sh 'bundle exec appraisal rails32-postgres rake spec:railsdisableenv'
-      sh 'bundle exec appraisal rails4-mysql2 rake test:rails'
-      sh 'bundle exec appraisal rails4-postgres rake test:rails'
-      sh 'bundle exec appraisal rails4-postgres-redis rake spec:railsredis'
-      sh 'bundle exec appraisal rails4-postgres rake spec:railsdisableenv'
-      sh 'bundle exec appraisal rails4-postgres-sidekiq rake spec:railsactivejob'
-      sh 'bundle exec appraisal rails5-mysql2 rake test:rails'
-      sh 'bundle exec appraisal rails5-postgres rake test:rails'
-      sh 'bundle exec appraisal rails5-postgres-redis rake spec:railsredis'
-      sh 'bundle exec appraisal rails5-postgres-redis-activesupport rake spec:railsredis'
-      sh 'bundle exec appraisal rails5-postgres-sidekiq rake spec:railsactivejob'
-      sh 'bundle exec appraisal rails5-postgres rake spec:railsdisableenv'
+      declare 'bundle exec appraisal rails30-postgres rake test:rails'
+      declare 'bundle exec appraisal rails30-postgres rake spec:railsdisableenv'
+      declare 'bundle exec appraisal rails32-mysql2 rake test:rails'
+      declare 'bundle exec appraisal rails32-postgres rake test:rails'
+      declare 'bundle exec appraisal rails32-postgres-redis rake spec:railsredis'
+      declare 'bundle exec appraisal rails32-postgres rake spec:railsdisableenv'
+      declare 'bundle exec appraisal rails4-mysql2 rake test:rails'
+      declare 'bundle exec appraisal rails4-postgres rake test:rails'
+      declare 'bundle exec appraisal rails4-postgres-redis rake spec:railsredis'
+      declare 'bundle exec appraisal rails4-postgres rake spec:railsdisableenv'
+      declare 'bundle exec appraisal rails4-postgres-sidekiq rake spec:railsactivejob'
+      declare 'bundle exec appraisal rails5-mysql2 rake test:rails'
+      declare 'bundle exec appraisal rails5-postgres rake test:rails'
+      declare 'bundle exec appraisal rails5-postgres-redis rake spec:railsredis'
+      declare 'bundle exec appraisal rails5-postgres-redis-activesupport rake spec:railsredis'
+      declare 'bundle exec appraisal rails5-postgres-sidekiq rake spec:railsactivejob'
+      declare 'bundle exec appraisal rails5-postgres rake spec:railsdisableenv'
       # Rails specs
-      sh 'bundle exec appraisal rails30-postgres rake spec:rails'
-      sh 'bundle exec appraisal rails32-mysql2 rake spec:rails'
-      sh 'bundle exec appraisal rails32-postgres rake spec:rails'
-      sh 'bundle exec appraisal rails4-mysql2 rake spec:rails'
-      sh 'bundle exec appraisal rails4-postgres rake spec:rails'
-      sh 'bundle exec appraisal rails5-mysql2 rake spec:rails'
-      sh 'bundle exec appraisal rails5-postgres rake spec:rails'
+      declare 'bundle exec appraisal rails30-postgres rake spec:rails'
+      declare 'bundle exec appraisal rails32-mysql2 rake spec:rails'
+      declare 'bundle exec appraisal rails32-postgres rake spec:rails'
+      declare 'bundle exec appraisal rails4-mysql2 rake spec:rails'
+      declare 'bundle exec appraisal rails4-postgres rake spec:rails'
+      declare 'bundle exec appraisal rails5-mysql2 rake spec:rails'
+      declare 'bundle exec appraisal rails5-postgres rake spec:rails'
+
+      # explicitly test resque-2x compatability
+      declare 'bundle exec appraisal resque2-redis3 rake spec:resque'
+      declare 'bundle exec appraisal resque2-redis4 rake spec:resque'
     end
   elsif Gem::Version.new('2.4.0') <= Gem::Version.new(RUBY_VERSION) \
         && Gem::Version.new(RUBY_VERSION) < Gem::Version.new('2.5.0')
     # Main library
-    sh 'bundle exec rake test:main'
-    sh 'bundle exec rake spec:main'
-    sh 'bundle exec rake spec:contrib'
-    sh 'bundle exec rake spec:opentracer'
-    sh 'bundle exec rake spec:opentelemetry'
-    # Benchmarks
-    sh 'bundle exec rake spec:benchmark'
+    declare 'bundle exec rake test:main'
+    declare 'bundle exec rake spec:main'
+    declare 'bundle exec rake spec:contrib'
+    declare 'bundle exec rake spec:opentracer'
+    declare 'bundle exec rake spec:opentelemetry'
 
     if RUBY_PLATFORM != 'java'
-      # Benchmarks
-      sh 'bundle exec rake benchmark'
       # Contrib minitests
-      sh 'bundle exec appraisal contrib rake test:grape'
-      sh 'bundle exec appraisal contrib rake test:sidekiq'
-      sh 'bundle exec appraisal contrib rake test:sucker_punch'
       # Contrib specs
-      sh 'bundle exec appraisal contrib rake spec:action_pack'
-      sh 'bundle exec appraisal contrib rake spec:action_view'
-      sh 'bundle exec appraisal contrib rake spec:active_model_serializers'
-      sh 'bundle exec appraisal contrib rake spec:active_record'
-      sh 'bundle exec appraisal contrib rake spec:active_support'
-      sh 'bundle exec appraisal contrib rake spec:aws'
-      sh 'bundle exec appraisal contrib rake spec:concurrent_ruby'
-      sh 'bundle exec appraisal contrib rake spec:dalli'
-      sh 'bundle exec appraisal contrib rake spec:delayed_job'
-      sh 'bundle exec appraisal contrib rake spec:elasticsearch'
-      sh 'bundle exec appraisal contrib rake spec:ethon'
-      sh 'bundle exec appraisal contrib rake spec:excon'
-      sh 'bundle exec appraisal contrib rake spec:faraday'
-      sh 'bundle exec appraisal contrib rake spec:grape'
-      sh 'bundle exec appraisal contrib rake spec:graphql'
-      sh 'bundle exec appraisal contrib rake spec:grpc'
-      sh 'bundle exec appraisal contrib rake spec:http'
-      sh 'bundle exec appraisal contrib rake spec:mongodb'
-      sh 'bundle exec appraisal contrib rake spec:mysql2'
-      sh 'bundle exec appraisal contrib rake spec:presto'
-      sh 'bundle exec appraisal contrib rake spec:racecar'
-      sh 'bundle exec appraisal contrib rake spec:rack'
-      sh 'bundle exec appraisal contrib rake spec:rake'
-      sh 'bundle exec appraisal contrib rake spec:redis'
-      sh 'bundle exec appraisal contrib rake spec:resque'
-      sh 'bundle exec appraisal contrib rake spec:rest_client'
-      sh 'bundle exec appraisal contrib rake spec:sequel'
-      sh 'bundle exec appraisal contrib rake spec:shoryuken'
-      sh 'bundle exec appraisal contrib rake spec:sidekiq'
-      sh 'bundle exec appraisal contrib rake spec:sinatra'
-      sh 'bundle exec appraisal contrib rake spec:sucker_punch'
-      sh 'bundle exec appraisal contrib rake spec:suite'
+      declare 'bundle exec appraisal contrib rake spec:action_pack'
+      declare 'bundle exec appraisal contrib rake spec:action_view'
+      declare 'bundle exec appraisal contrib rake spec:active_model_serializers'
+      declare 'bundle exec appraisal contrib rake spec:active_record'
+      declare 'bundle exec appraisal contrib rake spec:active_support'
+      declare 'bundle exec appraisal contrib rake spec:aws'
+      declare 'bundle exec appraisal contrib rake spec:concurrent_ruby'
+      declare 'bundle exec appraisal contrib rake spec:dalli'
+      declare 'bundle exec appraisal contrib rake spec:delayed_job'
+      declare 'bundle exec appraisal contrib rake spec:elasticsearch'
+      declare 'bundle exec appraisal contrib rake spec:ethon'
+      declare 'bundle exec appraisal contrib rake spec:excon'
+      declare 'bundle exec appraisal contrib rake spec:faraday'
+      declare 'bundle exec appraisal contrib rake spec:grape'
+      declare 'bundle exec appraisal contrib rake spec:graphql'
+      declare 'bundle exec appraisal contrib rake spec:grpc'
+      declare 'bundle exec appraisal contrib rake spec:http'
+      declare 'bundle exec appraisal contrib rake spec:httprb'
+      declare 'bundle exec appraisal contrib rake spec:mongodb'
+      declare 'bundle exec appraisal contrib rake spec:mysql2'
+      declare 'bundle exec appraisal contrib rake spec:presto'
+      declare 'bundle exec appraisal contrib rake spec:que'
+      declare 'bundle exec appraisal contrib rake spec:racecar'
+      declare 'bundle exec appraisal contrib rake spec:rack'
+      declare 'bundle exec appraisal contrib rake spec:rake'
+      declare 'bundle exec appraisal contrib rake spec:redis'
+      declare 'bundle exec appraisal contrib rake spec:resque'
+      declare 'bundle exec appraisal contrib rake spec:rest_client'
+      declare 'bundle exec appraisal contrib rake spec:sequel'
+      declare 'bundle exec appraisal contrib rake spec:shoryuken'
+      declare 'bundle exec appraisal contrib rake spec:sidekiq'
+      declare 'bundle exec appraisal contrib rake spec:sinatra'
+      declare 'bundle exec appraisal contrib rake spec:sneakers'
+      declare 'bundle exec appraisal contrib rake spec:sucker_punch'
+      declare 'bundle exec appraisal contrib rake spec:suite'
       # Contrib specs with old gem versions
-      sh 'bundle exec appraisal contrib-old rake spec:faraday'
+      declare 'bundle exec appraisal contrib-old rake spec:faraday'
       # Rails minitests
       # We only test Rails 5+ because older versions require Bundler < 2.0
-      sh 'bundle exec appraisal rails5-mysql2 rake test:rails'
-      sh 'bundle exec appraisal rails5-postgres rake test:rails'
-      sh 'bundle exec appraisal rails5-postgres-redis rake spec:railsredis'
-      sh 'bundle exec appraisal rails5-postgres-redis-activesupport rake spec:railsredis'
-      sh 'bundle exec appraisal rails5-postgres-sidekiq rake spec:railsactivejob'
-      sh 'bundle exec appraisal rails5-postgres rake spec:railsdisableenv'
+      declare 'bundle exec appraisal rails5-mysql2 rake test:rails'
+      declare 'bundle exec appraisal rails5-postgres rake test:rails'
+      declare 'bundle exec appraisal rails5-postgres-redis rake spec:railsredis'
+      declare 'bundle exec appraisal rails5-postgres-redis-activesupport rake spec:railsredis'
+      declare 'bundle exec appraisal rails5-postgres-sidekiq rake spec:railsactivejob'
+      declare 'bundle exec appraisal rails5-postgres rake spec:railsdisableenv'
       # Rails specs
-      sh 'bundle exec appraisal rails5-mysql2 rake spec:rails'
-      sh 'bundle exec appraisal rails5-postgres rake spec:rails'
+      declare 'bundle exec appraisal rails5-mysql2 rake spec:rails'
+      declare 'bundle exec appraisal rails5-postgres rake spec:rails'
+
+      # explicitly test resque-2x compatability
+      declare 'bundle exec appraisal resque2-redis3 rake spec:resque'
+      declare 'bundle exec appraisal resque2-redis4 rake spec:resque'
     end
   elsif Gem::Version.new('2.5.0') <= Gem::Version.new(RUBY_VERSION) \
         && Gem::Version.new(RUBY_VERSION) < Gem::Version.new('2.6.0')
     # Main library
-    sh 'bundle exec rake test:main'
-    sh 'bundle exec rake spec:main'
-    sh 'bundle exec rake spec:contrib'
-    sh 'bundle exec rake spec:opentracer'
-    sh 'bundle exec rake spec:opentelemetry'
-    # Benchmarks
-    sh 'bundle exec rake spec:benchmark'
-
-    if RUBY_PLATFORM != 'java'
-      # Benchmarks
-      sh 'bundle exec rake benchmark'
-      # Contrib minitests
-      sh 'bundle exec appraisal contrib rake test:grape'
-      sh 'bundle exec appraisal contrib rake test:sidekiq'
-      sh 'bundle exec appraisal contrib rake test:sucker_punch'
-      # Contrib specs
-      sh 'bundle exec appraisal contrib rake spec:action_pack'
-      sh 'bundle exec appraisal contrib rake spec:action_view'
-      sh 'bundle exec appraisal contrib rake spec:active_model_serializers'
-      sh 'bundle exec appraisal contrib rake spec:active_record'
-      sh 'bundle exec appraisal contrib rake spec:active_support'
-      sh 'bundle exec appraisal contrib rake spec:aws'
-      sh 'bundle exec appraisal contrib rake spec:concurrent_ruby'
-      sh 'bundle exec appraisal contrib rake spec:dalli'
-      sh 'bundle exec appraisal contrib rake spec:delayed_job'
-      sh 'bundle exec appraisal contrib rake spec:elasticsearch'
-      sh 'bundle exec appraisal contrib rake spec:ethon'
-      sh 'bundle exec appraisal contrib rake spec:excon'
-      sh 'bundle exec appraisal contrib rake spec:faraday'
-      sh 'bundle exec appraisal contrib rake spec:grape'
-      sh 'bundle exec appraisal contrib rake spec:graphql'
-      sh 'bundle exec appraisal contrib rake spec:grpc'
-      sh 'bundle exec appraisal contrib rake spec:http'
-      sh 'bundle exec appraisal contrib rake spec:mongodb'
-      sh 'bundle exec appraisal contrib rake spec:mysql2'
-      sh 'bundle exec appraisal contrib rake spec:presto'
-      sh 'bundle exec appraisal contrib rake spec:racecar'
-      sh 'bundle exec appraisal contrib rake spec:rack'
-      sh 'bundle exec appraisal contrib rake spec:rake'
-      sh 'bundle exec appraisal contrib rake spec:redis'
-      sh 'bundle exec appraisal contrib rake spec:resque'
-      sh 'bundle exec appraisal contrib rake spec:rest_client'
-      sh 'bundle exec appraisal contrib rake spec:sequel'
-      sh 'bundle exec appraisal contrib rake spec:shoryuken'
-      sh 'bundle exec appraisal contrib rake spec:sidekiq'
-      sh 'bundle exec appraisal contrib rake spec:sinatra'
-      sh 'bundle exec appraisal contrib rake spec:sucker_punch'
-      sh 'bundle exec appraisal contrib rake spec:suite'
-      # Contrib specs with old gem versions
-      sh 'bundle exec appraisal contrib-old rake spec:faraday'
-      # Rails minitests
-      # We only test Rails 5+ because older versions require Bundler < 2.0
-      sh 'bundle exec appraisal rails5-mysql2 rake test:rails'
-      sh 'bundle exec appraisal rails5-postgres rake test:rails'
-      sh 'bundle exec appraisal rails5-postgres-redis rake spec:railsredis'
-      sh 'bundle exec appraisal rails5-postgres-redis-activesupport rake spec:railsredis'
-      sh 'bundle exec appraisal rails5-postgres-sidekiq rake spec:railsactivejob'
-      sh 'bundle exec appraisal rails5-postgres rake spec:railsdisableenv'
-      sh 'bundle exec appraisal rails6-mysql2 rake test:rails'
-      sh 'bundle exec appraisal rails6-postgres rake test:rails'
-      sh 'bundle exec appraisal rails6-postgres-redis rake spec:railsredis'
-      sh 'bundle exec appraisal rails6-postgres-redis-activesupport rake spec:railsredis'
-      sh 'bundle exec appraisal rails6-postgres-sidekiq rake spec:railsactivejob'
-      sh 'bundle exec appraisal rails6-postgres rake spec:railsdisableenv'
-      # Rails specs
-      sh 'bundle exec appraisal rails5-mysql2 rake spec:action_cable'
-      sh 'bundle exec appraisal rails5-mysql2 rake spec:rails'
-      sh 'bundle exec appraisal rails5-postgres rake spec:rails'
-      # sh 'bundle exec appraisal rails6-mysql2 rake spec:action_cable' # TODO: Hangs CI jobs... fix and re-enable.
-      sh 'bundle exec appraisal rails6-mysql2 rake spec:rails'
-      sh 'bundle exec appraisal rails6-postgres rake spec:rails'
-    end
+    declare 'bundle exec rake test:main'
+    declare 'bundle exec rake spec:main'
+    declare 'bundle exec rake spec:contrib'
+    declare 'bundle exec rake spec:opentracer'
+    declare 'bundle exec rake spec:opentelemetry'
+    # Contrib minitests
+    # Contrib specs
+    declare 'bundle exec appraisal contrib rake spec:action_pack'
+    declare 'bundle exec appraisal contrib rake spec:action_view'
+    declare 'bundle exec appraisal contrib rake spec:active_model_serializers'
+    declare 'bundle exec appraisal contrib rake spec:active_record'
+    declare 'bundle exec appraisal contrib rake spec:active_support'
+    declare 'bundle exec appraisal contrib rake spec:aws'
+    declare 'bundle exec appraisal contrib rake spec:concurrent_ruby'
+    declare 'bundle exec appraisal contrib rake spec:dalli'
+    declare 'bundle exec appraisal contrib rake spec:delayed_job'
+    declare 'bundle exec appraisal contrib rake spec:elasticsearch'
+    declare 'bundle exec appraisal contrib rake spec:ethon'
+    declare 'bundle exec appraisal contrib rake spec:excon'
+    declare 'bundle exec appraisal contrib rake spec:faraday'
+    declare 'bundle exec appraisal contrib rake spec:grape'
+    declare 'bundle exec appraisal contrib rake spec:graphql'
+    declare 'bundle exec appraisal contrib rake spec:grpc' if RUBY_PLATFORM != 'java' # protobuf not supported
+    declare 'bundle exec appraisal contrib rake spec:http'
+    declare 'bundle exec appraisal contrib rake spec:httprb'
+    declare 'bundle exec appraisal contrib rake spec:mongodb'
+    declare 'bundle exec appraisal contrib rake spec:mysql2' if RUBY_PLATFORM != 'java' # built-in jdbc is used instead
+    declare 'bundle exec appraisal contrib rake spec:presto'
+    declare 'bundle exec appraisal contrib rake spec:que'
+    declare 'bundle exec appraisal contrib rake spec:racecar'
+    declare 'bundle exec appraisal contrib rake spec:rack'
+    declare 'bundle exec appraisal contrib rake spec:rake'
+    declare 'bundle exec appraisal contrib rake spec:redis'
+    declare 'bundle exec appraisal contrib rake spec:resque'
+    declare 'bundle exec appraisal contrib rake spec:rest_client'
+    declare 'bundle exec appraisal contrib rake spec:sequel'
+    declare 'bundle exec appraisal contrib rake spec:shoryuken'
+    declare 'bundle exec appraisal contrib rake spec:sidekiq'
+    declare 'bundle exec appraisal contrib rake spec:sinatra'
+    declare 'bundle exec appraisal contrib rake spec:sneakers'
+    declare 'bundle exec appraisal contrib rake spec:sucker_punch'
+    declare 'bundle exec appraisal contrib rake spec:suite'
+    # Contrib specs with old gem versions
+    declare 'bundle exec appraisal contrib-old rake spec:faraday'
+    # Rails minitests
+    # We only test Rails 5+ because older versions require Bundler < 2.0
+    declare 'bundle exec appraisal rails5-mysql2 rake test:rails'
+    declare 'bundle exec appraisal rails5-postgres rake test:rails'
+    declare 'bundle exec appraisal rails5-postgres-redis rake spec:railsredis'
+    declare 'bundle exec appraisal rails5-postgres-redis-activesupport rake spec:railsredis'
+    declare 'bundle exec appraisal rails5-postgres-sidekiq rake spec:railsactivejob'
+    declare 'bundle exec appraisal rails5-postgres rake spec:railsdisableenv'
+    declare 'bundle exec appraisal rails6-mysql2 rake test:rails'
+    declare 'bundle exec appraisal rails6-postgres rake test:rails'
+    declare 'bundle exec appraisal rails6-postgres-redis rake spec:railsredis'
+    declare 'bundle exec appraisal rails6-postgres-redis-activesupport rake spec:railsredis'
+    declare 'bundle exec appraisal rails6-postgres-sidekiq rake spec:railsactivejob'
+    declare 'bundle exec appraisal rails6-postgres rake spec:railsdisableenv'
+    # Rails specs
+    declare 'bundle exec appraisal rails5-mysql2 rake spec:action_cable'
+    declare 'bundle exec appraisal rails5-mysql2 rake spec:rails'
+    declare 'bundle exec appraisal rails5-postgres rake spec:rails'
+    # declare 'bundle exec appraisal rails6-mysql2 rake spec:action_cable' # TODO: Hangs CI jobs... fix and re-enable.
+    declare 'bundle exec appraisal rails6-mysql2 rake spec:rails'
+    declare 'bundle exec appraisal rails6-postgres rake spec:rails'
+
+    # explicitly test resque-2x compatability
+    declare 'bundle exec appraisal resque2-redis3 rake spec:resque'
+    declare 'bundle exec appraisal resque2-redis4 rake spec:resque'
   elsif Gem::Version.new('2.6.0') <= Gem::Version.new(RUBY_VERSION) \
       && Gem::Version.new(RUBY_VERSION) < Gem::Version.new('2.7.0')
     # Main library
-    sh 'bundle exec rake test:main'
-    sh 'bundle exec rake spec:main'
-    sh 'bundle exec rake spec:contrib'
-    sh 'bundle exec rake spec:opentracer'
-    sh 'bundle exec rake spec:opentelemetry'
-    # Benchmarks
-    sh 'bundle exec rake spec:benchmark'
+    declare 'bundle exec rake test:main'
+    declare 'bundle exec rake spec:main'
+    declare 'bundle exec rake spec:contrib'
+    declare 'bundle exec rake spec:opentracer'
+    declare 'bundle exec rake spec:opentelemetry'
 
     if RUBY_PLATFORM != 'java'
-      # Benchmarks
-      sh 'bundle exec rake benchmark'
       # Contrib minitests
-      sh 'bundle exec appraisal contrib rake test:grape'
-      sh 'bundle exec appraisal contrib rake test:sidekiq'
-      sh 'bundle exec appraisal contrib rake test:sucker_punch'
       # Contrib specs
-      sh 'bundle exec appraisal contrib rake spec:action_pack'
-      sh 'bundle exec appraisal contrib rake spec:action_view'
-      sh 'bundle exec appraisal contrib rake spec:active_model_serializers'
-      sh 'bundle exec appraisal contrib rake spec:active_record'
-      sh 'bundle exec appraisal contrib rake spec:active_support'
-      sh 'bundle exec appraisal contrib rake spec:aws'
-      sh 'bundle exec appraisal contrib rake spec:concurrent_ruby'
-      sh 'bundle exec appraisal contrib rake spec:dalli'
-      sh 'bundle exec appraisal contrib rake spec:delayed_job'
-      sh 'bundle exec appraisal contrib rake spec:elasticsearch'
-      sh 'bundle exec appraisal contrib rake spec:ethon'
-      sh 'bundle exec appraisal contrib rake spec:excon'
-      sh 'bundle exec appraisal contrib rake spec:faraday'
-      sh 'bundle exec appraisal contrib rake spec:grape'
-      sh 'bundle exec appraisal contrib rake spec:graphql'
-      sh 'bundle exec appraisal contrib rake spec:grpc'
-      sh 'bundle exec appraisal contrib rake spec:http'
-      sh 'bundle exec appraisal contrib rake spec:mongodb'
-      sh 'bundle exec appraisal contrib rake spec:mysql2'
-      sh 'bundle exec appraisal contrib rake spec:presto'
-      sh 'bundle exec appraisal contrib rake spec:racecar'
-      sh 'bundle exec appraisal contrib rake spec:rack'
-      sh 'bundle exec appraisal contrib rake spec:rake'
-      sh 'bundle exec appraisal contrib rake spec:redis'
-      sh 'bundle exec appraisal contrib rake spec:resque'
-      sh 'bundle exec appraisal contrib rake spec:rest_client'
-      sh 'bundle exec appraisal contrib rake spec:sequel'
-      sh 'bundle exec appraisal contrib rake spec:shoryuken'
-      sh 'bundle exec appraisal contrib rake spec:sidekiq'
-      sh 'bundle exec appraisal contrib rake spec:sinatra'
-      sh 'bundle exec appraisal contrib rake spec:sucker_punch'
-      sh 'bundle exec appraisal contrib rake spec:suite'
+      declare 'bundle exec appraisal contrib rake spec:action_pack'
+      declare 'bundle exec appraisal contrib rake spec:action_view'
+      declare 'bundle exec appraisal contrib rake spec:active_model_serializers'
+      declare 'bundle exec appraisal contrib rake spec:active_record'
+      declare 'bundle exec appraisal contrib rake spec:active_support'
+      declare 'bundle exec appraisal contrib rake spec:aws'
+      declare 'bundle exec appraisal contrib rake spec:concurrent_ruby'
+      declare 'bundle exec appraisal contrib rake spec:dalli'
+      declare 'bundle exec appraisal contrib rake spec:delayed_job'
+      declare 'bundle exec appraisal contrib rake spec:elasticsearch'
+      declare 'bundle exec appraisal contrib rake spec:ethon'
+      declare 'bundle exec appraisal contrib rake spec:excon'
+      declare 'bundle exec appraisal contrib rake spec:faraday'
+      declare 'bundle exec appraisal contrib rake spec:grape'
+      declare 'bundle exec appraisal contrib rake spec:graphql'
+      declare 'bundle exec appraisal contrib rake spec:grpc'
+      declare 'bundle exec appraisal contrib rake spec:http'
+      declare 'bundle exec appraisal contrib rake spec:httprb'
+      declare 'bundle exec appraisal contrib rake spec:mongodb'
+      declare 'bundle exec appraisal contrib rake spec:mysql2'
+      declare 'bundle exec appraisal contrib rake spec:presto'
+      declare 'bundle exec appraisal contrib rake spec:que'
+      declare 'bundle exec appraisal contrib rake spec:racecar'
+      declare 'bundle exec appraisal contrib rake spec:rack'
+      declare 'bundle exec appraisal contrib rake spec:rake'
+      declare 'bundle exec appraisal contrib rake spec:redis'
+      declare 'bundle exec appraisal contrib rake spec:resque'
+      declare 'bundle exec appraisal contrib rake spec:rest_client'
+      declare 'bundle exec appraisal contrib rake spec:sequel'
+      declare 'bundle exec appraisal contrib rake spec:shoryuken'
+      declare 'bundle exec appraisal contrib rake spec:sidekiq'
+      declare 'bundle exec appraisal contrib rake spec:sinatra'
+      declare 'bundle exec appraisal contrib rake spec:sneakers'
+      declare 'bundle exec appraisal contrib rake spec:sucker_punch'
+      declare 'bundle exec appraisal contrib rake spec:suite'
       # Contrib specs with old gem versions
-      sh 'bundle exec appraisal contrib-old rake spec:faraday'
+      declare 'bundle exec appraisal contrib-old rake spec:faraday'
       # Rails minitests
       # We only test Rails 5+ because older versions require Bundler < 2.0
-      sh 'bundle exec appraisal rails5-mysql2 rake test:rails'
-      sh 'bundle exec appraisal rails5-postgres rake test:rails'
-      sh 'bundle exec appraisal rails5-postgres-redis rake spec:railsredis'
-      sh 'bundle exec appraisal rails5-postgres-redis-activesupport rake spec:railsredis'
-      sh 'bundle exec appraisal rails5-postgres-sidekiq rake spec:railsactivejob'
-      sh 'bundle exec appraisal rails5-postgres rake spec:railsdisableenv'
-      sh 'bundle exec appraisal rails6-mysql2 rake test:rails'
-      sh 'bundle exec appraisal rails6-postgres rake test:rails'
-      sh 'bundle exec appraisal rails6-postgres-redis rake spec:railsredis'
-      sh 'bundle exec appraisal rails6-postgres-redis-activesupport rake spec:railsredis'
-      sh 'bundle exec appraisal rails6-postgres-sidekiq rake spec:railsactivejob'
-      sh 'bundle exec appraisal rails6-postgres rake spec:railsdisableenv'
+      declare 'bundle exec appraisal rails5-mysql2 rake test:rails'
+      declare 'bundle exec appraisal rails5-postgres rake test:rails'
+      declare 'bundle exec appraisal rails5-postgres-redis rake spec:railsredis'
+      declare 'bundle exec appraisal rails5-postgres-redis-activesupport rake spec:railsredis'
+      declare 'bundle exec appraisal rails5-postgres-sidekiq rake spec:railsactivejob'
+      declare 'bundle exec appraisal rails5-postgres rake spec:railsdisableenv'
+      declare 'bundle exec appraisal rails6-mysql2 rake test:rails'
+      declare 'bundle exec appraisal rails6-postgres rake test:rails'
+      declare 'bundle exec appraisal rails6-postgres-redis rake spec:railsredis'
+      declare 'bundle exec appraisal rails6-postgres-redis-activesupport rake spec:railsredis'
+      declare 'bundle exec appraisal rails6-postgres-sidekiq rake spec:railsactivejob'
+      declare 'bundle exec appraisal rails6-postgres rake spec:railsdisableenv'
       # Rails specs
-      sh 'bundle exec appraisal rails5-mysql2 rake spec:action_cable'
-      sh 'bundle exec appraisal rails5-mysql2 rake spec:rails'
-      sh 'bundle exec appraisal rails5-postgres rake spec:rails'
-      # sh 'bundle exec appraisal rails6-mysql2 rake spec:action_cable' # TODO: Hangs CI jobs... fix and re-enable.
-      sh 'bundle exec appraisal rails6-mysql2 rake spec:rails'
-      sh 'bundle exec appraisal rails6-postgres rake spec:rails'
+      declare 'bundle exec appraisal rails5-mysql2 rake spec:action_cable'
+      declare 'bundle exec appraisal rails5-mysql2 rake spec:rails'
+      declare 'bundle exec appraisal rails5-postgres rake spec:rails'
+      # declare 'bundle exec appraisal rails6-mysql2 rake spec:action_cable' # TODO: Hangs CI jobs... fix and re-enable.
+      declare 'bundle exec appraisal rails6-mysql2 rake spec:rails'
+      declare 'bundle exec appraisal rails6-postgres rake spec:rails'
+
+      # explicitly test resque-2x compatability
+      declare 'bundle exec appraisal resque2-redis3 rake spec:resque'
+      declare 'bundle exec appraisal resque2-redis4 rake spec:resque'
     end
   elsif Gem::Version.new('2.7.0') <= Gem::Version.new(RUBY_VERSION)
     # Main library
-    sh 'bundle exec rake test:main'
-    sh 'bundle exec rake spec:main'
-    sh 'bundle exec rake spec:contrib'
-    sh 'bundle exec rake spec:opentracer'
-    sh 'bundle exec rake spec:opentelemetry'
-    # Benchmarks
-    sh 'bundle exec rake spec:benchmark'
+    declare 'bundle exec rake test:main'
+    declare 'bundle exec rake spec:main'
+    declare 'bundle exec rake spec:contrib'
+    declare 'bundle exec rake spec:opentracer'
+    declare 'bundle exec rake spec:opentelemetry'
 
     if RUBY_PLATFORM != 'java'
-      # Benchmarks
-      sh 'bundle exec rake benchmark'
       # Contrib minitests
-      sh 'bundle exec appraisal contrib rake test:grape'
-      sh 'bundle exec appraisal contrib rake test:sidekiq'
-      sh 'bundle exec appraisal contrib rake test:sucker_punch'
       # Contrib specs
-      sh 'bundle exec appraisal contrib rake spec:action_pack'
-      sh 'bundle exec appraisal contrib rake spec:action_view'
-      sh 'bundle exec appraisal contrib rake spec:active_model_serializers'
-      sh 'bundle exec appraisal contrib rake spec:active_record'
-      sh 'bundle exec appraisal contrib rake spec:active_support'
-      sh 'bundle exec appraisal contrib rake spec:aws'
-      sh 'bundle exec appraisal contrib rake spec:concurrent_ruby'
-      sh 'bundle exec appraisal contrib rake spec:dalli'
-      sh 'bundle exec appraisal contrib rake spec:delayed_job'
-      sh 'bundle exec appraisal contrib rake spec:elasticsearch'
-      sh 'bundle exec appraisal contrib rake spec:ethon'
-      sh 'bundle exec appraisal contrib rake spec:excon'
-      sh 'bundle exec appraisal contrib rake spec:faraday'
-      sh 'bundle exec appraisal contrib rake spec:grape'
-      sh 'bundle exec appraisal contrib rake spec:graphql'
-      sh 'bundle exec appraisal contrib rake spec:grpc'
-      sh 'bundle exec appraisal contrib rake spec:http'
-      sh 'bundle exec appraisal contrib rake spec:mongodb'
-      sh 'bundle exec appraisal contrib rake spec:mysql2'
-      sh 'bundle exec appraisal contrib rake spec:presto'
-      sh 'bundle exec appraisal contrib rake spec:racecar'
-      sh 'bundle exec appraisal contrib rake spec:rack'
-      sh 'bundle exec appraisal contrib rake spec:rake'
-      sh 'bundle exec appraisal contrib rake spec:redis'
-      sh 'bundle exec appraisal contrib rake spec:resque'
-      sh 'bundle exec appraisal contrib rake spec:rest_client'
-      sh 'bundle exec appraisal contrib rake spec:sequel'
-      sh 'bundle exec appraisal contrib rake spec:shoryuken'
-      sh 'bundle exec appraisal contrib rake spec:sidekiq'
-      sh 'bundle exec appraisal contrib rake spec:sinatra'
-      sh 'bundle exec appraisal contrib rake spec:sucker_punch'
-      sh 'bundle exec appraisal contrib rake spec:suite'
+      declare 'bundle exec appraisal contrib rake spec:action_pack'
+      declare 'bundle exec appraisal contrib rake spec:action_view'
+      declare 'bundle exec appraisal contrib rake spec:active_model_serializers'
+      declare 'bundle exec appraisal contrib rake spec:active_record'
+      declare 'bundle exec appraisal contrib rake spec:active_support'
+      declare 'bundle exec appraisal contrib rake spec:aws'
+      declare 'bundle exec appraisal contrib rake spec:concurrent_ruby'
+      declare 'bundle exec appraisal contrib rake spec:dalli'
+      declare 'bundle exec appraisal contrib rake spec:delayed_job'
+      declare 'bundle exec appraisal contrib rake spec:elasticsearch'
+      declare 'bundle exec appraisal contrib rake spec:ethon'
+      declare 'bundle exec appraisal contrib rake spec:excon'
+      declare 'bundle exec appraisal contrib rake spec:faraday'
+      declare 'bundle exec appraisal contrib rake spec:grape'
+      declare 'bundle exec appraisal contrib rake spec:graphql'
+      declare 'bundle exec appraisal contrib rake spec:grpc'
+      declare 'bundle exec appraisal contrib rake spec:http'
+      declare 'bundle exec appraisal contrib rake spec:httprb'
+      declare 'bundle exec appraisal contrib rake spec:mongodb'
+      declare 'bundle exec appraisal contrib rake spec:mysql2'
+      declare 'bundle exec appraisal contrib rake spec:presto'
+      declare 'bundle exec appraisal contrib rake spec:que'
+      declare 'bundle exec appraisal contrib rake spec:racecar'
+      declare 'bundle exec appraisal contrib rake spec:rack'
+      declare 'bundle exec appraisal contrib rake spec:rake'
+      declare 'bundle exec appraisal contrib rake spec:redis'
+      declare 'bundle exec appraisal contrib rake spec:resque'
+      declare 'bundle exec appraisal contrib rake spec:rest_client'
+      declare 'bundle exec appraisal contrib rake spec:sequel'
+      declare 'bundle exec appraisal contrib rake spec:shoryuken'
+      declare 'bundle exec appraisal contrib rake spec:sidekiq'
+      declare 'bundle exec appraisal contrib rake spec:sinatra'
+      declare 'bundle exec appraisal contrib rake spec:sneakers'
+      declare 'bundle exec appraisal contrib rake spec:sucker_punch'
+      declare 'bundle exec appraisal contrib rake spec:suite'
       # Contrib specs with old gem versions
-      sh 'bundle exec appraisal contrib-old rake spec:faraday'
+      declare 'bundle exec appraisal contrib-old rake spec:faraday'
       # Rails minitests
       # We only test Rails 5+ because older versions require Bundler < 2.0
-      sh 'bundle exec appraisal rails5-mysql2 rake test:rails'
-      sh 'bundle exec appraisal rails5-postgres rake test:rails'
-      sh 'bundle exec appraisal rails5-postgres-redis rake spec:railsredis'
-      sh 'bundle exec appraisal rails5-postgres-redis-activesupport rake spec:railsredis'
-      sh 'bundle exec appraisal rails5-postgres-sidekiq rake spec:railsactivejob'
-      sh 'bundle exec appraisal rails5-postgres rake spec:railsdisableenv'
-      sh 'bundle exec appraisal rails6-mysql2 rake test:rails'
-      sh 'bundle exec appraisal rails6-postgres rake test:rails'
-      sh 'bundle exec appraisal rails6-postgres-redis rake spec:railsredis'
-      sh 'bundle exec appraisal rails6-postgres-redis-activesupport rake spec:railsredis'
-      sh 'bundle exec appraisal rails6-postgres-sidekiq rake spec:railsactivejob'
-      sh 'bundle exec appraisal rails6-postgres rake spec:railsdisableenv'
+      declare 'bundle exec appraisal rails5-mysql2 rake test:rails'
+      declare 'bundle exec appraisal rails5-postgres rake test:rails'
+      declare 'bundle exec appraisal rails5-postgres-redis rake spec:railsredis'
+      declare 'bundle exec appraisal rails5-postgres-redis-activesupport rake spec:railsredis'
+      declare 'bundle exec appraisal rails5-postgres-sidekiq rake spec:railsactivejob'
+      declare 'bundle exec appraisal rails5-postgres rake spec:railsdisableenv'
+      declare 'bundle exec appraisal rails6-mysql2 rake test:rails'
+      declare 'bundle exec appraisal rails6-postgres rake test:rails'
+      declare 'bundle exec appraisal rails6-postgres-redis rake spec:railsredis'
+      declare 'bundle exec appraisal rails6-postgres-redis-activesupport rake spec:railsredis'
+      declare 'bundle exec appraisal rails6-postgres-sidekiq rake spec:railsactivejob'
+      declare 'bundle exec appraisal rails6-postgres rake spec:railsdisableenv'
       # Rails specs
-      sh 'bundle exec appraisal rails5-mysql2 rake spec:rails'
-      sh 'bundle exec appraisal rails5-postgres rake spec:rails'
-      sh 'bundle exec appraisal rails6-mysql2 rake spec:rails'
-      sh 'bundle exec appraisal rails6-postgres rake spec:rails'
+      declare 'bundle exec appraisal rails5-mysql2 rake spec:rails'
+      declare 'bundle exec appraisal rails5-postgres rake spec:rails'
+      declare 'bundle exec appraisal rails6-mysql2 rake spec:rails'
+      declare 'bundle exec appraisal rails6-postgres rake spec:rails'
+
+      # explicitly test resque-2x compatability
+      declare 'bundle exec appraisal resque2-redis3 rake spec:resque'
+      declare 'bundle exec appraisal resque2-redis4 rake spec:resque'
+    end
+  end
+end
+
+namespace :coverage do
+  # Generates one global report for all tracer tests
+  task :report do
+    require 'simplecov'
+
+    resultset_files = Dir["#{ENV.fetch('COVERAGE_DIR', 'coverage')}/.resultset.json"] +
+                      Dir["#{ENV.fetch('COVERAGE_DIR', 'coverage')}/versions/**/.resultset.json"]
+
+    SimpleCov.collate resultset_files do
+      coverage_dir "#{ENV.fetch('COVERAGE_DIR', 'coverage')}/report"
+      formatter SimpleCov::Formatter::HTMLFormatter
+    end
+  end
+
+  # Generates one report for each Ruby version
+  task :report_per_ruby_version do
+    require 'simplecov'
+
+    versions = Dir["#{ENV.fetch('COVERAGE_DIR', 'coverage')}/versions/*"].map { |f| File.basename(f) }
+    versions.map do |version|
+      puts "Generating report for: #{version}"
+      SimpleCov.collate Dir["#{ENV.fetch('COVERAGE_DIR', 'coverage')}/versions/#{version}/**/.resultset.json"] do
+        coverage_dir "#{ENV.fetch('COVERAGE_DIR', 'coverage')}/report/versions/#{version}"
+        formatter SimpleCov::Formatter::HTMLFormatter
+      end
     end
   end
 end