RubyGems - karafka - Versions diffs - 2.4.15 → 2.4.17 - Mend

karafka 2.4.15 → 2.4.17

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.

Files changed (264) hide show

data/lib/karafka/pro/routing/features/throttling/topic.rb CHANGED Viewed

@@ -1,15 +1,7 @@
 # frozen_string_literal: true
-# This Karafka component is a Pro component under a commercial license.
-# This Karafka component is NOT licensed under LGPL.
-#
-# All of the commercial components are present in the lib/karafka/pro directory of this
-# repository and their usage requires commercial license agreement.
-#
-# Karafka has also commercial-friendly license, commercial support and commercial components.
-#
-# By sending a pull request to the pro components, you are agreeing to transfer the copyright of
-# your code to Maciej Mensfeld.
+# This code is part of Karafka Pro, a commercial component not licensed under LGPL.
+# See LICENSE for details.
 module Karafka
   module Pro

data/lib/karafka/pro/routing/features/throttling.rb CHANGED Viewed

@@ -1,15 +1,7 @@
 # frozen_string_literal: true
-# This Karafka component is a Pro component under a commercial license.
-# This Karafka component is NOT licensed under LGPL.
-#
-# All of the commercial components are present in the lib/karafka/pro directory of this
-# repository and their usage requires commercial license agreement.
-#
-# Karafka has also commercial-friendly license, commercial support and commercial components.
-#
-# By sending a pull request to the pro components, you are agreeing to transfer the copyright of
-# your code to Maciej Mensfeld.
+# This code is part of Karafka Pro, a commercial component not licensed under LGPL.
+# See LICENSE for details.
 module Karafka
   module Pro

data/lib/karafka/pro/routing/features/virtual_partitions/config.rb CHANGED Viewed

@@ -1,15 +1,7 @@
 # frozen_string_literal: true
-# This Karafka component is a Pro component under a commercial license.
-# This Karafka component is NOT licensed under LGPL.
-#
-# All of the commercial components are present in the lib/karafka/pro directory of this
-# repository and their usage requires commercial license agreement.
-#
-# Karafka has also commercial-friendly license, commercial support and commercial components.
-#
-# By sending a pull request to the pro components, you are agreeing to transfer the copyright of
-# your code to Maciej Mensfeld.
+# This code is part of Karafka Pro, a commercial component not licensed under LGPL.
+# See LICENSE for details.
 module Karafka
   module Pro

data/lib/karafka/pro/routing/features/virtual_partitions/contracts/topic.rb CHANGED Viewed

@@ -1,15 +1,7 @@
 # frozen_string_literal: true
-# This Karafka component is a Pro component under a commercial license.
-# This Karafka component is NOT licensed under LGPL.
-#
-# All of the commercial components are present in the lib/karafka/pro directory of this
-# repository and their usage requires commercial license agreement.
-#
-# Karafka has also commercial-friendly license, commercial support and commercial components.
-#
-# By sending a pull request to the pro components, you are agreeing to transfer the copyright of
-# your code to Maciej Mensfeld.
+# This code is part of Karafka Pro, a commercial component not licensed under LGPL.
+# See LICENSE for details.
 module Karafka
   module Pro

data/lib/karafka/pro/routing/features/virtual_partitions/topic.rb CHANGED Viewed

@@ -1,15 +1,7 @@
 # frozen_string_literal: true
-# This Karafka component is a Pro component under a commercial license.
-# This Karafka component is NOT licensed under LGPL.
-#
-# All of the commercial components are present in the lib/karafka/pro directory of this
-# repository and their usage requires commercial license agreement.
-#
-# Karafka has also commercial-friendly license, commercial support and commercial components.
-#
-# By sending a pull request to the pro components, you are agreeing to transfer the copyright of
-# your code to Maciej Mensfeld.
+# This code is part of Karafka Pro, a commercial component not licensed under LGPL.
+# See LICENSE for details.
 module Karafka
   module Pro

data/lib/karafka/pro/routing/features/virtual_partitions.rb CHANGED Viewed

@@ -1,15 +1,7 @@
 # frozen_string_literal: true
-# This Karafka component is a Pro component under a commercial license.
-# This Karafka component is NOT licensed under LGPL.
-#
-# All of the commercial components are present in the lib/karafka/pro directory of this
-# repository and their usage requires commercial license agreement.
-#
-# Karafka has also commercial-friendly license, commercial support and commercial components.
-#
-# By sending a pull request to the pro components, you are agreeing to transfer the copyright of
-# your code to Maciej Mensfeld.
+# This code is part of Karafka Pro, a commercial component not licensed under LGPL.
+# See LICENSE for details.
 module Karafka
   module Pro

data/lib/karafka/pro/scheduled_messages/consumer.rb CHANGED Viewed

@@ -1,15 +1,7 @@
 # frozen_string_literal: true
-# This Karafka component is a Pro component under a commercial license.
-# This Karafka component is NOT licensed under LGPL.
-#
-# All of the commercial components are present in the lib/karafka/pro directory of this
-# repository and their usage requires commercial license agreement.
-#
-# Karafka has also commercial-friendly license, commercial support and commercial components.
-#
-# By sending a pull request to the pro components, you are agreeing to transfer the copyright of
-# your code to Maciej Mensfeld.
+# This code is part of Karafka Pro, a commercial component not licensed under LGPL.
+# See LICENSE for details.
 module Karafka
   module Pro

data/lib/karafka/pro/scheduled_messages/contracts/config.rb CHANGED Viewed

@@ -1,15 +1,7 @@
 # frozen_string_literal: true
-# This Karafka component is a Pro component under a commercial license.
-# This Karafka component is NOT licensed under LGPL.
-#
-# All of the commercial components are present in the lib/karafka/pro directory of this
-# repository and their usage requires commercial license agreement.
-#
-# Karafka has also commercial-friendly license, commercial support and commercial components.
-#
-# By sending a pull request to the pro components, you are agreeing to transfer the copyright of
-# your code to Maciej Mensfeld.
+# This code is part of Karafka Pro, a commercial component not licensed under LGPL.
+# See LICENSE for details.
 module Karafka
   module Pro

data/lib/karafka/pro/scheduled_messages/contracts/message.rb CHANGED Viewed

@@ -1,15 +1,7 @@
 # frozen_string_literal: true
-# This Karafka component is a Pro component under a commercial license.
-# This Karafka component is NOT licensed under LGPL.
-#
-# All of the commercial components are present in the lib/karafka/pro directory of this
-# repository and their usage requires commercial license agreement.
-#
-# Karafka has also commercial-friendly license, commercial support and commercial components.
-#
-# By sending a pull request to the pro components, you are agreeing to transfer the copyright of
-# your code to Maciej Mensfeld.
+# This code is part of Karafka Pro, a commercial component not licensed under LGPL.
+# See LICENSE for details.
 module Karafka
   module Pro

data/lib/karafka/pro/scheduled_messages/daily_buffer.rb CHANGED Viewed

@@ -1,15 +1,7 @@
 # frozen_string_literal: true
-# This Karafka component is a Pro component under a commercial license.
-# This Karafka component is NOT licensed under LGPL.
-#
-# All of the commercial components are present in the lib/karafka/pro directory of this
-# repository and their usage requires commercial license agreement.
-#
-# Karafka has also commercial-friendly license, commercial support and commercial components.
-#
-# By sending a pull request to the pro components, you are agreeing to transfer the copyright of
-# your code to Maciej Mensfeld.
+# This code is part of Karafka Pro, a commercial component not licensed under LGPL.
+# See LICENSE for details.
 module Karafka
   module Pro

data/lib/karafka/pro/scheduled_messages/day.rb CHANGED Viewed

@@ -1,15 +1,7 @@
 # frozen_string_literal: true
-# This Karafka component is a Pro component under a commercial license.
-# This Karafka component is NOT licensed under LGPL.
-#
-# All of the commercial components are present in the lib/karafka/pro directory of this
-# repository and their usage requires commercial license agreement.
-#
-# Karafka has also commercial-friendly license, commercial support and commercial components.
-#
-# By sending a pull request to the pro components, you are agreeing to transfer the copyright of
-# your code to Maciej Mensfeld.
+# This code is part of Karafka Pro, a commercial component not licensed under LGPL.
+# See LICENSE for details.
 module Karafka
   module Pro

data/lib/karafka/pro/scheduled_messages/deserializers/headers.rb CHANGED Viewed

@@ -1,15 +1,7 @@
 # frozen_string_literal: true
-# This Karafka component is a Pro component under a commercial license.
-# This Karafka component is NOT licensed under LGPL.
-#
-# All of the commercial components are present in the lib/karafka/pro directory of this
-# repository and their usage requires commercial license agreement.
-#
-# Karafka has also commercial-friendly license, commercial support and commercial components.
-#
-# By sending a pull request to the pro components, you are agreeing to transfer the copyright of
-# your code to Maciej Mensfeld.
+# This code is part of Karafka Pro, a commercial component not licensed under LGPL.
+# See LICENSE for details.
 module Karafka
   module Pro

data/lib/karafka/pro/scheduled_messages/deserializers/payload.rb CHANGED Viewed

@@ -1,15 +1,7 @@
 # frozen_string_literal: true
-# This Karafka component is a Pro component under a commercial license.
-# This Karafka component is NOT licensed under LGPL.
-#
-# All of the commercial components are present in the lib/karafka/pro directory of this
-# repository and their usage requires commercial license agreement.
-#
-# Karafka has also commercial-friendly license, commercial support and commercial components.
-#
-# By sending a pull request to the pro components, you are agreeing to transfer the copyright of
-# your code to Maciej Mensfeld.
+# This code is part of Karafka Pro, a commercial component not licensed under LGPL.
+# See LICENSE for details.
 module Karafka
   module Pro

data/lib/karafka/pro/scheduled_messages/dispatcher.rb CHANGED Viewed

@@ -1,15 +1,7 @@
 # frozen_string_literal: true
-# This Karafka component is a Pro component under a commercial license.
-# This Karafka component is NOT licensed under LGPL.
-#
-# All of the commercial components are present in the lib/karafka/pro directory of this
-# repository and their usage requires commercial license agreement.
-#
-# Karafka has also commercial-friendly license, commercial support and commercial components.
-#
-# By sending a pull request to the pro components, you are agreeing to transfer the copyright of
-# your code to Maciej Mensfeld.
+# This code is part of Karafka Pro, a commercial component not licensed under LGPL.
+# See LICENSE for details.
 module Karafka
   module Pro

data/lib/karafka/pro/scheduled_messages/errors.rb CHANGED Viewed

@@ -1,15 +1,7 @@
 # frozen_string_literal: true
-# This Karafka component is a Pro component under a commercial license.
-# This Karafka component is NOT licensed under LGPL.
-#
-# All of the commercial components are present in the lib/karafka/pro directory of this
-# repository and their usage requires commercial license agreement.
-#
-# Karafka has also commercial-friendly license, commercial support and commercial components.
-#
-# By sending a pull request to the pro components, you are agreeing to transfer the copyright of
-# your code to Maciej Mensfeld.
+# This code is part of Karafka Pro, a commercial component not licensed under LGPL.
+# See LICENSE for details.
 module Karafka
   module Pro

data/lib/karafka/pro/scheduled_messages/max_epoch.rb CHANGED Viewed

@@ -1,15 +1,7 @@
 # frozen_string_literal: true
-# This Karafka component is a Pro component under a commercial license.
-# This Karafka component is NOT licensed under LGPL.
-#
-# All of the commercial components are present in the lib/karafka/pro directory of this
-# repository and their usage requires commercial license agreement.
-#
-# Karafka has also commercial-friendly license, commercial support and commercial components.
-#
-# By sending a pull request to the pro components, you are agreeing to transfer the copyright of
-# your code to Maciej Mensfeld.
+# This code is part of Karafka Pro, a commercial component not licensed under LGPL.
+# See LICENSE for details.
 module Karafka
   module Pro

data/lib/karafka/pro/scheduled_messages/proxy.rb CHANGED Viewed

@@ -1,15 +1,7 @@
 # frozen_string_literal: true
-# This Karafka component is a Pro component under a commercial license.
-# This Karafka component is NOT licensed under LGPL.
-#
-# All of the commercial components are present in the lib/karafka/pro directory of this
-# repository and their usage requires commercial license agreement.
-#
-# Karafka has also commercial-friendly license, commercial support and commercial components.
-#
-# By sending a pull request to the pro components, you are agreeing to transfer the copyright of
-# your code to Maciej Mensfeld.
+# This code is part of Karafka Pro, a commercial component not licensed under LGPL.
+# See LICENSE for details.
 module Karafka
   module Pro

data/lib/karafka/pro/scheduled_messages/schema_validator.rb CHANGED Viewed

@@ -1,15 +1,7 @@
 # frozen_string_literal: true
-# This Karafka component is a Pro component under a commercial license.
-# This Karafka component is NOT licensed under LGPL.
-#
-# All of the commercial components are present in the lib/karafka/pro directory of this
-# repository and their usage requires commercial license agreement.
-#
-# Karafka has also commercial-friendly license, commercial support and commercial components.
-#
-# By sending a pull request to the pro components, you are agreeing to transfer the copyright of
-# your code to Maciej Mensfeld.
+# This code is part of Karafka Pro, a commercial component not licensed under LGPL.
+# See LICENSE for details.
 module Karafka
   module Pro

data/lib/karafka/pro/scheduled_messages/serializer.rb CHANGED Viewed

@@ -1,15 +1,7 @@
 # frozen_string_literal: true
-# This Karafka component is a Pro component under a commercial license.
-# This Karafka component is NOT licensed under LGPL.
-#
-# All of the commercial components are present in the lib/karafka/pro directory of this
-# repository and their usage requires commercial license agreement.
-#
-# Karafka has also commercial-friendly license, commercial support and commercial components.
-#
-# By sending a pull request to the pro components, you are agreeing to transfer the copyright of
-# your code to Maciej Mensfeld.
+# This code is part of Karafka Pro, a commercial component not licensed under LGPL.
+# See LICENSE for details.
 module Karafka
   module Pro

data/lib/karafka/pro/scheduled_messages/setup/config.rb CHANGED Viewed

@@ -1,15 +1,7 @@
 # frozen_string_literal: true
-# This Karafka component is a Pro component under a commercial license.
-# This Karafka component is NOT licensed under LGPL.
-#
-# All of the commercial components are present in the lib/karafka/pro directory of this
-# repository and their usage requires commercial license agreement.
-#
-# Karafka has also commercial-friendly license, commercial support and commercial components.
-#
-# By sending a pull request to the pro components, you are agreeing to transfer the copyright of
-# your code to Maciej Mensfeld.
+# This code is part of Karafka Pro, a commercial component not licensed under LGPL.
+# See LICENSE for details.
 module Karafka
   module Pro

data/lib/karafka/pro/scheduled_messages/state.rb CHANGED Viewed

@@ -1,15 +1,7 @@
 # frozen_string_literal: true
-# This Karafka component is a Pro component under a commercial license.
-# This Karafka component is NOT licensed under LGPL.
-#
-# All of the commercial components are present in the lib/karafka/pro directory of this
-# repository and their usage requires commercial license agreement.
-#
-# Karafka has also commercial-friendly license, commercial support and commercial components.
-#
-# By sending a pull request to the pro components, you are agreeing to transfer the copyright of
-# your code to Maciej Mensfeld.
+# This code is part of Karafka Pro, a commercial component not licensed under LGPL.
+# See LICENSE for details.
 module Karafka
   module Pro

data/lib/karafka/pro/scheduled_messages/tracker.rb CHANGED Viewed

@@ -1,15 +1,7 @@
 # frozen_string_literal: true
-# This Karafka component is a Pro component under a commercial license.
-# This Karafka component is NOT licensed under LGPL.
-#
-# All of the commercial components are present in the lib/karafka/pro directory of this
-# repository and their usage requires commercial license agreement.
-#
-# Karafka has also commercial-friendly license, commercial support and commercial components.
-#
-# By sending a pull request to the pro components, you are agreeing to transfer the copyright of
-# your code to Maciej Mensfeld.
+# This code is part of Karafka Pro, a commercial component not licensed under LGPL.
+# See LICENSE for details.
 module Karafka
   module Pro

data/lib/karafka/pro/scheduled_messages.rb CHANGED Viewed

@@ -1,15 +1,7 @@
 # frozen_string_literal: true
-# This Karafka component is a Pro component under a commercial license.
-# This Karafka component is NOT licensed under LGPL.
-#
-# All of the commercial components are present in the lib/karafka/pro directory of this
-# repository and their usage requires commercial license agreement.
-#
-# Karafka has also commercial-friendly license, commercial support and commercial components.
-#
-# By sending a pull request to the pro components, you are agreeing to transfer the copyright of
-# your code to Maciej Mensfeld.
+# This code is part of Karafka Pro, a commercial component not licensed under LGPL.
+# See LICENSE for details.
 module Karafka
   module Pro

data/lib/karafka/pro/swarm/liveness_listener.rb CHANGED Viewed

@@ -1,15 +1,7 @@
 # frozen_string_literal: true
-# This Karafka component is a Pro component under a commercial license.
-# This Karafka component is NOT licensed under LGPL.
-#
-# All of the commercial components are present in the lib/karafka/pro directory of this
-# repository and their usage requires commercial license agreement.
-#
-# Karafka has also commercial-friendly license, commercial support and commercial components.
-#
-# By sending a pull request to the pro components, you are agreeing to transfer the copyright of
-# your code to Maciej Mensfeld.
+# This code is part of Karafka Pro, a commercial component not licensed under LGPL.
+# See LICENSE for details.
 module Karafka
   module Pro

data/lib/karafka/processing/executor.rb CHANGED Viewed

@@ -81,6 +81,13 @@ module Karafka
         consumer.on_before_consume
       end
+      # Runs the wrap/around execution context appropriate for a given action
+      # @param action [Symbol] action execution wrapped with our block
+      # @param block [Proc] execution context
+      def wrap(action, &block)
+        consumer.on_wrap(action, &block)
+      end
       # Runs consumer data processing against given batch and handles failures and errors.
       def consume
         # We run the consumer client logic...

data/lib/karafka/processing/jobs/base.rb CHANGED Viewed

@@ -15,6 +15,11 @@ module Karafka
         attr_reader :executor
+        class << self
+          # @return [Symbol] Job matching appropriate action
+          attr_accessor :action
+        end
         # Creates a new job instance
         def initialize
           # All jobs are blocking by default and they can release the lock when blocking operations
@@ -23,6 +28,14 @@ module Karafka
           @status = :pending
         end
+        # Runs the wrap/around job hook within which the rest of the flow happens
+        # @param block [Proc] whole user related processing flow
+        # @note We inject the action name so user can decide whether to run custom logic on a
+        #   given action or not.
+        def wrap(&block)
+          executor.wrap(self.class.action, &block)
+        end
         # When redefined can run any code prior to the job being scheduled
         # @note This will run in the listener thread and not in the worker
         def before_schedule

data/lib/karafka/processing/jobs/consume.rb CHANGED Viewed

@@ -9,6 +9,8 @@ module Karafka
         # @return [Array<Rdkafka::Consumer::Message>] array with messages
         attr_reader :messages
+        self.action = :consume
         # @param executor [Karafka::Processing::Executor] executor that is suppose to run a given
         #   job
         # @param messages [Karafka::Messages::Messages] karafka messages batch

data/lib/karafka/processing/jobs/eofed.rb CHANGED Viewed

@@ -5,6 +5,8 @@ module Karafka
     module Jobs
       # Job that runs the eofed operation when we receive eof without messages alongside.
       class Eofed < Base
+        self.action = :eofed
         # @param executor [Karafka::Processing::Executor] executor that is suppose to run the job
         # @return [Eofed]
         def initialize(executor)

data/lib/karafka/processing/jobs/idle.rb CHANGED Viewed

@@ -6,6 +6,8 @@ module Karafka
       # Type of job that we may use to run some extra handling that happens without the user
       # related lifecycle event like consumption, revocation, etc.
       class Idle < Base
+        self.action = :idle
         # @param executor [Karafka::Processing::Executor] executor that is suppose to run a given
         #   job on an active consumer
         # @return [Shutdown]

data/lib/karafka/processing/jobs/revoked.rb CHANGED Viewed

@@ -5,6 +5,8 @@ module Karafka
     module Jobs
       # Job that runs the revoked operation when we loose a partition on a consumer that lost it.
       class Revoked < Base
+        self.action = :revoked
         # @param executor [Karafka::Processing::Executor] executor that is suppose to run the job
         # @return [Revoked]
         def initialize(executor)

data/lib/karafka/processing/jobs/shutdown.rb CHANGED Viewed

@@ -5,6 +5,8 @@ module Karafka
     module Jobs
       # Job that runs on each active consumer upon process shutdown (one job per consumer).
       class Shutdown < Base
+        self.action = :shutdown
         # @param executor [Karafka::Processing::Executor] executor that is suppose to run a given
         #   job on an active consumer
         # @return [Shutdown]

data/lib/karafka/processing/strategies/aj_dlq_mom.rb CHANGED Viewed

@@ -35,7 +35,7 @@ module Karafka
             # since AJ consumer commits the offset after each job, we also know that the
             # previous job was successful
             mark_dispatched_to_dlq(skippable_message)
-            pause(coordinator.seek_offset, nil, false)
+            pause(seek_offset, nil, false)
           end
         end
       end