karafka-web 0.11.2 → 0.11.4

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 4320bd74426900e3a77f1748242c757cb44a1b0b578300a413d5a1cb706ec3de
-  data.tar.gz: 75be8a6b974829adde0b266cb2df6e1f62752a35dc271110a04a00eef93865df
+  metadata.gz: c30d2f5113f89bf796fbfa024336ebcad6796826bcbd691fc73fab1fb3fd05dd
+  data.tar.gz: 3c4fe2b494603f7c7f73c73fc1b0f8a82a4c09dc06ab885dd334f7d96632c8da
 SHA512:
-  metadata.gz: 58a4c8ed2d9d400070aa4d43bb29a73006c435c00fd4d9143dd520db01368b5984729bd947bd88a8f2c1865fff25935449150b329f9396405ec53ce82c850299
-  data.tar.gz: d1c96b677662d862d9d05a70945f3ca7fbc55359033fb7f3350600eb4e0388673bc8482f1f165f0775b5d02bf8075801e1450286b59a0fdc4bd2b2d9e5405ef7
+  metadata.gz: d4327b5af8e3a41e379e5db63b08269ec9a22d5912a4839e86d113a377f8003b0d597af7613b2d6243cbaa6520c649b1f1ec66d548bf780afda069f121fd4921
+  data.tar.gz: 14c3162caadaf02381148953758e5162278bc5f8415d28dd0476453942059aa0cd582957b9cd7f8e84faf8d9213302510594fc548ec3602c9171785eb25ba813

data/CHANGELOG.md

@@ -1,5 +1,26 @@
 # Karafka Web Changelog
 
+## 0.11.4 (2025-11-01)
+- [Enhancement] Show placeholder rows for partitions with no data during rebalances in health view. The UI now displays all topic partitions (0 to N-1) with "No data available" indicators for partitions currently being rebalanced, preventing confusion from disappearing partitions. Consumer reports now include `partitions_cnt` field extracted from librdkafka statistics. Consumer schema version bumped to 1.5.0 (breaking change).
+- [Enhancement] Track and report UI errors originating from Roda/Puma web processes directly to Kafka errors topic for visibility and debugging. UI errors are dispatched asynchronously from web processes using a dedicated listener.
+- [Enhancement] Require Karafka 2.5.2 at minimum and migrate from string-based execution mode comparisons to the new ExecutionMode object API.
+- [Enhancement] Increase Web UI processing consumer backoff time to 30 seconds when encountering incompatible schema errors to prevent error spam during rolling upgrades.
+- [Enhancement] Add unique `id` field to error reports to track duplicate error occurrences. Error schema version bumped to 1.2.0 while maintaining backward compatibility with older error formats (1.0.0, 1.1.0) in the Web UI.
+- [Enhancement] Add container-aware metrics collection for Docker/Kubernetes environments. The Web UI now reports accurate container memory limits from cgroups (v1 and v2) instead of misleading host metrics, while maintaining full backward compatibility with non-containerized deployments.
+- [Enhancement] Add per-message report migration system to handle schema evolution for consumer reports. This allows transparent migration of old report formats (e.g., schema 1.2.x using `process[:name]`) to current expectations (schema 1.3.0+ using `process[:id]`), ensuring backward compatibility with reports from older karafka-web versions (≤ v0.8.2) that may still exist in Kafka topics.
+- [Change] Reduce `max_messages` for consumer reports processing from 1000 to 200 to prevent excessive memory usage in large-scale deployments. Processing 1000 messages at once can impact memory consumption significantly in big systems, while 200 messages provides better memory efficiency with negligible impact on throughput.
+- [Refactor] Extract metrics collection logic from monolithic Sampler into focused, single-responsibility classes (Metrics::Base, Metrics::Os, Metrics::Container, Metrics::Network, Metrics::Server, Metrics::Jobs) and consumer groups enrichment into dedicated enricher (Enrichers::Base, Enrichers::ConsumerGroups) for improved maintainability and testability.
+- [Testing] Add Docker-based integration tests for container metrics collection. Tests verify cgroup v1/v2 detection, memory limit reading, and fallback behavior across multiple containerized scenarios with different resource constraints.
+- [Fix] Fix "OS memory used" metric on Linux reporting same value as RSS instead of system-wide memory usage. The metric now correctly sums memory usage across all processes (or all container processes when running in Docker/Kubernetes) to match macOS behavior and original design intent.
+- [Fix] Fix crash when processing old consumer reports from schema versions < 1.3.0 (karafka-web ≤ v0.8.2) that used `process[:name]` field instead of `process[:id]`. The error `undefined method 'to_sym' for nil` would occur when these old reports were encountered during upgrades. Reports are now automatically migrated in-place to the current schema format.
+
+## 0.11.3 (2025-09-29)
+- [Enhancement] Upgrade DaisyUI to 5.1.
+- [Change] Remove Ruby `3.1` support according to the EOL schedule.
+- [Change] Normalize how libs and dependencies are required (no functional change for the end user)
+- [Fix] Fix a case where the states JSON would contain multiple entries for the same processes causing `JSON.parse` with `allow_duplicate_key: false` to fail.
+- [Fix] Fix incorrect reference to `IncompatibleSchemaError`.
+
 ## 0.11.2 (2025-08-18)
 - [Enhancement] Make sure that TTL counters related `#inspect` are thread-safe.
 - [Change] Add new CI action to trigger auto-doc refresh.
@@ -158,6 +179,9 @@
 - [Fix] License identifier `LGPL-3.0` is deprecated for SPDX (#2177).
 - [Fix] Do not include prettifying the payload for visibility in the resource computation cost.
 
+## 0.9.2 (2025-09-19)
+- [Fix] Fix BaseController caller action name extraction.
+
 ## 0.9.1 (2024-05-03)
 - [Fix] OSS `lag_stored` for not-subscribed consumers causes Web UI to crash.
 

data/Gemfile

@@ -2,8 +2,6 @@
 
 source 'https://rubygems.org'
 
-plugin 'diffend'
-
 gemspec
 
 group :test do

data/Gemfile.lock

@@ -1,9 +1,9 @@
 PATH
   remote: .
   specs:
-    karafka-web (0.11.2)
+    karafka-web (0.11.4)
       erubi (~> 1.4)
-      karafka (>= 2.5.0.rc2, < 2.6.0)
+      karafka (>= 2.5.2, < 2.6.0)
       karafka-core (>= 2.5.0, < 2.6.0)
       roda (~> 3.68, >= 3.69)
       tilt (~> 2.0)
@@ -11,7 +11,7 @@ PATH
 GEM
   remote: https://rubygems.org/
   specs:
-    activesupport (7.2.2.2)
+    activesupport (8.0.3)
       base64
       benchmark (>= 0.3)
       bigdecimal
@@ -23,102 +23,141 @@ GEM
       minitest (>= 5.1)
       securerandom (>= 0.3)
       tzinfo (~> 2.0, >= 2.0.5)
-    base64 (0.2.0)
+      uri (>= 0.13.1)
+    base64 (0.3.0)
     benchmark (0.4.1)
-    bigdecimal (3.1.9)
+    bigdecimal (3.3.1)
     byebug (12.0.0)
     concurrent-ruby (1.3.5)
-    connection_pool (2.5.3)
+    connection_pool (2.5.4)
     diff-lcs (1.6.2)
     docile (1.4.1)
     drb (2.2.3)
     erubi (1.13.1)
-    et-orbi (1.2.11)
+    et-orbi (1.4.0)
       tzinfo
-    factory_bot (6.5.5)
+    factory_bot (6.5.6)
       activesupport (>= 6.1.0)
     ffi (1.17.2)
-    fugit (1.11.1)
-      et-orbi (~> 1, >= 1.2.11)
+    ffi (1.17.2-aarch64-linux-gnu)
+    ffi (1.17.2-aarch64-linux-musl)
+    ffi (1.17.2-arm-linux-gnu)
+    ffi (1.17.2-arm-linux-musl)
+    ffi (1.17.2-arm64-darwin)
+    ffi (1.17.2-x86-linux-gnu)
+    ffi (1.17.2-x86-linux-musl)
+    ffi (1.17.2-x86_64-darwin)
+    ffi (1.17.2-x86_64-linux-gnu)
+    ffi (1.17.2-x86_64-linux-musl)
+    fugit (1.12.1)
+      et-orbi (~> 1.4)
       raabro (~> 1.4)
     i18n (1.14.7)
       concurrent-ruby (~> 1.0)
-    karafka (2.5.0)
+    json (2.15.1)
+    karafka (2.5.2)
       base64 (~> 0.2)
-      karafka-core (>= 2.5.2, < 2.6.0)
-      karafka-rdkafka (>= 0.19.5)
-      waterdrop (>= 2.8.3, < 3.0.0)
+      karafka-core (>= 2.5.6, < 2.6.0)
+      karafka-rdkafka (>= 0.22.0)
+      waterdrop (>= 2.8.9, < 3.0.0)
       zeitwerk (~> 2.3)
-    karafka-core (2.5.2)
-      karafka-rdkafka (>= 0.19.2, < 0.21.0)
+    karafka-core (2.5.7)
+      karafka-rdkafka (>= 0.20.0)
       logger (>= 1.6.0)
-    karafka-rdkafka (0.19.5)
+    karafka-rdkafka (0.22.2)
       ffi (~> 1.15)
+      json (> 2.0)
+      logger
+      mini_portile2 (~> 2.6)
+      rake (> 12)
+    karafka-rdkafka (0.22.2-aarch64-linux-gnu)
+      ffi (~> 1.15)
+      json (> 2.0)
+      logger
+      mini_portile2 (~> 2.6)
+      rake (> 12)
+    karafka-rdkafka (0.22.2-arm64-darwin)
+      ffi (~> 1.15)
+      json (> 2.0)
+      logger
+      mini_portile2 (~> 2.6)
+      rake (> 12)
+    karafka-rdkafka (0.22.2-x86_64-linux-gnu)
+      ffi (~> 1.15)
+      json (> 2.0)
+      logger
+      mini_portile2 (~> 2.6)
+      rake (> 12)
+    karafka-rdkafka (0.22.2-x86_64-linux-musl)
+      ffi (~> 1.15)
+      json (> 2.0)
+      logger
       mini_portile2 (~> 2.6)
       rake (> 12)
     logger (1.7.0)
     mini_portile2 (2.8.9)
-    minitest (5.25.5)
-    nokogiri (1.18.9)
+    minitest (5.26.0)
+    nokogiri (1.18.10)
       mini_portile2 (~> 2.8.2)
       racc (~> 1.4)
-    nokogiri (1.18.9-aarch64-linux-gnu)
+    nokogiri (1.18.10-aarch64-linux-gnu)
       racc (~> 1.4)
-    nokogiri (1.18.9-aarch64-linux-musl)
+    nokogiri (1.18.10-aarch64-linux-musl)
       racc (~> 1.4)
-    nokogiri (1.18.9-arm-linux-gnu)
+    nokogiri (1.18.10-arm-linux-gnu)
       racc (~> 1.4)
-    nokogiri (1.18.9-arm-linux-musl)
+    nokogiri (1.18.10-arm-linux-musl)
       racc (~> 1.4)
-    nokogiri (1.18.9-arm64-darwin)
+    nokogiri (1.18.10-arm64-darwin)
       racc (~> 1.4)
-    nokogiri (1.18.9-x86_64-darwin)
+    nokogiri (1.18.10-x86_64-darwin)
       racc (~> 1.4)
-    nokogiri (1.18.9-x86_64-linux-gnu)
+    nokogiri (1.18.10-x86_64-linux-gnu)
       racc (~> 1.4)
-    nokogiri (1.18.9-x86_64-linux-musl)
+    nokogiri (1.18.10-x86_64-linux-musl)
       racc (~> 1.4)
     ostruct (0.6.3)
     raabro (1.4.0)
     racc (1.8.1)
-    rack (3.1.16)
+    rack (3.2.3)
     rack-test (2.2.0)
       rack (>= 1.3)
     rackup (0.2.3)
       rack (>= 3.0.0.beta1)
       webrick
-    rake (13.2.1)
-    roda (3.92.0)
+    rake (13.3.0)
+    roda (3.97.0)
       rack
-    rspec (3.13.1)
+    rspec (3.13.2)
       rspec-core (~> 3.13.0)
       rspec-expectations (~> 3.13.0)
       rspec-mocks (~> 3.13.0)
-    rspec-core (3.13.4)
+    rspec-core (3.13.6)
       rspec-support (~> 3.13.0)
     rspec-expectations (3.13.5)
       diff-lcs (>= 1.2.0, < 2.0)
       rspec-support (~> 3.13.0)
-    rspec-mocks (3.13.5)
+    rspec-mocks (3.13.6)
       diff-lcs (>= 1.2.0, < 2.0)
       rspec-support (~> 3.13.0)
-    rspec-support (3.13.4)
+    rspec-support (3.13.6)
     securerandom (0.4.1)
     simplecov (0.22.0)
       docile (~> 1.1)
       simplecov-html (~> 0.11)
       simplecov_json_formatter (~> 0.1)
-    simplecov-html (0.13.1)
+    simplecov-html (0.13.2)
     simplecov_json_formatter (0.1.4)
-    tilt (2.6.0)
+    tilt (2.6.1)
     tzinfo (2.0.6)
       concurrent-ruby (~> 1.0)
-    waterdrop (2.8.4)
+    uri (1.0.4)
+    waterdrop (2.8.12)
       karafka-core (>= 2.4.9, < 3.0.0)
-      karafka-rdkafka (>= 0.19.2)
+      karafka-rdkafka (>= 0.20.0)
       zeitwerk (~> 2.3)
     webrick (1.9.1)
-    zeitwerk (2.6.18)
+    zeitwerk (2.7.3)
 
 PLATFORMS
   aarch64-linux-gnu

data/bin/integrations

@@ -0,0 +1,44 @@
+#!/usr/bin/env bash
+
+# Integration test runner for container metrics
+# Runs tests inside Docker containers with various memory/CPU configurations
+
+set -e
+
+echo "================================================"
+echo "Container Metrics Integration Tests"
+echo "================================================"
+echo ""
+
+# Build the test image first
+echo "Building integration test Docker image..."
+docker compose -f spec/integrations/docker-compose.yml build
+
+echo ""
+echo "Running integration tests in containers..."
+echo ""
+
+# Run all test scenarios
+# Note: Each container runs independently and exits after tests complete
+docker compose -f spec/integrations/docker-compose.yml up \
+  --abort-on-container-exit \
+  --exit-code-from test-container-limited \
+  test-container-limited
+
+docker compose -f spec/integrations/docker-compose.yml up \
+  --abort-on-container-exit \
+  --exit-code-from test-container-unlimited \
+  test-container-unlimited
+
+docker compose -f spec/integrations/docker-compose.yml up \
+  --abort-on-container-exit \
+  --exit-code-from test-container-strict \
+  test-container-strict
+
+echo ""
+echo "================================================"
+echo "All integration tests completed successfully!"
+echo "================================================"
+
+# Clean up
+docker compose -f spec/integrations/docker-compose.yml down

data/bin/rspecs

@@ -2,5 +2,9 @@
 
 set -e
 
-SPECS_TYPE=regular bundle exec rspec --exclude-pattern "**/pro/**/*_spec.rb"
-SPECS_TYPE=pro bundle exec rspec spec/lib/karafka/web/pro
+SPECS_TYPE=regular bundle exec rspec \
+  spec/lib \
+  --exclude-pattern "**/pro/**/*_spec.rb"
+
+SPECS_TYPE=pro bundle exec rspec \
+  spec/lib/karafka/web/pro

data/bin/verify_kafka_warnings

@@ -13,7 +13,7 @@ allowed_patterns=(
 )
 
 # Get all warnings
-warnings=$(docker logs --since=0 kafka | grep WARN)
+warnings=$(docker logs --since=0 kafka | grep "] WARN ")
 exit_code=0
 
 while IFS= read -r line; do

data/config/locales/errors.yml

@@ -7,3 +7,4 @@ en:
       missing: needs to be present
       id_format: needs to be a String
       format: is invalid
+      processes_format: must be a hash with symbol keys

data/docker-compose.yml

@@ -1,9 +1,7 @@
-version: '2'
-
 services:
   kafka:
     container_name: kafka
-    image: confluentinc/cp-kafka:8.0.0
+    image: confluentinc/cp-kafka:8.1.0
 
     ports:
       - 9092:9092

data/karafka-web.gemspec

@@ -17,14 +17,14 @@ Gem::Specification.new do |spec|
   spec.licenses    = %w[LGPL-3.0-only Commercial]
 
   spec.add_dependency 'erubi', '~> 1.4'
-  spec.add_dependency 'karafka', '>= 2.5.0.rc2', '< 2.6.0'
+  spec.add_dependency 'karafka', '>= 2.5.2', '< 2.6.0'
   spec.add_dependency 'karafka-core', '>= 2.5.0', '< 2.6.0'
   spec.add_dependency 'roda', '~> 3.68', '>= 3.69'
   spec.add_dependency 'tilt', '~> 2.0'
 
   spec.add_development_dependency 'rackup', '~> 0.2'
 
-  spec.required_ruby_version = '>= 3.1.0'
+  spec.required_ruby_version = '>= 3.2.0'
 
   spec.executables   = %w[karafka-web]
   spec.require_paths = %w[lib]

data/lib/karafka/web/app.rb

@@ -6,9 +6,8 @@ module Karafka
     class App
       class << self
         # @param env [Hash] Rack env
-        # @param block [Proc] Rack block
-        def call(env, &block)
-          engine.call(env, &block)
+        def call(env, &)
+          engine.call(env, &)
         end
 
         # @return [Class] regular or pro Web engine

data/lib/karafka/web/cli/help.rb

@@ -10,7 +10,7 @@ module Karafka
         # Print available commands
         def call
           # Find the longest command for alignment purposes
-          max_command_length = self.class.commands.map(&:name).map(&:size).max
+          max_command_length = self.class.commands.map { |command| command.name.size }.max
 
           puts 'Karafka Web UI commands:'
 

data/lib/karafka/web/config.rb

@@ -171,6 +171,14 @@ module Karafka
             Tracking::Producers::Listeners::Errors.new
           ]
         end
+
+        setting :ui do
+          # Listeners needed for the Web UI to track errors from Roda/Puma
+          # These dispatch directly to Kafka since there's no background reporter in web processes
+          setting :listeners, default: [
+            Tracking::Ui::Errors.new
+          ]
+        end
       end
 
       # States processing related settings

data/lib/karafka/web/contracts/base.rb

@@ -13,10 +13,8 @@ module Karafka
             return super if block_given?
 
             super do |config|
-              config.error_messages = YAML.safe_load(
-                File.read(
-                  File.join(Karafka::Web.gem_root, 'config', 'locales', 'errors.yml')
-                )
+              config.error_messages = YAML.safe_load_file(
+                File.join(Karafka::Web.gem_root, 'config', 'locales', 'errors.yml')
               ).fetch('en').fetch('validations').fetch('web')
             end
           end

data/lib/karafka/web/contracts/config.rb

@@ -19,7 +19,7 @@ module Karafka
             required(:name) { |val| val.is_a?(String) && TOPIC_REGEXP.match?(val) }
 
             required(:config) do |val|
-              val.is_a?(Hash) && !val.empty? && val.keys.all? { |key| key.is_a?(Symbol) }
+              val.is_a?(Hash) && !val.empty? && val.keys.all?(Symbol)
             end
           end
 
@@ -28,7 +28,7 @@ module Karafka
               required(:name) { |val| val.is_a?(String) && TOPIC_REGEXP.match?(val) }
 
               required(:config) do |val|
-                val.is_a?(Hash) && !val.empty? && val.keys.all? { |key| key.is_a?(Symbol) }
+                val.is_a?(Hash) && !val.empty? && val.keys.all?(Symbol)
               end
             end
 
@@ -36,7 +36,7 @@ module Karafka
               required(:name) { |val| val.is_a?(String) && TOPIC_REGEXP.match?(val) }
 
               required(:config) do |val|
-                val.is_a?(Hash) && !val.empty? && val.keys.all? { |key| key.is_a?(Symbol) }
+                val.is_a?(Hash) && !val.empty? && val.keys.all?(Symbol)
               end
             end
 
@@ -44,7 +44,7 @@ module Karafka
               required(:name) { |val| val.is_a?(String) && TOPIC_REGEXP.match?(val) }
 
               required(:config) do |val|
-                val.is_a?(Hash) && !val.empty? && val.keys.all? { |key| key.is_a?(Symbol) }
+                val.is_a?(Hash) && !val.empty? && val.keys.all?(Symbol)
               end
             end
 
@@ -52,7 +52,7 @@ module Karafka
               required(:name) { |val| val.is_a?(String) && TOPIC_REGEXP.match?(val) }
 
               required(:config) do |val|
-                val.is_a?(Hash) && !val.empty? && val.keys.all? { |key| key.is_a?(Symbol) }
+                val.is_a?(Hash) && !val.empty? && val.keys.all?(Symbol)
               end
             end
           end

data/lib/karafka/web/deserializer.rb

@@ -21,7 +21,12 @@ module Karafka
 
         ::JSON.parse(
           raw_payload,
-          symbolize_names: true
+          symbolize_names: true,
+          # We allow duplicates keys because of a fixed bug that was causing duplicated process
+          # ids to leak into the consumers states data. Once a proper migration is written, this
+          # can be retired
+          # @see https://github.com/karafka/karafka-web/issues/741
+          allow_duplicate_key: true
         )
       end
     end

data/lib/karafka/web/errors.rb

@@ -54,6 +54,14 @@ module Karafka
 
         # Similar to the one related to consumers states
         MissingConsumersMetricsTopicError = Class.new(BaseError)
+
+        # Similar to management and ui errors with the same name, it is raised when a critical
+        # incompatibility is detected during processing.
+        #
+        # This error is raised when there was an attempt to process reports that are in a newer
+        # version that the one in the current process. We prevent this from happening not to
+        # corrupt the data. Please upgrade all the Web UI consumers to the same version
+        IncompatibleSchemaError = Class.new(BaseError)
       end
 
       # Ui related errors
@@ -67,11 +75,6 @@ module Karafka
 
         # Raised when we want to stop the flow and render 403
         ForbiddenError = Class.new(BaseError)
-
-        # Raised when trying to get info about a consumer that has incompatible schema in its
-        # report. It usually means you are running different version of the Web UI in the consumer
-        # and in the Web server
-        IncompatibleSchemaError = Class.new(BaseError)
       end
     end
   end

data/lib/karafka/web/management/actions/enable.rb

@@ -61,7 +61,7 @@ module Karafka
                   # Since we materialize state in intervals, we can poll for half of this time
                   # without impacting the reporting responsiveness
                   max_wait_time ::Karafka::Web.config.processing.interval / 2
-                  max_messages 1_000
+                  max_messages 200
                   consumer ::Karafka::Web::Processing::Consumer
                   # This needs to be true in order not to reload the consumer in dev. This consumer
                   # should not be affected by the end user development process
@@ -73,6 +73,13 @@ module Karafka
                   # consumer group name would be renamed and we would start consuming all
                   # historical
                   initial_offset 'latest'
+                  # Increase backoff time on errors. Incompatible schema errors are not recoverable
+                  # until rolling upgrade completes, so we use a longer max timeout to prevent
+                  # spamming errors in logs.
+                  # We set this ourselves so user settings do not impact frequency of retrying
+                  pause_timeout 5_000
+                  pause_max_timeout 60_000
+                  pause_with_exponential_backoff true
                   # We use the defaults + our config alterations that may not align with what
                   # user wants for his topics.
                   kafka kafka_config
@@ -124,6 +131,12 @@ module Karafka
 
               ::Karafka::Web.producer.monitor.subscribe(listener)
             end
+
+            # Installs all the UI related listeners for tracking errors from web processes
+            # These listen on Karafka monitor to catch instrumented UI errors
+            ::Karafka::Web.config.tracking.ui.listeners.each do |listener|
+              ::Karafka.monitor.subscribe(listener)
+            end
           end
 
           # In most cases we want to close the producer if possible.

data/lib/karafka/web/management/migrations/consumers_reports/1761645571_rename_process_name_to_id.rb

@@ -0,0 +1,38 @@
+# frozen_string_literal: true
+
+module Karafka
+  module Web
+    module Management
+      module Migrations
+        # Consumer reports migrations
+        module ConsumersReports
+          # Migrates consumer reports from schema < 1.3.0 that used process[:name] to process[:id]
+          #
+          # In schema versions 1.2.x and earlier (karafka-web <= v0.8.2), the process identifier
+          # was stored in the :name field. Starting with schema 1.3.0 (karafka-web v0.9.0+),
+          # this was renamed to :id for consistency.
+          #
+          # This migration ensures old reports can be processed by current aggregators that
+          # expect the :id field.
+          class RenameProcessNameToId < Base
+            # Apply to all schema versions before 1.3.0
+            self.versions_until = '1.3.0'
+            self.type = :consumers_reports
+
+            # @param report [Hash] consumer report to migrate
+            def migrate(report)
+              # If :id already exists, nothing to do (already migrated or newer schema)
+              return if report[:process][:id]
+
+              # Rename :name to :id
+              # Both :name (in schema < 1.3.0) and :id (in schema >= 1.3.0) were always
+              # required fields, so we don't need nil checks for valid reports
+              report[:process][:id] = report[:process][:name]
+              report[:process].delete(:name)
+            end
+          end
+        end
+      end
+    end
+  end
+end

data/lib/karafka/web/management/migrator.rb

@@ -65,8 +65,6 @@ module Karafka
               'consumers metrics newer than supported'
             )
           end
-
-          true
         end
 
         # Applies migrations if needed and mutates the in-memory data
@@ -76,6 +74,9 @@ module Karafka
           any_migrations = false
 
           Migrations::Base.sorted_descendants.each do |migration_class|
+            # Skip report migrations - they are applied per-message by ReportsMigrator
+            next if migration_class.type == :consumers_reports
+
             data = send(migration_class.type)
 
             next unless migration_class.applicable?(data[:schema_version])

data/lib/karafka/web/pro/commanding/commands/base.rb

@@ -50,7 +50,7 @@ module Karafka
             #   being executed in the embedded or swarm processes since there the signaling is
             #   handled differently (either via the main process or supervisor).
             def standalone?
-              Karafka::Server.execution_mode == :standalone
+              Karafka::Server.execution_mode.standalone?
             end
 
             # @return [String] id of the current consumer process

data/lib/karafka/web/pro/commanding/contracts/config.rb

@@ -12,10 +12,8 @@ module Karafka
           # Makes sure, all the expected commanding config is defined as it should be
           class Config < ::Karafka::Contracts::Base
             configure do |config|
-              config.error_messages = YAML.safe_load(
-                File.read(
-                  File.join(Karafka::Web.gem_root, 'config', 'locales', 'pro_errors.yml')
-                )
+              config.error_messages = YAML.safe_load_file(
+                File.join(Karafka::Web.gem_root, 'config', 'locales', 'pro_errors.yml')
               ).fetch('en').fetch('validations').fetch('config')
             end
 

data/lib/karafka/web/pro/commanding/handlers/partitions/tracker.rb

@@ -41,17 +41,16 @@ module Karafka
               # @param subscription_group_id [String] id of the subscription group for which we
               #   want to get all the requests. Subscription groups ids (not names) are unique
               #   within the application, so it is unique "enough".
-              # @param block [Proc]
               #
               # @yieldparam [Request] given command request for the requested subscription group
-              def each_for(subscription_group_id, &block)
+              def each_for(subscription_group_id, &)
                 requests = nil
 
                 @mutex.synchronize do
                   requests = @requests.delete(subscription_group_id)
                 end
 
-                (requests || EMPTY_ARRAY).each(&block)
+                (requests || EMPTY_ARRAY).each(&)
               end
             end
           end

data/lib/karafka/web/pro/ui/controllers/scheduled_messages/schedules_controller.rb

@@ -21,8 +21,7 @@ module Karafka
                 # cluster
                 candidates = Karafka::App
                              .routes
-                             .map(&:topics)
-                             .map(&:to_a)
+                             .map { |route| route.topics.to_a }
                              .flatten
                              .select(&:scheduled_messages?)
                              .reject { |topic| topic.name.end_with?(states_postfix) }