karafka-web 0.11.5 → 1.0.0.beta1

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 24ceb5279e48629e0a1c3a609b1c041323bdedc9faf6cf03dec926c7c0278b4f
-  data.tar.gz: 4ea8f9aef69bb0ee9ac51cc20e132e64e955df2984f6f2359b1c878421793972
+  metadata.gz: 27e32327bc795732ee58f5dc757bd1fbe1dbc24198a8561f67cffbb48c5a4eb3
+  data.tar.gz: 81bb5e628233f6acf7d9cf0527ed07517271cc87f4b19cef925dd2e4e3887ef0
 SHA512:
-  metadata.gz: 7861ba705d420ddd875053bb9f687302ad8d2719d332e925cab53075edf267245660e2467934c746f3707327f198538321585b77abe60fcb1bcb49c3c8a1771a
-  data.tar.gz: dd30a59da0ed8590eb471965d1f6e917b15f2a390eb099e4b1527ca1a490dda46695fb3a40cc1e96729f15377a2b74d3a361d593a8b6cf5747fb03ecd4efb461
+  metadata.gz: 935b6515910e2eaf6871c5cb00920cda705935d06449de61410e941dfdb185c7437a2e7fa388244997dcb338efd0221ad7cf9c9e207d0b2fa4237fd9f63166e0
+  data.tar.gz: 9d3fe3b1c638b6a72b729464a2dc5178202fe9158f88aa3d5c692498d82eda3e65760141d5233e43e7bfd083ecd68bbaf2881f97db6a828825498e1771b4bdcf

data/CHANGELOG.md

@@ -1,5 +1,37 @@
 # Karafka Web Changelog
 
+## 1.0.0 (Unreleased)
+- [Fix] Add `initialize` to `Status::Context` that defines all instance variables upfront in a consistent order, giving every instance the same Ruby object shape and eliminating the `:performance` shape-variation warning.
+- [Enhancement] Add `Warning.process` block to the test helper to turn Ruby warnings originating from the project code into test failures.
+- [Enhancement] Enable all opt-in Ruby warning categories in the test helper via `Warning.categories` (available since Ruby 3.4), so any new categories added in future Ruby versions are automatically enabled without code changes.
+- [Enhancement] Replace sequential per-partition `query_watermark_offsets` consumer calls in `Counters#estimate_errors_count` with a single targeted `topic_info` metadata call followed by a batch `read_watermark_offsets` admin call. This eliminates the consumer connection overhead and reduces Kafka roundtrips from up to N+1 sequential calls to 3 regardless of partition count.
+- [Enhancement] Allow for zero value in number of workers to support dynamic scaling of Karafka workers.
+- [Enhancement] Align concurrency tracking with dynamic thread pool scaling. Workers count is now read from `Karafka::Server.workers.size` instead of the static `Karafka::App.config.concurrency`, so the Web UI accurately reflects runtime thread pool changes.
+- [Enhancement] Track `poll_interval` (max.poll.interval.ms) per subscription group alongside `poll_age` to help users monitor how close they are to the polling timeout limit. Consumer schema version bumped to 1.7.0.
+- [Enhancement] Replace token-based CSRF protection (`route_csrf` plugin) with header-based protection using `Sec-Fetch-Site` header (`sec_fetch_site_csrf` plugin). This eliminates the need for CSRF tokens by leveraging browser-enforced headers that cannot be forged from cross-origin requests. Modern browsers automatically include this header, providing simpler and more robust CSRF protection.
+- [Enhancement] Include a short spec file hash in generated test topic names for traceability. Topic names now follow the `it-{hash}-{uuid}` format, making it easy to identify which test file created a given topic in Kafka logs.
+- [Change] Require Roda `>= 3.100` (previously `~> 3.69`).
+- [Fix] Accept (and ignore) a block in `Karafka::Web::Producer#__getobj__` to silence Ruby 3.4's `strict_unused_block` warning emitted via `SimpleDelegator#method_missing` on every delegated producer call.
+- [Fix] Remove `cgi` as no longer needed.
+- [Fix] Exclude `test/` directory from gem releases to reduce package size.
+- [Fix] Update LinksValidator regexes to match the new `it-{hash}-{uuid}` test topic naming format, fixing test-order dependent failures in explorer controller specs.
+- [Fix] Fix alerts formatting for the distribution view.
+- [Fix] Fix 500 error in the Pro Explorer when a message payload parses as valid JSON but contains strings with invalid UTF-8 byte sequences. `JSON.pretty_generate` would raise `JSON::GeneratorError` outside of any error boundary and propagate as an unhandled 500. The pretty-print step is now wrapped in a dedicated `@safe_pretty_payload` SafeRunner; on failure the raw bytes are displayed alongside a deserialization warning.
+- [Fix] Fix 500 error in the Pro Explorer message JSON export when a payload deserializes correctly but cannot be serialized back to JSON (for example when it contains strings with invalid UTF-8 byte sequences). The export endpoint now responds with 404 in such cases and the export action button is no longer rendered for such messages.
+
+## 0.11.6 (2026-02-01)
+- **[Feature]** Provide ability to pause/resume all partitions of a topic at once across all consumer processes via the Health Overview page (Pro). Topic-level commands are broadcast to all processes, and each process applies the command to partitions it owns within the specified consumer group. This simplifies bulk operations compared to pausing/resuming individual partitions one by one.
+- [Enhancement] Optimize partition command tracker to use index-based lookup instead of iterating over 10,000 partitions during rebalance events. The tracker now maintains a partition index for O(n) lookups where n is the number of partitions with pending commands.
+- [Enhancement] Report `group.instance.id` (static membership ID) per subscription group in consumer reports. This enables identifying consumers using Kafka's static group membership feature. The ID is displayed in the per-consumer subscription view header and in Health Overview below each process ID, making it easy to find a process by its static membership ID. Consumer schema version bumped to 1.6.0.
+- [Enhancement] Display `min.insync.replicas` alongside replication factor on the topic replication page with fault tolerance indicators (Pro). Shows specific warnings for different resilience issues: no redundancy (RF=1), zero fault tolerance (RF ≤ minISR), and low durability (minISR=1). Each warning includes impact details, environment-aware severity messaging, and recommended actions. Helps users identify misconfigured topics that would cause outages or data loss.
+- [Enhancement] Add `.options` CSS class for table columns containing action buttons, providing consistent `width: 1%; white-space: nowrap` styling to prevent column width fluctuation.
+- [Enhancement] Add commands topic presence status check for Pro users. Warns when the `karafka_consumers_commands` topic is missing, which is required for commanding features (pause, resume, trace).
+- [Enhancement] Disable "Quiet All" and "Stop All" buttons when only swarm or embedded consumers are running (Pro). These commands only work on standalone consumer processes.
+- [Enhancement] Use low-ack producer variant (`acks: 0`) for Web UI reporting. Since Web UI reporting serves analytical purposes, fire-and-forget semantics minimize latency and overhead while occasional message loss is acceptable. Falls back to the original producer for idempotent/transactional producers.
+- [Refactor] Refactor Status model into a DSL-based architecture with individual check classes. Each status check is now a separate class in `Karafka::Web::Ui::Models::Status::Checks` that declares its dependencies using `depends_on :check_name` DSL. Shared state is managed through a `Context` class, and the `Step` struct has been extracted to its own file. This improves maintainability, testability, and makes it easier to add new status checks in the future.
+- [Fix] Fix session keys to use strings instead of symbols for compatibility with Roda's session management.
+- [Fix] Fix actions and selector alignment in explorer and errors views by wrapping col-span elements in proper grid container.
+
 ## 0.11.5 (2025-11-14)
 - [Enhancement] Utilize newly released Roda session management `:env_key` to isolate Karafka Web session from the main application session.
 

data/Gemfile

@@ -1,18 +1,18 @@
 # frozen_string_literal: true
 
-source 'https://rubygems.org'
+source "https://rubygems.org"
 
 gemspec
 
 group :test do
-  gem 'byebug'
-  gem 'factory_bot'
-  gem 'fugit'
+  gem "byebug"
+  gem "fugit"
+  gem "mocha"
   # Needed for links extraction for visits verification
-  gem 'nokogiri'
-  gem 'ostruct'
-  gem 'rack-test'
-  gem 'rspec'
-  gem 'simplecov'
-  gem 'yard-lint'
+  gem "nokogiri"
+  gem "ostruct"
+  gem "rack-test"
+  gem "minitest"
+  gem "simplecov"
+  gem "warning"
 end

data/Gemfile.lint

@@ -0,0 +1,14 @@
+# frozen_string_literal: true
+
+source "https://rubygems.org"
+
+# Documentation linting
+gem "yard-lint"
+
+# Code style (StandardRB via RuboCop)
+gem "standard"
+gem "standard-performance"
+gem "rubocop-performance"
+gem "rubocop-minitest"
+gem "standard-minitest"
+gem "rubocop-thread_safety"

data/Gemfile.lint.lock

@@ -0,0 +1,108 @@
+GEM
+  remote: https://rubygems.org/
+  specs:
+    ast (2.4.3)
+    json (2.18.0)
+    language_server-protocol (3.17.0.5)
+    lint_roller (1.1.0)
+    parallel (1.27.0)
+    parser (3.3.10.1)
+      ast (~> 2.4.1)
+      racc
+    prism (1.8.0)
+    racc (1.8.1)
+    rainbow (3.1.1)
+    regexp_parser (2.11.3)
+    rubocop (1.82.1)
+      json (~> 2.3)
+      language_server-protocol (~> 3.17.0.2)
+      lint_roller (~> 1.1.0)
+      parallel (~> 1.10)
+      parser (>= 3.3.0.2)
+      rainbow (>= 2.2.2, < 4.0)
+      regexp_parser (>= 2.9.3, < 3.0)
+      rubocop-ast (>= 1.48.0, < 2.0)
+      ruby-progressbar (~> 1.7)
+      unicode-display_width (>= 2.4.0, < 4.0)
+    rubocop-ast (1.49.0)
+      parser (>= 3.3.7.2)
+      prism (~> 1.7)
+    rubocop-minitest (0.39.1)
+      lint_roller (~> 1.1)
+      rubocop (>= 1.75.0, < 2.0)
+      rubocop-ast (>= 1.38.0, < 2.0)
+    rubocop-performance (1.26.1)
+      lint_roller (~> 1.1)
+      rubocop (>= 1.75.0, < 2.0)
+      rubocop-ast (>= 1.47.1, < 2.0)
+    rubocop-thread_safety (0.7.3)
+      lint_roller (~> 1.1)
+      rubocop (~> 1.72, >= 1.72.1)
+      rubocop-ast (>= 1.44.0, < 2.0)
+    ruby-progressbar (1.13.0)
+    standard (1.53.0)
+      language_server-protocol (~> 3.17.0.2)
+      lint_roller (~> 1.0)
+      rubocop (~> 1.82.0)
+      standard-custom (~> 1.0.0)
+      standard-performance (~> 1.8)
+    standard-custom (1.0.2)
+      lint_roller (~> 1.0)
+      rubocop (~> 1.50)
+    standard-minitest (1.0.0)
+      lint_roller (~> 1.0)
+      rubocop-minitest
+    standard-performance (1.9.0)
+      lint_roller (~> 1.1)
+      rubocop-performance (~> 1.26.0)
+    unicode-display_width (3.2.0)
+      unicode-emoji (~> 4.1)
+    unicode-emoji (4.2.0)
+    yard (0.9.38)
+    yard-lint (1.4.0)
+      yard (~> 0.9)
+      zeitwerk (~> 2.6)
+    zeitwerk (2.7.4)
+
+PLATFORMS
+  ruby
+  x86_64-linux
+
+DEPENDENCIES
+  rubocop-minitest
+  rubocop-performance
+  rubocop-thread_safety
+  standard
+  standard-minitest
+  standard-performance
+  yard-lint
+
+CHECKSUMS
+  ast (2.4.3) sha256=954615157c1d6a382bc27d690d973195e79db7f55e9765ac7c481c60bdb4d383
+  json (2.18.0) sha256=b10506aee4183f5cf49e0efc48073d7b75843ce3782c68dbeb763351c08fd505
+  language_server-protocol (3.17.0.5) sha256=fd1e39a51a28bf3eec959379985a72e296e9f9acfce46f6a79d31ca8760803cc
+  lint_roller (1.1.0) sha256=2c0c845b632a7d172cb849cc90c1bce937a28c5c8ccccb50dfd46a485003cc87
+  parallel (1.27.0) sha256=4ac151e1806b755fb4e2dc2332cbf0e54f2e24ba821ff2d3dcf86bf6dc4ae130
+  parser (3.3.10.1) sha256=06f6a725d2cd91e5e7f2b7c32ba143631e1f7c8ae2fb918fc4cebec187e6a688
+  prism (1.8.0) sha256=84453a16ef5530ea62c5f03ec16b52a459575ad4e7b9c2b360fd8ce2c39c1254
+  racc (1.8.1) sha256=4a7f6929691dbec8b5209a0b373bc2614882b55fc5d2e447a21aaa691303d62f
+  rainbow (3.1.1) sha256=039491aa3a89f42efa1d6dec2fc4e62ede96eb6acd95e52f1ad581182b79bc6a
+  regexp_parser (2.11.3) sha256=ca13f381a173b7a93450e53459075c9b76a10433caadcb2f1180f2c741fc55a4
+  rubocop (1.82.1) sha256=09f1a6a654a960eda767aebea33e47603080f8e9c9a3f019bf9b94c9cab5e273
+  rubocop-ast (1.49.0) sha256=49c3676d3123a0923d333e20c6c2dbaaae2d2287b475273fddee0c61da9f71fd
+  rubocop-minitest (0.39.1) sha256=998398d6da4026d297f0f9bf709a1eac5f2b6947c24431f94af08138510cf7ed
+  rubocop-performance (1.26.1) sha256=cd19b936ff196df85829d264b522fd4f98b6c89ad271fa52744a8c11b8f71834
+  rubocop-thread_safety (0.7.3) sha256=067cdd52fbf5deffc18995437e45b5194236eaff4f71de3375a1f6052e48f431
+  ruby-progressbar (1.13.0) sha256=80fc9c47a9b640d6834e0dc7b3c94c9df37f08cb072b7761e4a71e22cff29b33
+  standard (1.53.0) sha256=f3c9493385db7079d0abce6f7582f553122156997b81258cd361d3480eeacf9c
+  standard-custom (1.0.2) sha256=424adc84179a074f1a2a309bb9cf7cd6bfdb2b6541f20c6bf9436c0ba22a652b
+  standard-minitest (1.0.0) sha256=450caa86a64a6e6f6f186cc88601dbb49b6cfaa3b0dce77a73b50ba8cdc15b2a
+  standard-performance (1.9.0) sha256=49483d31be448292951d80e5e67cdcb576c2502103c7b40aec6f1b6e9c88e3f2
+  unicode-display_width (3.2.0) sha256=0cdd96b5681a5949cdbc2c55e7b420facae74c4aaf9a9815eee1087cb1853c42
+  unicode-emoji (4.2.0) sha256=519e69150f75652e40bf736106cfbc8f0f73aa3fb6a65afe62fefa7f80b0f80f
+  yard (0.9.38) sha256=721fb82afb10532aa49860655f6cc2eaa7130889df291b052e1e6b268283010f
+  yard-lint (1.4.0) sha256=7dd88fbb08fd77cb840bea899d58812817b36d92291b5693dd0eeb3af9f91f0f
+  zeitwerk (2.7.4) sha256=2bef90f356bdafe9a6c2bd32bcd804f83a4f9b8bc27f3600fff051eb3edcec8b
+
+BUNDLED WITH
+  4.0.3

data/Gemfile.lock

@@ -1,93 +1,79 @@
 PATH
   remote: .
   specs:
-    karafka-web (0.11.5)
+    karafka-web (1.0.0.beta1)
       erubi (~> 1.4)
-      karafka (>= 2.5.2, < 2.6.0)
-      karafka-core (>= 2.5.0, < 2.6.0)
-      roda (~> 3.69, >= 3.69)
+      karafka (>= 2.5.10.rc1, < 2.7.0)
+      karafka-core (>= 2.5.0, < 2.7.0)
+      roda (>= 3.100, < 4.0)
       tilt (~> 2.0)
 
 GEM
   remote: https://rubygems.org/
   specs:
-    activesupport (8.1.1)
-      base64
-      bigdecimal
-      concurrent-ruby (~> 1.0, >= 1.3.1)
-      connection_pool (>= 2.2.5)
-      drb
-      i18n (>= 1.6, < 2)
-      json
-      logger (>= 1.4.2)
-      minitest (>= 5.1)
-      securerandom (>= 0.3)
-      tzinfo (~> 2.0, >= 2.0.5)
-      uri (>= 0.13.1)
-    base64 (0.3.0)
-    bigdecimal (3.3.1)
-    byebug (12.0.0)
-    concurrent-ruby (1.3.5)
-    connection_pool (2.5.4)
-    diff-lcs (1.6.2)
+    byebug (13.0.0)
+      reline (>= 0.6.0)
+    concurrent-ruby (1.3.6)
     docile (1.4.1)
     drb (2.2.3)
     erubi (1.13.1)
     et-orbi (1.4.0)
       tzinfo
-    factory_bot (6.5.6)
-      activesupport (>= 6.1.0)
-    ffi (1.17.2)
-    ffi (1.17.2-aarch64-linux-gnu)
-    ffi (1.17.2-aarch64-linux-musl)
-    ffi (1.17.2-arm-linux-gnu)
-    ffi (1.17.2-arm-linux-musl)
-    ffi (1.17.2-arm64-darwin)
-    ffi (1.17.2-x86-linux-gnu)
-    ffi (1.17.2-x86-linux-musl)
-    ffi (1.17.2-x86_64-darwin)
-    ffi (1.17.2-x86_64-linux-gnu)
-    ffi (1.17.2-x86_64-linux-musl)
-    fugit (1.12.1)
+    ffi (1.17.4)
+    ffi (1.17.4-aarch64-linux-gnu)
+    ffi (1.17.4-aarch64-linux-musl)
+    ffi (1.17.4-arm-linux-gnu)
+    ffi (1.17.4-arm-linux-musl)
+    ffi (1.17.4-arm64-darwin)
+    ffi (1.17.4-x86-linux-gnu)
+    ffi (1.17.4-x86-linux-musl)
+    ffi (1.17.4-x86_64-darwin)
+    ffi (1.17.4-x86_64-linux-gnu)
+    ffi (1.17.4-x86_64-linux-musl)
+    fugit (1.12.2)
       et-orbi (~> 1.4)
       raabro (~> 1.4)
-    i18n (1.14.7)
-      concurrent-ruby (~> 1.0)
-    json (2.16.0)
-    karafka (2.5.2)
-      base64 (~> 0.2)
-      karafka-core (>= 2.5.6, < 2.6.0)
-      karafka-rdkafka (>= 0.22.0)
-      waterdrop (>= 2.8.9, < 3.0.0)
+    io-console (0.8.2)
+    json (2.19.7)
+    karafka (2.5.10.rc1)
+      karafka-core (>= 2.5.13, < 2.6.0)
+      karafka-rdkafka (>= 0.26.1)
+      waterdrop (>= 2.8.14, < 3.0.0)
       zeitwerk (~> 2.3)
-    karafka-core (2.5.7)
+    karafka-core (2.5.13)
       karafka-rdkafka (>= 0.20.0)
       logger (>= 1.6.0)
-    karafka-rdkafka (0.23.0)
+    karafka-rdkafka (0.27.2)
       ffi (~> 1.17.1)
       json (> 2.0)
       logger
       mini_portile2 (~> 2.6)
       rake (> 12)
-    karafka-rdkafka (0.23.0-aarch64-linux-gnu)
+    karafka-rdkafka (0.27.2-aarch64-linux-gnu)
       ffi (~> 1.17.1)
       json (> 2.0)
       logger
       mini_portile2 (~> 2.6)
       rake (> 12)
-    karafka-rdkafka (0.23.0-arm64-darwin)
+    karafka-rdkafka (0.27.2-aarch64-linux-musl)
       ffi (~> 1.17.1)
       json (> 2.0)
       logger
       mini_portile2 (~> 2.6)
       rake (> 12)
-    karafka-rdkafka (0.23.0-x86_64-linux-gnu)
+    karafka-rdkafka (0.27.2-arm64-darwin)
       ffi (~> 1.17.1)
       json (> 2.0)
       logger
       mini_portile2 (~> 2.6)
       rake (> 12)
-    karafka-rdkafka (0.23.0-x86_64-linux-musl)
+    karafka-rdkafka (0.27.2-x86_64-linux-gnu)
+      ffi (~> 1.17.1)
+      json (> 2.0)
+      logger
+      mini_portile2 (~> 2.6)
+      rake (> 12)
+    karafka-rdkafka (0.27.2-x86_64-linux-musl)
       ffi (~> 1.17.1)
       json (> 2.0)
       logger
@@ -95,72 +81,62 @@ GEM
       rake (> 12)
     logger (1.7.0)
     mini_portile2 (2.8.9)
-    minitest (5.26.1)
-    nokogiri (1.18.10)
+    minitest (6.0.6)
+      drb (~> 2.0)
+      prism (~> 1.5)
+    mocha (3.1.0)
+      ruby2_keywords (>= 0.0.5)
+    nokogiri (1.19.3)
       mini_portile2 (~> 2.8.2)
       racc (~> 1.4)
-    nokogiri (1.18.10-aarch64-linux-gnu)
+    nokogiri (1.19.3-aarch64-linux-gnu)
       racc (~> 1.4)
-    nokogiri (1.18.10-aarch64-linux-musl)
+    nokogiri (1.19.3-aarch64-linux-musl)
       racc (~> 1.4)
-    nokogiri (1.18.10-arm-linux-gnu)
+    nokogiri (1.19.3-arm-linux-gnu)
       racc (~> 1.4)
-    nokogiri (1.18.10-arm-linux-musl)
+    nokogiri (1.19.3-arm-linux-musl)
       racc (~> 1.4)
-    nokogiri (1.18.10-arm64-darwin)
+    nokogiri (1.19.3-arm64-darwin)
       racc (~> 1.4)
-    nokogiri (1.18.10-x86_64-darwin)
+    nokogiri (1.19.3-x86_64-darwin)
       racc (~> 1.4)
-    nokogiri (1.18.10-x86_64-linux-gnu)
+    nokogiri (1.19.3-x86_64-linux-gnu)
       racc (~> 1.4)
-    nokogiri (1.18.10-x86_64-linux-musl)
+    nokogiri (1.19.3-x86_64-linux-musl)
       racc (~> 1.4)
     ostruct (0.6.3)
+    prism (1.9.0)
     raabro (1.4.0)
     racc (1.8.1)
-    rack (3.2.4)
+    rack (3.2.6)
     rack-test (2.2.0)
       rack (>= 1.3)
     rackup (0.2.3)
       rack (>= 3.0.0.beta1)
       webrick
-    rake (13.3.1)
-    roda (3.98.0)
+    rake (13.4.2)
+    reline (0.6.3)
+      io-console (~> 0.5)
+    roda (3.104.0)
       rack
-    rspec (3.13.2)
-      rspec-core (~> 3.13.0)
-      rspec-expectations (~> 3.13.0)
-      rspec-mocks (~> 3.13.0)
-    rspec-core (3.13.6)
-      rspec-support (~> 3.13.0)
-    rspec-expectations (3.13.5)
-      diff-lcs (>= 1.2.0, < 2.0)
-      rspec-support (~> 3.13.0)
-    rspec-mocks (3.13.7)
-      diff-lcs (>= 1.2.0, < 2.0)
-      rspec-support (~> 3.13.0)
-    rspec-support (3.13.6)
-    securerandom (0.4.1)
+    ruby2_keywords (0.0.5)
     simplecov (0.22.0)
       docile (~> 1.1)
       simplecov-html (~> 0.11)
       simplecov_json_formatter (~> 0.1)
     simplecov-html (0.13.2)
     simplecov_json_formatter (0.1.4)
-    tilt (2.6.1)
+    tilt (2.7.0)
     tzinfo (2.0.6)
       concurrent-ruby (~> 1.0)
-    uri (1.1.1)
-    waterdrop (2.8.13)
-      karafka-core (>= 2.4.9, < 3.0.0)
-      karafka-rdkafka (>= 0.20.0)
+    warning (1.6.0)
+    waterdrop (2.10.1)
+      karafka-core (>= 2.5.12, < 3.0.0)
+      karafka-rdkafka (>= 0.24.0)
       zeitwerk (~> 2.3)
-    webrick (1.9.1)
-    yard (0.9.37)
-    yard-lint (1.2.3)
-      yard (~> 0.9)
-      zeitwerk (~> 2.6)
-    zeitwerk (2.7.3)
+    webrick (1.9.2)
+    zeitwerk (2.8.2)
 
 PLATFORMS
   aarch64-linux-gnu
@@ -177,16 +153,16 @@ PLATFORMS
 
 DEPENDENCIES
   byebug
-  factory_bot
   fugit
   karafka-web!
+  minitest
+  mocha
   nokogiri
   ostruct
   rack-test
   rackup (~> 0.2)
-  rspec
   simplecov
-  yard-lint
+  warning
 
 BUNDLED WITH
-   2.7.1
+  4.0.12

data/README.md

@@ -4,31 +4,31 @@
 [![Gem Version](https://badge.fury.io/rb/karafka-web.svg)](http://badge.fury.io/rb/karafka-web)
 [![Join the chat at https://slack.karafka.io](https://raw.githubusercontent.com/karafka/misc/master/slack.svg)](https://slack.karafka.io)
 
-Karafka Web UI is a user interface for the [Karafka framework](https://github.com/karafka/karafka). The Web UI provides a convenient way for developers to monitor and manage their Karafka-based applications, without the need to use the command line or third party software.
+Karafka Web UI is a web-based interface for the [Karafka framework](https://github.com/karafka/karafka). The Web UI provides a convenient way for developers to monitor and manage their Kafka-based applications, eliminating the need to use command-line tools or third-party software.
 
-It allows for easy access to various metrics, such as the number of messages consumed, the number of errors, and the number of consumers operating. It also provides a way to view the different Kafka topics, consumers, and groups that are being used by the application.
+It provides easy access to various metrics, including the number of messages consumed, the number of errors, and the number of consumers in operation. It also provides a way to view the various Kafka topics, consumers, and groups used by the application.
 
 > [!IMPORTANT]
-> All of Karafka ecosystems components documentation, including the Web UI, can be found [here](https://karafka.io/docs/#web-ui).
+> Documentation for all ecosystem components, including the Web UI, is available in the [Karafka framework docs Wiki](https://karafka.io/docs/).
 
 ## Getting started
 
-Karafka Web UI documentation is part of the Karafka framework documentation and can be found [here](https://karafka.io/docs).
+To get started with the Karafka Web UI, see the [Web UI](https://karafka.io/docs/#web-ui) chapter of the Karafka documentation Wiki.
 
 ![karafka web ui dashboard](https://raw.githubusercontent.com/karafka/misc/master/printscreens/web-ui.png)
 
 ## Karafka Pro Enhanced Web UI
 
-The Enhanced Web UI, aside from all the features from the OSS version, also offers additional features and capabilities not available in the free version, making it a better option for those looking for more robust monitoring and management capabilities for their Karafka applications. Some of the key benefits of the Enhanced Web UI version include the following:
+The Enhanced Web UI, in addition to all the features from the OSS version, also offers additional features and capabilities not available in the free version, making it a more robust option for those seeking enhanced monitoring and management capabilities for their Karafka applications. Some of the key benefits of the Enhanced Web UI version include the following:
 
-- Real-time and historical processing and utilization metrics.
-- Real-time topics lag awareness.
-- Enhanced consumers utilization metrics providing much better insights into processes resources utilization.
-- Consumer process inspection to quickly analyze the state of a given consuming process.
-- Consumer jobs inspection to view currently running jobs on a per-process basis.
-- Health dashboard containing general consumption overview information
-- Data Explorer allowing for viewing and exploring the data produced to Kafka topics. It understands the routing table and can deserialize data before it is displayed.
-- Enhanced error reporting allowing for backtrace inspection and providing multi-partition support.
-- DLQ / Dead insights allowing to navigate through DLQ topics and messages that were dispatched to them.
+- Real-time and historical processing and utilization metrics
+- Real-time topics lag awareness
+- Enhanced consumer utilization metrics providing much better insights into process and resource utilization
+- Consumer process inspection to quickly analyze the state of a given consuming process
+- Consumer jobs inspection to view currently running jobs on a per-process basis
+- A health dashboard containing general consumption overview information
+- Data Explorer allowing for viewing and exploring the data produced to Kafka topics and understanding the routing table and deserializing data before it is displayed
+- Enhanced error reporting allowing for backtrace inspection and providing multi-partition support
+- DLQ / Dead insights allowing navigation through DLQ topics and messages dispatched
 
-Help me provide high-quality open-source software. Please see the Karafka [homepage](https://karafka.io) for more details.
+Help me provide high-quality open-source software. For more details, see the Karafka [homepage](https://karafka.io).

data/Rakefile

@@ -1,4 +1,30 @@
 # frozen_string_literal: true
 
-require 'bundler/setup'
-require 'bundler/gem_tasks'
+require "bundler/setup"
+require "bundler/gem_tasks"
+require "minitest/test_task"
+
+specs_type = ENV.fetch("SPECS_TYPE", "regular")
+
+Minitest::TestTask.create(:test) do |t|
+  t.libs << "test"
+  t.libs << "lib"
+  t.test_prelude = 'require "test_helper"; require "minitest/autorun"'
+
+  t.test_globs = if specs_type == "pro"
+    ["test/lib/karafka/web/pro/**/*_test.rb"]
+  else
+    # Exclude pro tests from regular test runs
+    [
+      "test/lib/karafka/web/*_test.rb",
+      "test/lib/karafka/web/cli/**/*_test.rb",
+      "test/lib/karafka/web/contracts/**/*_test.rb",
+      "test/lib/karafka/web/management/**/*_test.rb",
+      "test/lib/karafka/web/processing/**/*_test.rb",
+      "test/lib/karafka/web/tracking/**/*_test.rb",
+      "test/lib/karafka/web/ui/**/*_test.rb"
+    ]
+  end
+end
+
+task default: :test

data/bin/balance_tests

@@ -0,0 +1,120 @@
+#!/usr/bin/env ruby
+# frozen_string_literal: true
+
+# Balances test files across N workers using timing data
+# Uses greedy bin-packing: assign each file to worker with lowest total time
+#
+# Usage: bin/balance_tests <regular|pro> <num_workers>
+#
+# Output: JSON array of arrays where each inner array contains the test files
+#         assigned to that worker
+#
+# Example:
+#   bin/balance_tests regular 4
+#   [["test/a.rb","test/d.rb"],["test/b.rb"],["test/c.rb"],["test/e.rb"]]
+
+require 'json'
+
+TIMINGS_DIR = File.expand_path('../test/timings', __dir__)
+DEFAULT_TIME = 1.0 # Default time for files not in timing data
+
+# Loads timing data from a JSON file for the given test type
+#
+# @param tests_type [String] the type of tests ('regular' or 'pro')
+# @return [Hash<String, Float>] hash mapping file paths to execution times in seconds
+def load_timings(tests_type)
+  file_path = File.join(TIMINGS_DIR, "#{tests_type}.json")
+
+  if File.exist?(file_path)
+    JSON.parse(File.read(file_path))
+  else
+    {}
+  end
+end
+
+# Returns a sorted list of test files for the given test type
+#
+# @param tests_type [String] the type of tests ('regular' or 'pro')
+# @return [Array<String>] sorted array of test file paths
+def get_test_files(tests_type)
+  all_tests = Dir.glob('test/lib/karafka/web/**/*_test.rb').sort
+
+  case tests_type
+  when 'pro'
+    all_tests.select { |f| f.include?('/pro/') }
+  when 'regular'
+    all_tests.reject { |f| f.include?('/pro/') }
+  else
+    warn "Unknown tests type: #{tests_type}"
+    exit 1
+  end
+end
+
+# Balances test files across workers using greedy bin-packing algorithm
+#
+# Files are sorted by execution time (descending) and each file is assigned
+# to the worker with the lowest total time. This minimizes the imbalance
+# between the slowest and fastest workers.
+#
+# @param files [Array<String>] list of test file paths to balance
+# @param timings [Hash<String, Float>] hash mapping file paths to execution times
+# @param num_workers [Integer] number of workers to distribute files across
+# @return [Array<Hash>] array of worker hashes, each with :files and :total_time keys
+def balance_files(files, timings, num_workers)
+  # Get timing for each file, using default if not found
+  # Handle both "./test/..." and "test/..." path formats
+  files_with_times = files.map do |file|
+    time = timings[file] || timings["./#{file}"] || DEFAULT_TIME
+    [file, time]
+  end
+
+  # Sort by time descending (largest first for better bin packing)
+  files_with_times.sort_by! { |_, time| -time }
+
+  # Initialize workers
+  workers = Array.new(num_workers) { { files: [], total_time: 0.0 } }
+
+  # Greedy assignment: assign each file to worker with lowest total time
+  files_with_times.each do |file, time|
+    # Find worker with minimum total time
+    min_worker = workers.min_by { |w| w[:total_time] }
+    min_worker[:files] << file
+    min_worker[:total_time] += time
+  end
+
+  workers
+end
+
+# Prints balance information to stderr for debugging/visibility
+#
+# @param workers [Array<Hash>] array of worker hashes with :files and :total_time keys
+def print_balance_info(workers)
+  total_time = workers.sum { |w| w[:total_time] }
+  max_time = workers.max_by { |w| w[:total_time] }[:total_time]
+  min_time = workers.min_by { |w| w[:total_time] }[:total_time]
+
+  warn "Balance info:"
+  workers.each_with_index do |worker, i|
+    warn "  Worker #{i + 1}: #{worker[:files].size} files, #{worker[:total_time].round(1)}s"
+  end
+  warn "  Total: #{total_time.round(1)}s, Max: #{max_time.round(1)}s, Imbalance: #{(max_time - min_time).round(1)}s"
+end
+
+# Main
+tests_type = ARGV[0]
+num_workers = (ARGV[1] || '4').to_i
+
+unless tests_type
+  warn "Usage: bin/balance_tests <regular|pro> <num_workers>"
+  exit 1
+end
+
+timings = load_timings(tests_type)
+files = get_test_files(tests_type)
+workers = balance_files(files, timings, num_workers)
+
+# Print balance info to stderr
+print_balance_info(workers)
+
+# Output file lists as JSON array of arrays
+puts JSON.generate(workers.map { |w| w[:files] })