karafka-web 0.11.6 → 1.0.0.rc1

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 5377e1f7c20ed732850895389e9e47be86f94c85068fe363fab13fb52d4f12a4
-  data.tar.gz: f774171188b56858db87e66088436f88dc4d36460743d29152cb3b3fcc7119b2
+  metadata.gz: 64a1fc3668da51d60226e170e3942d77e9da1dc440d85a16e5678d0bb54ca592
+  data.tar.gz: efa56ac32d1591a5a47fb220f295909796e2b891bb26ab26ced879f55f0c8484
 SHA512:
-  metadata.gz: 494a61a08bf0fd768827c05add65ad3d6d13f9e50140d37b25cf9faf9c8f2eecc1b6033612d377fd9cde6fe9d2004817ffa4e1ce8fea1fb24363ca845f979c69
-  data.tar.gz: 3c55088e048fe5a8a861a09d2dabdbea6d4e47423949d3927de646456a5f891628858c377c0bb636e34545d512d3a01887cc25dc55c37bf3904ccc79b3b918de
+  metadata.gz: aacdce1efe87f6d288f6167e980418def9d1f5c17c51fc255c2bdce025caf3bd80466d946b48972c5f33259a5e6aff3d38f1b529133688b0698e6e6f86b8f21c
+  data.tar.gz: db6a64d3fefd229472b6b67c96844328e7e926e9bc145602c8d72b8f40cbf2911bc7092e8401fab30dad6cdc39a09fb7e020ddc279d4c103d3425a58041db422

data/CHANGELOG.md

@@ -1,5 +1,50 @@
 # Karafka Web Changelog
 
+## 1.0.0 (Unreleased)
+- [Fix] Fix two precision bugs in `Aggregators::State`/`Aggregators::Metrics` process eviction and utilization, both caught by a Copilot PR review and confirmed on the merged pipeline refactor. `evict_expired_processes` computed the ttl window via integer division (`config.ttl / 1_000`), truncating any non-multiple-of-1000 millisecond ttl and evicting processes up to ~999ms earlier than configured; it now uses float division. `RefreshCurrentStats#call` computed average utilization via `utilization / (stats[:processes] + 0.0001)`, an epsilon guard against division by zero that also systematically underestimated utilization for any nonzero process count; it now divides exactly and returns `0.0` only when there are zero active processes.
+- [Fix] Fix the real cause of the intermittent, seemingly-unrelated CI-only Pro Explorer flakes finally surfaced by the `assert_ok` diagnostic below: not a Kafka broker/timing race, but Ruby's object-shape warning (a controller class crossing 8 distinct instance-variable shapes) being turned into a hard failure by the test suite's `Warning.process` hook. Controllers, like the Roda app classes already exempted, legitimately accumulate many shapes because they conditionally set a handful of instance variables depending on the specific request branch taken (e.g. Explorer's `#show` only sets `@safe_key`/`@safe_headers`/`@safe_payload` when the message isn't a compacted/system entry). Which controller happens to cross the threshold depends on minitest's random run order, which is why it surfaced as an unrelated-looking flake instead of a stable, reproducible failure. Widened the existing `Ui::App` shape-variation exception to cover controller classes too.
+- [Enhancement] Make `assert_ok` surface the actual captured exception (class, message, backtrace) on a 500, not just the generic static error page body. Subscribes to the same `error.occurred` monitor event the production error handler already dispatches web UI errors through, capturing the last one per test. This has been the main blocker in diagnosing rare CI-only flakes in the Pro Explorer controller specs, where a failure only ever showed the generic HTML error page with no indication of what actually broke.
+- [Enhancement] Remove the OSS "support Karafka Pro" banner that was rendered on every Web UI page for non-Pro users. It's no longer needed at this stage since users are already aware of the Pro offering.
+- [Enhancement] Migrate the Web UI topic declarations to Karafka's new standalone `Karafka::App.declaratives.draw` API (Karafka `2.6.0.beta1`). The Web UI topics are declared as `active false` (Web UI manages their creation and runtime replication factor itself), replacing the deprecated routing-based `config(active: false)` bridge that was previously called on each routing topic.
+- [Enhancement] Add `Warning.process` block to the test helper to turn Ruby warnings originating from the project code into test failures.
+- [Enhancement] Enable all opt-in Ruby warning categories in the test helper via `Warning.categories` (available since Ruby 3.4), so any new categories added in future Ruby versions are automatically enabled without code changes.
+- [Enhancement] Replace sequential per-partition `query_watermark_offsets` consumer calls in `Counters#estimate_errors_count` with a single targeted `topic_info` metadata call followed by a batch `read_watermark_offsets` admin call. This eliminates the consumer connection overhead and reduces Kafka roundtrips from up to N+1 sequential calls to 3 regardless of partition count.
+- [Enhancement] Allow for zero value in number of workers to support dynamic scaling of Karafka workers.
+- [Enhancement] Align concurrency tracking with dynamic thread pool scaling. Workers count is now read from `Karafka::Server.workers.size` instead of the static `Karafka::App.config.concurrency`, so the Web UI accurately reflects runtime thread pool changes.
+- [Enhancement] Track `poll_interval` (max.poll.interval.ms) per subscription group alongside `poll_age` to help users monitor how close they are to the polling timeout limit. Consumer schema version bumped to 1.7.0.
+- [Enhancement] Replace token-based CSRF protection (`route_csrf` plugin) with header-based protection using `Sec-Fetch-Site` header (`sec_fetch_site_csrf` plugin). This eliminates the need for CSRF tokens by leveraging browser-enforced headers that cannot be forged from cross-origin requests. Modern browsers automatically include this header, providing simpler and more robust CSRF protection.
+- [Enhancement] Include a short spec file hash in generated test topic names for traceability. Topic names now follow the `it-{hash}-{uuid}` format, making it easy to identify which test file created a given topic in Kafka logs.
+- [Change] Require Roda `>= 3.100` (previously `~> 3.69`).
+- [Fix] Harden the `wait_for_offset_visible` test helper (used after a transactional produce) to also exercise the Web UI's own message-read path, not just the admin watermark offset. The admin watermark advancing only proves the broker appended the control record; the Web UI reads with a much shorter `fetch.wait.max.ms` than the admin client and could still intermittently raise or return stale results on that exact offset (e.g. the flaky Pro Explorer `system entry` spec), even after the watermark-only wait introduced previously. The helper now also polls the same `Karafka::Web::Ui::Lib::Admin.read_topic` call the Web UI performs and requires it to complete without error before returning.
+- [Fix] Fix two more flaky Pro Explorer `#recent` specs (`when getting recent for the whole topic` / `when recent is on the first partition` and `when recent is on another partition`). Both produced a message to one partition, then a fixed `sleep(0.1)` before producing the message that should be "most recent" to another partition and immediately requesting the endpoint, racing broker propagation under CI load the same way the already-fixed single-partition `#recent` spec did. Replaced the fixed sleep with a `wait_for_message` poll on the second produce's own offset, matching the existing pattern used by the sibling spec right below it.
+- [Fix] Stop a long, unbreakable page title (e.g. a long topic name on the Pro Explorer topic page) and the breadcrumbs bar above it from overflowing the page. A grid/flex item's default `min-width: auto` let the title and breadcrumbs blow out past the viewport instead of shrinking, which pushed layout wide enough to force an unexpected page scrollbar. The title wrapper and `breadcrumbs-wrapper` now set `min-width: 0`, the title text wraps via `overflow-wrap: anywhere`, and the breadcrumbs list now wraps onto multiple lines instead of relying on an easy-to-miss horizontal scroll.
+- [Fix] Stop long, unbreakable flash messages (e.g. a long dotted/underscored topic name in a "successfully created" notice) from overflowing their alert box. DaisyUI's `.alert` grid track sized the message column to its content's intrinsic width, so long single-token strings pushed past the box edge instead of wrapping. The message `span` now sets `overflow-wrap: anywhere` and `min-width: 0` so it wraps within the alert instead.
+- [Fix] Stop long, dotted/underscored Pro Explorer, DLQ, and Topics topic-tile names from overflowing or overlapping their tile. `topic-tile-text` now sets `overflow-wrap: anywhere` so unbreakable names wrap inside the tile instead of spilling out, and the topic-tile link in those three views now carries a `title` attribute showing the full topic name on hover.
+- [Fix] Make the `create_topic` test helper wait until a freshly created topic's partitions are actually readable (expected partition count visible and watermark offsets queryable), not just until the topic name appears in cluster metadata. This removes a flaky failure in multi-partition specs (e.g. the topics distribution controller) that intermittently 404'd because watermark offsets were read before the partition leaders had propagated.
+- [Fix] Stop the array paginator from offering a "Next" link to an empty page when the last page is exactly full. `Paginators::Arrays` decided "is there a next page?" from whether the current page was full, so any list whose total size was an exact multiple of `per_page` (25/50/75/...) surfaced a Next link leading to an empty page. It now reports the last page based on whether a further slice actually exists.
+- [Fix] Compute the dashboard average batch size with float division so it is no longer floored. `Metrics::Aggregated` divided the per-window message delta by the batch delta using integer division, so e.g. 1000 messages over 47 batches charted as `21` instead of `21.28`, systematically under-reporting the average. It now uses float division rounded to 2 decimals.
+- [Fix] Include jobs in the `waiting` state when aggregating the dashboard "Pending" counter. `State#refresh_current_stats` now resets and sums `stats[:waiting]` from incoming consumer reports (previously it was never aggregated and stayed `0`), so `Counters#pending` (`enqueued + waiting`) no longer undercounts jobs sitting in advanced/recurring/scheduled-message schedulers. `:waiting` is now also validated by the `AggregatedStats` contract.
+- [Fix] Add `initialize` to `Status::Context` that defines all instance variables upfront in a consistent order, giving every instance the same Ruby object shape and eliminating the `:performance` shape-variation warning.
+- [Fix] Accept (and ignore) a block in `Karafka::Web::Producer#__getobj__` to silence Ruby 3.4's `strict_unused_block` warning emitted via `SimpleDelegator#method_missing` on every delegated producer call.
+- [Fix] Remove `cgi` as no longer needed.
+- [Fix] Exclude `test/` directory from gem releases to reduce package size.
+- [Fix] Update LinksValidator regexes to match the new `it-{hash}-{uuid}` test topic naming format, fixing test-order dependent failures in explorer controller specs.
+- [Fix] Fix alerts formatting for the distribution view.
+- [Fix] Fix 500 error in the Pro Explorer when a message payload parses as valid JSON but contains strings with invalid UTF-8 byte sequences. `JSON.pretty_generate` would raise `JSON::GeneratorError` outside of any error boundary and propagate as an unhandled 500. The pretty-print step is now wrapped in a dedicated `@safe_pretty_payload` SafeRunner; on failure the raw bytes are displayed alongside a deserialization warning.
+- [Fix] Fix 500 error in the Pro Explorer message JSON export when a payload deserializes correctly but cannot be serialized back to JSON (for example when it contains strings with invalid UTF-8 byte sequences). The export endpoint now responds with 404 in such cases and the export action button is no longer rendered for such messages.
+- [Fix] Normalize a batch of styling inconsistencies found while auditing #906: a `data-table-wraper` typo left the Cluster replication table unstyled, `Cluster::_config` rendered raw `true`/`false` instead of badges (unlike the identical `Topics::Configs` table), a Recurring Tasks "Trigger" button's disabled state was computed but never applied to its class, several views carried dead pre-Tailwind Bootstrap classes (`col-sm-*`, `col-lg-*`, `row`, `container-wrapper`) with no effect, one Topics Configs action cell was missing the `options` column class, a handful of breadcrumb/title labels had grammar or casing inconsistencies ("Cluster informations", "Consumers Groups Health", "Dead Letter Queue topics"), the OSS Routing topic list hand-rolled a `badge-warning` for inactive topics instead of the `badge_secondary` used by the identical Pro table, the filtered-payload notice used unstyled Bootstrap-era markup instead of the shared `alert_box_warning` primitive, `status-row-stopping` was colored red (`border-l-error`) while `status_badge` treats "stopping" as the same warning tier as "quiet"/"quieting", three Pro Topics checklist notices (before deleting a topic, increasing partitions, or editing a config value) hand-rolled a bare `alert` div with no severity color or icon instead of the shared `alert_box_warning` primitive used by their sibling warning boxes on the same pages, `alert_box_primary`/`alert_box_secondary` displayed the success checkmark icon (copy-pasted from `alert_box_success`) instead of matching their non-box `info_circle`/`pause_circle` siblings, the internal style-guide page demoed the wrong pencil icon for edit actions, and a scheduled message's "Cancel dispatch" button used a passive error-status icon instead of the `trash` icon already used for every other removal action.
+- [Fix] Continue normalizing styling inconsistencies from the #906 audit: Health and Recurring Tasks tab bars hand-rolled `col-span-12 mb-9` instead of the shared `tab-container-wrapper` class, and the Scheduled Messages per-partition schedule heading used `h3`/`.h3` where the equivalent per-group heading on Health pages uses `h2`/`.h2`.
+- [Fix] Retire the `.row-table`/`.row-table-wrapper` table primitive, which had drifted to a single real caller (the Pro per-topic Errors table) against 45+ real uses of `.data-table`, and additionally used a different button-alignment convention (`text-center` vs. `.data-table`'s `text-right`) than every other action column in the app. Switched that one table to `.data-table`, removed the now fully unused CSS utilities and their style-guide demo, and fixed a stale ".row-table" label left over in an unrelated `.data-table` demo section.
+- [Enhancement] Add a standardized `empty_state` helper/component (icon, message, optional description, and optional call-to-action) and replace the ad hoc `alert_info`/`alert_box_info` "There are no X" messages across every empty-list view (Jobs, DLQ, Explorer, Health, Errors, Consumers, Recurring Tasks, Scheduled Messages, dashboard, and paginated tables) with it, for a consistent look across the Web UI. Demoed on the internal style-guide `/ux` page.
+- [Fix] Fix unreadable `.btn-outline.btn-active` buttons (e.g. the dashboard time-range selector) in both the light and dark themes. The daisyUI 5.6 upgrade left the active state's background color computed from the same `--btn-color` variable as the outline's text color, so the two nearly matched; the button now switches to the color-variant's contrasting foreground color when active, matching its existing `:hover` behavior.
+- [Enhancement] Expand the internal `/ux` style-guide page to cover every UI component actually used across the app, so upgrades (daisyUI, Tailwind, etc.) can be visually spot-checked in one place: plain `.card`/`.card-body`, `.modal`/`dialog`, `.dropdown`, `.tooltip`, the `.btn-ghost`/`.btn-square`/`.btn-action`/`.btn-lockable`/`.confirm-action` button modifiers, the breadcrumbs component, and the `status_badge`/`lag_trend_badge`/`kafka_state_badge`/`lso_risk_state_badge`/`truncate`/`lag_with_label`/`offset_with_label` helper methods (previously only their raw CSS classes were demoed). Adds a small reusable `ModalOpener` JS component (`[data-modal-open]`) since the CSP disallows the inline `onclick` handler style used by the existing search modal trigger.
+- [Fix] Fix a flaky Pro Explorer spec (`when requested message exists but is a system entry`) caused by the `produce` test helper's transactional flow: it only waited a fixed `sleep(0.1)` for a transactional produce's commit control record to become visible before the test reads it back, which is too short under CI load and made the spec intermittently 404 or see stale content. Replaced the fixed sleep with a `wait_for_offset_visible` poll that waits until the control record's offset is actually part of the readable watermark range, mirroring the existing `wait_for_message`/`create_topic` readiness-polling pattern instead of a fixed delay.
+- [Fix] Stop a misclick on a Pro-gated OSS element from fully navigating away to the standalone "Pro Feature" upsell page. This affected the sidebar (Health, Explorer, Cron, Schedules, Dead, Topics), the Consumers tabs (Performance, Controls, Commands), the dashboard's "Data transfers" chart tab, and several unguarded links with no visual gating indicator at all: the dashboard's "Total lag"/"Dead" counters, Cluster topic/partition names, per-message Explorer offset links on the Errors detail page, and consumer process IDs on the Consumers and Jobs list pages. Gated sidebar/tab items are now truly inert `disabled` buttons with an "Available in Karafka Pro" hover tooltip instead of `<a href>` links (or, for the dashboard chart tab, a JS-clickable `<span>`) pointing at the real Pro-only content; the previously-unguarded inline links are now plain text in the OSS templates, with a matching Pro-only view override (`dashboard/_counters`, `cluster/_partition`, `errors/_detail`) restoring the links for Pro users, keeping the OSS templates free of any `Karafka.pro?` branching. Also fixes the sidebar's collapse/expand toggle showing the default arrow cursor instead of a pointer on hover, and hardens `TabsManager` (the chart-tab-switching JS) to no-op instead of throwing when a tab's target content or a previously-active tab is missing/disabled, which had broken tab-switching for the Utilization/RSS/Concurrency charts for anyone who had the now-disabled "Data transfers" tab persisted as their last-active tab. Closes #1106.
+- [Fix] Add `rel="noopener noreferrer"` to every `target="_blank"` link across the Web UI (docs, Slack, GitHub, and "become Pro" links in the support, status, dashboard, and Pro topic-replication warning views). Without it, the opened external page could access `window.opener` and redirect the original Web UI tab to an arbitrary page (reverse tabnabbing).
+- [Fix] Fix a flaky Pro Explorer spec (`ExplorerController#recent::when getting recent for the partition`) that produced a message and immediately requested the "recent" endpoint with no readiness wait, occasionally racing the broker's propagation of the just-produced message under CI load. Added a `wait_for_message` poll before the request, matching the existing readiness-polling pattern used elsewhere in the suite.
+- [Enhancement] Replace the bare `assert(response.ok?)` pattern with a new `assert_ok` test helper across the whole controller test suite (381 call sites). On failure it now prints the actual response status and a body excerpt instead of a generic "Expected false to be truthy", making intermittent CI-only non-200 failures actually diagnosable.
+- [Change] Switch to Karafka 2.6's new, group-type-agnostic `#group`/`group_id` accessors instead of `#consumer_group`/`consumer_group_id` when reading from Karafka's own routing and instrumentation APIs (`topic.group`, `subscription_group.group`, `event[:group_id]`), preparing for upcoming Kafka share group support (KIP-932). `consumer_group`/`consumer_group_id` remain as karafka-web's own internal naming (tracking payloads, commanding schema, UI labels) — only the calls into Karafka's own API surface changed. Closes #1022.
+
 ## 0.11.6 (2026-02-01)
 - **[Feature]** Provide ability to pause/resume all partitions of a topic at once across all consumer processes via the Health Overview page (Pro). Topic-level commands are broadcast to all processes, and each process applies the command to partitions it owns within the specified consumer group. This simplifies bulk operations compared to pausing/resuming individual partitions one by one.
 - [Enhancement] Optimize partition command tracker to use index-based lookup instead of iterating over 10,000 partitions during rebalance events. The tracker now maintains a partition index for O(n) lookups where n is the number of partitions with pending commands.

data/Gemfile

@@ -6,12 +6,13 @@ gemspec
 
 group :test do
   gem "byebug"
-  gem "factory_bot"
   gem "fugit"
+  gem "mocha"
   # Needed for links extraction for visits verification
   gem "nokogiri"
   gem "ostruct"
   gem "rack-test"
-  gem "rspec"
+  gem "minitest"
   gem "simplecov"
+  gem "warning"
 end

data/Gemfile.lint

@@ -9,6 +9,6 @@ gem "yard-lint"
 gem "standard"
 gem "standard-performance"
 gem "rubocop-performance"
-gem "rubocop-rspec"
-gem "standard-rspec"
+gem "rubocop-minitest"
+gem "standard-minitest"
 gem "rubocop-thread_safety"

data/Gemfile.lint.lock

@@ -27,23 +27,14 @@ GEM
     rubocop-ast (1.49.0)
       parser (>= 3.3.7.2)
       prism (~> 1.7)
-    rubocop-capybara (2.22.1)
+    rubocop-minitest (0.39.1)
       lint_roller (~> 1.1)
-      rubocop (~> 1.72, >= 1.72.1)
-    rubocop-factory_bot (2.28.0)
-      lint_roller (~> 1.1)
-      rubocop (~> 1.72, >= 1.72.1)
+      rubocop (>= 1.75.0, < 2.0)
+      rubocop-ast (>= 1.38.0, < 2.0)
     rubocop-performance (1.26.1)
       lint_roller (~> 1.1)
       rubocop (>= 1.75.0, < 2.0)
       rubocop-ast (>= 1.47.1, < 2.0)
-    rubocop-rspec (3.9.0)
-      lint_roller (~> 1.1)
-      rubocop (~> 1.81)
-    rubocop-rspec_rails (2.32.0)
-      lint_roller (~> 1.1)
-      rubocop (~> 1.72, >= 1.72.1)
-      rubocop-rspec (~> 3.5)
     rubocop-thread_safety (0.7.3)
       lint_roller (~> 1.1)
       rubocop (~> 1.72, >= 1.72.1)
@@ -58,39 +49,37 @@ GEM
     standard-custom (1.0.2)
       lint_roller (~> 1.0)
       rubocop (~> 1.50)
+    standard-minitest (1.0.0)
+      lint_roller (~> 1.0)
+      rubocop-minitest
     standard-performance (1.9.0)
       lint_roller (~> 1.1)
       rubocop-performance (~> 1.26.0)
-    standard-rspec (0.3.1)
-      lint_roller (>= 1.0)
-      rubocop-capybara (~> 2.22)
-      rubocop-factory_bot (~> 2.27)
-      rubocop-rspec (~> 3.5)
-      rubocop-rspec_rails (~> 2.31)
     unicode-display_width (3.2.0)
       unicode-emoji (~> 4.1)
     unicode-emoji (4.2.0)
-    yard (0.9.38)
-    yard-lint (1.4.0)
+    yard (0.9.45)
+    yard-lint (1.10.1)
       yard (~> 0.9)
       zeitwerk (~> 2.6)
-    zeitwerk (2.7.4)
+    zeitwerk (2.8.2)
 
 PLATFORMS
   ruby
   x86_64-linux
 
 DEPENDENCIES
+  rubocop-minitest
   rubocop-performance
-  rubocop-rspec
   rubocop-thread_safety
   standard
+  standard-minitest
   standard-performance
-  standard-rspec
   yard-lint
 
 CHECKSUMS
   ast (2.4.3) sha256=954615157c1d6a382bc27d690d973195e79db7f55e9765ac7c481c60bdb4d383
+  bundler (4.0.17) sha256=214e21431b5665dd2f99df8a5511c6b151d7a72e8015c8b38f8b775b61cbb6c1
   json (2.18.0) sha256=b10506aee4183f5cf49e0efc48073d7b75843ce3782c68dbeb763351c08fd505
   language_server-protocol (3.17.0.5) sha256=fd1e39a51a28bf3eec959379985a72e296e9f9acfce46f6a79d31ca8760803cc
   lint_roller (1.1.0) sha256=2c0c845b632a7d172cb849cc90c1bce937a28c5c8ccccb50dfd46a485003cc87
@@ -102,22 +91,19 @@ CHECKSUMS
   regexp_parser (2.11.3) sha256=ca13f381a173b7a93450e53459075c9b76a10433caadcb2f1180f2c741fc55a4
   rubocop (1.82.1) sha256=09f1a6a654a960eda767aebea33e47603080f8e9c9a3f019bf9b94c9cab5e273
   rubocop-ast (1.49.0) sha256=49c3676d3123a0923d333e20c6c2dbaaae2d2287b475273fddee0c61da9f71fd
-  rubocop-capybara (2.22.1) sha256=ced88caef23efea53f46e098ff352f8fc1068c649606ca75cb74650970f51c0c
-  rubocop-factory_bot (2.28.0) sha256=4b17fc02124444173317e131759d195b0d762844a71a29fe8139c1105d92f0cb
+  rubocop-minitest (0.39.1) sha256=998398d6da4026d297f0f9bf709a1eac5f2b6947c24431f94af08138510cf7ed
   rubocop-performance (1.26.1) sha256=cd19b936ff196df85829d264b522fd4f98b6c89ad271fa52744a8c11b8f71834
-  rubocop-rspec (3.9.0) sha256=8fa70a3619408237d789aeecfb9beef40576acc855173e60939d63332fdb55e2
-  rubocop-rspec_rails (2.32.0) sha256=4a0d641c72f6ebb957534f539d9d0a62c47abd8ce0d0aeee1ef4701e892a9100
   rubocop-thread_safety (0.7.3) sha256=067cdd52fbf5deffc18995437e45b5194236eaff4f71de3375a1f6052e48f431
   ruby-progressbar (1.13.0) sha256=80fc9c47a9b640d6834e0dc7b3c94c9df37f08cb072b7761e4a71e22cff29b33
   standard (1.53.0) sha256=f3c9493385db7079d0abce6f7582f553122156997b81258cd361d3480eeacf9c
   standard-custom (1.0.2) sha256=424adc84179a074f1a2a309bb9cf7cd6bfdb2b6541f20c6bf9436c0ba22a652b
+  standard-minitest (1.0.0) sha256=450caa86a64a6e6f6f186cc88601dbb49b6cfaa3b0dce77a73b50ba8cdc15b2a
   standard-performance (1.9.0) sha256=49483d31be448292951d80e5e67cdcb576c2502103c7b40aec6f1b6e9c88e3f2
-  standard-rspec (0.3.1) sha256=67bc957281cacf24f0d88235ca1bf28a8995265b1a60eb519cd0451858b56a22
   unicode-display_width (3.2.0) sha256=0cdd96b5681a5949cdbc2c55e7b420facae74c4aaf9a9815eee1087cb1853c42
   unicode-emoji (4.2.0) sha256=519e69150f75652e40bf736106cfbc8f0f73aa3fb6a65afe62fefa7f80b0f80f
-  yard (0.9.38) sha256=721fb82afb10532aa49860655f6cc2eaa7130889df291b052e1e6b268283010f
-  yard-lint (1.4.0) sha256=7dd88fbb08fd77cb840bea899d58812817b36d92291b5693dd0eeb3af9f91f0f
-  zeitwerk (2.7.4) sha256=2bef90f356bdafe9a6c2bd32bcd804f83a4f9b8bc27f3600fff051eb3edcec8b
+  yard (0.9.45) sha256=52e211493f7cb8a3ebf7e104a25a1e73937a3103092545d34cb88fafebb3dc51
+  yard-lint (1.10.1) sha256=172ea1905304580bd515c093d82831ec4889e725100c49d5bf77e62101f49129
+  zeitwerk (2.8.2) sha256=7212a61311083c604184b1ea2574b9aa05cd14f855a0841c06985cabe9181d12
 
 BUNDLED WITH
-  4.0.3
+  4.0.17

data/Gemfile.lock

@@ -1,95 +1,78 @@
 PATH
   remote: .
   specs:
-    karafka-web (0.11.6)
+    karafka-web (1.0.0.rc1)
       erubi (~> 1.4)
-      karafka (>= 2.5.2, < 2.6.0)
-      karafka-core (>= 2.5.0, < 2.6.0)
-      roda (~> 3.69, >= 3.69)
+      karafka (>= 2.6.0.beta1, < 2.7.0)
+      karafka-core (>= 2.6.0, < 2.7.0)
+      roda (>= 3.100, < 4.0)
       tilt (~> 2.0)
 
 GEM
   remote: https://rubygems.org/
   specs:
-    activesupport (8.1.1)
-      base64
-      bigdecimal
-      concurrent-ruby (~> 1.0, >= 1.3.1)
-      connection_pool (>= 2.2.5)
-      drb
-      i18n (>= 1.6, < 2)
-      json
-      logger (>= 1.4.2)
-      minitest (>= 5.1)
-      securerandom (>= 0.3)
-      tzinfo (~> 2.0, >= 2.0.5)
-      uri (>= 0.13.1)
-    base64 (0.3.0)
-    bigdecimal (3.3.1)
     byebug (13.0.0)
       reline (>= 0.6.0)
-    concurrent-ruby (1.3.5)
-    connection_pool (2.5.4)
-    diff-lcs (1.6.2)
-    docile (1.4.1)
+    concurrent-ruby (1.3.7)
     drb (2.2.3)
     erubi (1.13.1)
     et-orbi (1.4.0)
       tzinfo
-    factory_bot (6.5.6)
-      activesupport (>= 6.1.0)
-    ffi (1.17.2)
-    ffi (1.17.2-aarch64-linux-gnu)
-    ffi (1.17.2-aarch64-linux-musl)
-    ffi (1.17.2-arm-linux-gnu)
-    ffi (1.17.2-arm-linux-musl)
-    ffi (1.17.2-arm64-darwin)
-    ffi (1.17.2-x86-linux-gnu)
-    ffi (1.17.2-x86-linux-musl)
-    ffi (1.17.2-x86_64-darwin)
-    ffi (1.17.2-x86_64-linux-gnu)
-    ffi (1.17.2-x86_64-linux-musl)
-    fugit (1.12.1)
+    ffi (1.17.4)
+    ffi (1.17.4-aarch64-linux-gnu)
+    ffi (1.17.4-aarch64-linux-musl)
+    ffi (1.17.4-arm-linux-gnu)
+    ffi (1.17.4-arm-linux-musl)
+    ffi (1.17.4-arm64-darwin)
+    ffi (1.17.4-x86-linux-gnu)
+    ffi (1.17.4-x86-linux-musl)
+    ffi (1.17.4-x86_64-darwin)
+    ffi (1.17.4-x86_64-linux-gnu)
+    ffi (1.17.4-x86_64-linux-musl)
+    fugit (1.13.0)
       et-orbi (~> 1.4)
       raabro (~> 1.4)
-    i18n (1.14.7)
-      concurrent-ruby (~> 1.0)
     io-console (0.8.2)
-    json (2.16.0)
-    karafka (2.5.2)
-      base64 (~> 0.2)
-      karafka-core (>= 2.5.6, < 2.6.0)
-      karafka-rdkafka (>= 0.22.0)
-      waterdrop (>= 2.8.9, < 3.0.0)
+    json (2.20.0)
+    karafka (2.6.0.beta1)
+      karafka-core (>= 2.6.0, < 2.7.0)
+      karafka-rdkafka (>= 0.27.2)
+      waterdrop (>= 2.10.1, < 3.0.0)
       zeitwerk (~> 2.3)
-    karafka-core (2.5.7)
+    karafka-core (2.6.2)
       karafka-rdkafka (>= 0.20.0)
       logger (>= 1.6.0)
-    karafka-rdkafka (0.23.0)
+    karafka-rdkafka (0.27.2)
       ffi (~> 1.17.1)
       json (> 2.0)
       logger
       mini_portile2 (~> 2.6)
       rake (> 12)
-    karafka-rdkafka (0.23.0-aarch64-linux-gnu)
+    karafka-rdkafka (0.27.2-aarch64-linux-gnu)
       ffi (~> 1.17.1)
       json (> 2.0)
       logger
       mini_portile2 (~> 2.6)
       rake (> 12)
-    karafka-rdkafka (0.23.0-arm64-darwin)
+    karafka-rdkafka (0.27.2-aarch64-linux-musl)
       ffi (~> 1.17.1)
       json (> 2.0)
       logger
       mini_portile2 (~> 2.6)
       rake (> 12)
-    karafka-rdkafka (0.23.0-x86_64-linux-gnu)
+    karafka-rdkafka (0.27.2-arm64-darwin)
       ffi (~> 1.17.1)
       json (> 2.0)
       logger
       mini_portile2 (~> 2.6)
       rake (> 12)
-    karafka-rdkafka (0.23.0-x86_64-linux-musl)
+    karafka-rdkafka (0.27.2-x86_64-linux-gnu)
+      ffi (~> 1.17.1)
+      json (> 2.0)
+      logger
+      mini_portile2 (~> 2.6)
+      rake (> 12)
+    karafka-rdkafka (0.27.2-x86_64-linux-musl)
       ffi (~> 1.17.1)
       json (> 2.0)
       logger
@@ -97,70 +80,57 @@ GEM
       rake (> 12)
     logger (1.7.0)
     mini_portile2 (2.8.9)
-    minitest (5.26.1)
-    nokogiri (1.19.0)
+    minitest (6.0.6)
+      drb (~> 2.0)
+      prism (~> 1.5)
+    mocha (3.1.0)
+      ruby2_keywords (>= 0.0.5)
+    nokogiri (1.19.4)
       mini_portile2 (~> 2.8.2)
       racc (~> 1.4)
-    nokogiri (1.19.0-aarch64-linux-gnu)
+    nokogiri (1.19.4-aarch64-linux-gnu)
       racc (~> 1.4)
-    nokogiri (1.19.0-aarch64-linux-musl)
+    nokogiri (1.19.4-aarch64-linux-musl)
       racc (~> 1.4)
-    nokogiri (1.19.0-arm-linux-gnu)
+    nokogiri (1.19.4-arm-linux-gnu)
       racc (~> 1.4)
-    nokogiri (1.19.0-arm-linux-musl)
+    nokogiri (1.19.4-arm-linux-musl)
       racc (~> 1.4)
-    nokogiri (1.19.0-arm64-darwin)
+    nokogiri (1.19.4-arm64-darwin)
       racc (~> 1.4)
-    nokogiri (1.19.0-x86_64-darwin)
+    nokogiri (1.19.4-x86_64-darwin)
       racc (~> 1.4)
-    nokogiri (1.19.0-x86_64-linux-gnu)
+    nokogiri (1.19.4-x86_64-linux-gnu)
       racc (~> 1.4)
-    nokogiri (1.19.0-x86_64-linux-musl)
+    nokogiri (1.19.4-x86_64-linux-musl)
       racc (~> 1.4)
     ostruct (0.6.3)
+    prism (1.9.0)
     raabro (1.4.0)
     racc (1.8.1)
-    rack (3.2.4)
+    rack (3.2.6)
     rack-test (2.2.0)
       rack (>= 1.3)
     rackup (0.2.3)
       rack (>= 3.0.0.beta1)
       webrick
-    rake (13.3.1)
+    rake (13.4.2)
     reline (0.6.3)
       io-console (~> 0.5)
-    roda (3.98.0)
+    roda (3.105.0)
       rack
-    rspec (3.13.2)
-      rspec-core (~> 3.13.0)
-      rspec-expectations (~> 3.13.0)
-      rspec-mocks (~> 3.13.0)
-    rspec-core (3.13.6)
-      rspec-support (~> 3.13.0)
-    rspec-expectations (3.13.5)
-      diff-lcs (>= 1.2.0, < 2.0)
-      rspec-support (~> 3.13.0)
-    rspec-mocks (3.13.7)
-      diff-lcs (>= 1.2.0, < 2.0)
-      rspec-support (~> 3.13.0)
-    rspec-support (3.13.6)
-    securerandom (0.4.1)
-    simplecov (0.22.0)
-      docile (~> 1.1)
-      simplecov-html (~> 0.11)
-      simplecov_json_formatter (~> 0.1)
-    simplecov-html (0.13.2)
-    simplecov_json_formatter (0.1.4)
-    tilt (2.6.1)
+    ruby2_keywords (0.0.5)
+    simplecov (1.0.2)
+    tilt (2.7.0)
     tzinfo (2.0.6)
       concurrent-ruby (~> 1.0)
-    uri (1.1.1)
-    waterdrop (2.8.13)
-      karafka-core (>= 2.4.9, < 3.0.0)
-      karafka-rdkafka (>= 0.20.0)
+    warning (1.6.0)
+    waterdrop (2.10.2)
+      karafka-core (>= 2.5.12, < 3.0.0)
+      karafka-rdkafka (>= 0.24.0)
       zeitwerk (~> 2.3)
-    webrick (1.9.1)
-    zeitwerk (2.7.3)
+    webrick (1.9.2)
+    zeitwerk (2.8.2)
 
 PLATFORMS
   aarch64-linux-gnu
@@ -177,15 +147,16 @@ PLATFORMS
 
 DEPENDENCIES
   byebug
-  factory_bot
   fugit
   karafka-web!
+  minitest
+  mocha
   nokogiri
   ostruct
   rack-test
   rackup (~> 0.2)
-  rspec
   simplecov
+  warning
 
 BUNDLED WITH
-   2.7.1
+  4.0.12

data/Rakefile

@@ -2,3 +2,29 @@
 
 require "bundler/setup"
 require "bundler/gem_tasks"
+require "minitest/test_task"
+
+specs_type = ENV.fetch("SPECS_TYPE", "regular")
+
+Minitest::TestTask.create(:test) do |t|
+  t.libs << "test"
+  t.libs << "lib"
+  t.test_prelude = 'require "test_helper"; require "minitest/autorun"'
+
+  t.test_globs = if specs_type == "pro"
+    ["test/lib/karafka/web/pro/**/*_test.rb"]
+  else
+    # Exclude pro tests from regular test runs
+    [
+      "test/lib/karafka/web/*_test.rb",
+      "test/lib/karafka/web/cli/**/*_test.rb",
+      "test/lib/karafka/web/contracts/**/*_test.rb",
+      "test/lib/karafka/web/management/**/*_test.rb",
+      "test/lib/karafka/web/processing/**/*_test.rb",
+      "test/lib/karafka/web/tracking/**/*_test.rb",
+      "test/lib/karafka/web/ui/**/*_test.rb"
+    ]
+  end
+end
+
+task default: :test

data/bin/{balance_specs → balance_tests}

@@ -1,29 +1,29 @@
 #!/usr/bin/env ruby
 # frozen_string_literal: true
 
-# Balances spec files across N workers using timing data
+# Balances test files across N workers using timing data
 # Uses greedy bin-packing: assign each file to worker with lowest total time
 #
-# Usage: bin/balance_specs <regular|pro> <num_workers>
+# Usage: bin/balance_tests <regular|pro> <num_workers>
 #
-# Output: JSON array of arrays where each inner array contains the spec files
+# Output: JSON array of arrays where each inner array contains the test files
 #         assigned to that worker
 #
 # Example:
-#   bin/balance_specs regular 4
-#   [["spec/a.rb","spec/d.rb"],["spec/b.rb"],["spec/c.rb"],["spec/e.rb"]]
+#   bin/balance_tests regular 4
+#   [["test/a.rb","test/d.rb"],["test/b.rb"],["test/c.rb"],["test/e.rb"]]
 
 require 'json'
 
-TIMINGS_DIR = File.expand_path('../spec/timings', __dir__)
+TIMINGS_DIR = File.expand_path('../test/timings', __dir__)
 DEFAULT_TIME = 1.0 # Default time for files not in timing data
 
-# Loads timing data from a JSON file for the given spec type
+# Loads timing data from a JSON file for the given test type
 #
-# @param specs_type [String] the type of specs ('regular' or 'pro')
+# @param tests_type [String] the type of tests ('regular' or 'pro')
 # @return [Hash<String, Float>] hash mapping file paths to execution times in seconds
-def load_timings(specs_type)
-  file_path = File.join(TIMINGS_DIR, "#{specs_type}.json")
+def load_timings(tests_type)
+  file_path = File.join(TIMINGS_DIR, "#{tests_type}.json")
 
   if File.exist?(file_path)
     JSON.parse(File.read(file_path))
@@ -32,37 +32,37 @@ def load_timings(specs_type)
   end
 end
 
-# Returns a sorted list of spec files for the given spec type
+# Returns a sorted list of test files for the given test type
 #
-# @param specs_type [String] the type of specs ('regular' or 'pro')
-# @return [Array<String>] sorted array of spec file paths
-def get_spec_files(specs_type)
-  all_specs = Dir.glob('spec/lib/karafka/web/**/*_spec.rb').sort
+# @param tests_type [String] the type of tests ('regular' or 'pro')
+# @return [Array<String>] sorted array of test file paths
+def get_test_files(tests_type)
+  all_tests = Dir.glob('test/lib/karafka/web/**/*_test.rb').sort
 
-  case specs_type
+  case tests_type
   when 'pro'
-    all_specs.select { |f| f.include?('/pro/') }
+    all_tests.select { |f| f.include?('/pro/') }
   when 'regular'
-    all_specs.reject { |f| f.include?('/pro/') }
+    all_tests.reject { |f| f.include?('/pro/') }
   else
-    warn "Unknown specs type: #{specs_type}"
+    warn "Unknown tests type: #{tests_type}"
     exit 1
   end
 end
 
-# Balances spec files across workers using greedy bin-packing algorithm
+# Balances test files across workers using greedy bin-packing algorithm
 #
 # Files are sorted by execution time (descending) and each file is assigned
 # to the worker with the lowest total time. This minimizes the imbalance
 # between the slowest and fastest workers.
 #
-# @param files [Array<String>] list of spec file paths to balance
+# @param files [Array<String>] list of test file paths to balance
 # @param timings [Hash<String, Float>] hash mapping file paths to execution times
 # @param num_workers [Integer] number of workers to distribute files across
 # @return [Array<Hash>] array of worker hashes, each with :files and :total_time keys
 def balance_files(files, timings, num_workers)
   # Get timing for each file, using default if not found
-  # Handle both "./spec/..." and "spec/..." path formats
+  # Handle both "./test/..." and "test/..." path formats
   files_with_times = files.map do |file|
     time = timings[file] || timings["./#{file}"] || DEFAULT_TIME
     [file, time]
@@ -101,16 +101,16 @@ def print_balance_info(workers)
 end
 
 # Main
-specs_type = ARGV[0]
+tests_type = ARGV[0]
 num_workers = (ARGV[1] || '4').to_i
 
-unless specs_type
-  warn "Usage: bin/balance_specs <regular|pro> <num_workers>"
+unless tests_type
+  warn "Usage: bin/balance_tests <regular|pro> <num_workers>"
   exit 1
 end
 
-timings = load_timings(specs_type)
-files = get_spec_files(specs_type)
+timings = load_timings(tests_type)
+files = get_test_files(tests_type)
 workers = balance_files(files, timings, num_workers)
 
 # Print balance info to stderr

data/bin/check_coverage

@@ -1,11 +1,11 @@
 #!/usr/bin/env bash
 
-# Collates SimpleCov results from parallel spec runs and checks minimum coverage
+# Collates SimpleCov results from parallel test runs and checks minimum coverage
 #
-# This script should be run after bin/rspecs_parallel or bin/rspecs to verify
+# This script should be run after bin/tests_parallel to verify
 # code coverage meets the minimum threshold.
 #
-# Coverage thresholds are defined in spec/support/coverage_config.rb
+# Coverage thresholds are defined in test/support/coverage_config.rb
 
 set -e
 
@@ -13,10 +13,10 @@ echo "Collating SimpleCov coverage results..."
 
 bundle exec ruby -e "
   require 'simplecov'
-  require_relative 'spec/support/coverage_config'
+  require_relative 'test/support/coverage_config'
 
   SimpleCov.collate Dir['coverage/.resultset.json'], 'rails' do
-    add_filter '/spec/'
+    add_filter '/test/'
     add_filter '/vendor/'
     add_filter '/gems/'
     add_filter '/.bundle/'