rspec-mergify 2026.10.6-aarch64-linux → 2026.10.7-aarch64-linux

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 5a261c01ae4011bcfd847272cc83aa77f9b4a155f419e35875e71ad4b19dfa46
-  data.tar.gz: 34f603a76225677b684ec5e6ac304b23d8c771d7c8c84e4340620fcce983a51a
+  metadata.gz: 2dd9298ba46962f5dfe79716bb1f5c65f3111772f932581ac5d2346c54532d7b
+  data.tar.gz: 655b110390643ebaf9aa1c551166adb912373403378d01e9f38975d0771783dd
 SHA512:
-  metadata.gz: 6c49d27be53c6d9063a9db44c5ce802d063c48f98ca06eca5a2ca4c855294eb6e0b256257bd62bccbff0584c7302e119ddfdb426c26297a20683d500da0dc2ae
-  data.tar.gz: 4b398660a673b816b4e3996c3ab22d0e8321496b39acbdaafc8f22c82097602253d2f42ee20419f6676d5820cbf058f93e9ad4d2141bee5c6d949cf5b6ce20ac
+  metadata.gz: 8e3c439dd4f41fdebd9861fd7a7471c7669e0da2c599ce57b2245940b71967c9ff3a36d86f916f035b67701169993390d94ba1e0831e14c26704a144b11e0bb9
+  data.tar.gz: 286b86f8c8cc0a50f5ef263b6f220ef7847a4219df0fb90e9c362f5b1704936d444ecd9bc9e6139ce4c6e9c448d2bc2e57a15784569233a6e8c51c296a188413

data/README.md

@@ -7,7 +7,7 @@ RSpec plugin for [Mergify Test Engine](https://docs.mergify.com/test-engine/).
 - **Test tracing** — Sends OpenTelemetry traces for every test to Mergify's API
 - **Flaky test detection** — Intelligently reruns tests to detect flakiness with budget constraints
 - **Test quarantine** — Quarantines failing tests so they don't block CI
-- **Test selection** — Runs only the previously-failing examples when Mergify's merge queue reruns a job
+- **Test selection** — Runs first the examples a merge-queue bisection step failed in the step above, and stops once one fails again
 
 ## Installation
 
@@ -61,60 +61,44 @@ them: `RSPEC_MERGIFY_DEBUG=false` leaves debug off.
 
 ### Test selection
 
-When Mergify's merge queue reruns a job — a retry, or a step of a batch
-bisection — only the examples that failed on the previous attempt are
-informative. The gem asks Mergify whether the current run is such a rerun and,
-if so, runs only those examples.
+When Mergify's merge queue splits a failed batch, each bisection step only
+needs to tell whether it is red. The gem asks Mergify whether the current run
+is such a step and, if so, runs first the examples this job failed in the run
+the step was split from (Fail First). The top-level groups holding them run
+first, and inside each group they run before its other examples and child
+groups — whatever the order (`--order rand`, `config.order`, your own
+`register_ordering`, `order:` metadata), which still applies to everything
+else. RSpec runs a group's whole subtree before the next group, and a group's
+own examples before its child groups, so when they span several groups the
+rest of each of those groups runs in between. If one of them fails again, the
+step is red whatever the rest does, so the run stops once they have all run
+(exit code 1, the remaining examples not run) and the queue can split again
+without waiting for the suite. If none fails again, the rest of the suite runs
+as usual. No example is ever skipped, so a green step still comes from a full
+suite. A quarantined failure does not stop the run; a `--fail-fast` of your own
+still stops at the first failure.
 
 **This is off until you turn it on, per job.** Set
-`MERGIFY_TEST_SELECTION_ENABLE=true` on the job you want reduced. Installing the
-gem is not enough — a feature that decides not to run tests starts only where
-you wrote that it should. Anything that is not a recognised yes (unset, empty,
-`false`, unparsable) means no, and a job that has not opted in never asks.
+`MERGIFY_TEST_SELECTION_ENABLE=true` on the job you want to run its failures
+first. Installing the gem is not enough. Anything that is not a recognised yes
+(unset, empty, `false`, unparsable) means no, and a job that has not opted in
+never asks.
 
-Once opted in, it only ever removes work:
+Once opted in:
 
-- the answer is applied **after** RSpec's own filters — file and line
-  arguments, `--tag`, `-e`, `--only-failures` all still narrow the run, never
-  widen it;
+- the order applies **after** RSpec's own filters — file and line arguments,
+  `--tag`, `-e`, `--only-failures` all still narrow the run;
 - examples are matched by their id (`./spec/models/user_spec.rb[1:2]`), the
   identity RSpec itself reruns failures by;
-- if Mergify says the previous attempt already ran every one of these examples
-  and they passed, the run executes none and exits green;
-- if any example Mergify asks for is not collected here, the full suite runs;
-- any error, timeout, or unrecognised answer runs the full suite;
-- if Mergify refuses to pick a previous attempt (several runs of this job
-  report under one name), the run **fails** with Mergify's explanation: give
-  each run its own `MERGIFY_TEST_JOB_NAME`;
+- any error, timeout, or unrecognised answer runs the full suite in its usual
+  order;
 - at the end of the run the gem sends Mergify what it concluded (the counts
   and the failing examples) — unless the run failed outside any example (a
-  failing `after(:context)` or suite hook), in which case a retry runs the
-  full suite.
+  failing `after(:context)` or suite hook), in which case the next bisection
+  step runs its full suite in its usual order.
 
 Each parallel_tests worker, and each CI job handed a slice of the spec files,
-is matched to the same slice of the previous attempt, by the examples it
-collects. This needs the slices to be the same on both attempts, which is the
-case for a split by file size or by a committed runtime log; Knapsack Pro's
-Queue Mode hands files out dynamically and is not supported.
-
-#### Bisection steps: failures first
-
-When the merge queue splits a failed batch, a test that passed with every pull
-request of the batch can fail with only some of them, so a bisection step is
-never reduced: it runs its full suite. Mergify may instead tell it to run first
-the examples this job failed in the run the step was split from. The top-level
-groups holding them run first, and inside each group they run before its other
-examples and child groups — whatever the order (`--order rand`, `config.order`,
-your own `register_ordering`, `order:` metadata), which still applies to
-everything else. RSpec runs a group's whole subtree before the next group, and a
-group's own examples before its child groups, so when they span several groups
-the rest of each of those groups runs in between. If one of them fails again,
-the step is red whatever the rest does, so the run stops once they have all run
-(exit code 1, the remaining examples not run) and the queue can split again
-without waiting for the suite. If none fails again, the rest of the suite runs
-as usual. No example is ever skipped, so a green step still comes from a full
-suite. A quarantined failure does not stop the run; a `--fail-fast` of your own
-still stops at the first failure.
+reports its own collection, by the examples it collects.
 
 ### Parallel runs
 

data/lib/mergify/rspec/configuration.rb

@@ -96,74 +96,37 @@ module Mergify
         end
       end
 
-      # Hand the session what this process is about to run, and apply what it
-      # decided: leave out what it does not keep, put first what a bisection
-      # step answered, or stop a refused run.
+      # Hand the session what this process is about to run, and put first
+      # what a bisection step answered.
       #
       # A `before(:suite)` hook, because that is the first moment RSpec has both
       # loaded the spec files and applied its filters, and the last one before
       # an example group starts. What each group runs is read from
       # `RSpec.world.filtered_examples`, which RSpec memoized while counting the
-      # run; narrowing those lists is what deselects.
+      # run.
       def select_examples
         ci = Mergify::RSpec.test_run
         return unless ci
 
-        groups, examples = collected
-        decision = ci.select(examples.map(&:id))
-        apply_decision(ci, decision, groups, examples) if decision
+        examples = collected
+        return unless ci.select(examples.map(&:id))
+
+        # Ordered, not filtered: a served example this run did not collect is
+        # expected -- a parallel worker holds part of the job's failures.
+        fail_first = ci.fail_first
+        FailureFirst.apply(fail_first, examples, reporter: ::RSpec.configuration.reporter) if fail_first
       rescue StandardError => e
         # This runs on every CI run, opted in or not, and RSpec would answer a
         # raise here by running nothing: a fault of this gem must cost the run
-        # its reduction, never its tests.
+        # its order, never its tests.
         ::RSpec.configuration.error_stream.puts(
           "Mergify Test Selection failed, so the full suite runs: #{e.class}: #{e.message}"
         )
       end
 
-      # Every group, and the examples RSpec will run of them, in its order.
+      # The examples RSpec will run, in its order.
       def collected
-        groups = ::RSpec.world.example_groups.flat_map(&:descendants)
-        [groups, groups.flat_map { |group| ::RSpec.world.filtered_examples[group] }]
-      end
-
-      def apply_decision(test_run, decision, groups, examples)
-        return refuse(decision['refusal']) if decision['refusal']
-
-        # Ordered, not filtered: a served example this run did not collect is
-        # expected -- a parallel worker holds part of the job's failures.
-        fail_first = test_run.fail_first
-        return run_failure_first(fail_first, examples) if fail_first
-
-        deselect(groups, decision['keep'].to_set) if decision['keep']
-      end
-
-      # Everything runs, the examples the step above failed first.
-      def run_failure_first(fail_first, examples)
-        FailureFirst.apply(fail_first, examples, reporter: ::RSpec.configuration.reporter)
-      end
-
-      # Stop the run before any example, the way RSpec stops one whose suite
-      # hook failed -- nothing runs, the exit code is red, and the summary
-      # counts an error outside of examples -- but with the server's
-      # explanation alone. Raised from the hook, the same failure is printed
-      # under a "Failure/Error:" header pointing at a line of this gem, which
-      # only buries the explanation.
-      def refuse(message)
-        ::RSpec.configuration.error_stream.puts("\n#{message}\n")
-        ::RSpec.world.wants_to_quit = true
-        reporter = ::RSpec.configuration.reporter
-        count = reporter.instance_variable_get(:@non_example_exception_count)
-        reporter.instance_variable_set(:@non_example_exception_count, count + 1) if count.is_a?(Integer)
-      end
-
-      # A group left with no example runs none of its `before(:context)`
-      # hooks: RSpec decides that from these same lists, once the group starts.
-      def deselect(groups, keep)
-        groups.each do |group|
-          ::RSpec.world.filtered_examples[group] =
-            ::RSpec.world.filtered_examples[group].select { |example| keep.include?(example.id) }
-        end
+        ::RSpec.world.example_groups.flat_map(&:descendants).flat_map { |group| ::RSpec.world.filtered_examples[group] }
       end
 
       # The reporter has sent `start` by the time suite hooks run, so the

data/lib/mergify/rspec/native.rb

@@ -90,7 +90,7 @@ unless Mergify::RSpec::Native.available?
 
           # Nothing to ask with: every example runs.
           def select(_example_ids)
-            { 'outcome' => 'full', 'keep' => nil, 'refusal' => nil }
+            { 'outcome' => 'full' }
           end
 
           def executed_count

data/lib/mergify/rspec/test_run.rb

@@ -13,12 +13,10 @@ module Mergify
     # run's examples for its trace, and coordinates flaky detection,
     # quarantine and test selection.
     class TestRun
-      # What RSpec is, as the session takes it: its documentation page, where
-      # a run Test Selection refused is sent to read about
-      # MERGIFY_TEST_JOB_NAME; what it calls a test; what it can do about
-      # Fail First and reruns; and RSpec itself, which the trace names.
+      # What RSpec is, as the session takes it: what it calls a test; what it
+      # can do about Fail First and reruns; and RSpec itself, which the trace
+      # names.
       FRAMEWORK = {
-        docs_url: 'https://docs.mergify.com/test-engine/test-frameworks/rspec/',
         test_noun: 'example',
         # RSpec runs examples, in one process that can wait for every one put
         # first.
@@ -39,7 +37,6 @@ module Mergify
       # build their TestRun themselves -- or, for a run in another process,
       # install it from a file required before `rspec_mergify`. The instance
       # the gem builds takes none, and the gem reads no switch for them.
-      # rubocop:disable-next Metrics/MethodLength
       def initialize(doubles: nil)
         # What this process reads once: the CI context, the trace a caller
         # handed down, and the run's id; and the deprecated names the run
@@ -51,7 +48,6 @@ module Mergify
         @reruns = nil
         @flaky_detector = nil
         @quarantined_tests = nil
-        @decision = nil
         @captured_session_verdict = nil
         @examples_to_run = nil
 
@@ -65,9 +61,10 @@ module Mergify
         @session.reports?
       end
 
-      # Hand the session what this run is about to execute, and answer what
-      # it executes of it, as the session decided: a Hash with `outcome`,
-      # `keep` and `refusal` (see `Native::Session#select`).
+      # Hand the session what this run is about to execute, and answer how it
+      # executes it, as the session decided: a Hash whose `outcome` is `full`
+      # or `failure_first` (see `Native::Session#select`). Every example
+      # runs.
       #
       # Called once RSpec has loaded the spec files and applied every filter
       # of its own -- file and line arguments, `--tag`, `-e`,
@@ -80,10 +77,8 @@ module Mergify
       def select(example_ids)
         return unless reports?
 
-        @decision = @session.select(example_ids)
-        keep = @decision['keep']&.to_set
-        @examples_to_run = keep ? example_ids.count { |id| keep.include?(id) } : example_ids.size
-        @decision
+        @examples_to_run = example_ids.size
+        @session.select(example_ids)
       end
 
       # The run's Fail First, which the session hands out when Mergify

data/lib/mergify/rspec/version.rb

@@ -8,6 +8,6 @@ module Mergify
     # which resolved against whatever repository happened to be the working
     # directory at load time -- the monorepo's namespaced tags here, the user's
     # own tags once the gem was installed.
-    VERSION = '2026.10.6'
+    VERSION = '2026.10.7'
   end
 end

metadata

@@ -1,14 +1,14 @@
 --- !ruby/object:Gem::Specification
 name: rspec-mergify
 version: !ruby/object:Gem::Version
-  version: 2026.10.6
+  version: 2026.10.7
 platform: aarch64-linux
 authors:
 - Mergify
 autorequire: 
 bindir: bin
 cert_chain: []
-date: 2026-10-22 00:00:00.000000000 Z
+date: 2026-10-23 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: rspec-core