minitest-heat 0.0.12 → 1.1.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: d95ecb7dad79fef49909bf766fb8c428489a71a0a2a50f815e4f0e7b0dbe480b
-  data.tar.gz: f9e03a7fcb915c0f5f0e74eb20fb7cec2d65de7e4d73f6130b61d50d48d8fafc
+  metadata.gz: cf4115aeb375e2fef72d98e7f706dc023ae1e61fa9d1fc3e8f490797a31e2ae0
+  data.tar.gz: ba968646ff2b12fa2891b47fb58d2d98330d117c2a038e29f1caef449bfbd857
 SHA512:
-  metadata.gz: d9903cc0ea5edb14005ddcef3027ea09414100013f3e829989670a238bce2c2bd02b0227835632658022b82fff658d86dcab07aa58c7ddecdfb2452408258f97
-  data.tar.gz: 2ea218a55b33d8ba6fdb41f8aa3ef7d07443537e482a2a995a7aad2c01fc952c22135263739aa0963d9e0e88a153ffd146ac32e4a9979c5a32ccf218391f66cf
+  metadata.gz: 67a7e17e10fe0f75f5a5cad93bd97a7f4f87e136e6dfe6f338b0e8df0e80f83533d8e70b07e218fc0431e3e7c5bbdc2d14f71c8c3d32a98d846f276cb573f225
+  data.tar.gz: 2a0cb94a433fe5b69bef58cd4fe24393adaad5bf69e76120b9296a3f8224b2e9a55da10e176bb0fa13e228e3aa57f0836d61fe0ca8116bd973681cc7e458912f

data/.github/FUNDING.yml

@@ -0,0 +1,3 @@
+# These are supported funding model platforms
+
+github: garrettdimon

data/.github/workflows/main.yml

@@ -0,0 +1,23 @@
+name: Ruby
+
+on: [push,pull_request]
+
+env:
+  CI: true
+
+jobs:
+  build:
+    strategy:
+      matrix:
+        os: [ubuntu-latest, macos-latest]
+        ruby: [2.5.9, 2.6.9, 2.7.5, 3.0.3, 3.1.0-preview1]
+    runs-on: ubuntu-latest
+    steps:
+    - uses: actions/checkout@v2
+    - name: Set up Ruby
+      uses: ruby/setup-ruby@v1
+      with:
+        ruby-version: ${{ matrix.ruby }}
+        bundler-cache: true
+    - name: Run Tests
+      run: bundle exec rake

data/CHANGELOG.md

@@ -0,0 +1,17 @@
+## [Unreleased]
+
+Nothing at the moment.
+
+## [1.1.0] - 2021-12-09
+
+The biggest update is that the slow thresholds are now configurable.
+
+- Configurable Thresholds
+- Fixed a bug where `vendor/bundle` gem files were considered project source code files
+- Set up [GitHub Actions](https://github.com/garrettdimon/minitest-heat/actions) to ensure tests are run on Ubuntu latest and macOs for the [latest Ruby versions](https://github.com/garrettdimon/minitest-heat/blob/main/.github/workflows/main.yml)
+- Fixed some tests that were accidentally left path-dependent and couldn't pass on other machines
+
+## [1.0.0] - 2021-12-01
+
+Initial release.
+

data/Gemfile.lock

@@ -1,7 +1,7 @@
 PATH
   remote: .
   specs:
-    minitest-heat (0.0.12)
+    minitest-heat (1.1.0)
       minitest
 
 GEM

data/README.md

@@ -1,12 +1,11 @@
-# Minitest::Heat
-**Important:** As of September 13, 2021, Minitest::Heat is an early work-in-progress. It's usable, but it can still ocasionally be buggy as it takes shape.
+# 🔥 Minitest::Heat 🔥
+Minitest::Heat helps you identify problems faster so you can more efficiently resolve test failures. It does this through a few different methods.
 
-Minitest::Heat aims to surface context around test failures to help you more efficiently identify and prioritize fixing failed tests to help save time.
+For a more detailed explanation of Minitest Heat with screenshots, [head over the wiki for the full story](https://github.com/garrettdimon/minitest-heat/wiki).
 
-For some early insight about priorities and how it works, this [Twitter thread](https://twitter.com/garrettdimon/status/1432703746526560266) is currently the best place to start.
+Or for some additional insight about priorities and how it works, this [Twitter thread](https://twitter.com/garrettdimon/status/1432703746526560266) is a good read.
 
 ## Installation
-
 Add this line to your application's Gemfile:
 
 ```ruby
@@ -27,27 +26,44 @@ And depending on your usage, you may need to require Minitest Heat in your test
 require 'minitest/heat'
 ```
 
-## Usage
+## Configuration
+Minitest Heat doesn't currently offer a significant set of configuration options, but the thresholds for "Slow" and "Painfully Slow" tests can be adjusted. By default, it considers anything over 1.0s to be 'slow' and anything over 3.0s to be 'painfully slow'.
 
-**Important:** In its current state, `Minitest::Heat` replaces any other reporter plugins you may have. Long-term, it should play nicer with other reporters, but during the initial heavy development cycle, it's been easier to have a high confidence that other reporters aren't the source of unexpected behavior.
+You can add a configuration block to your `test_helper.rb` file after the `require 'minitest/heat'` line.
 
-Otherwise, once it's bundled and added to your `test_helper`, it shold "just work" whenever you run your test suite.
+For example:
 
-## Development
+```ruby
+Minitest::Heat.configure do |config|
+  config.slow_threshold = 0.01
+  config.painfully_slow_threshold = 0.5
+end
+```
 
+## Development
 After checking out the repo, run `bin/setup` to install dependencies. Then, run `rake test` to run the tests. You can also run `bin/console` for an interactive prompt that will allow you to experiment.
 
 To install this gem onto your local machine, run `bundle exec rake install`. To release a new version, update the version number in `version.rb`, and then run `bundle exec rake release`, which will create a git tag for the version, push git commits and tags, and push the `.gem` file to [rubygems.org](https://rubygems.org).
 
-## Contributing
+### Forcing Test Failures
+In order to easily see how Minitest Heat handles different combinations of different types of failures, the following environment variables can be used to force failures.
 
-Bug reports and pull requests are welcome on GitHub at https://github.com/[USERNAME]/minitest-heat. This project is intended to be a safe, welcoming space for collaboration, and contributors are expected to adhere to the [code of conduct](https://github.com/[USERNAME]/minitest-heat/blob/master/CODE_OF_CONDUCT.md).
+```bash
+IMPLODE=true           # Every possible type of failure, skip, and slow is generated
+FORCE_EXCEPTIONS=true  # Only exception-triggered failures
+FORCE_FAILURES=true    # Only standard assertion failures
+FORCE_SKIPS=true       # No errors, just the skipped tests
+FORCE_SLOWS=true       # No errors or skipped tests, just slow tests
+```
 
+So to see the full context of a test suite, `IMPLODE=true bundle exec rake` will work its magic.
+
+## Contributing
+Bug reports and pull requests are welcome on GitHub at https://github.com/garrettdimon/minitest-heat. This project is intended to be a safe, welcoming space for collaboration, and contributors are expected to adhere to the [code of conduct](https://github.com/[USERNAME]/minitest-heat/blob/master/CODE_OF_CONDUCT.md).
 
 ## License
 
 The gem is available as open source under the terms of the [MIT License](https://opensource.org/licenses/MIT).
 
 ## Code of Conduct
-
 Everyone interacting in the Minitest::Heat project's codebases, issue trackers, chat rooms and mailing lists is expected to follow the [code of conduct](https://github.com/[USERNAME]/minitest-heat/blob/master/CODE_OF_CONDUCT.md).

data/lib/minitest/heat/backtrace.rb

@@ -26,7 +26,7 @@ module Minitest
 
       # All lines of the backtrace converted to Backtrace::LineParser's
       #
-      # @return [Line] the full set of backtrace lines parsed as Backtrace::LineParser instances
+      # @return [Array<Location>] the full set of backtrace lines parsed as Location instances
       def locations
         return [] if raw_backtrace.nil?
 
@@ -36,28 +36,28 @@ module Minitest
       # All entries from the backtrace within the project and sorted with the most recently modified
       #   files at the beginning
       #
-      # @return [Line] the sorted backtrace lines from the project parsed as Backtrace::LineParser's
+      # @return [Array<Location>] the sorted backtrace lines from the project
       def recently_modified_locations
         @recently_modified_locations ||= project_locations.sort_by(&:mtime).reverse
       end
 
       # All entries from the backtrace that are files within the project
       #
-      # @return [Line] the backtrace lines from within the project parsed as Backtrace::LineParser's
+      # @return [Array<Location>] the backtrace lines from within the project
       def project_locations
         @project_locations ||= locations.select(&:project_file?)
       end
 
       # All entries from the backtrace within the project tests
       #
-      # @return [Line] the backtrace lines from within the project tests parsed as Backtrace::LineParser's
+      # @return [Array<Location>] the backtrace lines from within the tests
       def test_locations
         @test_locations ||= project_locations.select(&:test_file?)
       end
 
       # All source code entries from the backtrace (i.e. excluding tests)
       #
-      # @return [Line] the backtrace lines from within the source code parsed as Backtrace::LineParser's
+      # @return [Array<Location>] the backtrace lines from within the source code
       def source_code_locations
         @source_code_locations ||= project_locations.select(&:source_code_file?)
       end

data/lib/minitest/heat/configuration.rb

@@ -0,0 +1,18 @@
+# frozen_string_literal: true
+
+require 'forwardable'
+
+module Minitest
+  module Heat
+    # For managing configuration options on how Minitest Heat should handle results
+    class Configuration
+      attr_accessor :slow_threshold,
+                    :painfully_slow_threshold
+
+      def initialize
+        @slow_threshold = 1.0
+        @painfully_slow_threshold = 3.0
+      end
+    end
+  end
+end

data/lib/minitest/heat/issue.rb

@@ -116,20 +116,34 @@ module Minitest
         !passed? || slow? || painful?
       end
 
+      # The number, in seconds, for a test to be considered "slow"
+      #
+      # @return [Float] number of seconds after which a test is considered slow
+      def slow_threshold
+        Minitest::Heat.configuration.slow_threshold || SLOW_THRESHOLDS[:slow]
+      end
+
+      # The number, in seconds, for a test to be considered "painfully slow"
+      #
+      # @return [Float] number of seconds after which a test is considered painfully slow
+      def painfully_slow_threshold
+        Minitest::Heat.configuration.painfully_slow_threshold || SLOW_THRESHOLDS[:painful]
+      end
+
       # Determines if a test should be considered slow by comparing it to the low end definition of
       #   what is considered slow.
       #
-      # @return [Boolean] true if the test took longer to run than `SLOW_THRESHOLDS[:slow]`
+      # @return [Boolean] true if the test took longer to run than `slow_threshold`
       def slow?
-        execution_time >= SLOW_THRESHOLDS[:slow] && execution_time < SLOW_THRESHOLDS[:painful]
+        execution_time >= slow_threshold && execution_time < painfully_slow_threshold
       end
 
       # Determines if a test should be considered painfully slow by comparing it to the high end
       #   definition of what is considered slow.
       #
-      # @return [Boolean] true if the test took longer to run than `SLOW_THRESHOLDS[:painful]`
+      # @return [Boolean] true if the test took longer to run than `painfully_slow_threshold`
       def painful?
-        execution_time >= SLOW_THRESHOLDS[:painful]
+        execution_time >= painfully_slow_threshold
       end
 
       # Determines if the issue is an exception that was raised from directly within a test

data/lib/minitest/heat/location.rb

@@ -131,9 +131,16 @@ module Minitest
 
       # Determines if a given file is from the project directory
       #
-      # @return [Boolean] true if the file is in the project (source code or test)
+      # @return [Boolean] true if the file is in the project (source code or test) but not vendored
       def project_file?
-        path.include?(project_root_dir)
+        path.include?(project_root_dir) && !bundled_file?
+      end
+
+      # Determines if the file is in the project `vendor/bundle` directory.
+      #
+      # @return [Boolean] true if the file is in `<project_root>/vendor/bundle
+      def bundled_file?
+        path.include?("#{project_root_dir}/vendor/bundle")
       end
 
       # Determines if a given file follows the standard approaching to naming test files.
@@ -145,9 +152,9 @@ module Minitest
 
       # Determines if a given file is a non-test file from the project directory
       #
-      # @return [Boolean] true if the file is in the project but not a test file
+      # @return [Boolean] true if the file is in the project but not a test file or vendored file
       def source_code_file?
-        project_file? && !test_file?
+        project_file? && !test_file? && !bundled_file?
       end
 
       # A safe interface to getting the last modified time for the file in question

data/lib/minitest/heat/output/backtrace.rb

@@ -3,7 +3,7 @@
 module Minitest
   module Heat
     class Output
-      # Builds the collection of tokens for a backtrace when an exception occurs
+      # Builds the collection of tokens for displaying a backtrace when an exception occurs
       class Backtrace
         DEFAULT_LINE_COUNT = 10
         DEFAULT_INDENTATION_SPACES = 2
@@ -17,31 +17,47 @@ module Minitest
         end
 
         def tokens
-          # There could be option to expand and display more than one line of source code for the
-          # final backtrace line if it might be relevant/helpful?
-
           # Iterate over the selected lines from the backtrace
-          backtrace_locations.each do |location|
-            @tokens << backtrace_location_tokens(location)
-          end
-
-          @tokens
+          @tokens = backtrace_locations.map { |location| backtrace_location_tokens(location) }
         end
 
+        # Determines the number of lines to display from the backtrace.
+        #
+        # @return [Integer] the number of lines to limit the backtrace to
         def line_count
+          # Defined as a method instead of using the constant directlyr in order to easily support
+          # adding options for controlling how many lines are displayed from a backtrace.
+          #
+          # For example, instead of a fixed number, the backtrace could dynamically calculate how
+          # many lines it should displaye in order to get to the origination point. Or it could have
+          # a default, but inteligently go back further if the backtrace meets some criteria for
+          # displaying more lines.
           DEFAULT_LINE_COUNT
         end
 
-        # This should probably be smart about what lines are displayed in a backtrace.
-        # Maybe...
-        # ...it could intelligently display the full back trace?
-        # ...only the backtrace from the first/last line of project source?
-        # ...it behaves a little different when it's a broken test vs. a true exception?
-        # ...it could be smart about subtly flagging the lines that show up in the heat map frequently?
-        # ...it could be influenced by a "compact" or "robust" reporter super-style?
-        # ...it's smart about exceptions that were raised outside of the project?
-        # ...it's smart about highlighting lines of code differently based on whether it's source code, test code, or external code?
+        # A subset of parsed lines from the backtrace.
+        #
+        # @return [Array<Location>] the backtrace locations determined to be most relevant to the
+        #   context of the underlying issue
         def backtrace_locations
+          # This could eventually have additional intelligence to determine what lines are most
+          # relevant for a given type of issue. For now, it simply takes the line numbers, but the
+          # idea is that long-term, it could adjust that on the fly to keep the line count as low
+          # as possible but expand it if necessary to ensure enough context is displayed.
+          #
+          # - If there's no clear cut details about the source of the error from within the project,
+          #   it could display the entire backtrace without filtering anything.
+          # - It could scan the backtrace to the first appearance of project files and then display
+          #   all of the lines that occurred after that instance
+          # - It coudl filter the lines differently whether the issue originated from a test or from
+          #   the source code.
+          # - It could allow supporting a "compact" or "robust" reporter style so that someone on
+          #   a smaller screen could easily reduce the information shown so that the results could
+          #   be higher density even if it means truncating some occasionally useful details
+          # - It could be smarter about displaying context/guidance when the full backtrace is from
+          #   outside the project's code
+          #
+          # But for now. It just grabs some lines.
           backtrace.locations.take(line_count)
         end
 
@@ -65,8 +81,17 @@ module Minitest
           backtrace_locations.all?(&:project_file?)
         end
 
+        # Determines if the file referenced by a backtrace line is the most recently modified file
+        #   of all the files referenced in the visible backtrace locations.
+        #
+        # @param [Location] location the location to examine
+        #
+        # @return [<type>] <description>
+        #
         def most_recently_modified?(location)
-          # If there's more than one line being displayed, and the current line is the freshest
+          # If there's more than one line being displayed (otherwise, with one line, of course it's
+          # the most recently modified because there_aren't any others) and the current line is the
+          # same as the freshest location in the backtrace
           backtrace_locations.size > 1 && location == locations.freshest
         end
 

data/lib/minitest/heat/output/issue.rb

@@ -14,28 +14,16 @@ module Minitest
 
         def tokens
           case issue.type
-          when :error then error_tokens
-          when :broken then broken_tokens
-          when :failure then failure_tokens
-          when :skipped then skipped_tokens
-          when :painful then painful_tokens
-          when :slow then slow_tokens
+          when :error, :broken  then exception_tokens
+          when :failure         then failure_tokens
+          when :skipped         then skipped_tokens
+          when :painful, :slow  then slow_tokens
           end
         end
 
         private
 
-        def error_tokens
-          [
-            headline_tokens,
-            test_location_tokens,
-            summary_tokens,
-            *backtrace_tokens,
-            newline_tokens
-          ]
-        end
-
-        def broken_tokens
+        def exception_tokens
           [
             headline_tokens,
             test_location_tokens,
@@ -62,14 +50,6 @@ module Minitest
           ]
         end
 
-        def painful_tokens
-          [
-            headline_tokens,
-            slowness_summary_tokens,
-            newline_tokens
-          ]
-        end
-
         def slow_tokens
           [
             headline_tokens,
@@ -82,6 +62,11 @@ module Minitest
           [label_token(issue), spacer_token, [:default, test_name(issue)]]
         end
 
+        # Creates a display-friendly version of the test name with underscores removed and the
+        #   first letter capitalized regardless of the formatt used for the test definition
+        # @param issue [Issue] the issue to use to generate the test name
+        #
+        # @return [String] the cleaned up version of the test name
         def test_name(issue)
           test_prefix = 'test_'
           identifier = issue.test_identifier
@@ -97,27 +82,10 @@ module Minitest
           [issue.type, issue_label(issue.type)]
         end
 
-        def issue_label(issue_type)
-          case issue_type
-          when :error   then 'Error'
-          when :broken  then 'Broken Test'
-          when :failure then 'Failure'
-          when :skipped then 'Skipped'
-          when :slow    then 'Passed but Slow'
-          when :painful then 'Passed but Very Slow'
-          when :passed  then 'Success'
-          else 'Unknown'
-          end
-        end
-
         def test_name_and_class_tokens
           [[:default, issue.test_class], *test_location_tokens]
         end
 
-        def backtrace_tokens
-          @backtrace_tokens ||= ::Minitest::Heat::Output::Backtrace.new(locations).tokens
-        end
-
         def test_location_tokens
           [
             [:default, locations.test_definition.relative_filename],
@@ -176,6 +144,27 @@ module Minitest
         def arrow_token
           Output::TOKENS[:muted_arrow]
         end
+
+        def backtrace_tokens
+          @backtrace_tokens ||= ::Minitest::Heat::Output::Backtrace.new(locations).tokens
+        end
+
+        # The string to use to describe the failure type when displaying results/
+        # @param issue_type [Symbol] the symbol representing the issue's failure type
+        #
+        # @return [String] the display-friendly string describing the failure reason
+        def issue_label(issue_type)
+          case issue_type
+          when :error   then 'Error'
+          when :broken  then 'Broken Test'
+          when :failure then 'Failure'
+          when :skipped then 'Skipped'
+          when :slow    then 'Passed but Slow'
+          when :painful then 'Passed but Very Slow'
+          when :passed  then 'Success'
+          else 'Unknown'
+          end
+        end
       end
     end
   end

data/lib/minitest/heat/output/map.rb

@@ -14,24 +14,34 @@ module Minitest
 
         def tokens
           results.heat_map.file_hits.each do |hit|
-            # If there's legitimate failures or errors, skips and slows aren't relevant
+            # Focus on the relevant issues based on most significant problems. i.e. If there are
+            # legitimate failures or errors, skips and slows aren't relevant
             next unless relevant_issue_types?(hit)
 
+            # Add a new line
             @tokens << [[:muted, ""]]
+
+            # Build the summary line for the file
             @tokens << file_summary_tokens(hit)
 
-            repeats = repeated_line_numbers(hit)
-            next unless repeats.any?
+            # Get the set of line numbers that appear more than once
+            repeated_line_numbers = find_repeated_line_numbers_in(hit)
 
-            repeats.each do |line_number|
-              @tokens << [[:muted, "  Issues on Line #{line_number} initially triggered from these locations:"]]
+            # Only display more details if the same line number shows up more than once
+            next unless repeated_line_numbers.any?
 
+            repeated_line_numbers.each do |line_number|
+              # Get the backtraces for the given line numbers
               traces = hit.lines[line_number.to_s]
-              sorted_traces = traces.sort_by { |trace| trace.locations.last.line_number }
 
-              sorted_traces.each do |trace|
-                @tokens << origination_location_token(trace)
-              end
+              # If there aren't any traces there's no way to provide additional details
+              break unless traces.any?
+
+              # A short summary explaining the details that will follow
+              @tokens << [[:default, "  Line #{line_number}"], [:muted, ' issues triggered from:']]
+
+              # The last relevant location for each error's backtrace
+              @tokens += origination_sources(traces)
             end
           end
 
@@ -40,16 +50,28 @@ module Minitest
 
         private
 
+        def origination_sources(traces)
+          # 1. Only pull the traces that have proper locations
+          # 2. Sort the traces by the most recent line number so they're displayed in numeric order
+          # 3. Get the final relevant location from the trace
+          traces.
+            select  { |trace| trace.locations.any? }.
+            sort_by { |trace| trace.locations.last.line_number }.
+            map     { |trace| origination_location_token(trace) }
+        end
+
         def file_summary_tokens(hit)
           pathname_tokens = pathname(hit)
-          line_number_list_tokens = sorted_line_number_list(hit)
+          line_number_list_tokens = line_number_tokens_for_hit(hit)
 
           [*pathname_tokens, *line_number_list_tokens]
         end
 
         def origination_location_token(trace)
           # The earliest project line from the backtrace—this is probabyl wholly incorrect in terms
-          # of what would be the most helpful line to display, but it's a start.
+          # of what would be the most helpful line to display, but it's a start. Otherwise, the
+          # logic will need to compare all traces for the issue and find the unique origination
+          # lines
           location = trace.locations.last
 
           [
@@ -75,16 +97,18 @@ module Minitest
         end
 
         def relevant_issue_types?(hit)
+          # The intersection of which issue types are relevant based on the context and which issues
+          # matc those issue types
           intersection_issue_types = relevant_issue_types & hit.issues.keys
 
           intersection_issue_types.any?
         end
 
-        def repeated_line_numbers(hit)
+        def find_repeated_line_numbers_in(hit)
           repeated_line_numbers = []
 
           hit.lines.each_pair do |line_number, traces|
-            # If there aren't multiple traces for a line number, it's not a repeat, right?
+            # If there aren't multiple traces for a line number, it's not a repeat
             next unless traces.size > 1
 
             repeated_line_numbers << Integer(line_number)
@@ -93,10 +117,6 @@ module Minitest
           repeated_line_numbers.sort
         end
 
-        def repeated_line_numbers?(hit)
-          repeated_line_numbers(hit).any?
-        end
-
         def pathname(hit)
           directory = hit.pathname.dirname.to_s.delete_prefix("#{Dir.pwd}/")
           filename = hit.pathname.basename.to_s
@@ -108,6 +128,11 @@ module Minitest
           ]
         end
 
+        # Gets the list of line numbers for a given hit location (i.e. file) so they can be
+        #   displayed after the file name to show which lines were problematic
+        # @param hit [Hit] the instance to extract line numbers from
+        #
+        # @return [Array<Symbol,String>] [description]
         def line_number_tokens_for_hit(hit)
           line_number_tokens = []
 
@@ -116,34 +141,50 @@ module Minitest
             line_numbers_for_issue_type = hit.issues.fetch(issue_type) { [] }
 
             # Build the list of tokens representing styled line numbers
-            line_numbers_for_issue_type.each do |line_number|
-              line_number_tokens << line_number_token(issue_type, line_number)
+            line_numbers_for_issue_type.uniq.sort.each do |line_number|
+              frequency = line_numbers_for_issue_type.count(line_number)
+
+              line_number_tokens += line_number_token(issue_type, line_number, frequency)
             end
           end
 
           line_number_tokens.compact
         end
 
-        def line_number_token(style, line_number)
-          [style, "#{line_number} "]
-        end
-
-        # Generates the line number tokens styled based on their error type
+        # Builds a token representing a styled line number
         #
-        # @param [Hit] hit the instance of the hit file details to build the heat map entry
+        # @param style [Symbol] the relevant display style for the issue
+        # @param line_number [Integer] the affected line number
         #
-        # @return [Array] the arrays representing the line number tokens to display next to a file
-        #   name in the heat map
-        def sorted_line_number_list(hit)
-          # Sort the collected group of line number hits so they're in order
-          line_number_tokens_for_hit(hit).sort do |a, b|
-            # Ensure the line numbers are integers for sorting (otherwise '100' comes before '12')
-            first_line_number = Integer(a[1].strip)
-            second_line_number = Integer(b[1].strip)
-
-            first_line_number <=> second_line_number
+        # @return [Array<Symbol,Integer>] array token representing the line number and issue type
+        def line_number_token(style, line_number, frequency)
+          if frequency > 1
+            [
+              [style, "#{line_number}"],
+              [:muted, "✕#{frequency} "]
+            ]
+          else
+            [[style, "#{line_number} "]]
           end
         end
+
+        # # Sorts line number tokens so that line numbers are displayed in order regardless of their
+        # #   underlying issue type
+        # #
+        # # @param hit [Hit] the instance of the hit file details to build the heat map entry
+        # #
+        # # @return [Array] the arrays representing the line number tokens to display next to a file
+        # #   name in the heat map. ex [[:error, 12], [:falure, 13]]
+        # def sorted_line_number_list(hit)
+        #   # Sort the collected group of line number hits so they're in order
+        #   line_number_tokens_for_hit(hit).sort do |a, b|
+        #     # Ensure the line numbers are integers for sorting (otherwise '100' comes before '12')
+        #     first_line_number = Integer(a[1].strip)
+        #     second_line_number = Integer(b[1].strip)
+
+        #     first_line_number <=> second_line_number
+        #   end
+        # end
       end
     end
   end

data/lib/minitest/heat/output.rb

@@ -48,13 +48,20 @@ module Minitest
         newline
 
         # Issues start with the least critical and go up to the most critical so that the most
-        #   pressing issues are displayed at the bottom of the report in order to reduce scrolling.
-        #   This way, as you fix issues, the list gets shorter, and eventually the least critical
-        #   issues will be displayed without scrolling once more problematic issues are resolved.
+        # pressing issues are displayed at the bottom of the report in order to reduce scrolling.
+        #
+        # This way, as you fix issues, the list gets shorter, and eventually the least critical
+        # issues will be displayed without scrolling once more problematic issues are resolved.
         %i[slows painfuls skips failures brokens errors].each do |issue_category|
+          # Only show categories for the most pressing issues after the suite runs, otherwise,
+          # suppress them until the more critical issues are resolved.
           next unless show?(issue_category, results)
 
-          results.send(issue_category).each { |issue| issue_details(issue) }
+          issues = results.send(issue_category)
+
+          issues
+            .sort_by { |issue| issue.locations.most_relevant.to_a }
+            .each { |issue| issue_details(issue) }
         end
       rescue StandardError => e
         message = "Sorry, but Minitest Heat couldn't display the details of any failures."
@@ -64,7 +71,7 @@ module Minitest
       def issue_details(issue)
         print_tokens Minitest::Heat::Output::Issue.new(issue).tokens
       rescue StandardError => e
-        message = "Sorry, but Minitest Heat couldn't display output for a failure."
+        message = "Sorry, but Minitest Heat couldn't display output for a specific failure."
         exception_guidance(message, e)
       end
 
@@ -89,6 +96,15 @@ module Minitest
         exception_guidance(message, e)
       end
 
+      private
+
+      # Displays some guidance related to exceptions generated by Minitest Heat in order to help
+      #   people get back on track (and ideally submit issues)
+      # @param message [String] a slightly more specific explanation of which part of minitest-heat
+      #   caused the failure
+      # @param exception [Exception] the exception that caused the problem
+      #
+      # @return [void] displays the guidance to the console
       def exception_guidance(message, exception)
         newline
         puts "#{message} Disabling Minitest Heat can get you back on track until the problem can be fixed."
@@ -100,8 +116,6 @@ module Minitest
         newline
       end
 
-      private
-
       def no_problems?(results)
         !results.problems?
       end

data/lib/minitest/heat/results.rb

@@ -30,8 +30,20 @@ module Minitest
         # For heat map purposes, only the project backtrace lines are interesting
         pathname, line_number = issue.locations.project.to_a
 
-        # Backtrace is only relevant for exception-generating issues, not slows, skips, or failures
-        backtrace = issue.error? ? issue.locations.backtrace.project_locations : []
+        # A backtrace is only relevant for exception-generating issues (i.e. errors), not slows or skips
+        # However, while assertion failures won't have a backtrace, there can still be repeated line
+        # numbers if the tests reference a shared method with an assertion in it. So in those cases,
+        # the backtrace is simply the test definition
+        backtrace = if issue.error?
+          # With errors, we have a backtrace
+          issue.locations.backtrace.project_locations
+        else
+          # With failures, the test definition is the most granular backtrace equivalent
+          location = issue.locations.test_definition
+          location.raw_container = issue.test_identifier
+
+          [location]
+        end
 
         @heat_map.add(pathname, line_number, issue.type, backtrace: backtrace)
       end

data/lib/minitest/heat/version.rb

@@ -2,6 +2,6 @@
 
 module Minitest
   module Heat
-    VERSION = '0.0.12'
+    VERSION = '1.1.0'
   end
 end

data/lib/minitest/heat.rb

@@ -1,5 +1,6 @@
 # frozen_string_literal: true
 
+require_relative 'heat/configuration'
 require_relative 'heat/backtrace'
 require_relative 'heat/hit'
 require_relative 'heat/issue'
@@ -32,5 +33,20 @@ module Minitest
   # Pulls from minitest-color as well:
   #   https://github.com/teoljungberg/minitest-color/blob/master/lib/minitest/color_plugin.rb
   module Heat
+    class << self
+      attr_writer :configuration
+    end
+
+    def self.configuration
+      @configuration ||= Configuration.new
+    end
+
+    def self.reset
+      @configuration = Configuration.new
+    end
+
+    def self.configure
+      yield(configuration)
+    end
   end
 end

data/lib/minitest/heat_reporter.rb

@@ -96,7 +96,7 @@ module Minitest
       # The list of individual issues and their associated details
       output.issues_list(results)
 
-      # Display a short summary of the total issue counts fore ach category as well as performance
+      # Display a short summary of the total issue counts for each category as well as performance
       # details for the test suite as a whole
       output.compact_summary(results, timer)
 

metadata

@@ -1,14 +1,14 @@
 --- !ruby/object:Gem::Specification
 name: minitest-heat
 version: !ruby/object:Gem::Version
-  version: 0.0.12
+  version: 1.1.0
 platform: ruby
 authors:
 - Garrett Dimon
 autorequire:
 bindir: exe
 cert_chain: []
-date: 2021-11-15 00:00:00.000000000 Z
+date: 2021-12-09 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: minitest
@@ -130,9 +130,12 @@ executables: []
 extensions: []
 extra_rdoc_files: []
 files:
+- ".github/FUNDING.yml"
+- ".github/workflows/main.yml"
 - ".gitignore"
 - ".rubocop.yml"
 - ".travis.yml"
+- CHANGELOG.md
 - CODE_OF_CONDUCT.md
 - Gemfile
 - Gemfile.lock
@@ -144,6 +147,7 @@ files:
 - lib/minitest/heat.rb
 - lib/minitest/heat/backtrace.rb
 - lib/minitest/heat/backtrace/line_parser.rb
+- lib/minitest/heat/configuration.rb
 - lib/minitest/heat/hit.rb
 - lib/minitest/heat/issue.rb
 - lib/minitest/heat/location.rb