simplecov 0.16.1 → 0.18.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (38) hide show
  1. checksums.yaml +5 -5
  2. data/CHANGELOG.md +92 -0
  3. data/CODE_OF_CONDUCT.md +76 -0
  4. data/README.md +271 -112
  5. data/doc/alternate-formatters.md +10 -0
  6. data/lib/simplecov/combine/branches_combiner.rb +32 -0
  7. data/lib/simplecov/combine/files_combiner.rb +24 -0
  8. data/lib/simplecov/combine/lines_combiner.rb +43 -0
  9. data/lib/simplecov/combine/results_combiner.rb +60 -0
  10. data/lib/simplecov/combine.rb +30 -0
  11. data/lib/simplecov/command_guesser.rb +6 -3
  12. data/lib/simplecov/configuration.rb +110 -9
  13. data/lib/simplecov/coverage_statistics.rb +56 -0
  14. data/lib/simplecov/defaults.rb +6 -2
  15. data/lib/simplecov/file_list.rb +66 -13
  16. data/lib/simplecov/filter.rb +2 -1
  17. data/lib/simplecov/formatter/multi_formatter.rb +2 -2
  18. data/lib/simplecov/formatter/simple_formatter.rb +4 -4
  19. data/lib/simplecov/last_run.rb +3 -1
  20. data/lib/simplecov/lines_classifier.rb +2 -2
  21. data/lib/simplecov/profiles/hidden_filter.rb +5 -0
  22. data/lib/simplecov/profiles/rails.rb +1 -1
  23. data/lib/simplecov/profiles.rb +9 -7
  24. data/lib/simplecov/result.rb +39 -6
  25. data/lib/simplecov/result_adapter.rb +30 -0
  26. data/lib/simplecov/result_merger.rb +18 -11
  27. data/lib/simplecov/simulate_coverage.rb +29 -0
  28. data/lib/simplecov/source_file/branch.rb +84 -0
  29. data/lib/simplecov/source_file/line.rb +72 -0
  30. data/lib/simplecov/source_file.rb +223 -126
  31. data/lib/simplecov/useless_results_remover.rb +16 -0
  32. data/lib/simplecov/version.rb +1 -1
  33. data/lib/simplecov.rb +248 -63
  34. metadata +31 -53
  35. data/lib/simplecov/jruby_fix.rb +0 -44
  36. data/lib/simplecov/railtie.rb +0 -9
  37. data/lib/simplecov/railties/tasks.rake +0 -13
  38. data/lib/simplecov/raw_coverage.rb +0 -41
data/README.md CHANGED
@@ -1,5 +1,6 @@
1
- SimpleCov [![Build Status](https://travis-ci.org/colszowka/simplecov.svg)][Continuous Integration] [![Dependency Status](https://gemnasium.com/colszowka/simplecov.svg)][Dependencies] [![Code Climate](https://codeclimate.com/github/colszowka/simplecov.svg)](https://codeclimate.com/github/colszowka/simplecov) [![Inline docs](http://inch-ci.org/github/colszowka/simplecov.svg)](http://inch-ci.org/github/colszowka/simplecov)
1
+ SimpleCov [![Gem Version](https://badge.fury.io/rb/simplecov.svg)](https://badge.fury.io/rb/simplecov) [![Build Status](https://github.com/colszowka/simplecov/workflows/stable/badge.svg?branch=master)][Continuous Integration] [![Code Climate](https://codeclimate.com/github/colszowka/simplecov.svg)](https://codeclimate.com/github/colszowka/simplecov) [![Inline docs](http://inch-ci.org/github/colszowka/simplecov.svg)](http://inch-ci.org/github/colszowka/simplecov)
2
2
  =========
3
+
3
4
  **Code coverage for Ruby**
4
5
 
5
6
  * [Source Code]
@@ -8,13 +9,13 @@ SimpleCov [![Build Status](https://travis-ci.org/colszowka/simplecov.svg)][Conti
8
9
  * [Rubygem]
9
10
  * [Continuous Integration]
10
11
 
11
- [Coverage]: http://www.ruby-doc.org/stdlib-2.1.0/libdoc/coverage/rdoc/Coverage.html "API doc for Ruby's Coverage library"
12
+ [Coverage]: https://ruby-doc.org/stdlib/libdoc/coverage/rdoc/Coverage.html "API doc for Ruby's Coverage library"
12
13
  [Source Code]: https://github.com/colszowka/simplecov "Source Code @ GitHub"
13
14
  [API documentation]: http://rubydoc.info/gems/simplecov/frames "RDoc API Documentation at Rubydoc.info"
14
15
  [Configuration]: http://rubydoc.info/gems/simplecov/SimpleCov/Configuration "Configuration options API documentation"
15
16
  [Changelog]: https://github.com/colszowka/simplecov/blob/master/CHANGELOG.md "Project Changelog"
16
17
  [Rubygem]: http://rubygems.org/gems/simplecov "SimpleCov @ rubygems.org"
17
- [Continuous Integration]: http://travis-ci.org/colszowka/simplecov "SimpleCov is built around the clock by travis-ci.org"
18
+ [Continuous Integration]: https://github.com/colszowka/simplecov/actions?query=workflow%3Astable "SimpleCov is built around the clock by github.com"
18
19
  [Dependencies]: https://gemnasium.com/colszowka/simplecov "SimpleCov dependencies on Gemnasium"
19
20
  [simplecov-html]: https://github.com/colszowka/simplecov-html "SimpleCov HTML Formatter Source Code @ GitHub"
20
21
 
@@ -22,13 +23,14 @@ SimpleCov is a code coverage analysis tool for Ruby. It uses [Ruby's built-in Co
22
23
  coverage data, but makes processing its results much easier by providing a clean API to filter, group, merge, format,
23
24
  and display those results, giving you a complete code coverage suite that can be set up with just a couple lines of
24
25
  code.
26
+ SimpleCov/Coverage track covered ruby code, gathering coverage for common templating solutions like erb, slim and haml is not supported.
25
27
 
26
28
  In most cases, you'll want overall coverage results for your projects, including all types of tests, Cucumber features,
27
29
  etc. SimpleCov automatically takes care of this by caching and merging results when generating reports, so your
28
30
  report actually includes coverage across your test suites and thereby gives you a better picture of blank spots.
29
31
 
30
- The official formatter of SimpleCov is packaged as a separate gem called [simplecov-html], but will be installed and configured
31
- automatically when you launch SimpleCov. If you're curious, you can find it [on GitHub, too][simplecov-html].
32
+ The official formatter of SimpleCov is packaged as a separate gem called [simplecov-html], but will be installed and
33
+ configured automatically when you launch SimpleCov. If you're curious, you can find it [on GitHub, too][simplecov-html].
32
34
 
33
35
 
34
36
  ## Contact
@@ -36,11 +38,13 @@ automatically when you launch SimpleCov. If you're curious, you can find it [on
36
38
  *Code and Bug Reports*
37
39
 
38
40
  * [Issue Tracker](https://github.com/colszowka/simplecov/issues)
39
- * See [CONTRIBUTING](https://github.com/colszowka/simplecov/blob/master/CONTRIBUTING.md) for how to contribute along with some common problems to check out before creating an issue.
41
+ * See [CONTRIBUTING](https://github.com/colszowka/simplecov/blob/master/CONTRIBUTING.md) for how to contribute along
42
+ with some common problems to check out before creating an issue.
40
43
 
41
44
  *Questions, Problems, Suggestions, etc.*
42
45
 
43
- * [Mailing List](https://groups.google.com/forum/#!forum/simplecov) "Open mailing list for discussion and announcements on Google Groups"
46
+ * [Mailing List](https://groups.google.com/forum/#!forum/simplecov) "Open mailing list for discussion and announcements
47
+ on Google Groups"
44
48
 
45
49
  Getting started
46
50
  ---------------
@@ -70,8 +74,8 @@ Getting started
70
74
  endpoint) via a separate test process (e.g. when using Selenium) where you
71
75
  want to see all code executed by the `rails server`, and not just code
72
76
  executed in your actual test files, you'll want to add something like this
73
- to the top of `script/rails` (or `bin/rails` for Rails 4), but below the
74
- "shebang" line (`#! /usr/bin/env ruby`):
77
+ to the top of `bin/rails`, but below the "shebang" line (`#! /usr/bin/env
78
+ ruby`):
75
79
 
76
80
  ```ruby
77
81
  if ENV['RAILS_ENV'] == 'test'
@@ -81,23 +85,41 @@ Getting started
81
85
  end
82
86
  ```
83
87
 
84
- 3. Run your tests, open up `coverage/index.html` in your browser and check out
85
- what you've missed so far.
86
- 4. Add the following to your `.gitignore` file to ensure that coverage results
88
+ 3. Run your full test suite to see the percent coverage that your application has.
89
+ 4. After running your tests, open `coverage/index.html` in the browser of your choice. For example, in a Mac Terminal,
90
+ run the following command from your application's root directory:
91
+
92
+ ```
93
+ open coverage/index.html
94
+ ```
95
+ in a debian/ubuntu Terminal,
96
+
97
+ ```
98
+ xdg-open coverage/index.html
99
+ ```
100
+
101
+ **Note:** [This guide](https://dwheeler.com/essays/open-files-urls.html) can help if you're unsure which command your particular
102
+ operating system requires.
103
+
104
+ 5. Add the following to your `.gitignore` file to ensure that coverage results
87
105
  are not tracked by Git (optional):
88
106
 
89
- ```
90
- coverage
91
- ```
107
+ ```
108
+ echo "coverage" >> .gitignore
109
+ ```
110
+ Or if you use Windows:
111
+ ```
112
+ echo coverage >> .gitignore
113
+ ```
92
114
 
93
- If you're making a Rails application, SimpleCov comes with built-in configurations (see below for information on profiles)
94
- that will get you started with groups for your Controllers, Views, Models and Helpers. To use it, the first two lines of
95
- your test_helper should be like this:
115
+ If you're making a Rails application, SimpleCov comes with built-in configurations (see below for information on
116
+ profiles) that will get you started with groups for your Controllers, Models and Helpers. To use it, the
117
+ first two lines of your test_helper should be like this:
96
118
 
97
- ```ruby
98
- require 'simplecov'
99
- SimpleCov.start 'rails'
100
- ```
119
+ ```ruby
120
+ require 'simplecov'
121
+ SimpleCov.start 'rails'
122
+ ```
101
123
 
102
124
  ## Example output
103
125
 
@@ -123,8 +145,9 @@ require 'simplecov'
123
145
  SimpleCov.start 'rails'
124
146
  ```
125
147
 
126
- You could even track what kind of code your UI testers are touching if you want to go overboard with things. SimpleCov does not
127
- care what kind of framework it is running in; it just looks at what code is being executed and generates a report about it.
148
+ You could even track what kind of code your UI testers are touching if you want to go overboard with things. SimpleCov
149
+ does not care what kind of framework it is running in; it just looks at what code is being executed and generates a
150
+ report about it.
128
151
 
129
152
  ### Notes on specific frameworks and test utilities
130
153
 
@@ -135,28 +158,28 @@ to use SimpleCov with them. Here's an overview of the known ones:
135
158
  <tr><th>Framework</th><th>Notes</th><th>Issue</th></tr>
136
159
  <tr>
137
160
  <th>
138
- bootsnap
161
+ parallel_tests
139
162
  </th>
140
163
  <td>
141
- <a href="#want-to-use-bootsnap-with-simplecov">See section below.</a>
164
+ As of 0.8.0, SimpleCov should correctly recognize parallel_tests and
165
+ supplement your test suite names with their corresponding test env
166
+ numbers. SimpleCov locks the resultset cache while merging, ensuring no
167
+ race conditions occur when results are merged.
142
168
  </td>
143
169
  <td>
144
- <a href="https://github.com/Shopify/bootsnap/issues/35">Shopify/bootsnap#35</a>
170
+ <a href="https://github.com/colszowka/simplecov/issues/64">#64</a> &amp;
171
+ <a href="https://github.com/colszowka/simplecov/pull/185">#185</a>
145
172
  </td>
146
173
  </tr>
147
174
  <tr>
148
175
  <th>
149
- parallel_tests
176
+ knapsack_pro
150
177
  </th>
151
178
  <td>
152
- As of 0.8.0, SimpleCov should correctly recognize parallel_tests and
153
- supplement your test suite names with their corresponding test env
154
- numbers. SimpleCov locks the resultset cache while merging, ensuring no
155
- race conditions occur when results are merged.
179
+ To make SimpleCov work with Knapsack Pro Queue Mode to split tests in parallel on CI jobs you need to provide CI node index number to the <code>SimpleCov.command_name</code> in <code>KnapsackPro::Hooks::Queue.before_queue</code> hook.
156
180
  </td>
157
181
  <td>
158
- <a href="https://github.com/colszowka/simplecov/issues/64">#64</a> &amp;
159
- <a href="https://github.com/colszowka/simplecov/pull/185">#185</a>
182
+ <a href="https://knapsackpro.com/faq/question/how-to-use-simplecov-in-queue-mode">Tip</a>
160
183
  </td>
161
184
  </tr>
162
185
  <tr>
@@ -230,7 +253,8 @@ to use SimpleCov with them. Here's an overview of the known ones:
230
253
  ```ruby
231
254
  SimpleCov.some_config_option 'foo'
232
255
  ```
233
- * If you do not want to start coverage immediately after launch or want to add additional configuration later on in a concise way, use:
256
+ * If you do not want to start coverage immediately after launch or want to add additional configuration later on in a
257
+ concise way, use:
234
258
 
235
259
  ```ruby
236
260
  SimpleCov.configure do
@@ -242,11 +266,12 @@ Please check out the [Configuration] API documentation to find out what you can
242
266
 
243
267
  ## Using .simplecov for centralized config
244
268
 
245
- If you use SimpleCov to merge multiple test suite results (e.g. Test/Unit and Cucumber) into a single report, you'd normally have to
246
- set up all your config options twice, once in `test_helper.rb` and once in `env.rb`.
269
+ If you use SimpleCov to merge multiple test suite results (e.g. Test/Unit and Cucumber) into a single report, you'd
270
+ normally have to set up all your config options twice, once in `test_helper.rb` and once in `env.rb`.
247
271
 
248
- To avoid this, you can place a file called `.simplecov` in your project root. You can then just leave the `require 'simplecov'` in each
249
- test setup helper (**at the top**) and move the `SimpleCov.start` code with all your custom config options into `.simplecov`:
272
+ To avoid this, you can place a file called `.simplecov` in your project root. You can then just leave the
273
+ `require 'simplecov'` in each test setup helper (**at the top**) and move the `SimpleCov.start` code with all your
274
+ custom config options into `.simplecov`:
250
275
 
251
276
  ```ruby
252
277
  # test/test_helper.rb
@@ -261,21 +286,73 @@ SimpleCov.start 'rails' do
261
286
  end
262
287
  ```
263
288
 
264
- Using `.simplecov` rather than separately requiring SimpleCov multiple times is recommended if you are merging multiple test frameworks like Cucumber and RSpec that rely on each other, as invoking SimpleCov multiple times can cause coverage information to be lost.
289
+ Using `.simplecov` rather than separately requiring SimpleCov multiple times is recommended if you are merging multiple
290
+ test frameworks like Cucumber and RSpec that rely on each other, as invoking SimpleCov multiple times can cause coverage
291
+ information to be lost.
292
+
293
+ ## Branch coverage (ruby "~> 2.5")
294
+ Add branch coverage measurement statistics to your results. Supported in CRuby versions 2.5+.
295
+
296
+ ```ruby
297
+ # or in configure or just SimpleCov.enable_coverage :branch
298
+ SimpleCov.start do
299
+ enable_coverage :branch
300
+ end
301
+ ```
302
+
303
+ Branch coverage is a feature introduced in Ruby 2.5 concerning itself with whether a
304
+ particular branch of a condition had been executed. Line coverage on the other hand
305
+ is only interested in whether a line of code has been executed.
306
+
307
+ This comes in handy for instance for one line conditionals:
308
+
309
+ ```ruby
310
+ number.odd? ? "odd" : "even"
311
+ ```
312
+
313
+ In line coverage this line would always be marked as executed but you'd never know if both
314
+ conditions were met. Guard clauses have a similar story:
315
+
316
+ ```ruby
317
+ return if number.odd?
318
+
319
+ # more code
320
+ ```
321
+
322
+ If all the code in that method was covered you'd never know if the guard clause was ever
323
+ triggered! With line coverage as just evaluating the condition marks it as covered.
324
+
325
+ In the HTML report the lines of code will be annotated like `branch_type: hit_count`:
326
+
327
+ * `then: 2` - the then branch (of an `if`) was executed twice
328
+ * `else: 0` - the else branch (of an `if` or `case`) was never executed
329
+
330
+ Not that even if you don't declare an `else` branch it will still show up in the coverage
331
+ reports meaning that the condition of the `if` was not hit or that no `when` of `case`
332
+ was hit during the test runs.
333
+
334
+ **Is branch coverage strictly better?** No. Branch coverage really only concerns itself with
335
+ conditionals - meaning coverage of sequential code is of no interest to it. A file without
336
+ conditional logic will have no branch coverage data and SimpleCov will report 0 of 0
337
+ branches covered as 100% (as everything that can be covered was covered).
338
+
339
+ Hence, we recommend looking at both metrics together. Branch coverage might also be a good
340
+ overall metric to look at - while you might be missing only 10% of your lines that might
341
+ account for 50% of your branches for instance.
265
342
 
266
343
  ## Filters
267
344
 
268
- Filters can be used to remove selected files from your coverage data. By default, a filter is applied that removes all files
269
- OUTSIDE of your project's root directory - otherwise you'd end up with billions of coverage reports for source files in the
270
- gems you are using.
345
+ Filters can be used to remove selected files from your coverage data. By default, a filter is applied that removes all
346
+ files OUTSIDE of your project's root directory - otherwise you'd end up with billions of coverage reports for source
347
+ files in the gems you are using.
271
348
 
272
349
  You can define your own to remove things like configuration files, tests or whatever you don't need in your coverage
273
350
  report.
274
351
 
275
352
  ### Defining custom filters
276
353
 
277
- You can currently define a filter using either a String or Regexp (that will then be Regexp-matched against each source file's path),
278
- a block or by passing in your own Filter class.
354
+ You can currently define a filter using either a String or Regexp (that will then be Regexp-matched against each source
355
+ file's path), a block or by passing in your own Filter class.
279
356
 
280
357
  #### String filter
281
358
 
@@ -307,9 +384,10 @@ SimpleCov.start do
307
384
  end
308
385
  ```
309
386
 
310
- Block filters receive a SimpleCov::SourceFile instance and expect your block to return either true (if the file is to be removed
311
- from the result) or false (if the result should be kept). Please check out the RDoc for SimpleCov::SourceFile to learn about the
312
- methods available to you. In the above example, the filter will remove all files that have less than 5 lines of code.
387
+ Block filters receive a SimpleCov::SourceFile instance and expect your block to return either true (if the file is to be
388
+ removed from the result) or false (if the result should be kept). Please check out the RDoc for SimpleCov::SourceFile to
389
+ learn about the methods available to you. In the above example, the filter will remove all files that have less than 5
390
+ lines of code.
313
391
 
314
392
  #### Custom filter class
315
393
 
@@ -323,9 +401,10 @@ end
323
401
  SimpleCov.add_filter LineFilter.new(5)
324
402
  ```
325
403
 
326
- Defining your own filters is pretty easy: Just inherit from SimpleCov::Filter and define a method 'matches?(source_file)'. When running
327
- the filter, a true return value from this method will result in the removal of the given source_file. The filter_argument method
328
- is being set in the SimpleCov::Filter initialize method and thus is set to 5 in this example.
404
+ Defining your own filters is pretty easy: Just inherit from SimpleCov::Filter and define a method
405
+ 'matches?(source_file)'. When running the filter, a true return value from this method will result in the removal of the
406
+ given source_file. The filter_argument method is being set in the SimpleCov::Filter initialize method and thus is set to
407
+ 5 in this example.
329
408
 
330
409
  #### Array filter
331
410
 
@@ -352,7 +431,9 @@ end
352
431
 
353
432
  The name of the token can be changed to your liking. [Learn more about the nocov feature.]( https://github.com/colszowka/simplecov/blob/master/features/config_nocov_token.feature)
354
433
 
355
- **Note:** You shouldn't have to use the nocov token to skip private methods that are being included in your coverage. If you appropriately test the public interface of your classes and objects you should automatically get full coverage of your private methods.
434
+ **Note:** You shouldn't have to use the nocov token to skip private methods that are being included in your coverage. If
435
+ you appropriately test the public interface of your classes and objects you should automatically get full coverage of
436
+ your private methods.
356
437
 
357
438
  ## Default root filter and coverage for things outside of it
358
439
 
@@ -375,8 +456,8 @@ end
375
456
 
376
457
  You can separate your source files into groups. For example, in a Rails app, you'll want to have separate listings for
377
458
  Models, Controllers, Helpers, and Libs. Group definition works similarly to Filters (and also accepts custom
378
- filter classes), but source files end up in a group when the filter passes (returns true), as opposed to filtering results,
379
- which exclude files from results when the filter results in a true value.
459
+ filter classes), but source files end up in a group when the filter passes (returns true), as opposed to filtering
460
+ results, which exclude files from results when the filter results in a true value.
380
461
 
381
462
  Add your groups with:
382
463
 
@@ -396,12 +477,11 @@ end
396
477
 
397
478
  You normally want to have your coverage analyzed across ALL of your test suites, right?
398
479
 
399
- Simplecov automatically caches coverage results in your (coverage_path)/.resultset.json. Those results will then
400
- be automatically merged when generating the result, so when coverage is set up properly for Cucumber and your
401
- unit / functional / integration tests, all of those test suites will be taken into account when building the
402
- coverage report.
403
-
404
- There are two things to note here though:
480
+ Simplecov automatically caches coverage results in your
481
+ (coverage_path)/.resultset.json, and will merge or override those with
482
+ subsequent runs, depending on whether simplecov considers those subsequent runs
483
+ as different test suites or as the same test suite as the cached results. To
484
+ make this distinction, simplecov has the concept of "test suite names".
405
485
 
406
486
  ### Test suite names
407
487
 
@@ -455,24 +535,96 @@ SimpleCov.command_name "features" + (ENV['TEST_ENV_NUMBER'] || '')
455
535
 
456
536
  [simplecov-html] prints the used test suites in the footer of the generated coverage report.
457
537
 
458
- ### Timeout for merge
459
538
 
460
- Of course, your cached coverage data is likely to become invalid at some point. Thus, result sets that are older than
461
- `SimpleCov.merge_timeout` will not be used any more. By default, the timeout is 600 seconds (10 minutes), and you can
462
- raise (or lower) it by specifying `SimpleCov.merge_timeout 3600` (1 hour), or, inside a configure/start block, with
463
- just `merge_timeout 3600`.
539
+ ### Merging test runs under the same execution environment
464
540
 
465
- You can deactivate merging altogether with `SimpleCov.use_merging false`.
541
+ Test results are automatically merged with previous runs in the same execution
542
+ environment when generating the result, so when coverage is set up properly for
543
+ Cucumber and your unit / functional / integration tests, all of those test
544
+ suites will be taken into account when building the coverage report.
545
+
546
+ #### Timeout for merge
547
+
548
+ Of course, your cached coverage data is likely to become invalid at some point. Thus, when automatically merging
549
+ subsequent test runs, result sets that are older than `SimpleCov.merge_timeout` will not be used any more. By default,
550
+ the timeout is 600 seconds (10 minutes), and you can raise (or lower) it by specifying `SimpleCov.merge_timeout 3600`
551
+ (1 hour), or, inside a configure/start block, with just `merge_timeout 3600`.
552
+
553
+ You can deactivate this automatic merging altogether with `SimpleCov.use_merging false`.
554
+
555
+ ### Merging test runs under different execution environments
556
+
557
+ If your tests are done in parallel across multiple build machines, you can fetch them all and merge them into a single
558
+ result set using the `SimpleCov.collate` method. This can be added to a Rakefile or script file, having downloaded a set of
559
+ `.resultset.json` files from each parallel test run.
560
+
561
+ ```ruby
562
+ # lib/tasks/coverage_report.rake
563
+ namespace :coverage do
564
+ desc "Collates all result sets generated by the different test runners"
565
+ task :report do
566
+ require 'simplecov'
567
+
568
+ SimpleCov.collate Dir["simplecov-resultset-*/.resultset.json"]
569
+ end
570
+ end
571
+ ```
572
+
573
+ `SimpleCov.collate` also takes an optional simplecov profile and an optional
574
+ block for configuration, just the same as `SimpleCov.start` or
575
+ `SimpleCov.configure`. This means you can configure a separate formatter for
576
+ the collated output. For instance, you can make the formatter in
577
+ `SimpleCov.start` the `SimpleCov::Formatter::SimpleFormatter`, and only use more
578
+ complex formatters in the final `SimpleCov.collate` run.
579
+
580
+ ```ruby
581
+ # spec/spec_helper.rb
582
+ require 'simplecov'
583
+
584
+ SimpleCov.start 'rails' do
585
+ # Disambiguates individual test runs
586
+ command_name "Job #{ENV["TEST_ENV_NUMBER"]}" if ENV["TEST_ENV_NUMBER"]
587
+
588
+ if ENV['CI']
589
+ formatter SimpleCov::Formatter::SimpleFormatter
590
+ else
591
+ formatter SimpleCov::Formatter::MultiFormatter.new([
592
+ SimpleCov::Formatter::SimpleFormatter,
593
+ SimpleCov::Formatter::HTMLFormatter
594
+ ])
595
+ end
596
+
597
+ track_files "**/*.rb"
598
+ end
599
+ ```
600
+
601
+ ```ruby
602
+ # lib/tasks/coverage_report.rake
603
+ namespace :coverage do
604
+ task :report do
605
+ require 'simplecov'
606
+
607
+ SimpleCov.collate Dir["simplecov-resultset-*/.resultset.json"], 'rails' do
608
+ formatter SimpleCov::Formatter::MultiFormatter.new([
609
+ SimpleCov::Formatter::SimpleFormatter,
610
+ SimpleCov::Formatter::HTMLFormatter
611
+ ])
612
+ end
613
+ end
614
+ end
615
+ ```
466
616
 
467
617
  ## Running coverage only on demand
468
618
 
469
- The Ruby STDLIB Coverage library that SimpleCov builds upon is *very* fast (on a ~10 min Rails test suite, the speed drop was
470
- only a couple seconds for me), and therefore it's SimpleCov's policy to just generate coverage every time you run your tests because
471
- it doesn't do your test speed any harm and you're always equipped with the latest and greatest coverage results.
619
+ The Ruby STDLIB Coverage library that SimpleCov builds upon is *very* fast (on a ~10 min Rails test suite, the speed
620
+ drop was only a couple seconds for me), and therefore it's SimpleCov's policy to just generate coverage every time you
621
+ run your tests because it doesn't do your test speed any harm and you're always equipped with the latest and greatest
622
+ coverage results.
472
623
 
473
624
  Because of this, SimpleCov has no explicit built-in mechanism to run coverage only on demand.
474
625
 
475
- However, you can still accomplish this very easily by introducing an ENV variable conditional into your SimpleCov setup block, like this:
626
+ However, you can still accomplish this very easily by introducing an ENV variable conditional into your SimpleCov setup
627
+ block, like this:
476
628
 
477
629
  ```ruby
478
630
  SimpleCov.start if ENV["COVERAGE"]
@@ -484,6 +636,21 @@ Then, SimpleCov will only run if you execute your tests like this:
484
636
  COVERAGE=true rake test
485
637
  ```
486
638
 
639
+ ## Errors and exit statuses
640
+
641
+ To aid in debugging issues, if an error is raised, SimpleCov will print a message to `STDERR`
642
+ with the exit status of the error, like:
643
+
644
+ ```
645
+ SimpleCov failed with exit 1
646
+ ```
647
+
648
+ This `STDERR` message can be disabled with:
649
+
650
+ ```
651
+ SimpleCov.print_error_status = false
652
+ ```
653
+
487
654
  ## Profiles
488
655
 
489
656
  By default, SimpleCov's only config assumption is that you only want coverage reports for files inside your project
@@ -521,8 +688,8 @@ end
521
688
 
522
689
  ### Custom profiles
523
690
 
524
- You can load additional profiles with the SimpleCov.load_profile('xyz') method. This allows you to build upon an existing
525
- profile and customize it so you can reuse it in unit tests and Cucumber features. For example:
691
+ You can load additional profiles with the SimpleCov.load_profile('xyz') method. This allows you to build upon an
692
+ existing profile and customize it so you can reuse it in unit tests and Cucumber features. For example:
526
693
 
527
694
  ```ruby
528
695
  # lib/simplecov_custom_profile.rb
@@ -563,7 +730,8 @@ SimpleCov.minimum_coverage 90
563
730
 
564
731
  ### Minimum coverage by file
565
732
 
566
- You can define the minimum coverage by file percentage expected. SimpleCov will return non-zero if unmet. This is useful to help ensure coverage is relatively consistent, rather than being skewed by particularly good or bad areas of the code.
733
+ You can define the minimum coverage by file percentage expected. SimpleCov will return non-zero if unmet. This is useful
734
+ to help ensure coverage is relatively consistent, rather than being skewed by particularly good or bad areas of the code.
567
735
 
568
736
  ```ruby
569
737
  SimpleCov.minimum_coverage_by_file 80
@@ -593,8 +761,8 @@ You can use your own formatter with:
593
761
  SimpleCov.formatter = SimpleCov::Formatter::HTMLFormatter
594
762
  ```
595
763
 
596
- When calling SimpleCov.result.format!, it will be invoked with SimpleCov::Formatter::YourFormatter.new.format(result), "result"
597
- being an instance of SimpleCov::Result. Do whatever your wish with that!
764
+ When calling SimpleCov.result.format!, it will be invoked with SimpleCov::Formatter::YourFormatter.new.format(result),
765
+ "result" being an instance of SimpleCov::Result. Do whatever your wish with that!
598
766
 
599
767
 
600
768
  ## Using multiple formatters
@@ -616,11 +784,9 @@ SimpleCov.formatters = SimpleCov::Formatter::MultiFormatter.new([
616
784
 
617
785
  ## Ruby version compatibility
618
786
 
619
- Only Ruby 1.9+ ships with the coverage library that SimpleCov depends upon and that's what SimpleCov supports. Additionally JRuby 9.1+ is supported as well, while JRuby 1.7 and 9.0 should work they're not "officially" supported.
620
- SimpleCov is also built against Ruby 1.8 in [Continuous Integration], but this happens only to ensure that SimpleCov
621
- does not make your test suite crash right now.
787
+ SimpleCov is built in [Continuous Integration] on Ruby 2.4+ as well as JRuby 9.2+.
622
788
 
623
- SimpleCov is built in [Continuous Integration] on Ruby 1.9.3, 2.0.0, 2.1, 2.2, 2.3, 2.4, 2.5 as well as JRuby 9.1.
789
+ Note for JRuby => You need to pass JRUBY_OPTS="--debug" or create .jrubyrc and add debug.fullTrace=true
624
790
 
625
791
  ## Want to find dead code in production?
626
792
 
@@ -628,48 +794,36 @@ Try [Coverband](https://github.com/danmayer/coverband).
628
794
 
629
795
  ## Want to use Spring with SimpleCov?
630
796
 
631
- If you're using [Spring](https://github.com/rails/spring) to speed up test suite runs and want to run SimpleCov along with them, you'll find that it often misreports coverage with the default config due to some sort of eager loading issue. Don't despair!
632
-
633
- 1. Change the following settings in `test.rb`.
634
-
635
- ```ruby
636
- # For Rails
637
- # Do not eager load code on boot
638
- config.eager_load = false
639
- ```
640
- 2. Add your SimpleCov config, as you normally would, to your `spec_helper.rb`
641
- (or `rails_helper.rb` for RSpec 3). If you have a `config/spring.rb` file
642
- (or anything similar), add it to the start of such file. Here's a simple
643
- version of what the config should look like:
797
+ If you're using [Spring](https://github.com/rails/spring) to speed up test suite runs and want to run SimpleCov along
798
+ with them, you'll find that it often misreports coverage with the default config due to some sort of eager loading
799
+ issue. Don't despair!
644
800
 
645
- ```ruby
646
- if ENV['RAILS_ENV'] == 'test'
647
- require 'simplecov'
648
- SimpleCov.start
649
- end
650
- ```
651
- 3. Run `spring rspec <path>` as normal. Remember to run `spring stop` after
652
- making important changes to your app or its specs!
801
+ One solution is to [explicitly call eager
802
+ load](https://github.com/colszowka/simplecov/issues/381#issuecomment-347651728)
803
+ in your `test_helper.rb` / `spec_helper.rb` after calling `SimpleCov.start`.
653
804
 
654
- ## Want to use bootsnap with SimpleCov?
805
+ ```ruby
806
+ require 'simplecov'
807
+ SimpleCov.start 'rails'
808
+ Rails.application.eager_load!
809
+ ```
655
810
 
656
- As mentioned in [this issue](https://github.com/Shopify/bootsnap/issues/35) iseq
657
- loading/dumping doesn't work with coverage. Hence you need to deactivate it when
658
- you run coverage so for instance when you use the environment `COVERAGE=true` to
659
- decide that you want to gather coverage you can do:
811
+ Alternatively, you could disable Spring while running SimpleCov:
660
812
 
661
- ```ruby
662
- Bootsnap.setup(
663
- compile_cache_iseq: !ENV["COVERAGE"], # Compile Ruby code into ISeq cache, breaks coverage reporting.
664
- # all those other options
665
- )
813
+ ```
814
+ DISABLE_SPRING=1 rake test
666
815
  ```
667
816
 
817
+ Or you could remove `gem 'spring'` from your `Gemfile`.
818
+
668
819
  ## Troubleshooting
669
820
 
670
- The **most common problem is that simplecov isn't required and started before everything else**. In order to track coverage for your whole application **simplecov needs to be the first one** so that it (and the underlying coverage library) can subsequently track loaded files and their usage.
821
+ The **most common problem is that simplecov isn't required and started before everything else**. In order to track
822
+ coverage for your whole application **simplecov needs to be the first one** so that it (and the underlying coverage
823
+ library) can subsequently track loaded files and their usage.
671
824
 
672
- If you are missing coverage for some code a simple trick is to put a puts statement in there and right after `SimpleCov.start` so you can see if the file really was loaded after simplecov was started.
825
+ If you are missing coverage for some code a simple trick is to put a puts statement in there and right after
826
+ `SimpleCov.start` so you can see if the file really was loaded after simplecov was started.
673
827
 
674
828
  ```ruby
675
829
  # my_code.rb
@@ -697,6 +851,11 @@ MyCode is being loaded!
697
851
 
698
852
  then it's good otherwise you likely have a problem :)
699
853
 
854
+ ## Code of Conduct
855
+
856
+ Everyone participating in this project's development, issue trackers and other channels is expected to follow our
857
+ [Code of Conduct](./CODE_OF_CONDUCT.md)
858
+
700
859
  ## Contributing
701
860
 
702
861
  See the [contributing guide](https://github.com/colszowka/simplecov/blob/master/CONTRIBUTING.md).
@@ -10,6 +10,11 @@ If you have built or found one that is missing here, please send a Pull Request
10
10
 
11
11
  A formatter that generates a coverage badge for use in your project's readme using ImageMagick.
12
12
 
13
+ #### [simplecov-small-badge](https://github.com/marcgrimme/simplecov-small-badge)
14
+ *by Marc Grimme*
15
+
16
+ A formatter that generates a small coverage badge for use in your project's readme using the SVG.
17
+
13
18
  #### [simplecov-cobertura](https://github.com/dashingrocket/simplecov-cobertura)
14
19
  *by Jesse Bowes*
15
20
 
@@ -49,3 +54,8 @@ A formatter that prints the coverage of the file under test when you run a singl
49
54
  *by [Yosuke Kabuto](https://github.com/ysksn)*
50
55
 
51
56
  t_wada AA formatter for SimpleCov
57
+
58
+ #### [simplecov-material(https://github.com/chiefpansancolt/simplecov-material)
59
+ *by [Chiefpansancolt](https://github.com/chiefpansancolt)*
60
+
61
+ A Material Designed HTML formatter with clean and easy search of files with a tabular left Navigation.
@@ -0,0 +1,32 @@
1
+ # frozen_string_literal: true
2
+
3
+ module SimpleCov
4
+ module Combine
5
+ #
6
+ # Combine different branch coverage results on single file.
7
+ #
8
+ # Should be called through `SimpleCov.combine`.
9
+ module BranchesCombiner
10
+ module_function
11
+
12
+ #
13
+ # Return merged branches or the existed branche if other is missing.
14
+ #
15
+ # Branches inside files are always same if they exists, the difference only in coverage count.
16
+ # Branch coverage report for any conditional case is built from hash, it's key is a condition and
17
+ # it's body is a hash << keys from condition and value is coverage rate >>.
18
+ # ex: branches =>{ [:if, 3, 8, 6, 8, 36] => {[:then, 4, 8, 6, 8, 12] => 1, [:else, 5, 8, 6, 8, 36]=>2}, other conditions...}
19
+ # We create copy of result and update it values depending on the combined branches coverage values.
20
+ #
21
+ # @return [Hash]
22
+ #
23
+ def combine(coverage_a, coverage_b)
24
+ coverage_a.merge(coverage_b) do |_condition, branches_inside_a, branches_inside_b|
25
+ branches_inside_a.merge(branches_inside_b) do |_branch, a_count, b_count|
26
+ a_count + b_count
27
+ end
28
+ end
29
+ end
30
+ end
31
+ end
32
+ end