simplecov 0.15.1 → 0.18.0.beta1

Sign up to get free protection for your applications and to get access to all the features.
Files changed (147) hide show
  1. checksums.yaml +4 -4
  2. data/CHANGELOG.md +74 -1
  3. data/CODE_OF_CONDUCT.md +76 -0
  4. data/CONTRIBUTING.md +12 -9
  5. data/ISSUE_TEMPLATE.md +23 -0
  6. data/{MIT-LICENSE → LICENSE} +0 -0
  7. data/README.md +205 -104
  8. data/doc/alternate-formatters.md +20 -0
  9. data/lib/simplecov.rb +246 -52
  10. data/lib/simplecov/combine.rb +30 -0
  11. data/lib/simplecov/combine/branches_combiner.rb +32 -0
  12. data/lib/simplecov/combine/files_combiner.rb +25 -0
  13. data/lib/simplecov/combine/lines_combiner.rb +43 -0
  14. data/lib/simplecov/combine/results_combiner.rb +60 -0
  15. data/lib/simplecov/command_guesser.rb +8 -3
  16. data/lib/simplecov/configuration.rb +79 -8
  17. data/lib/simplecov/defaults.rb +12 -81
  18. data/lib/simplecov/exit_codes.rb +2 -0
  19. data/lib/simplecov/file_list.rb +32 -3
  20. data/lib/simplecov/filter.rb +5 -2
  21. data/lib/simplecov/formatter.rb +2 -0
  22. data/lib/simplecov/formatter/multi_formatter.rb +4 -2
  23. data/lib/simplecov/formatter/simple_formatter.rb +6 -4
  24. data/lib/simplecov/last_run.rb +4 -0
  25. data/lib/simplecov/lines_classifier.rb +21 -5
  26. data/lib/simplecov/load_global_config.rb +2 -0
  27. data/lib/simplecov/no_defaults.rb +2 -0
  28. data/lib/simplecov/profiles.rb +11 -7
  29. data/lib/simplecov/profiles/bundler_filter.rb +5 -0
  30. data/lib/simplecov/profiles/hidden_filter.rb +5 -0
  31. data/lib/simplecov/profiles/rails.rb +18 -0
  32. data/lib/simplecov/profiles/root_filter.rb +10 -0
  33. data/lib/simplecov/profiles/test_frameworks.rb +8 -0
  34. data/lib/simplecov/result.rb +23 -4
  35. data/lib/simplecov/result_adapter.rb +30 -0
  36. data/lib/simplecov/result_merger.rb +14 -11
  37. data/lib/simplecov/simulate_coverage.rb +29 -0
  38. data/lib/simplecov/source_file.rb +222 -110
  39. data/lib/simplecov/source_file/branch.rb +106 -0
  40. data/lib/simplecov/source_file/line.rb +72 -0
  41. data/lib/simplecov/useless_results_remover.rb +16 -0
  42. data/lib/simplecov/version.rb +3 -1
  43. metadata +44 -162
  44. data/.gitignore +0 -31
  45. data/.rspec +0 -3
  46. data/.rubocop.yml +0 -88
  47. data/.travis.yml +0 -29
  48. data/.yardopts +0 -1
  49. data/Gemfile +0 -38
  50. data/Rakefile +0 -39
  51. data/cucumber.yml +0 -13
  52. data/features/config_autoload.feature +0 -46
  53. data/features/config_command_name.feature +0 -45
  54. data/features/config_coverage_dir.feature +0 -33
  55. data/features/config_deactivate_merging.feature +0 -42
  56. data/features/config_formatters.feature +0 -77
  57. data/features/config_merge_timeout.feature +0 -39
  58. data/features/config_nocov_token.feature +0 -79
  59. data/features/config_profiles.feature +0 -44
  60. data/features/config_project_name.feature +0 -27
  61. data/features/config_styles.feature +0 -121
  62. data/features/config_tracked_files.feature +0 -29
  63. data/features/config_tracked_files_relevant_lines.feature +0 -31
  64. data/features/cucumber_basic.feature +0 -29
  65. data/features/maximum_coverage_drop.feature +0 -89
  66. data/features/merging_test_unit_and_rspec.feature +0 -44
  67. data/features/minimum_coverage.feature +0 -59
  68. data/features/refuse_coverage_drop.feature +0 -95
  69. data/features/rspec_basic.feature +0 -32
  70. data/features/rspec_fails_on_initialization.feature +0 -14
  71. data/features/rspec_groups_and_filters_basic.feature +0 -29
  72. data/features/rspec_groups_and_filters_complex.feature +0 -37
  73. data/features/rspec_groups_using_filter_class.feature +0 -41
  74. data/features/rspec_without_simplecov.feature +0 -20
  75. data/features/skipping_code_blocks_manually.feature +0 -70
  76. data/features/step_definitions/html_steps.rb +0 -44
  77. data/features/step_definitions/simplecov_steps.rb +0 -68
  78. data/features/step_definitions/transformers.rb +0 -13
  79. data/features/step_definitions/web_steps.rb +0 -64
  80. data/features/support/aruba_freedom_patch.rb +0 -53
  81. data/features/support/env.rb +0 -50
  82. data/features/test_unit_basic.feature +0 -34
  83. data/features/test_unit_groups_and_filters_basic.feature +0 -29
  84. data/features/test_unit_groups_and_filters_complex.feature +0 -35
  85. data/features/test_unit_groups_using_filter_class.feature +0 -40
  86. data/features/test_unit_without_simplecov.feature +0 -20
  87. data/features/unicode_compatiblity.feature +0 -67
  88. data/lib/simplecov/jruby_fix.rb +0 -42
  89. data/lib/simplecov/railtie.rb +0 -7
  90. data/lib/simplecov/railties/tasks.rake +0 -11
  91. data/lib/simplecov/raw_coverage.rb +0 -39
  92. data/simplecov.gemspec +0 -27
  93. data/spec/1_8_fallbacks_spec.rb +0 -31
  94. data/spec/command_guesser_spec.rb +0 -48
  95. data/spec/config_loader_spec.rb +0 -14
  96. data/spec/configuration_spec.rb +0 -35
  97. data/spec/defaults_spec.rb +0 -41
  98. data/spec/deleted_source_spec.rb +0 -12
  99. data/spec/faked_project/Gemfile +0 -6
  100. data/spec/faked_project/Rakefile +0 -8
  101. data/spec/faked_project/cucumber.yml +0 -13
  102. data/spec/faked_project/features/step_definitions/my_steps.rb +0 -22
  103. data/spec/faked_project/features/support/env.rb +0 -12
  104. data/spec/faked_project/features/test_stuff.feature +0 -6
  105. data/spec/faked_project/lib/faked_project.rb +0 -11
  106. data/spec/faked_project/lib/faked_project/framework_specific.rb +0 -18
  107. data/spec/faked_project/lib/faked_project/meta_magic.rb +0 -24
  108. data/spec/faked_project/lib/faked_project/some_class.rb +0 -28
  109. data/spec/faked_project/lib/faked_project/untested_class.rb +0 -11
  110. data/spec/faked_project/spec/faked_spec.rb +0 -11
  111. data/spec/faked_project/spec/forking_spec.rb +0 -8
  112. data/spec/faked_project/spec/meta_magic_spec.rb +0 -15
  113. data/spec/faked_project/spec/some_class_spec.rb +0 -13
  114. data/spec/faked_project/spec/spec_helper.rb +0 -11
  115. data/spec/faked_project/test/faked_test.rb +0 -11
  116. data/spec/faked_project/test/meta_magic_test.rb +0 -13
  117. data/spec/faked_project/test/some_class_test.rb +0 -15
  118. data/spec/faked_project/test/test_helper.rb +0 -12
  119. data/spec/file_list_spec.rb +0 -50
  120. data/spec/filters_spec.rb +0 -202
  121. data/spec/fixtures/app/controllers/sample_controller.rb +0 -10
  122. data/spec/fixtures/app/models/user.rb +0 -10
  123. data/spec/fixtures/deleted_source_sample.rb +0 -15
  124. data/spec/fixtures/frameworks/rspec_bad.rb +0 -9
  125. data/spec/fixtures/frameworks/rspec_good.rb +0 -9
  126. data/spec/fixtures/frameworks/testunit_bad.rb +0 -9
  127. data/spec/fixtures/frameworks/testunit_good.rb +0 -9
  128. data/spec/fixtures/iso-8859.rb +0 -3
  129. data/spec/fixtures/never.rb +0 -2
  130. data/spec/fixtures/resultset1.rb +0 -4
  131. data/spec/fixtures/resultset2.rb +0 -4
  132. data/spec/fixtures/sample.rb +0 -16
  133. data/spec/fixtures/skipped.rb +0 -4
  134. data/spec/fixtures/skipped_and_executed.rb +0 -8
  135. data/spec/fixtures/utf-8.rb +0 -3
  136. data/spec/helper.rb +0 -26
  137. data/spec/last_run_spec.rb +0 -48
  138. data/spec/lines_classifier_spec.rb +0 -103
  139. data/spec/multi_formatter_spec.rb +0 -20
  140. data/spec/raw_coverage_spec.rb +0 -92
  141. data/spec/result_merger_spec.rb +0 -171
  142. data/spec/result_spec.rb +0 -209
  143. data/spec/return_codes_spec.rb +0 -34
  144. data/spec/simplecov_spec.rb +0 -109
  145. data/spec/source_file_line_spec.rb +0 -155
  146. data/spec/source_file_spec.rb +0 -145
  147. data/spec/support/fail_rspec_on_ruby_warning.rb +0 -75
@@ -1,44 +0,0 @@
1
- @test_unit @config @profiles
2
- Feature:
3
-
4
- In order to re-use SimpleCov settings across projects,
5
- profiles can be defined that hold configuration settings
6
- that can be loaded at once.
7
-
8
- Background:
9
- Given SimpleCov for Test/Unit is configured with:
10
- """
11
- require 'simplecov'
12
- """
13
-
14
- Scenario: Defining and using a custom profile
15
- Given a file named ".simplecov" with:
16
- """
17
- SimpleCov.profiles.define 'custom_command' do
18
- command_name "Profile Command"
19
- end
20
-
21
- SimpleCov.start do
22
- load_profile 'test_frameworks'
23
- load_profile 'custom_command'
24
- end
25
- """
26
-
27
- When I open the coverage report generated with `bundle exec rake test`
28
- Then I should see "4 files in total."
29
- And I should see "using Profile Command" within "#footer"
30
-
31
- Scenario: Using existing profile in custom profile and supplying profile to start command
32
- Given a file named ".simplecov" with:
33
- """
34
- SimpleCov.profiles.define 'my_profile' do
35
- load_profile 'test_frameworks'
36
- command_name "My Profile"
37
- end
38
-
39
- SimpleCov.start 'my_profile'
40
- """
41
-
42
- When I open the coverage report generated with `bundle exec rake test`
43
- Then I should see "4 files in total."
44
- And I should see "using My Profile" within "#footer"
@@ -1,27 +0,0 @@
1
- @test_unit @config
2
- Feature:
3
-
4
- SimpleCov guesses the project name from the project root dir's name.
5
- If this is not sufficient for you, you can specify a custom name using
6
- SimpleCov.project_name('xyz')
7
-
8
-
9
- Scenario: Guessed name
10
- Given SimpleCov for Test/Unit is configured with:
11
- """
12
- require 'simplecov'
13
- SimpleCov.start
14
- """
15
-
16
- When I open the coverage report generated with `bundle exec rake test`
17
- Then I should see "Code coverage for Project" within "title"
18
-
19
- Scenario: Custom name
20
- Given SimpleCov for Test/Unit is configured with:
21
- """
22
- require 'simplecov'
23
- SimpleCov.start { project_name "Superfancy 2.0" }
24
- """
25
-
26
- When I open the coverage report generated with `bundle exec rake test`
27
- Then I should see "Code coverage for Superfancy 2.0" within "title"
@@ -1,121 +0,0 @@
1
- @test_unit @config
2
- Feature:
3
-
4
- There's several ways to configure SimpleCov. All of those
5
- config schemes below are equivalent and can be chosen by personal
6
- preference or project requirements.
7
-
8
- Background:
9
- Given SimpleCov for Test/Unit is configured with:
10
- """
11
- require 'simplecov'
12
- """
13
-
14
- Scenario: Inside start block
15
- Given a file named ".simplecov" with:
16
- """
17
- SimpleCov.start do
18
- add_filter 'test'
19
- command_name 'Config Test Runner'
20
- end
21
- """
22
-
23
- When I open the coverage report generated with `bundle exec rake test`
24
- Then I should see "4 files in total."
25
- And I should see "using Config Test Runner" within "#footer"
26
-
27
- Scenario: Inside start block, using instance var from outside
28
- Given a file named ".simplecov" with:
29
- """
30
- @filter = 'test'
31
- SimpleCov.start do
32
- add_filter @filter
33
- command_name 'Config Test Runner'
34
- end
35
- """
36
-
37
- When I open the coverage report generated with `bundle exec rake test`
38
- Then I should see "4 files in total."
39
- And I should see "using Config Test Runner" within "#footer"
40
-
41
- Scenario: Inside start block, using local var from outside
42
- Given a file named ".simplecov" with:
43
- """
44
- filter = 'test'
45
- SimpleCov.start do
46
- add_filter filter
47
- command_name 'Config Test Runner'
48
- end
49
- """
50
-
51
- When I open the coverage report generated with `bundle exec rake test`
52
- Then I should see "4 files in total."
53
- And I should see "using Config Test Runner" within "#footer"
54
-
55
- Scenario: Explicitly before start block
56
- Given a file named ".simplecov" with:
57
- """
58
- SimpleCov.add_filter 'test'
59
- SimpleCov.command_name 'Config Test Runner'
60
- SimpleCov.start
61
- """
62
-
63
- When I open the coverage report generated with `bundle exec rake test`
64
- Then I should see "4 files in total."
65
- And I should see "using Config Test Runner" within "#footer"
66
-
67
- Scenario: Explicitly after start block
68
- Given a file named ".simplecov" with:
69
- """
70
- SimpleCov.start
71
- SimpleCov.add_filter 'test'
72
- SimpleCov.command_name 'Config Test Runner'
73
- """
74
-
75
- When I open the coverage report generated with `bundle exec rake test`
76
- Then I should see "4 files in total."
77
- And I should see "using Config Test Runner" within "#footer"
78
-
79
- Scenario: Using configure block after start
80
- Given a file named ".simplecov" with:
81
- """
82
- SimpleCov.start
83
- SimpleCov.configure do
84
- add_filter 'test'
85
- command_name 'Config Test Runner'
86
- end
87
- """
88
-
89
- When I open the coverage report generated with `bundle exec rake test`
90
- Then I should see "4 files in total."
91
- And I should see "using Config Test Runner" within "#footer"
92
-
93
- Scenario: Using configure block before start
94
- Given a file named ".simplecov" with:
95
- """
96
- SimpleCov.configure do
97
- add_filter 'test'
98
- command_name 'Config Test Runner'
99
- end
100
- SimpleCov.start
101
- """
102
-
103
- When I open the coverage report generated with `bundle exec rake test`
104
- Then I should see "4 files in total."
105
- And I should see "using Config Test Runner" within "#footer"
106
-
107
- Scenario: Mixing configure and start block config
108
- Given a file named ".simplecov" with:
109
- """
110
- SimpleCov.configure do
111
- command_name 'Config Test Runner'
112
- end
113
- SimpleCov.start do
114
- add_filter 'test'
115
- end
116
- """
117
-
118
- When I open the coverage report generated with `bundle exec rake test`
119
- Then I should see "4 files in total."
120
- And I should see "using Config Test Runner" within "#footer"
121
-
@@ -1,29 +0,0 @@
1
- @test_unit
2
- Feature:
3
-
4
- Using the setting `tracked_files` should add files that were not
5
- required to the report.
6
-
7
- Scenario:
8
- Given SimpleCov for Test/Unit is configured with:
9
- """
10
- require 'simplecov'
11
- SimpleCov.start do
12
- track_files "lib/**/*.rb"
13
- end
14
- """
15
-
16
- When I open the coverage report generated with `bundle exec rake test`
17
- Then I should see the groups:
18
- | name | coverage | files |
19
- | All Files | 77.94% | 7 |
20
-
21
- And I should see the source files:
22
- | name | coverage |
23
- | lib/faked_project.rb | 100.0 % |
24
- | lib/faked_project/untested_class.rb | 0.0 % |
25
- | lib/faked_project/some_class.rb | 80.0 % |
26
- | lib/faked_project/framework_specific.rb | 75.0 % |
27
- | lib/faked_project/meta_magic.rb | 100.0 % |
28
- | test/meta_magic_test.rb | 100.0 % |
29
- | test/some_class_test.rb | 100.0 % |
@@ -1,31 +0,0 @@
1
- @rspec
2
- Feature:
3
-
4
- Using the setting `tracked_files` should classify whether lines
5
- are relevant or not (such as whitespace or comments).
6
-
7
- Scenario:
8
- Given SimpleCov for RSpec is configured with:
9
- """
10
- require 'simplecov'
11
- SimpleCov.start do
12
- track_files "lib/**/*.rb"
13
- end
14
- """
15
- Given a file named "lib/not_loaded.rb" with:
16
- """
17
- # A comment line. Plus a whitespace line below:
18
-
19
- # :nocov:
20
- def ignore_me
21
- end
22
- # :nocov:
23
-
24
- def this_is_relevant
25
- puts "still relevant"
26
- end
27
- """
28
-
29
- When I open the coverage report generated with `bundle exec rspec spec`
30
- Then I follow "lib/not_loaded.rb"
31
- Then I should see "3 relevant lines" within ".highlighted"
@@ -1,29 +0,0 @@
1
- @cucumber
2
- Feature:
3
-
4
- Simply adding the basic simplecov lines to a project should get
5
- the user a coverage report after running `cucumber features`
6
-
7
- Scenario:
8
- Given SimpleCov for Cucumber is configured with:
9
- """
10
- require 'simplecov'
11
- SimpleCov.start
12
- """
13
-
14
- When I open the coverage report generated with `bundle exec cucumber features`
15
- Then I should see the groups:
16
- | name | coverage | files |
17
- | All Files | 91.23% | 6 |
18
-
19
- And I should see the source files:
20
- | name | coverage |
21
- | lib/faked_project.rb | 100.0 % |
22
- | lib/faked_project/some_class.rb | 80.0 % |
23
- | lib/faked_project/framework_specific.rb | 75.0 % |
24
- | lib/faked_project/meta_magic.rb | 100.0 % |
25
- | features/step_definitions/my_steps.rb | 100.0 % |
26
- | features/support/simplecov_config.rb | 100.0 % |
27
-
28
- And the report should be based upon:
29
- | Cucumber Features |
@@ -1,89 +0,0 @@
1
- @test_unit @config
2
- Feature:
3
-
4
- Exit code should be non-zero if the overall coverage decreases by more than
5
- the maximum_coverage_drop threshold.
6
-
7
- Scenario: maximum_coverage_drop configured cam cause spec failure
8
- Given SimpleCov for Test/Unit is configured with:
9
- """
10
- require 'simplecov'
11
- SimpleCov.start do
12
- add_filter 'test.rb'
13
- maximum_coverage_drop 3.14
14
- end
15
- """
16
-
17
- When I run `bundle exec rake test`
18
- Then the exit status should be 0
19
- And a file named "coverage/.last_run.json" should exist
20
-
21
- Given a file named "lib/faked_project/missed.rb" with:
22
- """
23
- class UncoveredSourceCode
24
- def foo
25
- never_reached
26
- rescue => err
27
- but no one cares about invalid ruby here
28
- end
29
- end
30
- """
31
-
32
- When I run `bundle exec rake test`
33
- Then the exit status should not be 0
34
- And the output should contain "Coverage has dropped by 3.32% since the last time (maximum allowed: 3.14%)."
35
- And a file named "coverage/.last_run.json" should exist
36
- And the file "coverage/.last_run.json" should contain:
37
- """
38
- {
39
- "result": {
40
- "covered_percent": 88.1
41
- }
42
- }
43
- """
44
-
45
- Scenario: maximum_coverage_drop not configured updates resultset
46
- Given SimpleCov for Test/Unit is configured with:
47
- """
48
- require 'simplecov'
49
- SimpleCov.start do
50
- add_filter 'test.rb'
51
- end
52
- """
53
-
54
- When I run `bundle exec rake test`
55
- Then the exit status should be 0
56
- And a file named "coverage/.last_run.json" should exist
57
- And the file "coverage/.last_run.json" should contain:
58
- """
59
- {
60
- "result": {
61
- "covered_percent": 88.1
62
- }
63
- }
64
- """
65
-
66
- Given a file named "lib/faked_project/missed.rb" with:
67
- """
68
- class UncoveredSourceCode
69
- def foo
70
- never_reached
71
- rescue => err
72
- but no one cares about invalid ruby here
73
- end
74
- end
75
- """
76
-
77
- When I run `bundle exec rake test`
78
- Then the exit status should be 0
79
- And a file named "coverage/.last_run.json" should exist
80
- And the file "coverage/.last_run.json" should contain:
81
- """
82
- {
83
- "result": {
84
- "covered_percent": 84.78
85
- }
86
- }
87
- """
88
-
89
-
@@ -1,44 +0,0 @@
1
- @test_unit @rspec @merging
2
- Feature:
3
-
4
- Test suites like RSpec and Test/Unit should be merged automatically
5
- when both have been run recently. The coverage report will feature
6
- the joined results of all test suites that are using SimpleCov.
7
-
8
- Scenario:
9
- Given SimpleCov for Test/Unit is configured with:
10
- """
11
- require 'simplecov'
12
- SimpleCov.start do
13
- add_filter 'test.rb'
14
- add_filter 'spec.rb'
15
- end
16
- """
17
- And SimpleCov for RSpec is configured with:
18
- """
19
- require 'simplecov'
20
- SimpleCov.start do
21
- add_filter 'test.rb'
22
- add_filter 'spec.rb'
23
- end
24
- """
25
-
26
- When I open the coverage report generated with `bundle exec rake test`
27
- Then the report should be based upon:
28
- | Unit Tests |
29
-
30
- When I open the coverage report generated with `bundle exec rspec spec`
31
- Then the report should be based upon:
32
- | RSpec |
33
- | Unit Tests |
34
-
35
- And I should see the groups:
36
- | name | coverage | files |
37
- | All Files | 90.48% | 4 |
38
-
39
- And I should see the source files:
40
- | name | coverage |
41
- | lib/faked_project.rb | 100.0 % |
42
- | lib/faked_project/some_class.rb | 80.0 % |
43
- | lib/faked_project/framework_specific.rb | 87.5 % |
44
- | lib/faked_project/meta_magic.rb | 100.0 % |
@@ -1,59 +0,0 @@
1
- @test_unit @config
2
- Feature:
3
-
4
- Exit code should be non-zero if the overall coverage is below the
5
- minimum_coverage threshold.
6
-
7
- Scenario:
8
- Given SimpleCov for Test/Unit is configured with:
9
- """
10
- require 'simplecov'
11
- SimpleCov.start do
12
- add_filter 'test.rb'
13
- minimum_coverage 90
14
- end
15
- """
16
-
17
- When I run `bundle exec rake test`
18
- Then the exit status should not be 0
19
- And the output should contain "Coverage (88.10%) is below the expected minimum coverage (90.00%)."
20
-
21
- Scenario:
22
- Given SimpleCov for Test/Unit is configured with:
23
- """
24
- require 'simplecov'
25
- SimpleCov.start do
26
- add_filter 'test.rb'
27
- minimum_coverage 88.11
28
- end
29
- """
30
-
31
- When I run `bundle exec rake test`
32
- Then the exit status should not be 0
33
- And the output should contain "Coverage (88.10%) is below the expected minimum coverage (88.11%)."
34
-
35
- Scenario:
36
- Given SimpleCov for Test/Unit is configured with:
37
- """
38
- require 'simplecov'
39
- SimpleCov.start do
40
- add_filter 'test.rb'
41
- minimum_coverage 88.10
42
- end
43
- """
44
-
45
- When I run `bundle exec rake test`
46
- Then the exit status should be 0
47
-
48
- Scenario:
49
- Given SimpleCov for Test/Unit is configured with:
50
- """
51
- require 'simplecov'
52
- SimpleCov.start do
53
- add_filter 'test.rb'
54
- end
55
- """
56
-
57
- When I run `bundle exec rake test`
58
- Then the exit status should be 0
59
-