simplecov 0.8.0.pre2 → 0.18.0.beta1

Sign up to get free protection for your applications and to get access to all the features.
Files changed (135) hide show
  1. checksums.yaml +5 -5
  2. data/CHANGELOG.md +368 -27
  3. data/CODE_OF_CONDUCT.md +76 -0
  4. data/CONTRIBUTING.md +38 -7
  5. data/ISSUE_TEMPLATE.md +23 -0
  6. data/{MIT-LICENSE → LICENSE} +1 -1
  7. data/README.md +449 -230
  8. data/doc/alternate-formatters.md +61 -0
  9. data/doc/commercial-services.md +20 -0
  10. data/doc/editor-integration.md +18 -0
  11. data/lib/simplecov.rb +294 -59
  12. data/lib/simplecov/combine.rb +30 -0
  13. data/lib/simplecov/combine/branches_combiner.rb +32 -0
  14. data/lib/simplecov/combine/files_combiner.rb +25 -0
  15. data/lib/simplecov/combine/lines_combiner.rb +43 -0
  16. data/lib/simplecov/combine/results_combiner.rb +60 -0
  17. data/lib/simplecov/command_guesser.rb +46 -40
  18. data/lib/simplecov/configuration.rb +346 -221
  19. data/lib/simplecov/defaults.rb +35 -75
  20. data/lib/simplecov/exit_codes.rb +9 -4
  21. data/lib/simplecov/file_list.rb +80 -36
  22. data/lib/simplecov/filter.rb +51 -3
  23. data/lib/simplecov/formatter.rb +4 -2
  24. data/lib/simplecov/formatter/multi_formatter.rb +28 -19
  25. data/lib/simplecov/formatter/simple_formatter.rb +21 -15
  26. data/lib/simplecov/last_run.rb +21 -13
  27. data/lib/simplecov/lines_classifier.rb +48 -0
  28. data/lib/simplecov/load_global_config.rb +8 -0
  29. data/lib/simplecov/no_defaults.rb +4 -2
  30. data/lib/simplecov/profiles.rb +29 -23
  31. data/lib/simplecov/profiles/bundler_filter.rb +5 -0
  32. data/lib/simplecov/profiles/hidden_filter.rb +5 -0
  33. data/lib/simplecov/profiles/rails.rb +18 -0
  34. data/lib/simplecov/profiles/root_filter.rb +10 -0
  35. data/lib/simplecov/profiles/test_frameworks.rb +8 -0
  36. data/lib/simplecov/result.rb +39 -68
  37. data/lib/simplecov/result_adapter.rb +30 -0
  38. data/lib/simplecov/result_merger.rb +110 -60
  39. data/lib/simplecov/simulate_coverage.rb +29 -0
  40. data/lib/simplecov/source_file.rb +261 -135
  41. data/lib/simplecov/source_file/branch.rb +106 -0
  42. data/lib/simplecov/source_file/line.rb +72 -0
  43. data/lib/simplecov/useless_results_remover.rb +16 -0
  44. data/lib/simplecov/version.rb +4 -2
  45. metadata +48 -197
  46. data/.gitignore +0 -32
  47. data/.travis.yml +0 -28
  48. data/.yardopts +0 -1
  49. data/Appraisals +0 -8
  50. data/Gemfile +0 -16
  51. data/Rakefile +0 -32
  52. data/cucumber.yml +0 -13
  53. data/features/config_autoload.feature +0 -46
  54. data/features/config_command_name.feature +0 -45
  55. data/features/config_coverage_dir.feature +0 -33
  56. data/features/config_deactivate_merging.feature +0 -42
  57. data/features/config_formatters.feature +0 -52
  58. data/features/config_merge_timeout.feature +0 -39
  59. data/features/config_nocov_token.feature +0 -79
  60. data/features/config_profiles.feature +0 -44
  61. data/features/config_project_name.feature +0 -27
  62. data/features/config_styles.feature +0 -121
  63. data/features/cucumber_basic.feature +0 -29
  64. data/features/maximum_coverage_drop.feature +0 -36
  65. data/features/merging_test_unit_and_rspec.feature +0 -44
  66. data/features/minimum_coverage.feature +0 -59
  67. data/features/refuse_coverage_drop.feature +0 -35
  68. data/features/rspec_basic.feature +0 -31
  69. data/features/rspec_fails_on_initialization.feature +0 -14
  70. data/features/rspec_groups_and_filters_basic.feature +0 -29
  71. data/features/rspec_groups_and_filters_complex.feature +0 -35
  72. data/features/rspec_groups_using_filter_class.feature +0 -40
  73. data/features/rspec_without_simplecov.feature +0 -20
  74. data/features/skipping_code_blocks_manually.feature +0 -70
  75. data/features/step_definitions/html_steps.rb +0 -45
  76. data/features/step_definitions/simplecov_steps.rb +0 -66
  77. data/features/step_definitions/transformers.rb +0 -13
  78. data/features/step_definitions/web_steps.rb +0 -64
  79. data/features/support/env.rb +0 -44
  80. data/features/test_unit_basic.feature +0 -34
  81. data/features/test_unit_groups_and_filters_basic.feature +0 -29
  82. data/features/test_unit_groups_and_filters_complex.feature +0 -35
  83. data/features/test_unit_groups_using_filter_class.feature +0 -40
  84. data/features/test_unit_without_simplecov.feature +0 -20
  85. data/features/unicode_compatiblity.feature +0 -67
  86. data/gemfiles/multi_json_legacy.gemfile +0 -12
  87. data/gemfiles/multi_json_new.gemfile +0 -12
  88. data/lib/simplecov/jruby16_fix.rb +0 -43
  89. data/lib/simplecov/json.rb +0 -27
  90. data/lib/simplecov/merge_helpers.rb +0 -39
  91. data/lib/simplecov/railtie.rb +0 -7
  92. data/lib/simplecov/railties/tasks.rake +0 -11
  93. data/simplecov.gemspec +0 -30
  94. data/test/faked_project/Gemfile +0 -6
  95. data/test/faked_project/Rakefile +0 -8
  96. data/test/faked_project/cucumber.yml +0 -13
  97. data/test/faked_project/features/step_definitions/my_steps.rb +0 -23
  98. data/test/faked_project/features/support/env.rb +0 -12
  99. data/test/faked_project/features/test_stuff.feature +0 -6
  100. data/test/faked_project/lib/faked_project.rb +0 -11
  101. data/test/faked_project/lib/faked_project/framework_specific.rb +0 -18
  102. data/test/faked_project/lib/faked_project/meta_magic.rb +0 -24
  103. data/test/faked_project/lib/faked_project/some_class.rb +0 -29
  104. data/test/faked_project/spec/faked_spec.rb +0 -11
  105. data/test/faked_project/spec/meta_magic_spec.rb +0 -10
  106. data/test/faked_project/spec/some_class_spec.rb +0 -10
  107. data/test/faked_project/spec/spec_helper.rb +0 -15
  108. data/test/faked_project/test/faked_test.rb +0 -11
  109. data/test/faked_project/test/meta_magic_test.rb +0 -13
  110. data/test/faked_project/test/some_class_test.rb +0 -15
  111. data/test/faked_project/test/test_helper.rb +0 -16
  112. data/test/fixtures/app/controllers/sample_controller.rb +0 -10
  113. data/test/fixtures/app/models/user.rb +0 -10
  114. data/test/fixtures/deleted_source_sample.rb +0 -15
  115. data/test/fixtures/frameworks/rspec_bad.rb +0 -9
  116. data/test/fixtures/frameworks/rspec_good.rb +0 -9
  117. data/test/fixtures/frameworks/testunit_bad.rb +0 -9
  118. data/test/fixtures/frameworks/testunit_good.rb +0 -9
  119. data/test/fixtures/iso-8859.rb +0 -3
  120. data/test/fixtures/resultset1.rb +0 -4
  121. data/test/fixtures/resultset2.rb +0 -5
  122. data/test/fixtures/sample.rb +0 -16
  123. data/test/fixtures/utf-8.rb +0 -3
  124. data/test/helper.rb +0 -34
  125. data/test/shoulda_macros.rb +0 -19
  126. data/test/test_1_8_fallbacks.rb +0 -31
  127. data/test/test_command_guesser.rb +0 -19
  128. data/test/test_deleted_source.rb +0 -14
  129. data/test/test_file_list.rb +0 -22
  130. data/test/test_filters.rb +0 -78
  131. data/test/test_merge_helpers.rb +0 -105
  132. data/test/test_result.rb +0 -160
  133. data/test/test_return_codes.rb +0 -37
  134. data/test/test_source_file.rb +0 -106
  135. data/test/test_source_file_line.rb +0 -106
@@ -1,44 +0,0 @@
1
- @test_unit @config @profiles
2
- Feature:
3
-
4
- In order to re-use SimpleCov settings across projects,
5
- profiles can be defined that hold configuration settings
6
- that can be loaded at once.
7
-
8
- Background:
9
- Given SimpleCov for Test/Unit is configured with:
10
- """
11
- require 'simplecov'
12
- """
13
-
14
- Scenario: Defining and using a custom profile
15
- Given a file named ".simplecov" with:
16
- """
17
- SimpleCov.profiles.define 'custom_command' do
18
- command_name "Profile Command"
19
- end
20
-
21
- SimpleCov.start do
22
- load_profile 'test_frameworks'
23
- load_profile 'custom_command'
24
- end
25
- """
26
-
27
- When I open the coverage report generated with `bundle exec rake test`
28
- Then I should see "4 files in total."
29
- And I should see "using Profile Command" within "#footer"
30
-
31
- Scenario: Using existing profile in custom profile and supplying profile to start command
32
- Given a file named ".simplecov" with:
33
- """
34
- SimpleCov.profiles.define 'my_profile' do
35
- load_profile 'test_frameworks'
36
- command_name "My Profile"
37
- end
38
-
39
- SimpleCov.start 'my_profile'
40
- """
41
-
42
- When I open the coverage report generated with `bundle exec rake test`
43
- Then I should see "4 files in total."
44
- And I should see "using My Profile" within "#footer"
@@ -1,27 +0,0 @@
1
- @test_unit @config
2
- Feature:
3
-
4
- SimpleCov guesses the project name from the project root dir's name.
5
- If this is not sufficient for you, you can specify a custom name using
6
- SimpleCov.project_name('xyz')
7
-
8
-
9
- Scenario: Guessed name
10
- Given SimpleCov for Test/Unit is configured with:
11
- """
12
- require 'simplecov'
13
- SimpleCov.start
14
- """
15
-
16
- When I open the coverage report generated with `bundle exec rake test`
17
- Then I should see "Code coverage for Project" within "title"
18
-
19
- Scenario: Custom name
20
- Given SimpleCov for Test/Unit is configured with:
21
- """
22
- require 'simplecov'
23
- SimpleCov.start { project_name "Superfancy 2.0" }
24
- """
25
-
26
- When I open the coverage report generated with `bundle exec rake test`
27
- Then I should see "Code coverage for Superfancy 2.0" within "title"
@@ -1,121 +0,0 @@
1
- @test_unit @config
2
- Feature:
3
-
4
- There's several ways to configure SimpleCov. All of those
5
- config schemes below are equivalent and can be chosen by personal
6
- preference or project requirements.
7
-
8
- Background:
9
- Given SimpleCov for Test/Unit is configured with:
10
- """
11
- require 'simplecov'
12
- """
13
-
14
- Scenario: Inside start block
15
- Given a file named ".simplecov" with:
16
- """
17
- SimpleCov.start do
18
- add_filter 'test'
19
- command_name 'Config Test Runner'
20
- end
21
- """
22
-
23
- When I open the coverage report generated with `bundle exec rake test`
24
- Then I should see "4 files in total."
25
- And I should see "using Config Test Runner" within "#footer"
26
-
27
- Scenario: Inside start block, using instance var from outside
28
- Given a file named ".simplecov" with:
29
- """
30
- @filter = 'test'
31
- SimpleCov.start do
32
- add_filter @filter
33
- command_name 'Config Test Runner'
34
- end
35
- """
36
-
37
- When I open the coverage report generated with `bundle exec rake test`
38
- Then I should see "4 files in total."
39
- And I should see "using Config Test Runner" within "#footer"
40
-
41
- Scenario: Inside start block, using local var from outside
42
- Given a file named ".simplecov" with:
43
- """
44
- filter = 'test'
45
- SimpleCov.start do
46
- add_filter filter
47
- command_name 'Config Test Runner'
48
- end
49
- """
50
-
51
- When I open the coverage report generated with `bundle exec rake test`
52
- Then I should see "4 files in total."
53
- And I should see "using Config Test Runner" within "#footer"
54
-
55
- Scenario: Explicitly before start block
56
- Given a file named ".simplecov" with:
57
- """
58
- SimpleCov.add_filter 'test'
59
- SimpleCov.command_name 'Config Test Runner'
60
- SimpleCov.start
61
- """
62
-
63
- When I open the coverage report generated with `bundle exec rake test`
64
- Then I should see "4 files in total."
65
- And I should see "using Config Test Runner" within "#footer"
66
-
67
- Scenario: Explicitly after start block
68
- Given a file named ".simplecov" with:
69
- """
70
- SimpleCov.start
71
- SimpleCov.add_filter 'test'
72
- SimpleCov.command_name 'Config Test Runner'
73
- """
74
-
75
- When I open the coverage report generated with `bundle exec rake test`
76
- Then I should see "4 files in total."
77
- And I should see "using Config Test Runner" within "#footer"
78
-
79
- Scenario: Using configure block after start
80
- Given a file named ".simplecov" with:
81
- """
82
- SimpleCov.start
83
- SimpleCov.configure do
84
- add_filter 'test'
85
- command_name 'Config Test Runner'
86
- end
87
- """
88
-
89
- When I open the coverage report generated with `bundle exec rake test`
90
- Then I should see "4 files in total."
91
- And I should see "using Config Test Runner" within "#footer"
92
-
93
- Scenario: Using configure block before start
94
- Given a file named ".simplecov" with:
95
- """
96
- SimpleCov.configure do
97
- add_filter 'test'
98
- command_name 'Config Test Runner'
99
- end
100
- SimpleCov.start
101
- """
102
-
103
- When I open the coverage report generated with `bundle exec rake test`
104
- Then I should see "4 files in total."
105
- And I should see "using Config Test Runner" within "#footer"
106
-
107
- Scenario: Mixing configure and start block config
108
- Given a file named ".simplecov" with:
109
- """
110
- SimpleCov.configure do
111
- command_name 'Config Test Runner'
112
- end
113
- SimpleCov.start do
114
- add_filter 'test'
115
- end
116
- """
117
-
118
- When I open the coverage report generated with `bundle exec rake test`
119
- Then I should see "4 files in total."
120
- And I should see "using Config Test Runner" within "#footer"
121
-
@@ -1,29 +0,0 @@
1
- @cucumber
2
- Feature:
3
-
4
- Simply adding the basic simplecov lines to a project should get
5
- the user a coverage report after running `cucumber features`
6
-
7
- Scenario:
8
- Given SimpleCov for Cucumber is configured with:
9
- """
10
- require 'simplecov'
11
- SimpleCov.start
12
- """
13
-
14
- When I open the coverage report generated with `bundle exec cucumber features`
15
- Then I should see the groups:
16
- | name | coverage | files |
17
- | All Files | 91.23% | 6 |
18
-
19
- And I should see the source files:
20
- | name | coverage |
21
- | lib/faked_project.rb | 100.0 % |
22
- | lib/faked_project/some_class.rb | 80.0 % |
23
- | lib/faked_project/framework_specific.rb | 75.0 % |
24
- | lib/faked_project/meta_magic.rb | 100.0 % |
25
- | features/step_definitions/my_steps.rb | 100.0 % |
26
- | features/support/simplecov_config.rb | 100.0 % |
27
-
28
- And the report should be based upon:
29
- | Cucumber Features |
@@ -1,36 +0,0 @@
1
- @test_unit @config
2
- Feature:
3
-
4
- Exit code should be non-zero if the overall coverage decreases by more than
5
- the maximum_coverage_drop threshold.
6
-
7
- Scenario:
8
- Given SimpleCov for Test/Unit is configured with:
9
- """
10
- require 'simplecov'
11
- SimpleCov.start do
12
- add_filter 'test.rb'
13
- maximum_coverage_drop 3.14
14
- end
15
- """
16
-
17
- When I run `bundle exec rake test`
18
- Then the exit status should be 0
19
- And a file named "coverage/.last_run.json" should exist
20
-
21
- Given a file named "lib/faked_project/missed.rb" with:
22
- """
23
- class UncoveredSourceCode
24
- def foo
25
- never_reached
26
- rescue => err
27
- but no one cares about invalid ruby here
28
- end
29
- end
30
- """
31
-
32
- When I run `bundle exec rake test`
33
- Then the exit status should not be 0
34
- And the output should contain "Coverage has dropped by 3.32% since the last time (maximum allowed: 3.14%)."
35
- And a file named "coverage/.last_run.json" should exist
36
-
@@ -1,44 +0,0 @@
1
- @test_unit @rspec @merging
2
- Feature:
3
-
4
- Test suites like RSpec and Test/Unit should be merged automatically
5
- when both have been run recently. The coverage report will feature
6
- the joined results of all test suites that are using SimpleCov.
7
-
8
- Scenario:
9
- Given SimpleCov for Test/Unit is configured with:
10
- """
11
- require 'simplecov'
12
- SimpleCov.start do
13
- add_filter 'test.rb'
14
- add_filter 'spec.rb'
15
- end
16
- """
17
- And SimpleCov for RSpec is configured with:
18
- """
19
- require 'simplecov'
20
- SimpleCov.start do
21
- add_filter 'test.rb'
22
- add_filter 'spec.rb'
23
- end
24
- """
25
-
26
- When I open the coverage report generated with `bundle exec rake test`
27
- Then the report should be based upon:
28
- | Unit Tests |
29
-
30
- When I open the coverage report generated with `bundle exec rspec spec`
31
- Then the report should be based upon:
32
- | RSpec |
33
- | Unit Tests |
34
-
35
- And I should see the groups:
36
- | name | coverage | files |
37
- | All Files | 90.48% | 4 |
38
-
39
- And I should see the source files:
40
- | name | coverage |
41
- | lib/faked_project.rb | 100.0 % |
42
- | lib/faked_project/some_class.rb | 80.0 % |
43
- | lib/faked_project/framework_specific.rb | 87.5 % |
44
- | lib/faked_project/meta_magic.rb | 100.0 % |
@@ -1,59 +0,0 @@
1
- @test_unit @config
2
- Feature:
3
-
4
- Exit code should be non-zero if the overall coverage is below the
5
- minimum_coverage threshold.
6
-
7
- Scenario:
8
- Given SimpleCov for Test/Unit is configured with:
9
- """
10
- require 'simplecov'
11
- SimpleCov.start do
12
- add_filter 'test.rb'
13
- minimum_coverage 90
14
- end
15
- """
16
-
17
- When I run `bundle exec rake test`
18
- Then the exit status should not be 0
19
- And the output should contain "Coverage (88.10%) is below the expected minimum coverage (90.00%)."
20
-
21
- Scenario:
22
- Given SimpleCov for Test/Unit is configured with:
23
- """
24
- require 'simplecov'
25
- SimpleCov.start do
26
- add_filter 'test.rb'
27
- minimum_coverage 88.11
28
- end
29
- """
30
-
31
- When I run `bundle exec rake test`
32
- Then the exit status should not be 0
33
- And the output should contain "Coverage (88.10%) is below the expected minimum coverage (88.11%)."
34
-
35
- Scenario:
36
- Given SimpleCov for Test/Unit is configured with:
37
- """
38
- require 'simplecov'
39
- SimpleCov.start do
40
- add_filter 'test.rb'
41
- minimum_coverage 88.10
42
- end
43
- """
44
-
45
- When I run `bundle exec rake test`
46
- Then the exit status should be 0
47
-
48
- Scenario:
49
- Given SimpleCov for Test/Unit is configured with:
50
- """
51
- require 'simplecov'
52
- SimpleCov.start do
53
- add_filter 'test.rb'
54
- end
55
- """
56
-
57
- When I run `bundle exec rake test`
58
- Then the exit status should be 0
59
-
@@ -1,35 +0,0 @@
1
- @test_unit @config
2
- Feature:
3
-
4
- Exit code should be non-zero if the overall coverage decreases.
5
-
6
- Scenario:
7
- Given SimpleCov for Test/Unit is configured with:
8
- """
9
- require 'simplecov'
10
- SimpleCov.start do
11
- add_filter 'test.rb'
12
- refuse_coverage_drop
13
- end
14
- """
15
-
16
- When I run `bundle exec rake test`
17
- Then the exit status should be 0
18
- And a file named "coverage/.last_run.json" should exist
19
-
20
- Given a file named "lib/faked_project/missed.rb" with:
21
- """
22
- class UncoveredSourceCode
23
- def foo
24
- never_reached
25
- rescue => err
26
- but no one cares about invalid ruby here
27
- end
28
- end
29
- """
30
-
31
- When I run `bundle exec rake test`
32
- Then the exit status should not be 0
33
- And the output should contain "Coverage has dropped by 3.32% since the last time (maximum allowed: 0.00%)."
34
- And a file named "coverage/.last_run.json" should exist
35
-
@@ -1,31 +0,0 @@
1
- @rspec
2
- Feature:
3
-
4
- Simply adding the basic simplecov lines to a project should get
5
- the user a coverage report after running `rspec`
6
-
7
- Scenario:
8
- Given SimpleCov for RSpec is configured with:
9
- """
10
- require 'simplecov'
11
- SimpleCov.start
12
- """
13
-
14
- When I open the coverage report generated with `bundle exec rspec spec`
15
- Then I should see the groups:
16
- | name | coverage | files |
17
- | All Files | 90.74% | 6 |
18
-
19
- And I should see the source files:
20
- | name | coverage |
21
- | lib/faked_project.rb | 100.0 % |
22
- | lib/faked_project/some_class.rb | 80.0 % |
23
- | lib/faked_project/framework_specific.rb | 75.0 % |
24
- | lib/faked_project/meta_magic.rb | 100.0 % |
25
- | spec/meta_magic_spec.rb | 100.0 % |
26
- | spec/some_class_spec.rb | 100.0 % |
27
-
28
- # Note: faked_spec.rb is not appearing here since that's the first unit test file
29
- # loaded by Rake, and only there test_helper is required, which then loads simplecov
30
- # and triggers tracking of all other loaded files! Solution for this would be to
31
- # configure simplecov in this first test instead of test_helper.
@@ -1,14 +0,0 @@
1
- @rspec
2
- Feature:
3
-
4
- Running specs with a failing rspec setup
5
-
6
- Scenario: Fail if rspec fails before starting its tests
7
- Given a file named "spec/spec_helper.rb" with:
8
- """
9
- require 'simplecov'
10
- SimpleCov.start
11
- raise "some exception in the class loading before the tests start"
12
- """
13
- When I run `bundle exec rspec spec`
14
- Then the exit status should not be 0