coverband 5.0.0.rc.8 → 5.0.0
Sign up to get free protection for your applications and to get access to all the features.
- checksums.yaml +4 -4
- data/README.md +61 -49
- data/changes.md +4 -0
- data/lib/coverband/reporters/console_report.rb +2 -8
- data/lib/coverband/version.rb +1 -1
- data/test/coverband/reporters/web_test.rb +2 -2
- data/views/nav.erb +2 -2
- data/views/settings.erb +2 -2
- metadata +4 -4
checksums.yaml
CHANGED
@@ -1,7 +1,7 @@
|
|
1
1
|
---
|
2
2
|
SHA256:
|
3
|
-
metadata.gz:
|
4
|
-
data.tar.gz:
|
3
|
+
metadata.gz: f73e90b7f1451c8f7a47355b680b361fa96e7ab665c1b135282e1cf2f87db8ac
|
4
|
+
data.tar.gz: e0bd9b0e10bd500dcb814091a048902e4123fa09a3532e8bffb7108cf69bea53
|
5
5
|
SHA512:
|
6
|
-
metadata.gz:
|
7
|
-
data.tar.gz:
|
6
|
+
metadata.gz: 67e8d3f7f1c925f030b828eb4a4b37a1b35e887341da8cc6956d4c84ec71cb2a31395f656d48ad3d1782e81404624ae95604a4d0198af4cef2e2c43fc7e08578
|
7
|
+
data.tar.gz: 3d4a7456beb6adfa1e6eeec4bacb35ef4f3b3a25049b9540b603e5f9bcd65aba1d370c1cbf446c7835106d8ccc536209fbdc74f77949847e91262cdffa0c715c
|
data/README.md
CHANGED
@@ -10,7 +10,7 @@
|
|
10
10
|
<p align="center">
|
11
11
|
<a href="#key-features">Key Features</a> •
|
12
12
|
<a href="#installation">Installation</a> •
|
13
|
-
<a href="#
|
13
|
+
<a href="#coverband-web-ui">Coverband Web UI</a> •
|
14
14
|
<a href="#advanced-config">Advanced Config</a> •
|
15
15
|
<a href="#license">License</a> •
|
16
16
|
<a href="/changes.md">Change Log / Roadmap</a> •
|
@@ -28,7 +28,7 @@ The primary goal of Coverband is giving deep insight into your production runtim
|
|
28
28
|
- Low performance overhead
|
29
29
|
- Simple setup and configuration
|
30
30
|
- Out of the box support for all standard code execution paths (web, cron, background jobs, rake tasks, etc)
|
31
|
-
- Splits load time (Rails eager load) and
|
31
|
+
- Splits load time (Rails eager load) and runtime metrics
|
32
32
|
- Easy to understand actionable insights from the report
|
33
33
|
- Development mode, offers deep insight of code usage details (number of LOC execution during single request, etc) during development.
|
34
34
|
- Mountable web interface to easily share reports
|
@@ -41,7 +41,7 @@ Coverband stores coverage data in Redis. The Redis endpoint is looked for in thi
|
|
41
41
|
|
42
42
|
1. `ENV['COVERBAND_REDIS_URL']`
|
43
43
|
2. `ENV['REDIS_URL']`
|
44
|
-
3. `localhost`
|
44
|
+
3. `localhost:6379`
|
45
45
|
|
46
46
|
The redis store can also be explicitly defined within the coverband.rb. See [advanced config](#advanced-config).
|
47
47
|
|
@@ -53,8 +53,6 @@ Add this line to your application's `Gemfile`, remember to `bundle install` afte
|
|
53
53
|
gem 'coverband'
|
54
54
|
```
|
55
55
|
|
56
|
-
## Upgrading to Latest
|
57
|
-
|
58
56
|
### No custom code or middleware required
|
59
57
|
|
60
58
|
With older versions of coverband, projects would report to redis using rack or sidekiq middleware. After coverband 4.0, this should no longer be required and could cause performance issues. Reporting to redis is now automatically done within a background thread with no custom code needed.
|
@@ -67,7 +65,7 @@ The Railtie integration means you shouldn't need to do anything else other than
|
|
67
65
|
|
68
66
|
## Sinatra
|
69
67
|
|
70
|
-
For the best coverage you want this loaded as early as possible.
|
68
|
+
For the best coverage you want this loaded as early as possible. We recommend requiring cover band directly in the `config.ru`. Requiring coverband within an initializer could also work, but you may end up missing some boot up coverage. To start collection require Coverband as early as possible.
|
71
69
|
|
72
70
|
```ruby
|
73
71
|
require 'coverband'
|
@@ -77,7 +75,33 @@ use Coverband::BackgroundMiddleware
|
|
77
75
|
run ActionController::Dispatcher.new
|
78
76
|
```
|
79
77
|
|
80
|
-
|
78
|
+
## Coverband Web UI
|
79
|
+
|
80
|
+
![image](https://raw.github.com/danmayer/coverband/master/docs/coverband_web_ui.png)
|
81
|
+
|
82
|
+
> The web index as available on the [Coverband Demo site](https://coverband-demo.herokuapp.com/coverage?#_Coverage)
|
83
|
+
|
84
|
+
- View overall coverage information
|
85
|
+
|
86
|
+
- Drill into individual file coverage
|
87
|
+
|
88
|
+
- View individual file details
|
89
|
+
|
90
|
+
- Clear Coverage - disabled by default as it could be considered a dangerous operation in production. Enable with `config.web_enable_clear` or leave off and clear from [rake task](#clear-coverage).
|
91
|
+
|
92
|
+
- Clear coverage report
|
93
|
+
|
94
|
+
This will clear the coverage data. This wipes out all collected data.
|
95
|
+
|
96
|
+
- Clear individual file coverage
|
97
|
+
|
98
|
+
This will clear the details of the file you are looking at. This is helpful if you don't want to lose all Coverage data but made a change that you expect would impact a particular file.
|
99
|
+
|
100
|
+
- Force coverage collection
|
101
|
+
|
102
|
+
This triggers coverage collection on the current webserver process. Useful in development but confusing in production environments where many ruby processes are usually running.
|
103
|
+
|
104
|
+
### Mounting as a Rack App
|
81
105
|
|
82
106
|
Coverband comes with a mountable rack app for viewing reports. For Rails this can be done in `config/routes.rb` with:
|
83
107
|
|
@@ -97,49 +121,23 @@ Rails.application.routes.draw do
|
|
97
121
|
end
|
98
122
|
```
|
99
123
|
|
100
|
-
or you can enable basic auth by setting `ENV['COVERBAND_PASSWORD']` or via your configuration `config.password =
|
124
|
+
or you can enable basic auth by setting `ENV['COVERBAND_PASSWORD']` or via your configuration `config.password = <YOUR_COMPLEX_UNGUESSABLE_PASSWORD>`
|
101
125
|
|
102
|
-
###
|
126
|
+
### Standalone
|
103
127
|
|
104
|
-
The
|
128
|
+
The coverage server can also be started standalone with a rake task:
|
105
129
|
|
106
|
-
|
107
|
-
|
108
|
-
|
109
|
-
|
110
|
-
- **force coverage collection:** This triggers coverage collection on the current webserver process
|
111
|
-
- **clear coverage report:** This will clear the coverage data. This wipes out all collected data (**dangerous**)
|
112
|
-
- View individual file details
|
113
|
-
- **clear individual file coverage:** This will clear the details of the file you are looking at. This is helpful if you don't want to lose all Coverage data but made a change that you expect would impact a particular file.
|
114
|
-
|
115
|
-
### JRuby Support
|
116
|
-
|
117
|
-
Coverband is compatible with JRuby. If you want to run on JRuby note that I haven't benchmarked and I believe the perf impact on older versions of JRuby could be significant, improved Coverage support is in [JRuby master](https://github.com/jruby/jruby/pull/6180), and will be in the next release.
|
118
|
-
|
119
|
-
- older versions of JRuby need tracing enabled to work (and this could cause bad performance)
|
120
|
-
- run Jruby with the `--debug` option
|
121
|
-
- add into your `.jrubyrc` the `debug.fullTrace=true` setting
|
122
|
-
- For best performance the `oneshot_lines` is recommended, and in the latest releases should have very low overhead
|
123
|
-
- See JRuby support in a Rails app configured to run via JRuby, in [Coverband Demo](https://github.com/coverband-service/coverband_demo)
|
124
|
-
- JRuby is tested via CI against Rails 5 and 6
|
125
|
-
|
126
|
-
### Rake Tasks
|
127
|
-
|
128
|
-
The rake task generates a report locally and opens a browser pointing to `coverage/index.html`.
|
129
|
-
|
130
|
-
`rake coverband:coverage`
|
131
|
-
|
132
|
-
This is mostly useful in your local development environment.
|
133
|
-
|
134
|
-
##### Example Output
|
130
|
+
```
|
131
|
+
bundle exec rake coverband:coverage_server
|
132
|
+
```
|
135
133
|
|
136
|
-
|
134
|
+
The web UI should then be available here: http://localhost:1022/
|
137
135
|
|
138
|
-
|
139
|
-
![image](https://raw.github.com/danmayer/coverband/master/docs/coverband_index.png)
|
136
|
+
This is especially useful for projects that are api only and cannot support the mounted rack app. To get production coverage, point coverband at your production redis server and ensure to checkout the production version of your project code locally.
|
140
137
|
|
141
|
-
|
142
|
-
|
138
|
+
```
|
139
|
+
COVERBAND_REDIS_URL=redis://username:password:redis_production_server:2322 bundle exec rake coverband:coverage_server
|
140
|
+
```
|
143
141
|
|
144
142
|
# Coverband Demo
|
145
143
|
|
@@ -245,7 +243,7 @@ end
|
|
245
243
|
|
246
244
|
### Avoiding Cache Stampede
|
247
245
|
|
248
|
-
If you have many servers and they all hit Redis at the same time you can see spikes in your Redis CPU, and memory. This is do to a concept called [cache stampede](https://en.wikipedia.org/wiki/Cache_stampede). It is better to spread out the reporting across your servers. A simple way to do this is to add a random wiggle on your background reporting. This configuration option allows a wiggle. The right amount of wiggle depends on the numbers of servers you have and how willing you are to have delays in your coverage reporting. I would recommend at least 1 second per server.
|
246
|
+
If you have many servers and they all hit Redis at the same time you can see spikes in your Redis CPU, and memory. This is do to a concept called [cache stampede](https://en.wikipedia.org/wiki/Cache_stampede). It is better to spread out the reporting across your servers. A simple way to do this is to add a random wiggle on your background reporting. This configuration option allows a wiggle. The right amount of wiggle depends on the numbers of servers you have and how willing you are to have delays in your coverage reporting. I would recommend at least 1 second per server. Note, the default wiggle is set to 30 seconds.
|
249
247
|
|
250
248
|
Add a wiggle (in seconds) to the background thread to avoid all your servers reporting at the same time:
|
251
249
|
|
@@ -253,11 +251,12 @@ Add a wiggle (in seconds) to the background thread to avoid all your servers rep
|
|
253
251
|
|
254
252
|
### Redis Hash Store
|
255
253
|
|
256
|
-
Coverband on very high volume sites with many server processes reporting can have a race condition. To resolve the race condition and reduce Ruby memory overhead we have introduced a new Redis storage option. This moves the some of the work from the Ruby processes to Redis. It is worth noting because of this, it has a larger demands on the Redis server. So adjust your Redis instance accordingly. To help reduce the extra redis load you can also change the background reporting
|
254
|
+
Coverband on very high volume sites with many server processes reporting can have a race condition which can cause hit counts to be inaccurate. To resolve the race condition and reduce Ruby memory overhead we have introduced a new Redis storage option. This moves the some of the work from the Ruby processes to Redis. It is worth noting because of this, it has a larger demands on the Redis server. So adjust your Redis instance accordingly. To help reduce the extra redis load you can also change the background reporting frequency.
|
257
255
|
|
258
|
-
-
|
259
|
-
-
|
260
|
-
|
256
|
+
- Use a dedicated coverband redis instance: `config.store = Coverband::Adapters::HashRedisStore.new(Redis.new(url: redis_url))`
|
257
|
+
- Adjust from default 30s reporting `config.background_reporting_sleep_seconds = 120`
|
258
|
+
|
259
|
+
See more discussion [here](https://github.com/danmayer/coverband/issues/384).
|
261
260
|
|
262
261
|
### Clear Coverage
|
263
262
|
|
@@ -265,6 +264,8 @@ Now that Coverband uses MD5 hashes there should be no reason to manually clear c
|
|
265
264
|
|
266
265
|
`rake coverband:clear`
|
267
266
|
|
267
|
+
This can also be done through the web if `config.web_enable_clear` is enabled.
|
268
|
+
|
268
269
|
### Coverage Data Migration
|
269
270
|
|
270
271
|
Between the release of 4.0 and 4.1 our data format changed. This resets all your coverage data. If you want to restore your previous coverage data, feel free to migrate.
|
@@ -339,6 +340,17 @@ We will match Heroku & Ruby's support lifetime, supporting the last 3 major Ruby
|
|
339
340
|
|
340
341
|
For Rails, we will follow the policy of the [Rails team maintenance policy](https://guides.rubyonrails.org/maintenance_policy.html). We officially support the last two major release versions, while providing minimal support (major bugs / security fixes) for an additional version. This means at the moment we primaryly target Rails 6.x, 5.x, and will try to keep current functionality working for Rails 4.x but may release new features that do not work on that target.
|
341
342
|
|
343
|
+
### JRuby Support
|
344
|
+
|
345
|
+
Coverband is compatible with JRuby. If you want to run on JRuby note that I haven't benchmarked and I believe the perf impact on older versions of JRuby could be significant. Improved Coverage support is in [JRuby master](https://github.com/jruby/jruby/pull/6180), and will be in the next release.
|
346
|
+
|
347
|
+
- older versions of JRuby need tracing enabled to work (and this could cause bad performance)
|
348
|
+
- run Jruby with the `--debug` option
|
349
|
+
- add into your `.jrubyrc` the `debug.fullTrace=true` setting
|
350
|
+
- For best performance the `oneshot_lines` is recommended, and in the latest releases should have very low overhead
|
351
|
+
- See JRuby support in a Rails app configured to run via JRuby, in [Coverband Demo](https://github.com/coverband-service/coverband_demo)
|
352
|
+
- JRuby is tested via CI against Rails 5 and 6
|
353
|
+
|
342
354
|
# Contributing To Coverband
|
343
355
|
|
344
356
|
If you are working on adding features, PRs, or bugfixes to Coverband this section should help get you going.
|
data/changes.md
CHANGED
@@ -66,12 +66,16 @@ Will be the fully modern release that drops maintenance legacy support in favor
|
|
66
66
|
- all config options can be set via coverband config, not requiring ENV var support
|
67
67
|
- deprecation notices on soon to be removed config options
|
68
68
|
- config exceptions on invalid configuration combinations
|
69
|
+
- additional testing around configurations
|
70
|
+
- improved defaults and reduced configuration options
|
69
71
|
- improved resque patching pattern
|
70
72
|
- improved default ignores
|
71
73
|
- additional adapters
|
72
74
|
- supports web-service adapter for http coverage collection
|
73
75
|
- support log/file adapter
|
76
|
+
- extendable pattern to support any additional backends
|
74
77
|
- reduce logs / errors / alerts on bad startup configurations
|
78
|
+
- fix: #301 runtime vs eagerload should always remain correct
|
75
79
|
|
76
80
|
# Released
|
77
81
|
|
@@ -8,14 +8,8 @@ module Coverband
|
|
8
8
|
class ConsoleReport < Base
|
9
9
|
def self.report(store, options = {})
|
10
10
|
scov_style_report = super(store, options)
|
11
|
-
|
12
|
-
|
13
|
-
# TODO: In Coverband 5 deprecate none hash format
|
14
|
-
if usage.is_a?(Hash)
|
15
|
-
Coverband.configuration.logger.info "#{file}: #{usage["data"]}"
|
16
|
-
else
|
17
|
-
Coverband.configuration.logger.info "#{file}: #{usage}"
|
18
|
-
end
|
11
|
+
scov_style_report[:merged].each_pair do |file, usage|
|
12
|
+
Coverband.configuration.logger.info "#{file}: #{usage["data"]}"
|
19
13
|
end
|
20
14
|
scov_style_report
|
21
15
|
end
|
data/lib/coverband/version.rb
CHANGED
@@ -22,13 +22,13 @@ if Gem::Version.new(RUBY_VERSION) >= Gem::Version.new("2.2.0")
|
|
22
22
|
test "renders index content" do
|
23
23
|
get "/"
|
24
24
|
assert last_response.ok?
|
25
|
-
assert_match "Coverband
|
25
|
+
assert_match "Coverband Home", last_response.body
|
26
26
|
end
|
27
27
|
|
28
28
|
test "renders index content for empty path" do
|
29
29
|
get ""
|
30
30
|
assert last_response.ok?
|
31
|
-
assert_match "Coverband
|
31
|
+
assert_match "Coverband Home", last_response.body
|
32
32
|
end
|
33
33
|
|
34
34
|
test "renders 404" do
|
data/views/nav.erb
CHANGED
@@ -1,7 +1,7 @@
|
|
1
1
|
|
2
2
|
<div id="header">
|
3
|
-
<a href='<%= base_path %>'>Coverband
|
4
|
-
<a href='<%= base_path %>settings'>
|
3
|
+
<a href='<%= base_path %>'>Coverband Home</a>
|
4
|
+
<a href='<%= base_path %>settings'>Configuration</a>
|
5
5
|
<% if Coverband.configuration.web_enable_clear %>
|
6
6
|
<%= button("#{base_path}clear", 'clear coverage report', delete: true) %>
|
7
7
|
<% end %>
|
data/views/settings.erb
CHANGED
@@ -11,8 +11,8 @@
|
|
11
11
|
<body>
|
12
12
|
<div id="wrapper" style="">
|
13
13
|
<div id="header">
|
14
|
-
<a href='<%= base_path %>'>Coverband
|
15
|
-
<a href='<%= base_path %>settings'>
|
14
|
+
<a href='<%= base_path %>'>Coverband Home</a>
|
15
|
+
<a href='<%= base_path %>settings'>Configuration</a>
|
16
16
|
</div>
|
17
17
|
<div id="content">
|
18
18
|
<dl>
|
metadata
CHANGED
@@ -1,7 +1,7 @@
|
|
1
1
|
--- !ruby/object:Gem::Specification
|
2
2
|
name: coverband
|
3
3
|
version: !ruby/object:Gem::Version
|
4
|
-
version: 5.0.0
|
4
|
+
version: 5.0.0
|
5
5
|
platform: ruby
|
6
6
|
authors:
|
7
7
|
- Dan Mayer
|
@@ -9,7 +9,7 @@ authors:
|
|
9
9
|
autorequire:
|
10
10
|
bindir: bin
|
11
11
|
cert_chain: []
|
12
|
-
date: 2020-08-
|
12
|
+
date: 2020-08-30 00:00:00.000000000 Z
|
13
13
|
dependencies:
|
14
14
|
- !ruby/object:Gem::Dependency
|
15
15
|
name: benchmark-ips
|
@@ -462,9 +462,9 @@ required_ruby_version: !ruby/object:Gem::Requirement
|
|
462
462
|
version: '0'
|
463
463
|
required_rubygems_version: !ruby/object:Gem::Requirement
|
464
464
|
requirements:
|
465
|
-
- - "
|
465
|
+
- - ">="
|
466
466
|
- !ruby/object:Gem::Version
|
467
|
-
version:
|
467
|
+
version: '0'
|
468
468
|
requirements: []
|
469
469
|
rubygems_version: 3.1.2
|
470
470
|
signing_key:
|