coverband 4.2.3 → 4.2.4

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 0f5ee08a6ec38b97538430db828645f0aab7736c8c51946fea8c44f871c6a4a9
-  data.tar.gz: 733933d77d75e9e50c09a282f87da2b7cd3b09db9e24679b0267f384ba034c0f
+  metadata.gz: 1c094b4a6ef2b76f771cb96aa1fbdc246dc8beea74033ffca4cb466ef96c0a08
+  data.tar.gz: 1162d9244c0e1a1b28c0fa051d7cd53d29b6a4fdfc50c1fadb7d6793229aaf8b
 SHA512:
-  metadata.gz: 68117ba4c4d9dbc9370187e2a31f3b916a0368cb46b915eb7f3e189f1c7bb4f5699d972e176d9a138d999ca59a50e2817658767ccb803f2726dd3fd3f8ff31b4
-  data.tar.gz: bffb9453d31c0c93ec6706a2c426a6835b713dfc1000c50e030c252a25bd7abdedd95f41622dfc309420aa27276b19afb44cec81a5e2ec20abc35b1768f71541
+  metadata.gz: d9eba70b91d87992d1e450490f7fd4545cccb5092bf093c424c51b964cb4b31ad5c8a1d49d1cc774ce6470c6466b7d3b7a7a1df92ecbc4e574a203467f621b55
+  data.tar.gz: 815c462d38f7a27b26f5d209044c53b2e0058c4ea2534db3f6663a267ad0cc435bd6c895128c5ea8f85c0aec61e4e31d9f61c426526b71423e24c941852f74be

data/.rubocop.yml

@@ -1,17 +1,18 @@
 AllCops:
   TargetRubyVersion: 2.4
   Exclude:
+    - vendor/bundle/**/*
     - docs/**/*
     - test/rails4_dummy/**/*
     - test/rails5_dummy/**/*
     - test/fixtures/**/*
     # Get the code passing first then we will enable for tests
-    - test/**/*
+    - test/**/*    
 Documentation:
   Enabled: false
 Metrics/MethodLength:
   Enabled: false
-Metrics/LineLength:
+Layout/LineLength:
   Max: 160
 Metrics/BlockNesting:
   Max: 5
@@ -31,6 +32,8 @@ Metrics/ParameterLists:
   Max: 10
 Naming/AccessorMethodName:
   Enabled: false
+Naming/RescuedExceptionsVariableName:
+  Enabled: false
 Naming/PredicateName:
   Enabled: true
 Style/TernaryParentheses:
@@ -59,10 +62,6 @@ Style/SymbolProc:
   Enabled: false
 Style/RegexpLiteral:
   Enabled: false
-Performance/Casecmp:
-  Enabled: false
-Performance/RegexpMatch:
-  Enabled: false
 Layout/MultilineMethodCallIndentation:
   Enabled: true
 Layout/MultilineOperationIndentation:

data/.travis.yml

@@ -4,12 +4,18 @@ rvm:
   - "2.4"
   - "2.5"
   - "2.6.1"
+cache:
+  bundler: true
+  directories:
+  - $HOME/lua51
 gemfile:
   - Gemfile
   - Gemfile.rails4
 services:
   - redis-server
 script:
+  - sudo ./lua/install.sh 
+  - $HOME/lua51/bin/busted lua/test/*
   - bundle exec rake rubocop
   - COVERBAND_HASH_REDIS_STORE=t bundle exec rake
   - COVERBAND_HASH_REDIS_STORE=t bundle exec rake forked_tests

data/README.md

@@ -67,7 +67,7 @@ See [changelog](https://github.com/danmayer/coverband/blob/master/changes.md).
 
 ## Rails
 
-The Railtie integration means you shouldn't need to do anything anything else other than ensure coverband is required after rails within your Gemfile. The only exception to this is gem tracking of `Bundle.require` which depends on requiring coverband within the application.rb. See [Collecting Gem / Library Usage](https://github.com/danmayer/coverband#collecting-gem--library-usage).
+The Railtie integration means you shouldn't need to do anything else other than ensure coverband is required after rails within your Gemfile. The only exception to this is gem tracking of `Bundle.require` which depends on requiring coverband within the application.rb. See [Collecting Gem / Library Usage](https://github.com/danmayer/coverband#collecting-gem--library-usage).
 
 ## Sinatra
 
@@ -114,7 +114,7 @@ The web endpoint is a barebones endpoint that you can either expose direct (afte
 - **force coverage collection:** This triggers coverage collection on the current webserver process
 - **clear coverage report:** This will clear the coverage data. This wipes out all collected data (**dangerous**)
 - View individual file details
-- **clear individual file coverage:** This will clear the details of the file you are looking at. This is helpful if you don't want to loose all Coverage data but made a change that you expect would impact a particular file.
+- **clear individual file coverage:** This will clear the details of the file you are looking at. This is helpful if you don't want to lose all Coverage data but made a change that you expect would impact a particular file.
 
 ### Rake Tasks
 
@@ -169,9 +169,29 @@ Coverband.configure do |config|
   # and is safe to use if one is investigating issues in production, but it will slightly
   # hit perf.
   config.verbose = false
+
+  # default false. button at the top of the web interface which clears all data
+  config.web_enable_clear = true
+
+  # default false. Experimental support for tracking view layer tracking.
+  # Does not track line-level usage, only indicates if an entire file
+  # is used or not.
+  config.track_views = true
 end
 ```
 
+### Working with environment variables
+
+Do you use figaro, mc-settings, dotenv or something else to inject environment variables into your app? If so ensure you have that done BEFORE coverband is required. 
+
+For example if you use dotenv, you need to do this, see https://github.com/bkeepers/dotenv#note-on-load-order
+
+```
+gem 'dotenv-rails', require: 'dotenv/rails-now'
+gem 'coverband'
+gem 'other-gem-that-requires-env-variables'
+```
+
 ### Ignoring Files
 
 Sometimes you have files that are known to be valuable perhaps in other environments or something that is just run very infrequently. Opposed to having to mentally filter them out of the report, you can just have them ignored in the Coverband reporting by using `config.ignore` as shown below. Ignore takes a string but can also match with regex rules see how below ignores all rake tasks as an example.
@@ -185,6 +205,7 @@ config.ignore +=  ['config/application.rb',
                    'config/environments/*',
                    'lib/tasks/*']
 ```
+
 ### View Tracking
 
 Coverband allows an optional feature to track all view files that are used by an application.
@@ -216,6 +237,14 @@ ENV['AWS_ACCESS_KEY_ID']
 ENV['AWS_SECRET_ACCESS_KEY']
 ```
 
+### Avoiding Cache Stampede
+
+If you have many servers and they all hit Redis at the same time you can see spikes in your Redis CPU, and memory. This is do to a concept called [cache stampede](https://en.wikipedia.org/wiki/Cache_stampede). It is better to spread out the reporting across your servers. A simple way to do this is to add a random wiggle on your background reporting. This configuration option allows a wiggle. The right amount of wiggle depends on the numbers of servers you have and how willing you are to have delays in your coverage reporting. I would recommend at least 1 second per server. 
+
+Add a wiggle (in seconds) to the background thread to avoid all your servers reporting at the same time:
+
+`config.reporting_wiggle = 30`
+
 ### Redis Hash Store
 
 Coverband on very high volume sites with many server processes reporting can have a race condition. To resolve the race condition and reduce Ruby memory overhead we have introduced a new Redis storage option. This moves the some of the work from the Ruby processes to Redis. It is worth noting because of this, it has a larger demands on the Redis server. So adjust your Redis instance accordingly. To help reduce the extra redis load you can also change the background reporting time period. 
@@ -258,22 +287,6 @@ rake coverband:clear         # reset coverband coverage data
 rake coverband:coverage      # report runtime coverband code coverage
 ```
 
-### Forcing Coverband to Track Coverage on files loaded during boot `safe_reload_files`
-
-Coverband will report code usage for anything `required` or `loaded` after calling `Coverband.start` which happens automatically when coverband is required. This means some of the files loaded before coverband such as the Rails application.rb will be reported as having no coverage.
-
-The `safe_reload_files` reload option in the configuration options can help to ensure you can track any files regardless of loading before Coverband. For example if I wanted to show the coverage of `config/coverband.rb`, which has to be loaded before calling `Coverband.start`, I could do that by adding that path to the `safe_reload_files` option.
-
-```
-Coverband.configure do |config|
-  # ... a bunch of other options
-  # using the new safe reload to enforce files loaded
-  config.safe_reload_files = ['config/coverband.rb']
-end
-```
-
-By adding any files above you will get reporting on those files as part of your coverage runtime report. The files are reloaded when Coverband first starts, you can also trigger a reload via the web interface.
-
 ### Collecting Gem / Library Usage
 
 __WARNING:__ Gem Tracking is still in experimental stages and not recommended for production. We have some performance issues when view reports on large applications. Gem tracing also during background thread data collection has HIGH memory requirements, during report merging (seemingly around 128mb of extra memory, which is crazy). We recommend deploying WITHOUT `track_gems` first and only enabling it after confirming that Coverband is working and performing well.
@@ -338,6 +351,12 @@ If you are trying to debug locally wondering what code is being run during a req
 - Coverband 3.0.X+ requires Ruby 2.3+
 - Coverband currently requires Redis for production usage
 
+### Ruby and Rails Version Support
+
+We will match Heroku & Ruby's support lifetime, supporting the last 3 major Ruby releases. For details see [supported runtimes](https://devcenter.heroku.com/articles/ruby-support#supported-runtimes). 
+
+For Rails, we will follow the policy of the [Rails team maintenance policy](https://guides.rubyonrails.org/maintenance_policy.html). We officially support the last two major release versions, while providing minimal support (major bugs / security fixes) for an additional version. This means at the moment we primaryly target Rails 6.x, 5.x, and will try to keep current functionality working for Rails 4.x but may release new features that do not work on that target.
+
 # Contributing To Coverband
 
 If you are working on adding features, PRs, or bugfixes to Coverband this section should help get you going.
@@ -363,9 +382,10 @@ If you submit a change please make sure the tests and benchmarks are passing.
 
 ### Known Issues
 
-- **total fail** on front end code, because of the precompiled template step basically coverage doesn't work well for `erb`, `slim`, and the like.
+- **total fail** on front end code, for line for line coverage, because of the precompiled template step basically coverage doesn't work well for `erb`, `slim`, and the like.
   - related it will try to report something, but the line numbers reported for `ERB` files are often off and aren't considered useful. I recommend filtering out .erb using the `config.ignore` option. The default configuration excludes these files
-- coverage doesn't show for Rails `config/application.rb` or `config/boot.rb` as they get loaded when loading the Rake environment prior to starting the `Coverage` library. See [reload files section](#forcing-coverband-to-track-coverage-on-files-loaded-during-boot-safe_reload_files).
+  - **NOTE:** We now have file level coverage for view files, but don't support line level detail
+  - The view file detection doesn't workf or mailers at the moment only for web related views / JSON templates. This is due to how Rails active mailer notifications work. 
 
 ### Debugging Redis Store
 

data/changes.md

@@ -76,19 +76,26 @@ Feature Ideas:
 
 # Alpha / Beta / Release Candidates
 
-### Coverband 4.2.2
+### Coverband 4.2.5
 
-- new experimental hash redis store for high volume collection
-(hundreds of clients), thanks @kbaum
-- view_tracker supports tracking view layer files like `.html.erb`
-- documentation improvements, thanks @brossetti1, @jjb, @kbaum
-- we now have discordapp for discussions, thanks @kbaum,
-https://discordapp.com/channels/609509533999562753/609509533999562756
-- perf fix on Rails initialization, thanks @skangg
-- simplified logging
+- ?
 
 # Released
 
+### Coverband 4.2.4
+
+- fixes related to startup without Redis, skipping Coverband on common rake tasks (assets:precompile), etc
+- avoid calls to redis if coverage not updated
+- split out lua work and added testing around lua scripts use for the hash redis store
+- improvements to hash redis store resulting in 25% faster perf
+- avoid duplicate hash calculations
+- debug data now includes md5_hashes
+- added support to download coverage and view data in JSON format
+- documentation about working with environment variables
+- add cache wiggle to avoid Redis CPU spikes (cache stampede on Redis server)
+- make the nocov consistant on the data download and html view
+- small performance improvements
+
 ### Coverband 4.2.3
 
 - readme fixes

data/coverband.gemspec

@@ -35,6 +35,7 @@ Gem::Specification.new do |spec|
   spec.add_development_dependency 'rake'
   spec.add_development_dependency 'resque'
   spec.add_development_dependency 'rubocop'
+  spec.add_development_dependency 'rubocop-performance'
 
   spec.add_development_dependency 'coveralls'
   # add when debugging

data/lib/coverband/adapters/base.rb

@@ -40,7 +40,7 @@ module Coverband
       end
 
       def size_in_mib
-        format('%.2f', (size.to_f / 2**20))
+        format('%<size>.2f', size: (size.to_f / 2**20))
       end
 
       def save_report(_report)

data/lib/coverband/adapters/hash_redis_store.rb

@@ -1,11 +1,13 @@
 # frozen_string_literal: true
 
+require 'securerandom'
+
 module Coverband
   module Adapters
     class HashRedisStore < Base
       FILE_KEY = 'file'
       FILE_LENGTH_KEY = 'file_length'
-      META_DATA_KEYS = [DATA_KEY, FIRST_UPDATED_KEY, LAST_UPDATED_KEY].freeze
+      META_DATA_KEYS = [DATA_KEY, FIRST_UPDATED_KEY, LAST_UPDATED_KEY, FILE_HASH].freeze
       ###
       # This key isn't related to the coverband version, but to the interal format
       # used to store data to redis. It is changed only when breaking changes to our
@@ -13,16 +15,19 @@ module Coverband
       ###
       REDIS_STORAGE_FORMAT_VERSION = 'coverband_hash_3_3'
 
+      JSON_PAYLOAD_EXPIRATION = 5 * 60
+
       attr_reader :redis_namespace
 
       def initialize(redis, opts = {})
         super()
         @redis_namespace = opts[:redis_namespace]
+        @save_report_batch_size = opts[:save_report_batch_size] || 100
         @format_version = REDIS_STORAGE_FORMAT_VERSION
         @redis = redis
         raise 'HashRedisStore requires redis >= 2.6.0' unless supported?
 
-        @ttl = opts[:ttl] || -1
+        @ttl = opts[:ttl]
         @relative_file_converter = opts[:relative_file_converter] || Utils::RelativeFileConverter
       end
 
@@ -53,13 +58,14 @@ module Coverband
       def save_report(report)
         report_time = Time.now.to_i
         updated_time = type == Coverband::EAGER_TYPE ? nil : report_time
-        script_id = hash_incr_script
-        @redis.pipelined do
-          keys = report.map do |file, data|
+        keys = []
+        report.each_slice(@save_report_batch_size) do |slice|
+          files_data = slice.map do |(file, data)|
             relative_file = @relative_file_converter.convert(file)
             file_hash = file_hash(relative_file)
             key = key(relative_file, file_hash: file_hash)
-            script_input = save_report_script_input(
+            keys << key
+            script_input(
               key: key,
               file: relative_file,
               file_hash: file_hash,
@@ -67,16 +73,24 @@ module Coverband
               report_time: report_time,
               updated_time: updated_time
             )
-            @redis.evalsha(script_id, script_input[:keys], script_input[:args])
-            key
           end
-          @redis.sadd(files_key, keys) if keys.any?
+          next unless files_data.any?
+
+          arguments_key = [@redis_namespace, SecureRandom.uuid].compact.join('.')
+          @redis.set(arguments_key, { ttl: @ttl, files_data: files_data }.to_json, ex: JSON_PAYLOAD_EXPIRATION)
+          @redis.evalsha(hash_incr_script, [arguments_key])
         end
+        @redis.sadd(files_key, keys) if keys.any?
       end
 
       def coverage(local_type = nil)
-        files_set(local_type).each_with_object({}) do |key, hash|
-          add_coverage_for_file(key, hash)
+        files_set = files_set(local_type)
+        @redis.pipelined do
+          files_set.map do |key|
+            @redis.hgetall(key)
+          end
+        end.each_with_object({}) do |data_from_redis, hash|
+          add_coverage_for_file(data_from_redis, hash)
         end
       end
 
@@ -94,9 +108,7 @@ module Coverband
 
       private
 
-      def add_coverage_for_file(key, hash)
-        data_from_redis = @redis.hgetall(key)
-
+      def add_coverage_for_file(data_from_redis, hash)
         return if data_from_redis.empty?
 
         file = data_from_redis[FILE_KEY]
@@ -116,38 +128,33 @@ module Coverband
         end
       end
 
-      def save_report_script_input(key:, file:, file_hash:, data:, report_time:, updated_time:)
-        data.each_with_index
-            .each_with_object(keys: [key], args: [report_time, updated_time, file, file_hash, @ttl, data.length]) do |(coverage, index), hash|
-          if coverage
-            hash[:keys] << index
-            hash[:args] << coverage
-          end
+      def script_input(key:, file:, file_hash:, data:, report_time:, updated_time:)
+        coverage_data = data.each_with_index.each_with_object({}) do |(coverage, index), hash|
+          hash[index] = coverage if coverage
         end
+        meta = {
+          first_updated_at: report_time,
+          file: file,
+          file_hash: file_hash,
+          file_length: data.length,
+          hash_key: key
+        }
+        meta[:last_updated_at] = updated_time if updated_time
+        {
+          hash_key: key,
+          meta: meta,
+          coverage: coverage_data
+        }
       end
 
       def hash_incr_script
-        @hash_incr_script ||= @redis.script(:load, <<~LUA)
-          local first_updated_at = table.remove(ARGV, 1)
-          local last_updated_at = table.remove(ARGV, 1)
-          local file = table.remove(ARGV, 1)
-          local file_hash = table.remove(ARGV, 1)
-          local ttl = table.remove(ARGV, 1)
-          local file_length = table.remove(ARGV, 1)
-          local hash_key = table.remove(KEYS, 1)
-          redis.call('HMSET', hash_key, '#{LAST_UPDATED_KEY}', last_updated_at, '#{FILE_KEY}', file, '#{FILE_HASH}', file_hash, '#{FILE_LENGTH_KEY}', file_length)
-          redis.call('HSETNX', hash_key, '#{FIRST_UPDATED_KEY}', first_updated_at)
-          for i, key in ipairs(KEYS) do
-            if ARGV[i] == '-1' then
-              redis.call("HSET", hash_key, key, ARGV[i])
-            else
-              redis.call("HINCRBY", hash_key, key, ARGV[i])
-            end
-          end
-          if ttl ~= '-1' then
-            redis.call("EXPIRE", hash_key, ttl)
-          end
-        LUA
+        @hash_incr_script ||= @redis.script(:load, lua_script_content)
+      end
+
+      def lua_script_content
+        File.read(File.join(
+                    File.dirname(__FILE__), '../../../lua/lib/persist-coverage.lua'
+                  ))
       end
 
       def values_from_redis(local_type, files)

data/lib/coverband/adapters/redis_store.rb

@@ -77,7 +77,9 @@ module Coverband
       def coverage(local_type = nil, opts = {})
         local_type ||= opts.key?(:override_type) ? opts[:override_type] : type
         data = redis.get type_base_key(local_type)
-        data ? JSON.parse(data) : {}
+        data = data ? JSON.parse(data) : {}
+        data.delete_if { |file_path, file_data| file_hash(file_path) != file_data['file_hash'] } unless opts[:skip_hash_check]
+        data
       end
 
       # Note: This could lead to slight race on redis
@@ -86,7 +88,7 @@ module Coverband
       # and the tradeoff has always been acceptable
       def save_report(report)
         data = report.dup
-        data = merge_reports(data, coverage)
+        data = merge_reports(data, coverage(nil, skip_hash_check: true))
         save_coverage(data)
       end
 

data/lib/coverband/collectors/coverage.rb

@@ -71,7 +71,7 @@ module Coverband
       ###
       def track_file?(file)
         @ignore_patterns.none? do |pattern|
-          file.include?(pattern)
+          file.match(pattern)
         end && (file.start_with?(@project_directory) ||
                 (@track_gems &&
                  Coverband.configuration.gem_paths.any? { |path| file.start_with?(path) }))

data/lib/coverband/collectors/view_tracker.rb

@@ -29,10 +29,10 @@ module Coverband
 
         @roots = options.fetch(:roots) { Coverband.configuration.all_root_patterns }
         @roots = @roots.split(',') if @roots.is_a?(String)
+        @one_time_timestamp = false
 
         @logged_views = []
         @views_to_record = []
-        redis_store.set(tracker_time_key, Time.now.to_i) unless redis_store.exists(tracker_time_key)
       end
 
       ###
@@ -79,6 +79,13 @@ module Coverband
         all_views.reject { |view| view.match(/\/layouts\//) && recently_used_views.any? { |used_view| view.include?(used_view) } }
       end
 
+      def as_json
+        {
+          unused_views: unused_views,
+          used_views: used_views
+        }.to_json
+      end
+
       def tracking_since
         if (tracking_time = redis_store.get(tracker_time_key))
           Time.at(tracking_time.to_i).iso8601
@@ -100,11 +107,9 @@ module Coverband
         logged_views.delete(filename)
       end
 
-      def self.supported_version?
-        defined?(Rails) && defined?(Rails::VERSION) && Rails::VERSION::STRING.split('.').first.to_i >= 4
-      end
-
       def report_views_tracked
+        redis_store.set(tracker_time_key, Time.now.to_i) unless @one_time_timestamp || redis_store.exists(tracker_time_key)
+        @one_time_timestamp = true
         reported_time = Time.now.to_i
         views_to_record.each do |file|
           redis_store.hset(tracker_key, file, reported_time)
@@ -116,6 +121,10 @@ module Coverband
         logger&.error "Coverband: view_tracker failed to store, error #{e.class.name}"
       end
 
+      def self.supported_version?
+        defined?(Rails) && defined?(Rails::VERSION) && Rails::VERSION::STRING.split('.').first.to_i >= 4
+      end
+
       protected
 
       def newly_seen_file?(file)

data/lib/coverband/configuration.rb

@@ -8,9 +8,11 @@ module Coverband
                   :background_reporting_enabled,
                   :background_reporting_sleep_seconds, :test_env,
                   :web_enable_clear, :gem_details, :web_debug, :report_on_exit,
-                  :simulate_oneshot_lines_coverage, :track_views, :view_tracker
+                  :simulate_oneshot_lines_coverage, :track_views, :view_tracker,
+                  :reporting_wiggle
 
-    attr_writer :logger, :s3_region, :s3_bucket, :s3_access_key_id, :s3_secret_access_key, :password
+    attr_writer :logger, :s3_region, :s3_bucket, :s3_access_key_id,
+                :s3_secret_access_key, :password
     attr_reader :track_gems, :ignore, :use_oneshot_lines_coverage
 
     #####
@@ -23,12 +25,22 @@ module Coverband
     IGNORE_TASKS = ['coverband:clear',
                     'coverband:coverage',
                     'coverband:coverage_server',
-                    'coverband:migrate']
+                    'coverband:migrate',
+                    'assets:precompile',
+                    'db:version',
+                    'db:create',
+                    'db:drop',
+                    'db:seed',
+                    'db:setup',
+                    'db:test:prepare',
+                    'db:structure:dump',
+                    'db:structure:load',
+                    'db:version']
 
     # Heroku when building assets runs code from a dynamic directory
     # /tmp was added to avoid coverage from /tmp/build directories during
     # heroku asset compilation
-    IGNORE_DEFAULTS = %w[vendor .erb$ .slim$ /tmp internal:prelude schema.rb]
+    IGNORE_DEFAULTS = %w[vendor/ .erb$ .slim$ /tmp internal:prelude schema.rb]
 
     # Add in missing files which were never loaded
     # we need to know what all paths to check for unloaded files
@@ -72,6 +84,7 @@ module Coverband
       @s3_secret_access_key = nil
       @redis_namespace = nil
       @redis_ttl = 2_592_000 # in seconds. Default is 30 days.
+      @reporting_wiggle = nil
     end
 
     def logger
@@ -144,7 +157,7 @@ module Coverband
 
       # by default we ignore vendor where many deployments put gems
       # we will remove this default if track_gems is set
-      @ignore.delete('vendor')
+      @ignore.delete('vendor/')
       # while we want to allow vendored gems we don't want to track vendored ruby STDLIB
       @ignore << 'vendor/ruby-*' unless @ignore.include?('vendor/ruby-*')
       add_group('App', root)

data/lib/coverband/integrations/background.rb

@@ -33,6 +33,9 @@ module Coverband
           loop do
             Coverband.report_coverage
             Coverband.configuration.view_tracker&.report_views_tracked
+            if Coverband.configuration.reporting_wiggle
+              sleep_seconds = Coverband.configuration.background_reporting_sleep_seconds + rand(Coverband.configuration.reporting_wiggle.to_i)
+            end
             if Coverband.configuration.verbose
               logger.debug("Coverband: background reporting coverage (#{Coverband.configuration.store.type}). Sleeping #{sleep_seconds}s")
             end

data/lib/coverband/reporters/html_report.rb

@@ -32,6 +32,10 @@ module Coverband
         end
       end
 
+      def report_data
+        report_dynamic_data
+      end
+
       private
 
       def static?
@@ -54,6 +58,12 @@ module Coverband
                                             base_path: base_path,
                                             notice: notice).format_dynamic_html!
       end
+
+      def report_dynamic_data
+        Coverband::Utils::HTMLFormatter.new(filtered_report_files,
+                                            base_path: base_path,
+                                            notice: notice).format_dynamic_data!
+      end
     end
   end
 end

data/lib/coverband/reporters/web.rb

@@ -51,8 +51,12 @@ module Coverband
             @static.call(env)
           when %r{\/settings}
             [200, { 'Content-Type' => 'text/html' }, [settings]]
+          when %r{\/view_tracker_data}
+            [200, { 'Content-Type' => 'text/json' }, [view_tracker_data]]
           when %r{\/view_tracker}
             [200, { 'Content-Type' => 'text/html' }, [view_tracker]]
+          when %r{\/enriched_debug_data}
+            [200, { 'Content-Type' => 'text/json' }, [enriched_debug_data]]
           when %r{\/debug_data}
             [200, { 'Content-Type' => 'text/json' }, [debug_data]]
           when %r{\/load_file_details}
@@ -87,10 +91,22 @@ module Coverband
                                             base_path: base_path).format_view_tracker!
       end
 
+      def view_tracker_data
+        Coverband::Collectors::ViewTracker.new(store: Coverband.configuration.store).as_json
+      end
+
       def debug_data
         Coverband.configuration.store.get_coverage_report.to_json
       end
 
+      def enriched_debug_data
+        Coverband::Reporters::HTMLReport.new(Coverband.configuration.store,
+                                             static: false,
+                                             base_path: base_path,
+                                             notice: '',
+                                             open_report: false).report_data
+      end
+
       def load_file_details
         filename = request.params['filename']
         Coverband::Reporters::HTMLReport.new(Coverband.configuration.store,

data/lib/coverband/utils/html_formatter.rb

@@ -29,6 +29,10 @@ module Coverband
         format_html(@coverage_result)
       end
 
+      def format_dynamic_data!
+        format_data(@coverage_result)
+      end
+
       def format_settings!
         format_settings
       end
@@ -71,6 +75,10 @@ module Coverband
         template('layout').result(binding)
       end
 
+      def format_data(result)
+        template('data').result(binding)
+      end
+
       # Returns the an erb instance for the template of given name
       def template(name)
         ERB.new(File.read(File.join(File.dirname(__FILE__), '../../../views/', "#{name}.erb")))