parallelized_specs 0.4.50 → 0.4.51

data/Rakefile

@@ -12,7 +12,7 @@ begin
     gem.email    = "jake@instructure.com"
     gem.homepage = "http://github.com/jakesorce/#{gem.name}"
     gem.authors  = "Jake Sorce, Bryan Madsen, Shawn Meredith"
-    gem.version = "0.4.50"
+    gem.version = "0.4.51"
   end
   Jeweler::GemcutterTasks.new
 rescue LoadError

data/Readme.md

@@ -3,16 +3,17 @@ ParallelizedSpecs splits tests into even groups(by number of tests or runtime) a
 
 Setup Requirements
 ***IMPORTANT***
-**OutcomeBuilder Formatter and FailuresFormatter must be enabled in the way specified starting from 4.47**
-This allows streamlined pass\fail determination and thorough false positive checking while handing unusual pass\fail conditions in ruby 1.9.3
-See FailuresFormatter read section and set RERUNS to 0 if don't want to allow reruns
+**OutcomeBuilder Formatter and FailuresFormatter must be enabled when using reruns or some ruby 1.9.3 version will provide false positives.
+This allows streamlined pass\fail determination and thorough false positive checking while handling unusual pass\fail conditions in some versions of ruby 1.9.3
+
+See FailuresFormatter readme section and set RERUNS to 0 if don't want to allow reruns but are using a ruby 1.9.3 version
 
 
 Setup for Rails
 ===============
 ## Install
 ### Rails 3
-If you use RSpec: ensure you got >= 2.4
+If you use RSpec: ensure you have >= 2.4
 
 As gem
 
@@ -66,8 +67,8 @@ ParallelizedSpecs uses 1 database per test-process, 2 processes will use `*_test
     rake parallel:spec          # RSpec
 
     rake parallel:spec[1] --> force 1 CPU --> 86 seconds
-    rake parallel:spec    --> got 2 CPUs? --> 47 seconds
-    rake parallel:spec    --> got 4 CPUs? --> 26 seconds
+    rake parallel:spec    --> have 2 CPUs? --> 47 seconds
+    rake parallel:spec    --> have 4 CPUs? --> 26 seconds
     ...
 
 Test by pattern (e.g. use one integration server per subfolder / see if you broke any 'user'-related tests)
@@ -124,7 +125,7 @@ SpecFailuresLogger
 
 This logger produces pasteable command-line snippets for each failed example.
 
-This also stores all failures in this file for later consumption during in optional RERUN process
+This also stores all failures in this file for later consumption during an optional RERUN process
 which can rerun all failed specs and potentially change the pass\fail outcome of a build if all specs pass.
 Enable this formatter
 
@@ -150,7 +151,7 @@ FailuresFormatter
 
 
 This formatter captures all needed data about failed examples and stores them in a file for an additional run
-at the end of the first build. If all specs that failed the first time pass the build will be marked as passed in the exit status
+at the end of the first build. If all specs that failed the first time pass the build will be marked as passed in the exit status.
 The output location defined below is not optional and if this formatter is used must not be changed.
 
 Use default MAX_RERUNS of 9 or set max number of failed specs to be allowed for reruns by exporting environment variable
@@ -177,7 +178,7 @@ OutcomeBuilder
 
 
 Because previously the pass\fail determination was solely on exit status and now we do things besides always fail on non 0 exits
-we must handle many other causes of non 0 exit codes that we don't want to start the rerun process if they happen
+we must handle many other causes of non 0 exit codes that we don't want to start the rerun process if they happen.
 
 E.g.
 
@@ -202,6 +203,7 @@ E.g.
 
 
 Add the following to your `spec/parallelized_spec.opts` (or `spec/spec.opts`) :
+
     RSpec 1.x:
       --format progress
       --require parallelized_specs/trending_example_failures_logger
@@ -211,7 +213,29 @@ Add the following to your `spec/parallelized_spec.opts` (or `spec/spec.opts`) :
       --format progress
       --format ParallelizedSpecs::SpecFailuresLogger --out tmp/parallel_log/trends.log
 
+SlowestSpecLogger
+-----------------------
+creates a text file with any specs taking longer than 30 seconds by default but can be overridden by setting a ENV["MAX_TIME"] var
+
+E.g.
+
+
+Add the following to your `spec/parallelized_spec.opts` (or `spec/spec.opts`) :
+
+    RSpec 1.x:
+      --format progress
+      --require parallelized_specs/slow_spec_logger
+      --format ParallelizedSpecs::SpecFailuresLogger:tmp/parallel_log/slowest_specs.log
+    RSpec >= 2.4:
+      If installed as plugin: -I vendor/plugins/parallelized_specs/lib
+      --format progress
+      --format ParallelizedSpecs::SpecFailuresLogger --out tmp/parallel_log/slowest_specs.log
+
+Tools
 
+selenium_trending_collector.rb
+------------------------
+This consumes the text files created by the trender formatter and parses it associates the data and pushes it to a database for storage
 
 
 Setup for non-rails
@@ -238,7 +262,7 @@ TIPS
  - [ActiveRecord] if you do not have `db:abort_if_pending_migrations` add this to your Rakefile: `task('db:abort_if_pending_migrations'){}`
  - `export PARALLEL_TEST_PROCESSORS=X` in your environment and parallelized_specs will use this number of processors by default
  - with zsh this would be `rake "parallel:prepare[3]"`
- - [RERUNS] if your using reruns formatter also use the outcome builder to make your builds handle syntax issues in some threads files
+ - [RERUNS] if you're using reruns formatter also use the outcome builder to make your builds handle syntax issues during example_group generation from rspec
    and thread crashes more cleanly
 
 Authors
@@ -249,8 +273,9 @@ based loosely from https://github.com/grosser/parallel_tests
 ### [Contributors](http://github.com/jakesorce/parallelized_specs/contributors)
  - [Bryan Madsen](http://github.com/bmad)
 
-[Jake Sorce](http://github.com/jakesorce)<br/>
+ - [Jake Sorce](http://github.com/jakesorce)
+
+ - [Shawn Meredith](https://github.com/smeredith0506)
 
-[Shawn Meredith](https://github.com/smeredith0506)<br/>
 Hereby placed under public domain, do what you want, just do not hold me accountable...<br/>
 [![Flattr](http://api.flattr.com/button/flattr-badge-large.png)](https://flattr.com/submit/auto?user_id=jakesorce&url=https://github.com/jakesorce/parallelized_specs&title=parallelized_specs&language=en_GB&tags=github&category=software)

data/lib/parallelized_specs/selenium_trending_collector.rb

@@ -0,0 +1,56 @@
+require 'rubygems'
+require 'active_record'
+require 'date'
+
+ActiveRecord::Base.establish_connection(
+    :adapter => 'yourdbtype',
+    :host => 'yourhost',
+    :encoding => 'utf8',
+    :database => 'selenium_trending',
+    :username => 'youruser',
+    :password => 'youtpass'
+)
+
+class SeleniumTrend < ActiveRecord::Base
+  ActiveRecord::Migration.class_eval do
+    unless SeleniumTrend.table_exists?
+      create_table :selenium_trends do |t|
+        t.integer :hudson_build
+        t.string :hudson_project
+        t.string :hudson_url
+        t.string :spec_line_failure
+        t.string :spec_name
+        t.string :nested_spec_name
+        t.string :trace
+        t.string :full_path
+        t.date :failure_date
+      end
+    end
+  end
+end
+
+def store_failure_data
+  dir = Dir.pwd
+  data = "#{dir}/tmp/parallel_log/trends.log"
+  File.open("#{data}", 'r') do |f|
+    f.each_line do |line|
+      values = line.split("*").to_a
+
+      if values != nil
+        spec_line_failure = values[0]
+        spec_name = values[1]
+        nested_spec_name = values[2]
+        trace = values[3]
+        full_path = values[4]
+        failure_date = values[5]
+        hudson_build = values[6]
+        hudson_project = values[7]
+        hudson_url = values[8]
+
+        SeleniumTrend.create!(:spec_line_failure => spec_line_failure, :spec_name => spec_name, :nested_spec_name => nested_spec_name, :trace => trace, :full_path => full_path, :failure_date => failure_date, :hudson_build => hudson_build, :hudson_project => hudson_project, :hudson_url => hudson_url)
+      end
+    end
+  end
+end
+
+store_failure_data

data/lib/parallelized_specs/trending_example_failures_logger.rb

@@ -20,11 +20,13 @@ class ParallelizedSpecs::TrendingExampleFailures < ParallelizedSpecs::SpecLogger
   def dump_pending(*args);end
 
   def dump_summary(*args)
+
     if File.exists?("#{Rails.root}/spec/build_info.txt")
       @hudson_build_info = File.read("#{Rails.root}/spec/build_info.txt")
     else
       @hudson_build_info = "no*hudson build*info"
     end
+
     lock_output do
       (@failed_examples||{}).each_pair do |example, details|
         @output.puts "#{example}#{details}#{@hudson_build_info}"

data/lib/parallelized_specs.rb

@@ -114,24 +114,24 @@ class ParallelizedSpecs
     failed = test_results.any? { |result| result[:exit_status] != 0 } #ruby 1.8.7 works breaks on 1.9.3
     slowest_spec_determination("#{Rails.root}/tmp/parallel_log/slowest_specs.log") if @slow_specs_enabled
 
-    #determines if any tricky conditions happened that can cause false positives and offers logging into what was the last spec to start or finishing running
     results = find_results(test_results.map { |result| result[:stdout] }*"")
-    @outcome_builder_enabled ? spec_summary = calculate_total_spec_details : spec_summary = summarize_results(results)
+
 
     if @outcome_builder_enabled
       puts "INFO: OutcomeBuilder is enabled now checking for false positives"
-      puts "INFO: Total specs run #{spec_summary[0]} failed specs #{spec_summary[1]} pending specs #{spec_summary[2]}\n INFO: Took #{Time.now - start} seconds"
+      @total_specs, @total_failures, @total_pending = calculate_total_spec_details
+      puts "INFO: Total specs run #{total_specs} failed specs  #{total_failures} pending specs #{total_pending}\n INFO: Took #{Time.now - start} seconds"
+      #determines if any tricky conditions happened that can cause false positives and offers logging into what was the last spec to start or finishing running
       false_positive_sniffer(num_processes)
-      if @reruns_enabled
+      if @reruns_enabled && @total_failures != 0
         puts "INFO: RERUNS are enabled"
-        rerun_initializer(name, failed, spec_summary)
+        rerun_initializer
       else
-        abort("SEVERE: #{name.capitalize}s Failed") if failed || spec_summary[2].to_i != 0
+        abort("SEVERE: #{name.capitalize}s Failed") if @total_failures != 0
       end
     else
       puts "WARNING: OutcomeBuilder is disabled not checking for false positives its likely things like thread failures and rspec non 0 exit codes will cause false positives"
-      puts spec_summary
-      puts "INFO: Took #{Time.now - start} seconds"
+      puts "INFO: #{summarize_results(results)} Took #{Time.now - start} seconds"
       abort("SEVERE: #{name.capitalize}s Failed") if failed
     end
     puts "INFO: marking build as PASSED"
@@ -145,7 +145,7 @@ class ParallelizedSpecs
       spec_total_details[1] += thread_spec_details[1].to_i
       spec_total_details[2] += thread_spec_details[2].to_i
     end
-    spec_total_details
+    [spec_total_details[0], spec_total_details[1], spec_total_details[2]]
   end
 
   def self.formatters_setup
@@ -178,13 +178,15 @@ class ParallelizedSpecs
     end
   end
 
-  def self.rerun_initializer(name, failed, spec_summary)
-    if spec_summary[2].to_i != 0 && !File.zero?("#{Rails.root}/tmp/parallel_log/rspec.failures") # works on both 1.8.7\1.9.3
+  def self.rerun_initializer()
+
+    if @total_failures != 0 && !File.zero?("#{Rails.root}/tmp/parallel_log/rspec.failures") # works on both 1.8.7\1.9.3
       puts "INFO: some specs failed, about to start the rerun process\n...\n..\n."
       ParallelizedSpecs.rerun()
     else
       #works on both 1.8.7\1.9.3
-      abort "SEVERE: #{name.capitalize}s Failed" if spec_summary[2].to_i != 0 || failed
+      puts "ERROR: the build had failures but the rspec.failures file is null"
+      abort "SEVERE: SPECS Failed"
     end
   end
 
@@ -192,7 +194,7 @@ class ParallelizedSpecs
     if Dir.glob("#{Rails.root}/tmp/parallel_log/spec_count/{*,.*}").count == 2 && Dir.glob("#{Rails.root}/tmp/parallel_log/thread_started/{*,.*}").count == num_processes + 2
       (puts "INFO: All threads completed")
     elsif Dir.glob("#{Rails.root}/tmp/parallel_log/thread_started/{*,.*}").count != num_processes + 2
-      File.open("#{Rails.root}/tmp/parallel_log/error.log", 'a+') { |f| f.write "\n\n\n syntax issues" }
+      File.open("#{Rails.root}/tmp/parallel_log/error.log", 'a+') { |f| f.write "\n\n\n syntax errors" }
       File.open("#{Rails.root}/tmp/failure_cause.log", 'a+') { |f| f.write "syntax errors" }
       abort "SEVERE: one or more threads didn't get started by rspec, this may be caused by a syntax issue in specs, check logs right before specs start running"
     else
@@ -563,8 +565,4 @@ class ParallelizedSpecs
       File.open(file, 'a+') { |f| f.puts slow_spec }
     end
   end
-
-end
-
-
-
+end

data/parallelized_specs.gemspec

@@ -5,11 +5,11 @@
 
 Gem::Specification.new do |s|
   s.name = "parallelized_specs"
-  s.version = "0.4.50"
+  s.version = "0.4.51"
 
   s.required_rubygems_version = Gem::Requirement.new(">= 0") if s.respond_to? :required_rubygems_version=
   s.authors = ["Jake Sorce, Bryan Madsen, Shawn Meredith"]
-  s.date = "2013-04-09"
+  s.date = "2013-04-12"
   s.email = "jake@instructure.com"
   s.files = [
     "Gemfile",
@@ -24,6 +24,7 @@ Gem::Specification.new do |s|
     "lib/parallelized_specs/outcome_builder.rb",
     "lib/parallelized_specs/railtie.rb",
     "lib/parallelized_specs/runtime_logger.rb",
+    "lib/parallelized_specs/selenium_trending_collector.rb",
     "lib/parallelized_specs/slow_spec_logger.rb",
     "lib/parallelized_specs/spec_error_count_logger.rb",
     "lib/parallelized_specs/spec_error_logger.rb",

metadata

@@ -1,13 +1,13 @@
 --- !ruby/object:Gem::Specification 
 name: parallelized_specs
 version: !ruby/object:Gem::Version 
-  hash: 107
+  hash: 105
   prerelease: 
   segments: 
   - 0
   - 4
-  - 50
-  version: 0.4.50
+  - 51
+  version: 0.4.51
 platform: ruby
 authors: 
 - Jake Sorce, Bryan Madsen, Shawn Meredith
@@ -15,7 +15,7 @@ autorequire:
 bindir: bin
 cert_chain: []
 
-date: 2013-04-09 00:00:00 Z
+date: 2013-04-12 00:00:00 Z
 dependencies: 
 - !ruby/object:Gem::Dependency 
   name: parallel
@@ -52,6 +52,7 @@ files:
 - lib/parallelized_specs/outcome_builder.rb
 - lib/parallelized_specs/railtie.rb
 - lib/parallelized_specs/runtime_logger.rb
+- lib/parallelized_specs/selenium_trending_collector.rb
 - lib/parallelized_specs/slow_spec_logger.rb
 - lib/parallelized_specs/spec_error_count_logger.rb
 - lib/parallelized_specs/spec_error_logger.rb