statsample-ekatena 2.0.2

data/LICENSE.txt

@@ -0,0 +1,12 @@
+Copyright (c) 2009-2015, Claudio Bustos
+All rights reserved.
+
+Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met:
+
+1. Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer.
+
+2. Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution.
+
+3. Neither the name of the copyright holder nor the names of its contributors may be used to endorse or promote products derived from this software without specific prior written permission.
+
+THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

data/README.md

@@ -0,0 +1,175 @@
+# Statsample
+
+[![Build Status](https://travis-ci.org/SciRuby/statsample.svg?branch=master)](https://travis-ci.org/SciRuby/statsample)
+[![Code Climate](https://codeclimate.com/github/SciRuby/statsample/badges/gpa.svg)](https://codeclimate.com/github/SciRuby/statsample)
+[![Gem Version](https://badge.fury.io/rb/statsample.svg)](http://badge.fury.io/rb/statsample)
+
+Homepage :: https://github.com/sciruby/statsample
+
+# Installation
+
+You should have a recent version of GSL and R (with the `irr` and `Rserve` libraries) installed. In Ubuntu:
+
+```bash
+$ sudo apt-get install libgsl0-dev r-base r-base-dev
+$ sudo Rscript -e "install.packages(c('Rserve', 'irr'))"
+```
+
+With these libraries in place, just install from rubygems:
+
+```bash
+$ [sudo] gem install statsample
+```
+
+On *nix, you should install statsample-optimization to retrieve gems gsl, statistics2 and a C extension to speed some methods.
+
+```bash
+$ [sudo] gem install statsample-optimization
+```
+
+If you need to work on Structural Equation Modeling, you could see +statsample-sem+. You need R with +sem+ or +OpenMx+ [http://openmx.psyc.virginia.edu/] libraries installed
+
+```bash
+$ [sudo] gem install statsample-sem
+```
+# Testing
+
+See CONTRIBUTING for information on testing and contributing to statsample.
+
+# Documentation
+
+You can see the latest documentation in [rubydoc.info](http://www.rubydoc.info/github/sciruby/statsample/master).
+
+# Usage
+
+## Notebooks
+
+You can see some iruby notebooks here:
+
+### Statistics
+
+* [Correlation Matrix with daru and statsample](http://nbviewer.ipython.org/github/SciRuby/sciruby-notebooks/blob/master/Statistics/Correlation%20Matrix%20with%20daru%20and%20statsample.ipynb)
+* [Dominance Analysis with statsample](http://nbviewer.ipython.org/github/SciRuby/sciruby-notebooks/blob/master/Statistics/Dominance%20Analysis%20with%20statsample.ipynb)
+* [Reliability ICC](http://nbviewer.ipython.org/github/v0dro/sciruby-notebooks/blob/master/Statistics/Reliability%20ICC%20with%20statsample.ipynb)
+* [Levene Test](http://nbviewer.ipython.org/github/v0dro/sciruby-notebooks/blob/master/Statistics/Levene%20Test.ipynb)
+* [Multiple Regression](http://nbviewer.ipython.org/github/v0dro/sciruby-notebooks/blob/master/Statistics/Multiple%20Regression.ipynb)
+* [Parallel Analysis on PCA](http://nbviewer.ipython.org/github/SciRuby/sciruby-notebooks/blob/master/Statistics/Parallel%20Analysis%20on%20PCA.ipynb)
+* [Polychoric Analysis](http://nbviewer.ipython.org/github/SciRuby/sciruby-notebooks/blob/master/Statistics/Polychoric%20Correlation.ipynb)
+* [Reliability Scale and Multiscale Analysis](https://github.com/SciRuby/sciruby-notebooks/blob/master/Statistics/Reliability%20Scale%20Analysis.ipynb)
+* [Velicer MAP Test](http://nbviewer.ipython.org/github/SciRuby/sciruby-notebooks/blob/master/Statistics/Velicer%20MAP%20test.ipynb)
+
+### Visualizations
+
+* [Creating Boxplots with daru and statsample](http://nbviewer.ipython.org/github/SciRuby/sciruby-notebooks/blob/master/Visualization/Boxplot%20with%20daru%20and%20statsample.ipynb)
+* [Creating A Histogram](http://nbviewer.ipython.org/github/SciRuby/sciruby-notebooks/blob/master/Visualization/Creating%20a%20Histogram.ipynb)
+* [Creating a Scatterplot](http://nbviewer.ipython.org/github/SciRuby/sciruby-notebooks/blob/master/Visualization/Scatterplot%20with%20statsample.ipynb)
+
+### Working with DataFrame and Vector
+
+* [Creating Vectors and DataFrames with daru](http://nbviewer.ipython.org/github/SciRuby/sciruby-notebooks/blob/master/Data%20Analysis/Creation%20of%20Vector%20and%20DataFrame.ipynb)
+* [Detailed Usage of Daru::Vector](http://nbviewer.ipython.org/github/SciRuby/sciruby-notebooks/blob/master/Data%20Analysis/Usage%20of%20Vector.ipynb)
+* [Detailed Usage of Daru::DataFrame](http://nbviewer.ipython.org/github/SciRuby/sciruby-notebooks/blob/master/Data%20Analysis/Usage%20of%20DataFrame.ipynb)
+* [Visualizing Data with Daru::DataFrame](http://nbviewer.ipython.org/github/SciRuby/sciruby-notebooks/blob/master/Visualization/Visualizing%20data%20with%20daru%20DataFrame.ipynb)
+
+## Examples
+
+See the /examples directory for some use cases. The notebooks listed above have mostly
+the same examples, and they look better so you might want to see that first.
+
+# Description
+
+A suite for basic and advanced statistics on Ruby. Tested on CRuby 1.9.3, 2.0.0 and 2.1.1. See `.travis.yml` for more information.
+
+Include:
+- Descriptive statistics: frequencies, median, mean, standard error, skew, kurtosis (and many others).
+- Correlations: Pearson's r, Spearman's rank correlation (rho), point biserial, tau a, tau b and  gamma.  Tetrachoric and Polychoric correlation provides by +statsample-bivariate-extension+ gem.
+- Intra-class correlation
+- Anova: generic and vector-based One-way ANOVA and Two-way ANOVA, with contrasts for One-way ANOVA.
+- Tests: F, T, Levene, U-Mannwhitney.
+- Regression: Simple, Multiple (OLS)
+- Factorial Analysis: Extraction (PCA and Principal Axis), Rotation (Varimax, Equimax, Quartimax) and Parallel Analysis and Velicer's MAP test, for estimation of number of factors.
+- Reliability analysis for simple scale and a DSL to easily analyze multiple scales using factor analysis and correlations, if you want it.
+- Basic time series support
+- Dominance Analysis, with multivariate dependent and bootstrap (Azen & Budescu)
+- Sample calculation related formulas
+- Structural Equation Modeling (SEM), using R libraries +sem+ and +OpenMx+
+- Creates reports on text, html and rtf, using ReportBuilder gem
+- Graphics: Histogram, Boxplot and Scatterplot
+
+## Principles
+
+- Software Design:
+  - One module/class for each type of analysis
+  - Options can be set as hash on initialize() or as setters methods
+  - Clean API for interactive sessions
+  - summary() returns all necessary informacion for interactive sessions
+  - All statistical data available though methods on objects
+  - All (important) methods should be tested. Better with random data.
+- Statistical Design
+  - Results are tested against text results, SPSS and R outputs.
+  - Go beyond Null Hiphotesis Testing, using confidence intervals and effect sizes when possible
+  - (When possible) All references for methods are documented, providing sensible information on documentation
+
+# Features
+
+- Classes for manipulation and storage of data:
+  - Uses [daru](https://github.com/v0dro/daru) for storing data and basic statistics.
+  - Statsample::Multiset: multiple datasets with same fields and type of vectors
+- Anova module provides generic Statsample::Anova::OneWay and vector based Statsample::Anova::OneWayWithVectors. Also you can create contrast using Statsample::Anova::Contrast
+- Module Statsample::Bivariate provides covariance and pearson, spearman, point biserial, tau a, tau b, gamma, tetrachoric (see Bivariate::Tetrachoric) and polychoric (see Bivariate::Polychoric) correlations. Include methods to create correlation and covariance matrices
+- Multiple types of regression.
+  - Simple Regression :  Statsample::Regression::Simple
+  - Multiple Regression: Statsample::Regression::Multiple
+- Factorial Analysis algorithms on Statsample::Factor module.
+  - Classes for Extraction of factors:
+    - Statsample::Factor::PCA
+    - Statsample::Factor::PrincipalAxis
+  - Classes for Rotation of factors:
+    - Statsample::Factor::Varimax
+    - Statsample::Factor::Equimax
+    - Statsample::Factor::Quartimax
+  - Classes for calculation of factors to retain
+    - Statsample::Factor::ParallelAnalysis performs Horn's 'parallel analysis' to a principal components analysis to adjust for sample bias in the retention of components.
+    - Statsample::Factor::MAP performs Velicer's Minimum Average Partial (MAP) test, which retain components as long as the variance in the correlation matrix represents systematic variance.
+- Dominance Analysis. Based on Budescu and Azen papers, dominance analysis is a method to analyze the relative importance of one predictor relative to another on multiple regression
+  - Statsample::DominanceAnalysis class can report dominance analysis for a sample, using uni or multivariate dependent variables
+  - Statsample::DominanceAnalysis::Bootstrap can execute bootstrap analysis to determine dominance stability, as recomended by  Azen & Budescu (2003) link[http://psycnet.apa.org/journals/met/8/2/129/].
+- Module Statsample::Codification, to help to codify open questions
+- Converters to export data:
+  - Statsample::Mx    : Write Mx Files
+  - Statsample::GGobi : Write Ggobi files
+- Module Statsample::Crosstab provides function to create crosstab for categorical data
+- Module Statsample::Reliability provides functions to analyze scales with psychometric methods.
+  - Class Statsample::Reliability::ScaleAnalysis provides statistics like mean, standard deviation for a scale, Cronbach's alpha and standarized Cronbach's alpha, and for each item: mean, correlation with total scale, mean if deleted, Cronbach's alpha is deleted.
+  - Class Statsample::Reliability::MultiScaleAnalysis provides a DSL to easily analyze reliability of multiple scales and retrieve correlation matrix and factor analysis of them.
+  - Class Statsample::Reliability::ICC provides intra-class correlation, using Shrout & Fleiss(1979) and McGraw & Wong (1996) formulations.
+- Module Statsample::SRS (Simple Random Sampling) provides a lot of functions to estimate standard error for several type of samples
+- Module Statsample::Test provides several methods and classes to perform inferencial statistics
+  - Statsample::Test::BartlettSphericity
+  - Statsample::Test::ChiSquare
+  - Statsample::Test::F
+  - Statsample::Test::KolmogorovSmirnov (only D value)
+  - Statsample::Test::Levene
+  - Statsample::Test::UMannWhitney
+  - Statsample::Test::T
+  - Statsample::Test::WilcoxonSignedRank
+- Module Graph provides several classes to create beautiful graphs using rubyvis
+  - Statsample::Graph::Boxplot
+  - Statsample::Graph::Histogram
+  - Statsample::Graph::Scatterplot
+- Gem <tt>bio-statsample-timeseries</tt> provides module Statsample::TimeSeries with support for time series, including ARIMA estimation using Kalman-Filter.
+- Gem <tt>statsample-sem</tt> provides a DSL to R libraries +sem+ and +OpenMx+
+- Gem <tt>statsample-glm</tt> provides you with GML method, to work with Logistic, Poisson and Gaussian regression ,using ML or IRWLS.
+- Close integration with gem <tt>reportbuilder</tt>, to easily create reports on text, html and rtf formats.
+
+# Resources
+
+- Source code on github :: http://github.com/sciruby/statsample
+- Bug report and feature request :: http://github.com/sciruby/statsample/issues
+- E-mailing list :: https://groups.google.com/forum/#!forum/sciruby-dev
+
+# License
+
+BSD-3 (See LICENSE.txt)
+
+Could change between version, without previous warning. If you want a specific license, just choose the version that you need.

data/Rakefile

@@ -0,0 +1,44 @@
+$:.unshift File.expand_path("../lib/", __FILE__)
+lib_folder = File.expand_path("../lib", __FILE__)
+
+require 'statsample/version'
+require 'rake'
+require 'rake/testtask'
+require 'rdoc/task'
+require 'bundler/gem_tasks'
+
+# Setup the necessary gems, specified in the gemspec.
+require 'bundler'
+begin
+  Bundler.setup(:default, :development)
+rescue Bundler::BundlerError => e
+  $stderr.puts e.message
+  $stderr.puts "Run `bundle install` to install missing gems"
+  exit e.status_code
+end
+
+Rake::TestTask.new do |t|
+  t.pattern = "test/test_*.rb"
+end
+
+RDoc::Task.new do |rdoc|
+  rdoc.main = "README.md"
+  rdoc.rdoc_files.include("README.md", "lib", "History.txt", "LICENSE.txt", "references.txt")
+end
+
+desc "Update pot/po files."
+task "gettext:updatepo" do
+  require 'gettext/tools'
+  GetText.update_pofiles("statsample", Dir.glob("{lib,bin}/**/*.{rb,rhtml}"), "statsample #{Statsample::VERSION}")
+end
+
+desc "Create mo-files"
+task "gettext:makemo" do
+  require 'gettext/tools'
+  GetText.create_mofiles()
+end
+
+desc 'Run pry'
+task :pry do |task|
+  sh "pry -r #{lib_folder}/statsample.rb"
+end

data/benchmarks/correlation_matrix_15_variables.rb

@@ -0,0 +1,32 @@
+require(File.expand_path(File.dirname(__FILE__)+'/helpers_benchmark.rb'))
+
+extend BenchPress
+cases=250
+vars=20
+
+name "gsl matrix based vs. manual ruby correlation matrix (#{vars} vars, #{cases} cases)"
+author 'Clbustos'
+date '2011-01-18'
+summary "
+A correlation matrix could be constructed using matrix algebra or
+mannualy, calculating covariances, means and sd for each pair of vectors.
+In this test, we test the calculation using #{vars} variables with 
+#{cases} cases on each vector
+"
+
+reps 200 #number of repetitions
+
+ds = Daru::DataFrame.new(
+  vars.times.inject({}) do |ac,v|
+    ac["x#{v}".to_sym]=Daru::Vector.new_with_size(cases) {rand()}
+    ac
+  end
+)
+    
+measure "Statsample::Bivariate.correlation_matrix_optimized" do
+  Statsample::Bivariate.correlation_matrix_optimized(ds)
+end
+
+measure "Statsample::Bivariate.correlation_matrix_pairwise" do
+  Statsample::Bivariate.correlation_matrix_pairwise(ds)
+end

data/benchmarks/correlation_matrix_5_variables.rb

@@ -0,0 +1,33 @@
+require(File.expand_path(File.dirname(__FILE__)+'/helpers_benchmark.rb'))
+
+extend BenchPress
+cases=500
+vars=5
+
+
+name "gsl matrix based vs. manual ruby correlation matrix (#{vars} vars, #{cases} cases)"
+author 'Clbustos'
+date '2011-01-18'
+summary "
+A correlation matrix could be constructed using matrix algebra or
+mannualy, calculating covariances, means and sd for each pair of vectors.
+In this test, we test the calculation using #{vars} variables with 
+#{cases} cases on each vector
+"
+
+reps 200 #number of repetitions
+
+ds = Daru::DataFrame.new(
+  vars.times.inject({}) do |ac,v|
+    ac["x#{v}".to_sym]=Daru::Vector.new_with_size(cases) {rand()}
+    ac
+  end
+)
+    
+measure "Statsample::Bivariate.correlation_matrix_optimized" do
+  Statsample::Bivariate.correlation_matrix_optimized(ds)
+end
+
+measure "Statsample::Bivariate.correlation_matrix_pairwise" do
+  Statsample::Bivariate.correlation_matrix_pairwise(ds)
+end

data/benchmarks/correlation_matrix_methods/correlation_matrix.html

@@ -0,0 +1,93 @@
+<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd">
+<html>
+<head>
+<meta http-equiv="Content-Type" content="text/html;charset=utf-8" >
+<title>Correlation matrix analysis</title>
+        <style>
+        body {
+          margin:0;
+          padding:1em;
+        }
+        table {
+          border-collapse: collapse;
+
+        }
+        table td {
+          border: 1px solid black;
+        }
+        .section {
+          margin:0.5em;
+        }
+        </style>
+
+</head><body>
+<h1>Correlation matrix analysis</h1><div id='toc'><div class='title'>List of contents</div>
+<ul>
+<li><a href='#toc_1'>Multiple reggresion of cases,vars,c_v on time_optimized</a></li>
+<ul>
+<li><a href='#toc_2'>ANOVA</a></li>
+</ul>
+<li><a href='#toc_3'>Multiple reggresion of cases,vars,c_v on time_pairwise</a></li>
+<ul>
+<li><a href='#toc_4'>ANOVA</a></li>
+</ul>
+</ul>
+</div>
+<div class='tot'><div class='title'>List of tables</div><ul><li><a href='#table_1'>ANOVA Table</a></li><li><a href='#table_2'>Beta coefficients</a></li><li><a href='#table_3'>ANOVA Table</a></li><li><a href='#table_4'>Beta coefficients</a></li></ul></div>
+  <div class='section'><h2>Multiple reggresion of cases,vars,c_v on time_optimized</h2><a name='toc_1'></a>
+    <p>Engine: Statsample::Regression::Multiple::RubyEngine</p>
+    <p>Cases(listwise)=63(63)</p>
+    <p>R=0.978844</p>
+    <p>R^2=0.958137</p>
+    <p>R^2 Adj=0.956008</p>
+    <p>Std.Error R=3.092024</p>
+    <p>Equation=4.031667 + 0.018039cases + 0.244790vars + 0.001197c_v</p>
+    <div class='section'><h3>ANOVA</h3><a name='toc_2'></a>
+      <a name='table_1'></a><table><caption>ANOVA Table</caption><thead><th>source</th><th>ss</th><th>df</th><th>ms</th><th>f</th><th>p</th></thead>
+<tbody>
+<tr><td>Regression</td><td>12910.098</td><td>3</td><td>4303.366</td><td>450.114</td><td>0.000</td></tr>
+<tr><td>Error</td><td>564.076</td><td>59</td><td>9.561</td><td></td><td></td></tr>
+<tr><td>Total</td><td>13474.174</td><td>62</td><td>4312.927</td><td></td><td></td></tr>
+</tbody>
+</table>
+
+    </div>
+    <a name='table_2'></a><table><caption>Beta coefficients</caption><thead><th>coeff</th><th>b</th><th>beta</th><th>se</th><th>t</th></thead>
+<tbody>
+<tr><td>Constant</td><td>4.031667</td><td>-</td><td>0.752604</td><td>5.356953</td></tr>
+<tr><td>cases</td><td>0.018039</td><td>0.381587</td><td>0.001961</td><td>9.200093</td></tr>
+<tr><td>vars</td><td>0.244790</td><td>0.224390</td><td>0.036055</td><td>6.789335</td></tr>
+<tr><td>c_v</td><td>0.001197</td><td>0.584174</td><td>0.000094</td><td>12.738410</td></tr>
+</tbody>
+</table>
+
+  </div>
+  <div class='section'><h2>Multiple reggresion of cases,vars,c_v on time_pairwise</h2><a name='toc_3'></a>
+    <p>Engine: Statsample::Regression::Multiple::RubyEngine</p>
+    <p>Cases(listwise)=63(63)</p>
+    <p>R=0.999637</p>
+    <p>R^2=0.999275</p>
+    <p>R^2 Adj=0.999238</p>
+    <p>Std.Error R=0.538365</p>
+    <p>Equation=-0.520303 + -0.000708cases + 1.234451vars + 0.000735c_v</p>
+    <div class='section'><h3>ANOVA</h3><a name='toc_4'></a>
+      <a name='table_3'></a><table><caption>ANOVA Table</caption><thead><th>source</th><th>ss</th><th>df</th><th>ms</th><th>f</th><th>p</th></thead>
+<tbody>
+<tr><td>Regression</td><td>23554.271</td><td>3</td><td>7851.424</td><td>27089.134</td><td>0.000</td></tr>
+<tr><td>Error</td><td>17.100</td><td>59</td><td>0.290</td><td></td><td></td></tr>
+<tr><td>Total</td><td>23571.372</td><td>62</td><td>7851.714</td><td></td><td></td></tr>
+</tbody>
+</table>
+
+    </div>
+    <a name='table_4'></a><table><caption>Beta coefficients</caption><thead><th>coeff</th><th>b</th><th>beta</th><th>se</th><th>t</th></thead>
+<tbody>
+<tr><td>Constant</td><td>-0.520303</td><td>-</td><td>0.131039</td><td>-3.970594</td></tr>
+<tr><td>cases</td><td>-0.000708</td><td>-0.011324</td><td>0.000341</td><td>-2.074007</td></tr>
+<tr><td>vars</td><td>1.234451</td><td>0.855546</td><td>0.006278</td><td>196.641087</td></tr>
+<tr><td>c_v</td><td>0.000735</td><td>0.271138</td><td>0.000016</td><td>44.912972</td></tr>
+</tbody>
+</table>
+
+  </div>
+</body></html>

data/benchmarks/correlation_matrix_methods/correlation_matrix.rb

@@ -0,0 +1,71 @@
+# This test create a database to adjust the best algorithm
+# to use on correlation matrix
+require(File.expand_path(File.dirname(__FILE__)+'/../helpers_benchmark.rb'))
+require 'statsample'
+require 'benchmark'
+
+def create_dataset(vars,cases) 
+  ran = Distribution::Normal.rng
+  ds  = Daru::DataFrame.new(
+    vars.times.inject({}) do |ac,v|
+      ac["x#{v}".to_sym] = Daru::Vector.new_with_size(cases) {ran.call}
+      ac
+    end
+  )
+end
+
+def prediction_pairwise(vars,cases)
+	Statsample::Bivariate.prediction_pairwise(vars,cases) / 10
+end
+def prediction_optimized(vars,cases)
+	Statsample::Bivariate.prediction_optimized(vars,cases) / 10
+end
+
+if !File.exists?("correlation_matrix.ds") or File.mtime(__FILE__) > File.mtime("correlation_matrix.ds")
+reps=100 #number of repetitions
+ds_sizes=[5,10,30,50,100,150,200,500,1000]
+ds_vars=[3,4,5,10,20,30,40]
+#ds_sizes=[5,10]
+#ds_vars=[3,5,20]
+rs = Daru::DataFrame.new({}, order: [:cases, :vars, :time_optimized, :time_pairwise])
+
+ds_sizes.each do |cases|
+  ds_vars.each do |vars|
+      ds = create_dataset(vars,cases)
+      time_optimized= Benchmark.realtime do
+        reps.times { 
+        Statsample::Bivariate.correlation_matrix_optimized(ds) 
+        ds.clear_gsl
+        }
+      end
+      
+      time_pairwise= Benchmark.realtime do
+        reps.times { Statsample::Bivariate.correlation_matrix_pairwise(ds) }
+      end
+      
+      puts "Cases:#{cases}, vars:#{vars} -> opt:%0.3f (%0.3f) | pair: %0.3f (%0.3f)" % [time_optimized, prediction_optimized(vars,cases), time_pairwise, prediction_pairwise(vars,cases)]
+      
+      rs.add_row(Daru::Vector.new({
+        :cases          => cases,
+        :vars           => vars,
+        :time_optimized => Math.sqrt(time_optimized*1000),
+        :time_pairwise  =>Math.sqrt(time_pairwise*1000)
+        })
+      )
+    end
+  end 
+else
+  rs=Statsample.load("correlation_matrix.ds")
+end
+
+rs[:c_v] = rs.collect {|row| row[:cases]*row[:vars]}
+
+rs.save("correlation_matrix.ds")
+Statsample::Excel.write(rs,"correlation_matrix.xls")
+
+rb = ReportBuilder.new(:name=>"Correlation matrix analysis")
+
+rb.add(Statsample::Regression.multiple(rs[:cases,:vars,:time_optimized,:c_v],:time_optimized, :digits=>6))
+rb.add(Statsample::Regression.multiple(rs[:cases,:vars,:time_pairwise,:c_v],:time_pairwise, :digits=>6))
+
+rb.save_html("correlation_matrix.html")