rumale 0.23.3 → 0.24.0

data/CHANGELOG.md

@@ -1,643 +0,0 @@
-# 0.23.3
-- Fix build failure with Xcode 14 and Ruby 3.1.x.
-
-# 0.23.2
-Rumale project will be rebooted on version 0.24.0.
-This version is probably the last release of the series starting with version 0.8.0.
-
-- Refactor some codes and configs.
-- Deprecate VPTree class.
-
-# 0.23.1
-- Fix all estimators to return inference results in a contiguous narray.
-- Fix to use until statement instead of recursive call on apply methods of tree estimators.
-- Rename native extension files.
-- Introduce clang-format for native extension codes.
-
-# 0.23.0
-## Breaking change
-- Change automalically selected solver from sgd to lbfgs in
-[LinearRegression](https://yoshoku.github.io/rumale/doc/Rumale/LinearModel/LinearRegression.html) and
-[Ridge](https://yoshoku.github.io/rumale/doc/Rumale/LinearModel/Ridge.html).
-  - When given 'auto' to solver parameter, these estimator select  the 'svd' solver if Numo::Linalg is loaded.
-  Otherwise, they select the 'lbfgs' solver.
-
-# 0.22.5
-- Add transformer class for calculating kernel matrix.
-  - [KernelCalculator](https://yoshoku.github.io/rumale/doc/Rumale/Preprocessing/KernelCalculator.html)
-- Add classifier class based on Ridge regression.
-  - [KernelRidgeClassifier](https://yoshoku.github.io/rumale/doc/Rumale/KernelMachine/KernelRidgeClassifier.html)
-- Add supported kernel functions to [Nystroem](https://yoshoku.github.io/rumale/doc/Rumale/KernelApproximation/Nystroem.html).
-- Add parameter for specifying the number of features to [load_libsvm_file](https://yoshoku.github.io/rumale/doc/Rumale/Dataset.html#load_libsvm_file-class_method).
-
-# 0.22.4
-- Add classifier and regressor classes for voting ensemble method.
-  - [VotingClassifier](https://yoshoku.github.io/rumale/doc/Rumale/Ensemble/VotingClassifier.html)
-  - [VotingRegressor](https://yoshoku.github.io/rumale/doc/Rumale/Ensemble/VotingRegressor.html)
-- Refactor some codes.
-- Fix some typos on API documentation.
-
-# 0.22.3
-- Add regressor class for non-negative least square method.
-  - [NNLS](https://yoshoku.github.io/rumale/doc/Rumale/LinearModel/NNLS.html)
-- Add lbfgs solver to [Ridge](https://yoshoku.github.io/rumale/doc/Rumale/LinearModel/Ridge.html) and [LinearRegression](https://yoshoku.github.io/rumale/doc/Rumale/LinearModel/LinearRegression.html).
-  - In version 0.23.0, these classes will be changed to attempt to optimize with 'svd' or 'lbfgs' solver if 'auto' is given to
-  the solver parameter. If you use 'sgd' solver, you need specify it explicitly.
-- Add GC guard to native extension codes.
-- Update API documentation.
-
-# 0.22.2
-- Add classifier and regressor classes for stacking method.
-  - [StackingClassifier](https://yoshoku.github.io/rumale/doc/Rumale/Ensemble/StackingClassifier.html)
-  - [StackingRegressor](https://yoshoku.github.io/rumale/doc/Rumale/Ensemble/StackingRegressor.html)
-- Refactor some codes with Rubocop.
-
-# 0.22.1
-- Add transfomer class for [MLKR](https://yoshoku.github.io/rumale/doc/Rumale/MetricLearning/MLKR.html), that implements Metric Learning for Kernel Regression.
-- Refactor NeighbourhoodComponentAnalysis.
-- Update API documentation.
-
-# 0.22.0
-## Breaking change
-- Add lbfgsb.rb gem to runtime dependencies. Rumale uses lbfgsb gem for optimization.
-This eliminates the need to require the mopti gem when using [NeighbourhoodComponentAnalysis](https://yoshoku.github.io/rumale/doc/Rumale/MetricLearning/NeighbourhoodComponentAnalysis.html).
-- Add lbfgs solver to [LogisticRegression](https://yoshoku.github.io/rumale/doc/Rumale/LinearModel/LogisticRegression.html) and make it the default solver.
-
-# 0.21.0
-## Breaking change
-- Change the default value of max_iter argument on LinearModel estimators to 1000.
-
-# 0.20.3
-- Fix to use automatic solver of PCA in NeighbourhoodComponentAnalysis.
-- Refactor some codes with Rubocop.
-- Update README.
-
-# 0.20.2
-- Add cross-validator class for time-series data.
-  - [TimeSeriesSplit](https://yoshoku.github.io/rumale/doc/Rumale/ModelSelection/TimeSeriesSplit.html)
-
-# 0.20.1
-- Add cross-validator classes that split data according group labels.
-  - [GroupKFold](https://yoshoku.github.io/rumale/doc/Rumale/ModelSelection/GroupKFold.html)
-  - [GroupShuffleSplit](https://yoshoku.github.io/rumale/doc/Rumale/ModelSelection/GroupShuffleSplit.html)
-- Fix fraction treating of the number of samples on shuffle split cross-validator classes.
-  - [ShuffleSplit](https://yoshoku.github.io/rumale/doc/Rumale/ModelSelection/ShuffleSplit.html)
-  - [StratifiedShuffleSplit](https://yoshoku.github.io/rumale/doc/Rumale/ModelSelection/StratifiedShuffleSplit.html)
-- Refactor some codes with Rubocop.
-
-# 0.20.0
-## Breaking changes
-- Delete deprecated estimators such as PolynomialModel, Optimizer, and BaseLinearModel.
-
-# 0.19.3
-- Add preprocessing class for [Binarizer](https://yoshoku.github.io/rumale/doc/Rumale/Preprocessing/Binarizer.html)
-- Add preprocessing class for [MaxNormalizer](https://yoshoku.github.io/rumale/doc/Rumale/Preprocessing/MaxNormalizer.html)
-- Refactor some codes with Rubocop.
-
-# 0.19.2
-- Fix L2Normalizer to avoid zero divide.
-- Add preprocssing class for [L1Normalizer](https://yoshoku.github.io/rumale/doc/Rumale/Preprocessing/L1Normalizer.html).
-- Add transformer class for [TfidfTransformer](https://yoshoku.github.io/rumale/doc/Rumale/FeatureExtraction/TfidfTransformer.html).
-
-# 0.19.1
-- Add cluster analysis class for [mini-batch K-Means](https://yoshoku.github.io/rumale/doc/Rumale/Clustering/MiniBatchKMeans.html).
-- Fix some typos.
-
-# 0.19.0
-## Breaking changes
-- Change mmh3 and mopti gem to non-runtime dependent library.
-  - The mmh3 gem is used in [FeatureHasher](https://yoshoku.github.io/rumale/doc/Rumale/FeatureExtraction/FeatureHasher.html).
-  You only need to require mmh3 gem when using FeatureHasher.
-    ```ruby
-    require 'mmh3'
-    require 'rumale'
-
-    encoder = Rumale::FeatureExtraction::FeatureHasher.new
-    ```
-  - The mopti gem is used in [NeighbourhoodComponentAnalysis](https://yoshoku.github.io/rumale/doc/Rumale/MetricLearning/NeighbourhoodComponentAnalysis.html).
-  You only need to require mopti gem when using NeighbourhoodComponentAnalysis.
-    ```ruby
-    require 'mopti'
-    require 'rumale'
-
-    transformer = Rumale::MetricLearning::NeighbourhoodComponentAnalysis.new
-    ```
-- Change the default value of solver parameter on [PCA](https://yoshoku.github.io/rumale/doc/Rumale/Decomposition/PCA.html) to 'auto'.
-If Numo::Linalg is loaded, 'evd' is selected for the solver, otherwise 'fpt' is selected.
-- Deprecate [PolynomialModel](https://yoshoku.github.io/rumale/doc/Rumale/PolynomialModel.html), [Optimizer](https://yoshoku.github.io/rumale/doc/Rumale/Optimizer.html), and the estimators contained in them. They will be deleted in version 0.20.0.
-  - Many machine learning libraries do not contain factorization machine algorithms, they are provided by another compatible library.
-  In addition, there are no plans to implement estimators in PolynomialModel.
-  Thus, the author decided to deprecate PolynomialModel.
-  - Currently, the Optimizer classes are only used by PolynomialModel estimators.
-  Therefore, they have been deprecated together with PolynomialModel.
-
-# 0.18.7
-- Fix to convert target_name to string array in [classification_report method](https://yoshoku.github.io/rumale/doc/Rumale/EvaluationMeasure.html#classification_report-class_method).
-- Refactor some codes with Rubocop.
-
-# 0.18.6
-- Fix some configuration files.
-- Update API documentation.
-
-# 0.18.5
-- Add functions for calculation of cosine similarity and distance to [Rumale::PairwiseMetric](https://yoshoku.github.io/rumale/doc/Rumale/PairwiseMetric.html).
-- Refactor some codes with Rubocop.
-
-# 0.18.4
-- Add transformer class for [KernelFDA](https://yoshoku.github.io/rumale/doc/Rumale/KernelMachine/KernelFDA.html).
-- Refactor [KernelPCA](https://yoshoku.github.io/rumale/doc/Rumale/KernelMachine/KernelPCA.html).
-- Fix API documentation.
-
-# 0.18.3
-- Fix API documentation on [KNeighborsRegressor](https://yoshoku.github.io/rumale/doc/Rumale/NearestNeighbors/KNeighborsRegressor.html)
-- Refector [rbf_kernel](https://yoshoku.github.io/rumale/doc/Rumale/PairwiseMetric.html#rbf_kernel-class_method) method.
-- Delete unneeded marshal dump and load methods. The deletion work is complete.
-  - [Tree](https://yoshoku.github.io/rumale/doc/Rumale/Tree.html),
-  [Ensemble](https://yoshoku.github.io/rumale/doc/Rumale/Ensemble.html),
-  [Optimizer](https://yoshoku.github.io/rumale/doc/Rumale/Optimizer.html),
-  [OneVsRestClassifier](https://yoshoku.github.io/rumale/doc/Rumale/Multiclass/OneVsRestClassifier.html),
-  [GridSearchCV](https://yoshoku.github.io/rumale/doc/Rumale/ModelSelection/GridSearchCV.html).
-
-# 0.18.2
-- Change file composition of naive bayes classifiers.
-- Add classifier class for [ComplementNaiveBayes](https://yoshoku.github.io/rumale/doc/Rumale/NaiveBayes/ComplementNB.html).
-- Add classifier class for [NegationNaiveBayes](https://yoshoku.github.io/rumale/doc/Rumale/NaiveBayes/NegationNB.html).
-- Add [module function](https://yoshoku.github.io/rumale/doc/Rumale/EvaluationMeasure.html#confusion_matrix-class_method) for calculating confusion matrix.
-- Delete unneeded marshal dump and load methods.
-  - [Clustering](https://yoshoku.github.io/rumale/doc/Rumale/Clustering.html),
-  [KernelApproximation](https://yoshoku.github.io/rumale/doc/Rumale/KernelApproximation.html),
-  [KernelMachine](https://yoshoku.github.io/rumale/doc/Rumale/KernelMachine.html),
-  [NearestNeighbors](https://yoshoku.github.io/rumale/doc/Rumale/NearestNeighbors.html),
-  [Preprocessing](https://yoshoku.github.io/rumale/doc/Rumale/Preprocessing.html).
-
-# 0.18.1
-- Add [module function](https://yoshoku.github.io/rumale/doc/Rumale/EvaluationMeasure.html#classification_report-class_method) for generating summary of classification performance.
-- Delete marshal dump and load methods for documentation.
-  The marshal methods are written in estimator classes for indicating on API documentation that the learned model can be saved with Marshal.
-  Even without these methods, Marshal can save the learned model, so they are deleted sequentially.
-  - [Manifold](https://yoshoku.github.io/rumale/doc/Rumale/Manifold.html),
-  [NaiveBayes](https://yoshoku.github.io/rumale/doc/Rumale/NaiveBayes.html),
-  [PolynomialModel](https://yoshoku.github.io/rumale/doc/Rumale/PolynomialModel.html),
-  [Decomposition](https://yoshoku.github.io/doc/Rumale/Decomposition.html).
-
-# 0.18.0
-- Add transformer class for [FisherDiscriminantAnalysis](https://yoshoku.github.io/rumale/doc/Rumale/MetricLearning/FisherDiscriminantAnalysis.html).
-- Add transformer class for [NeighbourhoodComponentAnalysis](https://yoshoku.github.io/rumale/doc/Rumale/MetricLearning/NeighbourhoodComponentAnalysis.html).
-- Add [module function](https://yoshoku.github.io/rumale/doc/Rumale/ModelSelection.html#train_test_split-class_method) for hold-out validation.
-
-# 0.17.3
-- Add pipeline class for [FeatureUnion](https://yoshoku.github.io/rumale/doc/Rumale/Pipeline/FeatureUnion.html).
-- Fix to use mmh3 gem for generating hash value on [FeatureHasher](https://yoshoku.github.io/rumale/doc/Rumale/FeatureExtraction/FeatureHasher.html).
-
-# 0.17.2
-- Add transformer class for kernel approximation with [Nystroem](https://yoshoku.github.io/rumale/doc/Rumale/KernelApproximation/Nystroem.html) method.
-- Delete array validation on [Pipeline](https://yoshoku.github.io/rumale/doc/Rumale/Pipeline/Pipeline.html) class considering that array of hash is given to HashVectorizer.
-
-# 0.17.1
-- Add transformer class for [PolynomialFeatures](https://yoshoku.github.io/rumale/doc/Rumale/Preprocessing/PolynomialFeatures.html)
-- Add verbose and tol parameter to [FactorizationMachineClassifier](https://yoshoku.github.io/rumale/doc/Rumale/PolynomialModel/FactorizationMachineClassifier.html)
-  and [FactorizationMachineRegressor](https://yoshoku.github.io/rumale/doc/Rumale/PolynomialModel/FactorizationMachineRegressor.html)
-- Fix bug that factor elements of Factorization Machines estimators are not learned caused by initializing factors to zero.
-
-# 0.17.0
-## Breaking changes
-- Fix all linear model estimators to use the new abstract class ([BaseSGD](https://yoshoku.github.io/rumale/doc/Rumale/LinearModel/BaseSGD.html)) introduced in version 0.16.1.
-  The major differences from the old abstract class are that
-  the optimizer of LinearModel estimators is fixed to mini-batch SGD with momentum term,
-  the max_iter parameter indicates the number of epochs instead of the maximum number of iterations,
-  the fit_bias parameter is true by default, and elastic-net style regularization can be used.
-  Note that there are additions and changes to hyperparameters.
-  Existing trained linear models may need to re-train the model and adjust the hyperparameters.
-  - [LogisticRegression](https://yoshoku.github.io/rumale/doc/Rumale/LinearModel/LogisticRegression.html)
-  - [SVC](https://yoshoku.github.io/rumale/doc/Rumale/LinearModel/SVC.html)
-  - [LinearRegression](https://yoshoku.github.io/rumale/doc/Rumale/LinearModel/LinearRegression.html)
-  - [Rdige](https://yoshoku.github.io/rumale/doc/Rumale/LinearModel/Ridge.html)
-  - [Lasso](https://yoshoku.github.io/rumale/doc/Rumale/LinearModel/Lasso.html)
-  - [SVR](https://yoshoku.github.io/rumale/doc/Rumale/LinearModel/SVR.html)
-- Change the default value of solver parameter on LinearRegression and Ridge to 'auto'.
-If Numo::Linalg is loaded, 'svd' is selected for the solver, otherwise 'sgd' is selected.
-- The meaning of the `max_iter` parameter of the factorization machine estimators
-has been changed from the maximum number of iterations to the number of epochs.
-  - [FactorizationMachineClassifier](https://yoshoku.github.io/rumale/doc/Rumale/PolynomialModel/FactorizationMachineClassifier.html)
-  - [FactorizationMachineRegressor](https://yoshoku.github.io/rumale/doc/Rumale/PolynomialModel/FactorizationMachineRegressor.html)
-
-# 0.16.1
-- Add regressor class for [ElasticNet](https://yoshoku.github.io/rumale/doc/Rumale/LinearModel/ElasticNet.html).
-- Add new linear model abstract class.
-  - In version 0.17.0, all LinearModel estimators will be changed to use this new abstract class.
-  The major differences from the existing abstract class are that
-  the optimizer of LinearModel estimators is fixed to mini-batch SGD with momentum term,
-  the max_iter parameter indicates the number of epochs instead of the maximum number of iterations,
-  the fit_bias parameter is true by default, and elastic-net style regularization can be used.
-
-# 0.16.0
-## Breaking changes
-- The meaning of the `max_iter` parameter of the multi-layer perceptron estimators
-has been changed from the maximum number of iterations to the number of epochs.
-The number of epochs is how many times the whole data is given to the training process.
-As a future plan, similar changes will be applied to other estimators used stochastic gradient descent such as SVC and Lasso.
-  - [MLPClassifier](https://yoshoku.github.io/rumale/doc/Rumale/NeuralNetwork/MLPClassifier.html)
-  - [MLPRegressor](https://yoshoku.github.io/rumale/doc/Rumale/NeuralNetwork/MLPRegressor.html)
-
-# 0.15.0
-- Add feature extractor classes:
-  - [HashVectorizer](https://yoshoku.github.io/rumale/doc/Rumale/FeatureExtraction/HashVectorizer.html)
-  - [FeatureHasher](https://yoshoku.github.io/rumale/doc/Rumale/FeatureExtraction/FeatureHasher.html)
-
-# 0.14.5
-- Fix to suppress deprecation warning about keyword argument in Ruby 2.7.
-
-# 0.14.4
-- Add metric parameter that specifies distance metric to
-[KNeighborsClassifier](https://yoshoku.github.io/rumale/doc/Rumale/NearestNeighbors/KNeighborsClassifier.html) and
-[KNeighborsRegressor](https://yoshoku.github.io/rumale/doc/Rumale/NearestNeighbors/KNeighborsRegressor.html).
-- Add algorithm parameter that specifies nearest neighbor search algorithm to
-[KNeighborsClassifier](https://yoshoku.github.io/rumale/doc/Rumale/NearestNeighbors/KNeighborsClassifier.html) and
-[KNeighborsRegressor](https://yoshoku.github.io/rumale/doc/Rumale/NearestNeighbors/KNeighborsRegressor.html).
-- Add nearest neighbor search class with [vantage point tree](https://yoshoku.github.io/rumale/doc/Rumale/NearestNeighbors/VPTree.html).
-
-# 0.14.3
-- Fix documents of GradientBoosting, RandomForest, and ExtraTrees.
-- Refactor gaussian mixture clustering with Rubocop.
-- Refactor specs.
-
-# 0.14.2
-- Refactor extension codes of decision tree estimators.
-- Refactor specs.
-
-# 0.14.1
-- Fix bug where MDS optimization is not performed when tol paremeter is given.
-- Refactor specs.
-
-# 0.14.0
-- Add classifier and regressor class with multi-layer perceptron.
-  - [MLPClassifier](https://yoshoku.github.io/rumale/doc/Rumale/NeuralNetwork/MLPClassifier.html)
-  - [MLPRegressor](https://yoshoku.github.io/rumale/doc/Rumale/NeuralNetwork/MLPRegressor.html)
-- Refactor specs.
-
-## Breaking changes
-- Change predict method of SVC, LogisticRegression, and FactorizationMachineClassifier classes to return the original label instead of -1 or 1 labels when binary classification problem.
-- Fix hyperparameter validation to check if the type of given value is Numeric type.
-- Fix array validation for samples, labels, and target values to accept Ruby Array.
-
-```ruby
-require 'rumale'
-
-samples = [[-1, 1], [1, 1], [1, -1], [-1, -1]]
-labels = [0, 1, 1, 0]
-
-svc = Rumale::LinearModel::SVC.new(reg_param: 1, batch_size: 1, random_seed: 1)
-svc.fit(samples, labels)
-svc.predict([[-1, 0], [1, 0]])
-# => Numo::Int32#shape=[2]
-# [0, 1]
-```
-
-# 0.13.8
-- Add [module function](https://yoshoku.github.io/rumale/doc/Rumale/Dataset.html#make_blobs-class_method) for generating artificial dataset with gaussian blobs.
-- Add documents about Rumale::SVM.
-- Refactor specs.
-
-# 0.13.7
-- Add some evaluator classes for clustering.
-  - [SilhouetteScore](https://yoshoku.github.io/rumale/doc/Rumale/EvaluationMeasure/SilhouetteScore.html)
-  - [CalinskiHarabaszScore](https://yoshoku.github.io/rumale/doc/Rumale/EvaluationMeasure/CalinskiHarabaszScore.html)
-  - [DaviesBouldinScore](https://yoshoku.github.io/rumale/doc/Rumale/EvaluationMeasure/DaviesBouldinScore.html)
-
-# 0.13.6
-- Add transformer class for [FastICA](https://yoshoku.github.io/rumale/doc/Rumale/Decomposition/FastICA.html).
-- Fix a typo on README ([#13](https://github.com/yoshoku/rumale/pull/13)).
-
-# 0.13.5
-- Add transformer class for [Factor Analysis](https://yoshoku.github.io/rumale/doc/Rumale/Decomposition/FactorAnalysis.html).
-- Add covariance_type parameter to [Rumale::Clustering::GaussianMixture](https://yoshoku.github.io/rumale/doc/Rumale/Clustering/GaussianMixture.html).
-
-# 0.13.4
-- Add cluster analysis class for [HDBSCAN](https://yoshoku.github.io/rumale/doc/Rumale/Clustering/HDBSCAN.html).
-- Add cluster analysis class for [spectral clustering](https://yoshoku.github.io/rumale/doc/Rumale/Clustering/SpectralClustering.html).
-- Refactor power iteration clustering.
-- Several documentation improvements.
-
-# 0.13.3
-- Add transformer class for [Kernel PCA](https://yoshoku.github.io/rumale/doc/Rumale/KernelMachine/KernelPCA.html).
-- Add regressor class for [Kernel Ridge](https://yoshoku.github.io/rumale/doc/Rumale/KernelMachine/KernelRidge.html).
-
-# 0.13.2
-- Add preprocessing class for label binarization.
-- Fix to use LabelBinarizer instead of OneHotEncoder.
-- Fix bug that OneHotEncoder leaves elements related to values that do not occur in training data.
-
-# 0.13.1
-- Add class for Shared Neareset Neighbor clustering.
-- Add function for calculation of manhattan distance to Rumale::PairwiseMetric.
-- Add metric parameter that specifies distance metric to Rumale::Clustering::DBSCAN.
-- Add the solver parameter that specifies the optimization algorithm to Rumale::LinearModel::LinearRegression.
-- Add the solver parameter that specifies the optimization algorithm to Rumale::LinearModel::Ridge.
-- Fix bug that the ndim of NArray of 1-dimensional principal components is not 1.
-
-# 0.13.0
-- Introduce [Numo::Linalg](https://github.com/ruby-numo/numo-linalg) to use linear algebra algorithms on the optimization.
-- Add the solver parameter that specifies the optimization algorithm to Rumale::Decomposition::PCA.
-
-```ruby
-require 'rumale'
-
-# Loading Numo::Linalg enables features based on linear algebra algorithms.
-require 'numo/linalg/autoloader'
-
-decomposer = Rumale::Decomposition::PCA.new(n_components: 2, solver: 'evd')
-low_dimensional_samples = decomposer.fit_transform(samples)
-```
-
-# 0.12.9
-- Add class for K-Medoids clustering.
-- Fix extension codes of decision tree regressor for using Numo::NArray.
-
-# 0.12.8
-- Fix bug that fails to build and install on Windows again. Fix extconf to add Numo::NArray libraries to $lib.
-
-# 0.12.7
-- Fix bug that fails to build and install on Windows. Add search for Numo::NArray static library path to extconf.
-
-# 0.12.6
-- Fix extension codes of decision tree classifier and gradient tree regressor for using Numo::NArray.
-
-# 0.12.5
-- Fix random number generator initialization on gradient boosting estimators
-to obtain the same result with and without parallel option.
-
-# 0.12.4
-- Add class for multidimensional scaling.
-- Fix parameter description on artificial dataset generation method.
-
-# 0.12.3
-- Add class for Power Iteration clustering.
-- Add classes for artificial dataset generation.
-
-# 0.12.2
-- Add class for cluster analysis with Gaussian Mixture Model.
-- Add encoder class for categorical features.
-
-# 0.12.1
-- Refactor kernel support vector classifier.
-- Refactor random sampling on tree estimators.
-
-# 0.12.0
-## Breaking changes
-- For reproductivity, Rumale changes to not repeatedly use the same random number generator in the same estimator.
-In the training phase, estimators use a copy of the random number generator created in the initialize method.
-Even with the same algorithm and the same data, the order of random number generation
-may make slight differences in learning results.
-By this change, even if the fit method is executed multiple times,
-the same learning result can be obtained if the same data is given.
-
-```ruby
-svc = Rumale::LinearModel::SVC.new(random_seed: 0)
-svc.fit(x, y)
-a = svc.weight_vec
-svc.fit(x, y)
-b = svc.weight_vec
-err = ((a - b)**2).mean
-
-# In version 0.11.0 or earlier, false may be output,
-# but from this version, true is always output.
-puts(err < 1e-4)
-```
-
-# 0.11.0
-- Introduce [Parallel gem](https://github.com/grosser/parallel) to improve execution speed for one-vs-the-rest and bagging methods.
-- Add the n_jobs parameter that specifies the number of jobs for parallel processing in some estimators belong to the Rumale::LinearModel, Rumale::PolynomialModel, and Rumale::Ensemble.
-- The n_jobs parameter is valid only when parallel gem is loaded.
-
-```ruby
-require 'rumale'
-require 'parallel'
-
-svc = Rumale::LinearModel::SVC.new(n_jobs: -1)
-```
-
-# 0.10.0
-- Add class for t-distributed Stochastic Neighborhood Embedding.
-- Fix bug of zero division on min-max scaling class.
-
-# 0.9.2
-- Add class for Gradient tree boosting classifier.
-- Add class for Gradient tree boosting regressor.
-- Add class for discretizing feature values.
-- Refactor extra-trees estimators.
-- Refactor decision tree base class.
-- Fix some typos on document ([#6](https://github.com/yoshoku/rumale/pull/6)).
-
-# 0.9.1
-- Add class for Extra-Trees classifier.
-- Add class for Extra-Trees regressor.
-- Refactor extension modules of decision tree estimators for improving performance.
-
-# 0.9.0
-## Breaking changes
-- Decide to introduce Ruby extensions for improving performance.
-- Fix to find split point on decision tree estimators using extension modules.
-
-# 0.8.4
-- Remove unused parameter on Nadam.
-- Fix condition to stop growing tree about decision tree.
-
-# 0.8.3
-- Add optimizer class for AdaGrad.
-- Add evaluator class for ROC AUC.
-- Add class for scaling with maximum absolute value.
-
-# 0.8.2
-- Add class for Adam optimizer.
-- Add data splitter classes for random permutation cross validation.
-- Add accessor method for number of splits to K-fold splitter classes.
-- Add execution result of example script on README ([#3](https://github.com/yoshoku/rumale/pull/3)).
-
-# 0.8.1
-- Add some evaluator classes.
-  - MeanSquaredLogError
-  - MedianAbsoluteError
-  - ExplainedVarianceScore
-  - AdjustedRandScore
-  - MutualInformation
-- Refactor normalized mutual infomation evaluator.
-- Fix typo on document ([#2](https://github.com/yoshoku/rumale/pull/2)).
-
-# 0.8.0
-## Breaking changes
-- Rename SVMKit to Rumale.
-- Rename SGDLienareEstimator class to BaseLienarModel class.
-- Add data type option to load_libsvm_file method. By default, the method represents the feature with Numo::DFloat.
-
-## Refactoring
-- Refactor factorization machine estimators.
-- Refactor decision tree estimators.
-
-# 0.7.3
-- Add class for grid search performing hyperparameter optimization.
-- Add argument validations to Pipeline.
-
-# 0.7.2
-- Add class for Pipeline that constructs chain of transformers and estimators.
-- Fix some typos on document ([#1](https://github.com/yoshoku/SVMKit/pull/1)).
-
-# 0.7.1
-- Fix to use CSV class in parsing libsvm format file.
-- Refactor ensemble estimators.
-
-# 0.7.0
-- Add class for AdaBoost classifier.
-- Add class for AdaBoost regressor.
-
-# 0.6.3
-- Fix bug on setting random seed and max_features parameter of Random Forest estimators.
-
-# 0.6.2
-- Refactor decision tree classes for improving performance.
-
-# 0.6.1
-- Add abstract class for linear estimator with stochastic gradient descent.
-- Refactor linear estimators to use linear esitmator abstract class.
-- Refactor decision tree classes to avoid unneeded type conversion.
-
-# 0.6.0
-- Add class for Principal Component Analysis.
-- Add class for Non-negative Matrix Factorization.
-
-# 0.5.2
-- Add class for DBSCAN clustering.
-
-# 0.5.1
-- Fix bug on class probability calculation of DecisionTreeClassifier.
-
-# 0.5.0
-- Add class for K-Means clustering.
-- Add class for evaluating purity.
-- Add class for evaluating normalized mutual information.
-
-# 0.4.1
-- Add class for linear regressor.
-- Add class for SGD optimizer.
-- Add class for RMSProp optimizer.
-- Add class for YellowFin optimizer.
-- Fix to be able to select optimizer on estimators of LineaModel and PolynomialModel.
-
-# 0.4.0
-## Breaking changes
-
-SVMKit introduces optimizer algorithm that calculates learning rates adaptively
-on each iteration of stochastic gradient descent (SGD).
-While Pegasos SGD runs fast, it sometimes fails to optimize complicated models
-like Factorization Machine.
-To solve this problem, in version 0.3.3, SVMKit introduced optimization with RMSProp on
-FactorizationMachineRegressor, Ridge and Lasso.
-This attempt realized stable optimization of those estimators.
-Following the success of the attempt, author decided to use modern optimizer algorithms
-with all SGD optimizations in SVMKit.
-Through some preliminary experiments, author implemented Nadam as the default optimizer.
-SVMKit plans to add other optimizer algorithms sequentially, so that users can select them.
-
-- Fix to use Nadam for optimization on SVC, SVR, LogisticRegression, Ridge, Lasso, and Factorization Machine estimators.
-  - Combine reg_param_weight and reg_param_bias parameters on Factorization Machine estimators into the unified parameter named reg_param_linear.
-  - Remove init_std paramter on Factorization Machine estimators.
-  - Remove learning_rate, decay, and momentum parameters on Ridge, Lasso, and FactorizationMachineRegressor.
-  - Remove normalize parameter on SVC, SVR, and LogisticRegression.
-
-# 0.3.3
-- Add class for Ridge regressor.
-- Add class for Lasso regressor.
-- Fix bug on gradient calculation of FactorizationMachineRegressor.
-- Fix some documents.
-
-# 0.3.2
-- Add class for Factorization Machine regressor.
-- Add class for Decision Tree regressor.
-- Add class for Random Forest regressor.
-- Fix to support loading and dumping libsvm file with multi-target variables.
-- Fix to require DecisionTreeClassifier on RandomForestClassifier.
-- Fix some mistakes on document.
-
-# 0.3.1
-- Fix bug on decision function calculation of FactorizationMachineClassifier.
-- Fix bug on weight updating process of KernelSVC.
-
-# 0.3.0
-- Add class for Support Vector Regression.
-- Add class for K-Nearest Neighbor Regression.
-- Add class for evaluating coefficient of determination.
-- Add class for evaluating mean squared error.
-- Add class for evaluating mean absolute error.
-- Fix to use min method instead of sort and first methods.
-- Fix cross validation class to be able to use for regression problem.
-- Fix some typos on document.
-- Rename spec filename for Factorization Machine classifier.
-
-# 0.2.9
-- Add predict_proba method to SVC and KernelSVC.
-- Add class for evaluating logarithmic loss.
-- Add classes for Label- and One-Hot- encoding.
-- Add some validator.
-- Fix bug on training data score calculation of cross validation.
-- Fix fit method of SVC for performance.
-- Fix criterion calculation on Decision Tree for performance.
-- Fix data structure of Decision Tree for performance.
-
-# 0.2.8
-- Fix bug on gradient calculation of Logistic Regression.
-- Fix to change accessor of params of estimators to read only.
-- Add parameter validation.
-
-# 0.2.7
-- Fix to support multiclass classifiction into LinearSVC, LogisticRegression, KernelSVC, and FactorizationMachineClassifier
-
-# 0.2.6
-- Add class for Decision Tree classifier.
-- Add class for Random Forest classifier.
-- Fix to use frozen string literal.
-- Refactor marshal dump method on some classes.
-- Introduce Coveralls to confirm test coverage.
-
-# 0.2.5
-- Add classes for Naive Bayes classifier.
-- Fix decision function method on Logistic Regression class.
-- Fix method visibility on RBF kernel approximation class.
-
-# 0.2.4
-- Add class for Factorization Machine classifier.
-- Add classes for evaluation measures.
-- Fix the method for prediction of class probability in Logistic Regression.
-
-# 0.2.3
-- Add class for cross validation.
-- Add specs for base modules.
-- Fix validation of the number of splits when a negative label is given.
-
-# 0.2.2
-- Add data splitter classes for K-fold cross validation.
-
-# 0.2.1
-- Add class for K-nearest neighbors classifier.
-
-# 0.2.0
-- Migrated the linear algebra library to Numo::NArray.
-- Add module for loading and saving libsvm format file.
-
-# 0.1.3
-- Add class for Kernel Support Vector Machine with Pegasos algorithm.
-- Add module for calculating pairwise kernel fuctions and euclidean distances.
-
-# 0.1.2
-- Add the function learning a model with bias term to the PegasosSVC and LogisticRegression classes.
-- Rewrite the document with yard notation.
-
-# 0.1.1
-- Add class for Logistic Regression with SGD optimization.
-- Fix some mistakes on the document.
-
-# 0.1.0
-- Add basic classes.
-- Add an utility module.
-- Add class for RBF kernel approximation.
-- Add class for Support Vector Machine with Pegasos alogrithm.
-- Add class that performs mutlclass classification with one-vs.-rest strategy.
-- Add classes for preprocessing such as min-max scaling, standardization, and L2 normalization.