ai4r 1.12 → 2.0

checksums.yaml

@@ -0,0 +1,7 @@
+---
+SHA256:
+  metadata.gz: 8d01465e193f7bda084a9cd76bc10e1dd4422b7c384eb0fe924d7a5f705123db
+  data.tar.gz: 64ffbe98250389997fbdc9fa1a93c4b79154c1b9d3cb4a5a6577c086ee392214
+SHA512:
+  metadata.gz: 2bf0626ab8227c93fbc8a784717806ec3c3b72a4e6d2f375f232be8ad0be9e5f1ee70c6dfc2be02cd2c6dd40311cb5ac1d840f3acc92300cc208c8ccfc839425
+  data.tar.gz: 5140c67b5213fa3ed1a9017c1d4dd09c05cba0786d27bc8b97c32e7d72d8638347f80ae22536ecacd4efb10742a88c2e7e263878baf73edcb064749564a1d8a0

data/README.md

@@ -0,0 +1,174 @@
+# AI4R — Artificial Intelligence for Ruby
+
+🎓 **Welcome to AI4R**
+
+Current version: 2.0
+
+Your Lightweight Lab for AI and Machine Learning in Ruby.
+
+AI4R isn’t just another machine learning library. It’s a learning playground. No black boxes and no bulky dependencies—just clean, readable Ruby implementations of core AI algorithms so you can explore, modify and really understand how they work.
+
+## Installation
+
+AI4R is distributed as a gem and requires Ruby 3.2 or later.
+
+Install the gem using RubyGems:
+
+```bash
+gem install ai4r
+```
+
+Add the library to your code:
+
+```ruby
+require 'ai4r'
+```
+
+## Where to start?
+- [Beginner Track](docs/learning_path_1_beginner.md) – Build core intuition for AI—step by step, in Ruby.
+- [Intermediate Track](docs/learning_path_2_intermediate.md) – From "I can run a model" to "I can tune, extend, and build smart stuff that actually works."
+- [Advanced Track](docs/learning_path_3_advanced.md) – Time to stop following recipes and start writing your own.
+
+
+## 🧭 What’s Inside?
+
+A quick map to AI4R’s built‑in toolkits, grouped by type. Each folder comes with examples and benchmark runners so you can dive right in.
+
+### 🤖 Transformers – *Play with the Building Blocks of Modern LLMs*
+
+> *“Meet your future coworker / overlord.”*
+
+This is not a full GPT—but it is the core logic, stripped down and readable.  
+AI4R ships with a bite-sized, dependency-free Transformer implementation that supports:
+
+- **Encoder-only** mode (like BERT)
+- **Decoder-only** mode (like GPT)
+- **Seq2Seq** mode (like T5)
+
+📂 Code: `lib/ai4r/neural_network/transformer.rb`
+Docs: [Transformer guide](docs/transformer.md)
+
+💡 **Try this**:  
+Load up the transformer and walk through a simple forward pass.  
+Everything from attention weights to layer normalization is short enough to read and understand in one go.
+
+### 🧠 Classifiers – Make Predictions
+"What’s the most likely outcome?"
+
+You’ll find in [lib/ai4r/classifiers/](lib/ai4r/classifiers/):
+
+- `ZeroR`, `OneR` – the simplest baselines
+- `LogisticRegression`, `SimpleLinearRegression`
+- `SupportVectorMachine`
+- `RandomForest`, `GradientBoosting`
+- `MultilayerPerceptron`
+
+Docs: [logistic_regression.md](docs/logistic_regression.md), [random_forest.md](docs/random_forest.md)
+
+Try this: run `compare_all.rb` to benchmark classifiers on real datasets.
+
+### 🔍 Clusterers – Find Hidden Patterns
+"What belongs together?"
+
+Includes in [lib/ai4r/clusterers/](lib/ai4r/clusterers/):
+
+- `KMeans`
+- `DBSCAN`
+- `Hierarchical` clustering variants
+
+Docs: [kmeans.md](docs/kmeans.md), [dbscan.md](docs/dbscan.md)
+
+Try this: cluster the Iris dataset using both KMeans and DBSCAN.
+
+### 🧬 Neural Networks – Learn From Data
+"What if we build a brain?"
+
+- Backpropagation – classic feedforward network
+- Hopfield – associative memory model
+- Transformer – a tiny GPT‑style block (encoder, decoder, seq2seq)
+
+Code: `lib/ai4r/neural_network/`
+
+Try this: open `transformer.rb` and trace each step—it’s short enough to grok in one sitting.
+
+### 🔎 Search Algorithms – Explore Possibility Spaces
+"What’s the best path?"
+
+You’ll find in [lib/ai4r/search/](lib/ai4r/search/):
+
+- `BreadthFirst`, `DepthFirst`, `IterativeDeepening`
+- `A*`
+- `MonteCarloTreeSearch`
+
+Docs: [search_algorithms.md](docs/search_algorithms.md)
+
+Try this: run A* and DFS on a maze and time the difference.
+
+### 🧪 Genetic Algorithms – Evolve a Solution
+"Let’s mutate our way to a better answer."
+
+- Generic GA framework
+- A Traveling Salesman Problem (TSP) chromosome
+
+Code: `lib/ai4r/genetic_algorithm/`
+
+Try this: tweak the mutation rate in the TSP example.
+
+### 🧭 Reinforcement Learning – Learn by Doing
+"Reward me, and I’ll improve."
+
+- Q‑Learning
+- Policy Iteration
+
+Code: `lib/ai4r/reinforcement/`
+
+Docs: `docs/reinforcement_learning.md`
+
+Try this: run a grid‑world training loop and watch the agent build its own policy.
+
+### 🕵️ Hidden Markov Models – Guess What’s Hidden
+"You can’t see the states—but you can infer them."
+
+Code: `lib/ai4r/hmm/hidden_markov_model.rb`
+
+Docs: `docs/hmm.md`
+
+Try this: model a weather prediction problem with hidden states and visible activities.
+
+### 🧠 Self‑Organizing Maps – Compress Dimensions
+"Can we project complex data onto a simpler map?"
+
+- Kohonen‑style SOM
+
+Code: `lib/ai4r/som/`
+
+Try this: reduce high‑dimensional vectors into a 2D neuron grid and color it based on class.
+
+## 🧪 Benchmarks: Experiment & Compare
+
+Each algorithm family has a benchmark runner:
+
+- `bench/classifier/`
+- `bench/clusterer/`
+- `bench/search/`
+
+Shared tools in `bench/common/` make it easy to run head‑to‑head comparisons, track runtime, accuracy and more, and output clean reports.
+
+Docs: `docs/benches_overview.md`
+
+Try this: run `bench/search/astar_vs_dfs.rb` and explain why A* usually wins.
+
+
+```bash
+git clone https://github.com/SergioFierens/ai4r
+cd ai4r
+bundle install
+ruby bench/classifier/compare_all.rb
+```
+
+
+
+## 💬 Feedback?
+
+This library is maintained for the joy of it (and perhaps a misplaced sense of duty to Ruby). You can do whatever you want with it—it’s unlicensed. If you build something cool or just find it useful, drop a note in the [project's comments](https://github.com/SergioFierens/ai4r/discussions).
+

data/examples/classifiers/hyperpipes_data.csv

@@ -0,0 +1,14 @@
+city,age,gender,marketing_target
+New York,25,M,Y
+New York,23,M,Y
+New York,18,M,Y
+Chicago,43,M,Y
+New York,34,F,N
+Chicago,33,F,Y
+New York,31,F,N
+Chicago,55,M,N
+New York,58,F,N
+New York,59,M,N
+Chicago,71,M,N
+New York,60,F,N
+Chicago,85,F,Y

data/examples/classifiers/hyperpipes_example.rb

@@ -0,0 +1,22 @@
+# frozen_string_literal: true
+
+require_relative '../../lib/ai4r/classifiers/hyperpipes'
+require_relative '../../lib/ai4r/data/data_set'
+
+# Use fully qualified class names instead of including modules.
+
+# Load the training data
+file = "#{File.dirname(__FILE__)}/hyperpipes_data.csv"
+data = Ai4r::Data::DataSet.new.parse_csv_with_labels(file)
+
+# Build the classifier using custom parameters
+classifier = Ai4r::Classifiers::Hyperpipes.new.set_parameters(tie_break: :random).build(data)
+
+# Inspect the generated pipes
+pipes_summary = classifier.pipes
+puts 'Pipes summary:'
+pp pipes_summary
+
+# Classify new instances
+puts "Prediction for ['Chicago', 85, 'F']: #{classifier.eval(['Chicago', 85, 'F'])}"
+puts "Prediction for ['New York', 25, 'M']: #{classifier.eval(['New York', 25, 'M'])}"

data/examples/classifiers/ib1_example.rb

@@ -0,0 +1,12 @@
+# frozen_string_literal: true
+
+require_relative '../../lib/ai4r/classifiers/ib1'
+require_relative '../../lib/ai4r/data/data_set'
+
+file = "#{File.dirname(__FILE__)}/hyperpipes_data.csv"
+data = Ai4r::Data::DataSet.new.parse_csv_with_labels(file)
+
+classifier = Ai4r::Classifiers::IB1.new.build(data)
+
+sample = ['Chicago', 55, 'M']
+puts "Prediction for #{sample.inspect}: #{classifier.eval(sample)}"

data/examples/classifiers/id3_example.rb

@@ -1,13 +1,15 @@
+# frozen_string_literal: true
+
 # Author::    Sergio Fierens
 # License::   MPL 1.1
 # Project::   ai4r
 # Url::       http://www.ai4r.org/
 #
-# You can redistribute it and/or modify it under the terms of 
-# the Mozilla Public License version 1.1  as published by the 
+# You can redistribute it and/or modify it under the terms of
+# the Mozilla Public License version 1.1  as published by the
 # Mozilla Foundation at http://www.mozilla.org/MPL/MPL-1.1.txt
 
-require File.dirname(__FILE__) + '/../../lib/ai4r/classifiers/id3'
+require_relative '../../lib/ai4r/classifiers/id3'
 
 # Load data from data_set.csv
 data_filename = "#{File.dirname(__FILE__)}/id3_data.csv"
@@ -17,13 +19,16 @@ data_set = Ai4r::Data::DataSet.new.load_csv_with_labels data_filename
 id3 = Ai4r::Classifiers::ID3.new.build(data_set)
 
 # Show rules
-puts "Discovered rules are:"
+puts 'Discovered rules are:'
 puts id3.get_rules
-puts 
+puts
 
 # Try to predict some values
-puts "Prediction samples:"
-puts "['Moron Sur (GBA)','4','[86 m2 - 100 m2]'] => " + id3.eval(['Moron Sur (GBA)','4','[86 m2 - 100 m2]'])
-puts "['Moron Sur (GBA)','3','[101 m2 - 125 m2]'] => " + id3.eval(['Moron Sur (GBA)','3','[101 m2 - 125 m2]'])
-puts "['Recoleta (CABA)','3','[86 m2 - 100 m2]'] => " + id3.eval(['Recoleta (CABA)','3','[86 m2 - 100 m2]',])
-puts "['Tigre (GBA)','3','[71 m2 - 85 m2]'] => " + id3.eval(['Tigre (GBA)','3','[71 m2 - 85 m2]',])
+puts 'Prediction samples:'
+puts "['Moron Sur (GBA)','4','[86 m2 - 100 m2]'] => #{id3.eval(['Moron Sur (GBA)', '4',
+                                                                '[86 m2 - 100 m2]'])}"
+puts "['Moron Sur (GBA)','3','[101 m2 - 125 m2]'] => #{id3.eval(['Moron Sur (GBA)', '3',
+                                                                 '[101 m2 - 125 m2]'])}"
+puts "['Recoleta (CABA)','3','[86 m2 - 100 m2]'] => #{id3.eval(['Recoleta (CABA)', '3',
+                                                                '[86 m2 - 100 m2]'])}"
+puts "['Tigre (GBA)','3','[71 m2 - 85 m2]'] => #{id3.eval(['Tigre (GBA)', '3', '[71 m2 - 85 m2]'])}"

data/examples/classifiers/id3_graphviz_example.rb

@@ -0,0 +1,17 @@
+# frozen_string_literal: true
+
+require_relative '../../lib/ai4r/classifiers/id3'
+
+# Load the training data
+file = "#{File.dirname(__FILE__)}/id3_data.csv"
+data_set = Ai4r::Data::DataSet.new.load_csv_with_labels(file)
+
+# Build the tree
+id3 = Ai4r::Classifiers::ID3.new.build(data_set)
+
+# Export DOT representation
+File.open('id3_tree.dot', 'w') { |f| f.puts id3.to_graphviz }
+puts 'Decision tree saved to id3_tree.dot'
+
+# You can also inspect the tree as nested hashes
+p id3.to_h

data/examples/classifiers/logistic_regression_example.rb

@@ -0,0 +1,11 @@
+require 'ai4r/classifiers/logistic_regression'
+require 'ai4r/data/data_set'
+
+items = [[0, 0, 0], [0, 1, 1], [1, 0, 1], [1, 1, 1]]
+labels = %w[x1 x2 class]
+set = Ai4r::Data::DataSet.new(data_items: items, data_labels: labels)
+
+reg = Ai4r::Classifiers::LogisticRegression.new
+reg.set_parameters(learning_rate: 0.5, iterations: 2000).build(set)
+
+puts reg.eval([1, 0])

data/examples/classifiers/naive_bayes_attributes_example.rb

@@ -0,0 +1,13 @@
+# frozen_string_literal: true
+
+require_relative '../../lib/ai4r/classifiers/naive_bayes'
+require_relative '../../lib/ai4r/data/data_set'
+
+file = "#{File.dirname(__FILE__)}/naive_bayes_data.csv"
+set = Ai4r::Data::DataSet.new.load_csv_with_labels(file)
+
+bayes = Ai4r::Classifiers::NaiveBayes.new.set_parameters(m: 3).build(set)
+
+puts bayes.class_prob.inspect
+puts bayes.pcc.inspect
+puts bayes.pcp.inspect

data/examples/classifiers/naive_bayes_example.rb

@@ -1,16 +1,15 @@
-require File.dirname(__FILE__) + '/../../lib/ai4r/classifiers/naive_bayes'
-require File.dirname(__FILE__) + '/../../lib/ai4r/data/data_set'
-require File.dirname(__FILE__) + '/../../lib/ai4r/classifiers/id3'
-require 'benchmark'
+# frozen_string_literal: true
 
-include Ai4r::Classifiers
-include Ai4r::Data
+require_relative '../../lib/ai4r/classifiers/naive_bayes'
+require_relative '../../lib/ai4r/data/data_set'
+require_relative '../../lib/ai4r/classifiers/id3'
+require 'benchmark'
 
-data_set = DataSet.new
-data_set.load_csv_with_labels File.dirname(__FILE__) + "/naive_bayes_data.csv"
+data_set = Ai4r::Data::DataSet.new
+data_set.load_csv_with_labels "#{File.dirname(__FILE__)}/naive_bayes_data.csv"
 
-b = NaiveBayes.new.
-      set_parameters({:m=>3}).
-      build data_set
-p b.eval(["Red", "SUV", "Domestic"])
-p b.get_probability_map(["Red", "SUV", "Domestic"])
+b = Ai4r::Classifiers::NaiveBayes.new
+                                 .set_parameters({ m: 3 })
+                                 .build data_set
+p b.eval(%w[Red SUV Domestic])
+p b.get_probability_map(%w[Red SUV Domestic])

data/examples/classifiers/one_r_example.rb

@@ -0,0 +1,27 @@
+# frozen_string_literal: true
+
+# Author::    Example contributor
+# License::   MPL 1.1
+# Project::   ai4r
+#
+# Simple example showing how to use OneR with numeric attributes.
+
+require_relative '../../lib/ai4r/classifiers/one_r'
+require_relative '../../lib/ai4r/data/data_set'
+
+items = [
+  ['New York', 20, 'M', 'Y'],
+  ['Chicago', 25, 'M', 'Y'],
+  ['New York', 28, 'M', 'Y'],
+  ['New York', 35, 'F', 'N'],
+  ['Chicago', 40, 'F', 'Y'],
+  ['New York', 45, 'F', 'N'],
+  ['Chicago', 55, 'M', 'N']
+]
+labels = %w[city age gender marketing_target]
+
+ds = Ai4r::Data::DataSet.new(data_items: items, data_labels: labels)
+
+classifier = Ai4r::Classifiers::OneR.new.build(ds)
+puts classifier.get_rules
+puts classifier.eval(['Chicago', 55, 'M'])

data/examples/classifiers/parameter_tutorial.rb

@@ -0,0 +1,29 @@
+# frozen_string_literal: true
+
+# This small tutorial shows how changing parameters of ZeroR and OneR
+# affects the generated rules. Run it with `ruby parameter_tutorial.rb`.
+
+require_relative '../../lib/ai4r/classifiers/zero_r'
+require_relative '../../lib/ai4r/classifiers/one_r'
+require_relative '../../lib/ai4r/data/data_set'
+
+# Load the demonstration data set
+file = "#{File.dirname(__FILE__)}/zero_one_r_data.csv"
+set = Ai4r::Data::DataSet.new.load_csv_with_labels file
+
+puts '== ZeroR with default parameters =='
+zero_default = Ai4r::Classifiers::ZeroR.new.build(set)
+puts zero_default.get_rules
+
+puts "\n== ZeroR with :tie_break => :random =="
+zero_rand = Ai4r::Classifiers::ZeroR.new.set_parameters(tie_break: :random).build(set)
+puts zero_rand.get_rules
+
+puts "\n== OneR default behaviour =="
+one_default = Ai4r::Classifiers::OneR.new.build(set)
+puts one_default.get_rules
+
+puts "\n== OneR forcing first attribute and :last tie break =="
+one_custom = Ai4r::Classifiers::OneR.new.set_parameters(selected_attribute: 0,
+                                                        tie_break: :last).build(set)
+puts one_custom.get_rules

data/examples/classifiers/prism_nominal_example.rb

@@ -0,0 +1,15 @@
+# frozen_string_literal: true
+
+require_relative '../../lib/ai4r/classifiers/prism'
+require_relative '../../lib/ai4r/data/data_set'
+
+data_file = "#{File.dirname(__FILE__)}/zero_one_r_data.csv"
+data = Ai4r::Data::DataSet.new.load_csv_with_labels(data_file)
+
+classifier = Ai4r::Classifiers::Prism.new.build(data)
+
+puts 'Discovered rules:'
+puts classifier.get_rules
+puts
+sample = data.data_items.first[0...-1]
+puts "Prediction for #{sample.inspect}: #{classifier.eval(sample)}"

data/examples/classifiers/prism_numeric_example.rb

@@ -0,0 +1,21 @@
+# frozen_string_literal: true
+
+require_relative '../../lib/ai4r/classifiers/prism'
+require_relative '../../lib/ai4r/data/data_set'
+
+items = [
+  [20, 70, 'N'],
+  [25, 80, 'N'],
+  [30, 60, 'Y'],
+  [35, 65, 'Y']
+]
+labels = %w[temperature humidity play]
+
+data = Ai4r::Data::DataSet.new(data_items: items, data_labels: labels)
+
+classifier = Ai4r::Classifiers::Prism.new.build(data)
+
+puts 'Rules:'
+puts classifier.get_rules
+puts
+puts "Prediction for [30, 70]: #{classifier.eval([30, 70])}"

data/examples/classifiers/simple_linear_regression_example.csv

@@ -0,0 +1,159 @@
+symboling,normalized-losses,wheel-base,length,width,height,curb-weight,engine-size,bore,stroke,compression-ratio,horsepower,peak-rpm,city-mpg,highway-mpg,class
+2,164,99.8,176.6,66.2,54.3,2337,109,3.19,3.4,10,102,5500,24,30,13950
+2,164,99.4,176.6,66.4,54.3,2824,136,3.19,3.4,8,115,5500,18,22,17450
+1,158,105.8,192.7,71.4,55.7,2844,136,3.19,3.4,8.5,110,5500,19,25,17710
+1,158,105.8,192.7,71.4,55.9,3086,131,3.13,3.4,8.3,140,5500,17,20,23875
+2,192,101.2,176.8,64.8,54.3,2395,108,3.5,2.8,8.8,101,5800,23,29,16430
+0,192,101.2,176.8,64.8,54.3,2395,108,3.5,2.8,8.8,101,5800,23,29,16925
+0,188,101.2,176.8,64.8,54.3,2710,164,3.31,3.19,9,121,4250,21,28,20970
+0,188,101.2,176.8,64.8,54.3,2765,164,3.31,3.19,9,121,4250,21,28,21105
+2,121,88.4,141.1,60.3,53.2,1488,61,2.91,3.03,9.5,48,5100,47,53,5151
+1,98,94.5,155.9,63.6,52,1874,90,3.03,3.11,9.6,70,5400,38,43,6295
+0,81,94.5,158.8,63.6,52,1909,90,3.03,3.11,9.6,70,5400,38,43,6575
+1,118,93.7,157.3,63.8,50.8,1876,90,2.97,3.23,9.41,68,5500,37,41,5572
+1,118,93.7,157.3,63.8,50.8,1876,90,2.97,3.23,9.4,68,5500,31,38,6377
+1,118,93.7,157.3,63.8,50.8,2128,98,3.03,3.39,7.6,102,5500,24,30,7957
+1,148,93.7,157.3,63.8,50.6,1967,90,2.97,3.23,9.4,68,5500,31,38,6229
+1,148,93.7,157.3,63.8,50.6,1989,90,2.97,3.23,9.4,68,5500,31,38,6692
+1,148,93.7,157.3,63.8,50.6,1989,90,2.97,3.23,9.4,68,5500,31,38,7609
+-1,110,103.3,174.6,64.6,59.8,2535,122,3.34,3.46,8.5,88,5000,24,30,8921
+3,145,95.9,173.2,66.3,50.2,2811,156,3.6,3.9,7,145,5000,19,24,12964
+2,137,86.6,144.6,63.9,50.8,1713,92,2.91,3.41,9.6,58,4800,49,54,6479
+2,137,86.6,144.6,63.9,50.8,1819,92,2.91,3.41,9.2,76,6000,31,38,6855
+1,101,93.7,150,64,52.6,1837,79,2.91,3.07,10.1,60,5500,38,42,5399
+1,101,93.7,150,64,52.6,1940,92,2.91,3.41,9.2,76,6000,30,34,6529
+1,101,93.7,150,64,52.6,1956,92,2.91,3.41,9.2,76,6000,30,34,7129
+0,110,96.5,163.4,64,54.5,2010,92,2.91,3.41,9.2,76,6000,30,34,7295
+0,78,96.5,157.1,63.9,58.3,2024,92,2.92,3.41,9.2,76,6000,30,34,7295
+0,106,96.5,167.5,65.2,53.3,2236,110,3.15,3.58,9,86,5800,27,33,7895
+0,106,96.5,167.5,65.2,53.3,2289,110,3.15,3.58,9,86,5800,27,33,9095
+0,85,96.5,175.4,65.2,54.1,2304,110,3.15,3.58,9,86,5800,27,33,8845
+0,85,96.5,175.4,62.5,54.1,2372,110,3.15,3.58,9,86,5800,27,33,10295
+0,85,96.5,175.4,65.2,54.1,2465,110,3.15,3.58,9,101,5800,24,28,12945
+1,107,96.5,169.1,66,51,2293,110,3.15,3.58,9.1,100,5500,25,31,10345
+0,145,113,199.6,69.6,52.8,4066,258,3.63,4.17,8.1,176,4750,15,19,32250
+1,104,93.1,159.1,64.2,54.1,1890,91,3.03,3.15,9,68,5000,30,31,5195
+1,104,93.1,159.1,64.2,54.1,1900,91,3.03,3.15,9,68,5000,31,38,6095
+1,104,93.1,159.1,64.2,54.1,1905,91,3.03,3.15,9,68,5000,31,38,6795
+1,113,93.1,166.8,64.2,54.1,1945,91,3.03,3.15,9,68,5000,31,38,6695
+1,113,93.1,166.8,64.2,54.1,1950,91,3.08,3.15,9,68,5000,31,38,7395
+1,129,98.8,177.8,66.5,53.7,2385,122,3.39,3.39,8.6,84,4800,26,32,8845
+0,115,98.8,177.8,66.5,55.5,2410,122,3.39,3.39,8.6,84,4800,26,32,8495
+1,129,98.8,177.8,66.5,53.7,2385,122,3.39,3.39,8.6,84,4800,26,32,10595
+0,115,98.8,177.8,66.5,55.5,2410,122,3.39,3.39,8.6,84,4800,26,32,10245
+0,115,98.8,177.8,66.5,55.5,2425,122,3.39,3.39,8.6,84,4800,26,32,11245
+0,118,104.9,175,66.1,54.4,2670,140,3.76,3.16,8,120,5000,19,27,18280
+-1,93,110,190.9,70.3,56.5,3515,183,3.58,3.64,21.5,123,4350,22,25,25552
+-1,93,110,190.9,70.3,58.7,3750,183,3.58,3.64,21.5,123,4350,22,25,28248
+0,93,106.7,187.5,70.3,54.9,3495,183,3.58,3.64,21.5,123,4350,22,25,28176
+-1,93,115.6,202.6,71.7,56.3,3770,183,3.58,3.64,21.5,123,4350,22,25,31600
+3,142,96.6,180.3,70.5,50.8,3685,234,3.46,3.1,8.3,155,4750,16,18,35056
+2,161,93.7,157.3,64.4,50.8,1918,92,2.97,3.23,9.4,68,5500,37,41,5389
+2,161,93.7,157.3,64.4,50.8,1944,92,2.97,3.23,9.4,68,5500,31,38,6189
+2,161,93.7,157.3,64.4,50.8,2004,92,2.97,3.23,9.4,68,5500,31,38,6669
+1,161,93,157.3,63.8,50.8,2145,98,3.03,3.39,7.6,102,5500,24,30,7689
+3,153,96.3,173,65.4,49.4,2370,110,3.17,3.46,7.5,116,5500,23,30,9959
+3,153,96.3,173,65.4,49.4,2328,122,3.35,3.46,8.5,88,5000,25,32,8499
+1,125,96.3,172.4,65.4,51.6,2365,122,3.35,3.46,8.5,88,5000,25,32,6989
+1,125,96.3,172.4,65.4,51.6,2405,122,3.35,3.46,8.5,88,5000,25,32,8189
+1,125,96.3,172.4,65.4,51.6,2403,110,3.17,3.46,7.5,116,5500,23,30,9279
+-1,137,96.3,172.4,65.4,51.6,2403,110,3.17,3.46,7.5,116,5500,23,30,9279
+1,128,94.5,165.3,63.8,54.5,1889,97,3.15,3.29,9.4,69,5200,31,37,5499
+1,128,94.5,165.3,63.8,54.5,2017,103,2.99,3.47,21.9,55,4800,45,50,7099
+1,128,94.5,165.3,63.8,54.5,1918,97,3.15,3.29,9.4,69,5200,31,37,6649
+1,122,94.5,165.3,63.8,54.5,1938,97,3.15,3.29,9.4,69,5200,31,37,6849
+1,103,94.5,170.2,63.8,53.5,2024,97,3.15,3.29,9.4,69,5200,31,37,7349
+1,128,94.5,165.3,63.8,54.5,1951,97,3.15,3.29,9.4,69,5200,31,37,7299
+1,128,94.5,165.6,63.8,53.3,2028,97,3.15,3.29,9.4,69,5200,31,37,7799
+1,122,94.5,165.3,63.8,54.5,1971,97,3.15,3.29,9.4,69,5200,31,37,7499
+1,103,94.5,170.2,63.8,53.5,2037,97,3.15,3.29,9.4,69,5200,31,37,7999
+2,168,95.1,162.4,63.8,53.3,2008,97,3.15,3.29,9.4,69,5200,31,37,8249
+0,106,97.2,173.4,65.2,54.7,2324,120,3.33,3.47,8.5,97,5200,27,34,8949
+0,106,97.2,173.4,65.2,54.7,2302,120,3.33,3.47,8.5,97,5200,27,34,9549
+0,128,100.4,181.7,66.5,55.1,3095,181,3.43,3.27,9,152,5200,17,22,13499
+0,108,100.4,184.6,66.5,56.1,3296,181,3.43,3.27,9,152,5200,17,22,14399
+0,108,100.4,184.6,66.5,55.1,3060,181,3.43,3.27,9,152,5200,19,25,13499
+3,194,91.3,170.7,67.9,49.7,3071,181,3.43,3.27,9,160,5200,19,25,17199
+3,194,91.3,170.7,67.9,49.7,3139,181,3.43,3.27,7.8,200,5200,17,23,19699
+1,231,99.2,178.5,67.9,49.7,3139,181,3.43,3.27,9,160,5200,19,25,18399
+0,161,107.9,186.7,68.4,56.7,3020,120,3.46,3.19,8.4,97,5000,19,24,11900
+0,161,107.9,186.7,68.4,56.7,3197,152,3.7,3.52,21,95,4150,28,33,13200
+0,161,107.9,186.7,68.4,56.7,3075,120,3.46,2.19,8.4,95,5000,19,24,15580
+0,161,107.9,186.7,68.4,56.7,3252,152,3.7,3.52,21,95,4150,28,33,16900
+0,161,107.9,186.7,68.4,56.7,3075,120,3.46,3.19,8.4,97,5000,19,24,16630
+0,161,107.9,186.7,68.4,56.7,3252,152,3.7,3.52,21,95,4150,28,33,17950
+0,161,108,186.7,68.3,56,3130,134,3.61,3.21,7,142,5600,18,24,18150
+1,119,93.7,157.3,63.8,50.8,1918,90,2.97,3.23,9.4,68,5500,37,41,5572
+1,119,93.7,157.3,63.8,50.8,2128,98,3.03,3.39,7.6,102,5500,24,30,7957
+1,154,93.7,157.3,63.8,50.6,1967,90,2.97,3.23,9.4,68,5500,31,38,6229
+1,154,93.7,167.3,63.8,50.8,1989,90,2.97,3.23,9.4,68,5500,31,38,6692
+1,154,93.7,167.3,63.8,50.8,2191,98,2.97,3.23,9.4,68,5500,31,38,7609
+-1,74,103.3,174.6,64.6,59.8,2535,122,3.35,3.46,8.5,88,5000,24,30,8921
+3,186,94.5,168.9,68.3,50.2,2778,151,3.94,3.11,9.5,143,5500,19,27,22018
+3,150,99.1,186.6,66.5,56.1,2658,121,3.54,3.07,9.31,110,5250,21,28,11850
+2,104,99.1,186.6,66.5,56.1,2695,121,3.54,3.07,9.3,110,5250,21,28,12170
+3,150,99.1,186.6,66.5,56.1,2707,121,2.54,2.07,9.3,110,5250,21,28,15040
+2,104,99.1,186.6,66.5,56.1,2758,121,3.54,3.07,9.3,110,5250,21,28,15510
+3,150,99.1,186.6,66.5,56.1,2808,121,3.54,3.07,9,160,5500,19,26,18150
+2,104,99.1,186.6,66.5,56.1,2847,121,3.54,3.07,9,160,5500,19,26,18620
+2,83,93.7,156.9,63.4,53.7,2050,97,3.62,2.36,9,69,4900,31,36,5118
+2,83,93.7,157.9,63.6,53.7,2120,108,3.62,2.64,8.7,73,4400,26,31,7053
+2,83,93.3,157.3,63.8,55.7,2240,108,3.62,2.64,8.7,73,4400,26,31,7603
+0,102,97.2,172,65.4,52.5,2145,108,3.62,2.64,9.5,82,4800,32,37,7126
+0,102,97.2,172,65.4,52.5,2190,108,3.62,2.64,9.5,82,4400,28,33,7775
+0,102,97.2,172,65.4,52.5,2340,108,3.62,2.64,9,94,5200,26,32,9960
+0,102,97,172,65.4,54.3,2385,108,3.62,2.64,9,82,4800,24,25,9233
+0,102,97,172,65.4,54.3,2510,108,3.62,2.64,7.7,111,4800,24,29,11259
+0,89,97,173.5,65.4,53,2290,108,3.62,2.64,9,82,4800,28,32,7463
+0,89,97,173.5,65.4,53,2455,108,3.62,2.64,9,94,5200,25,31,10198
+0,85,96.9,173.6,65.4,54.9,2420,108,3.62,2.64,9,82,4800,23,29,8013
+0,85,96.9,173.6,65.4,54.9,2650,108,3.62,2.64,7.7,111,4800,23,23,11694
+1,87,95.7,158.7,63.6,54.5,1985,92,3.05,3.03,9,62,4800,35,39,5348
+1,87,95.7,158.7,63.6,54.5,2040,92,3.05,3.03,9,62,4800,31,38,6338
+1,74,95.7,158.7,63.6,54.5,2015,92,3.05,3.03,9,62,4800,31,38,6488
+0,77,95.7,169.7,63.6,59.1,2280,92,3.05,3.03,9,62,4800,31,37,6918
+0,81,95.7,169.7,63.6,59.1,2290,92,3.05,3.03,9,62,4800,27,32,7898
+0,91,95.7,169.7,63.6,59.1,3110,92,3.05,3.03,9,62,4800,27,32,8778
+0,91,95.7,166.3,64.4,53,2081,98,3.19,3.03,9,70,4800,30,37,6938
+0,91,95.7,166.3,64.4,52.8,2109,98,3.19,3.03,9,70,4800,30,37,7198
+0,91,95.7,166.3,64.4,53,2275,110,3.27,3.35,22.5,56,4500,34,36,7898
+0,91,95.7,166.3,64.4,52.8,2275,110,3.27,3.35,22.5,56,4500,38,47,7788
+0,91,95.7,166.3,64.4,53,2094,98,3.19,3.03,9,70,4800,38,47,7738
+0,91,95.7,166.3,64.4,52.8,2122,98,3.19,3.03,9,70,4800,28,34,8358
+0,91,95.7,166.3,64.4,52.8,2140,98,3.19,3.03,9,70,4800,28,34,9258
+1,168,94.5,168.7,64,52.6,2169,98,3.19,3.03,9,70,4800,29,34,8058
+1,168,94.5,168.7,64,52.6,2204,98,3.19,3.03,9,70,4800,29,34,8238
+1,168,94.5,168.7,64,52.6,2265,98,3.24,3.08,9.4,112,6600,26,29,9298
+1,168,94.5,168.7,64,52.6,2300,98,3.24,3.08,9.4,112,6600,26,29,9538
+2,134,98.4,176.2,65.6,52,2540,146,3.62,3.5,9.3,116,4800,24,30,8449
+2,134,98.4,176.2,65.6,52,2536,146,3.62,3.5,9.3,116,4800,24,30,9639
+2,134,98.4,176.2,65.6,52,2551,146,3.62,3.5,9.3,116,4800,24,30,9989
+2,134,98.4,176.2,65.6,52,2679,146,3.62,3.5,9.3,116,4800,24,30,11199
+2,134,98.4,176.2,65.6,52,2714,146,3.62,3.5,9.3,116,4800,24,30,11549
+2,134,98.4,176.2,65.6,53,2975,146,3.62,3.5,9.3,116,4800,24,30,17669
+-1,65,102.4,175.6,66.5,54.9,2326,122,3.31,3.54,8.7,92,4200,29,34,8948
+-1,65,102.4,175.6,66.5,54.9,2480,110,3.27,3.35,22.5,73,4500,30,33,10698
+-1,65,102.4,175.6,66.5,53.9,2414,122,3.31,3.54,8.7,92,4200,27,32,9988
+-1,65,102.4,175.6,66.5,54.9,2414,122,3.31,3.54,8.7,92,4200,27,32,10898
+-1,65,102.4,175.6,66.5,53.9,2458,122,3.31,3.54,8.7,92,4200,27,32,11248
+3,197,102.9,183.5,67.7,52,2976,171,3.27,3.35,9.3,161,5200,20,24,16558
+3,197,102.9,183.5,67.7,52,3016,171,3.27,3.35,9.3,161,5200,19,24,15998
+-1,90,104.5,187.8,66.5,54.1,3131,171,3.27,3.35,9.2,156,5200,20,24,15690
+2,122,97.3,171.7,65.5,55.7,2261,97,3.01,3.4,23,52,4800,37,46,7775
+2,122,97.3,171.7,65.5,55.7,2209,109,3.19,3.4,9,85,5250,27,34,7975
+2,94,97.3,171.7,65.5,55.7,2264,97,3.01,3.4,23,52,4800,37,46,7995
+2,94,97.3,171.7,65.5,55.7,2212,109,3.19,3.4,9,85,5250,27,34,8195
+2,94,97.3,171.7,65.5,55.7,2275,109,3.19,3.4,9,85,5250,27,34,8495
+2,94,97.3,171.7,65.5,55.7,2319,97,3.01,3.4,23,68,4500,37,42,9495
+2,94,97.3,171.7,65.5,55.7,2300,109,3.19,3.4,10,100,5500,26,32,9995
+3,256,94.5,165.7,64,51.4,2221,109,3.19,3.4,8.5,90,5500,24,29,9980
+-2,103,104.3,188.8,67.2,56.2,2912,141,3.78,3.15,9.5,114,5400,23,28,12940
+-1,74,104.3,188.8,67.2,57.5,3034,141,3.78,3.15,9.5,114,5400,23,28,13415
+-2,103,104.3,188.8,67.2,56.2,2935,141,3.78,3.15,9.5,114,5400,24,28,15985
+-1,74,104.3,188.8,67.2,57.5,3042,141,3.78,3.15,9.5,114,5400,24,28,16515
+-2,103,104.3,188.8,67.2,56.2,3045,130,3.62,3.15,7.5,162,5100,17,22,18420
+-1,74,104.3,188.8,67.2,57.5,3157,130,3.62,3.15,7.5,162,5100,17,22,18950
+-1,95,109.1,188.8,68.9,55.5,2952,141,3.78,3.15,9.5,114,5400,23,28,16845
+-1,95,109.1,188.8,68.8,55.5,3049,141,3.78,3.15,8.7,160,5300,19,25,19045
+-1,95,109.1,188.8,68.9,55.5,3012,173,3.58,2.87,8.8,134,5500,18,23,21485
+-1,95,109.1,188.8,68.9,55.5,3217,145,3.01,3.4,23,106,4800,26,27,22470

data/examples/classifiers/simple_linear_regression_example.rb

@@ -0,0 +1,18 @@
+# frozen_string_literal: true
+
+require_relative '../../lib/ai4r/classifiers/simple_linear_regression'
+require_relative '../../lib/ai4r/data/data_set'
+
+# Load training data
+file = "#{File.dirname(__FILE__)}/simple_linear_regression_example.csv"
+data_set = Ai4r::Data::DataSet.new.parse_csv_with_labels file
+
+# Build the regression model and inspect its coefficients
+r = Ai4r::Classifiers::SimpleLinearRegression.new.build data_set
+puts "Selected attribute: #{r.attribute}"
+puts "Slope: #{r.slope}, Intercept: #{r.intercept}"
+
+# Predict a new sample
+predicted = r.eval([-1, 95, 109.1, 188.8, 68.9, 55.5, 3062, 141, 3.78, 3.15, 9.5, 114, 5400, 19,
+                    25])
+puts "Predicted value: #{predicted}"