NaiveText 0.5.1 → 0.6.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA1:
-  metadata.gz: ec519a11d1de21e62b71bb470ef0097ed62910f8
-  data.tar.gz: bc96077d8ed6fa7890692466a2954425a8719540
+  metadata.gz: 3b04e3a990ab60596a6e4067f3e6e6b7b762e9e7
+  data.tar.gz: 95cefeef5c2030e33c7290eecb848ec85e3a4d86
 SHA512:
-  metadata.gz: 15446a47f72ed08af4c32924f5b7b246878bdc184f21a9616259a346c010baba9f25ca426a22f60bb29ff5d9e94b9cd311c41221fdb728542d794fa7777f5c01
-  data.tar.gz: bfb9e832ddd6a8f3f7aebc8cc47c949f7aac93d1a718d6db461c827e247575c937ddf4ae23be3b89d6d2c0617b93d8a5f5ed1a830fc59b1f440c0bbd770e1e3b
+  metadata.gz: d4b7734d40ca51cb0af57485ca7312007ba2ef0982f471cd3d95c000e488ea1d526bc6a03a84d52cfc1eeb41a3dc0793c986e7d9be49424ead2811042f0b8ce5
+  data.tar.gz: aed39b603081561255c043fbd61d9de06e0e91a14a628e1b324589e8eb0f6d4d3428248b9e18c6f35bf79a21852f7a121256a8fa16530f0774960526eeab3deb

data/CHANGELOG.md

@@ -2,6 +2,10 @@
 All notable changes to this project will be documented in this file.
 This project adheres to [Semantic Versioning](http://semver.org/).
 
+## [0.6.0]- 2015-11-30
+### Added
+- Added optional language_model, that make it possible to compare words based on the word stem. (Like 'testing', 'tests', 'tested' all matched with the stem 'test')
+
 ## [0.5.1] - 2015-11-21
 ### Added
 - Added optional default category. This category will be returned from NaiveText.build if the algorithm can't find a match with the existing text examples. Default value is NullCategory.

data/Gemfile

@@ -2,3 +2,8 @@ source 'https://rubygems.org'
 
 # Specify your gem's dependencies in NaiveText.gemspec
 gemspec
+
+
+spec.add_development_dependency "guard"
+spec.add_development_dependency "guard-rspec"
+spec.add_development_dependency "guard-rubocop"

data/NaiveText.gemspec

@@ -19,13 +19,12 @@ Gem::Specification.new do |spec|
   spec.executables   = spec.files.grep(%r{^exe/}) { |f| File.basename(f) }
   spec.require_paths = ["lib"]
 
+  spec.required_ruby_version = '>= 2.0.0'
+
   if spec.respond_to?(:metadata)
     spec.metadata['allowed_push_host'] = "https://rubygems.org"
   end
 
   spec.add_development_dependency "bundler", "~> 1.8"
   spec.add_development_dependency "rake", "~> 10.0"
-  spec.add_development_dependency "guard"
-  spec.add_development_dependency "guard-rspec"
-  spec.add_development_dependency "guard-rubocop"
 end

data/README.md

@@ -6,7 +6,7 @@ NaiveText is a text classifier gem written in ruby and made to be easily integra
 
 Text classifier are used in many areas of IT. The filter spam, predict what a user wants to buy, detect which language a text is written in, ...
 
-The kind of classifier included in NaiveText, uses existing text examples (junk-makrde e-mails, allready bought products, texts in different languages, ...) to calculate in which category (spam/e-mail, interesting_product/not_interesting_product, ...) a unknown text belongs.
+The kind of classifier included in NaiveText, uses existing text examples (junk-makrde e-mails, already bought products, texts in different languages, ...) to calculate in which category (spam/e-mail, interesting_product/not_interesting_product, ...) a unknown text belongs.
 
 ## Installation
 
@@ -31,32 +31,9 @@ You can also use local files as examples (via ExamplesFactory.from_files('path/t
 
 
 
-### Example
+## Example
 
-Lets pretend you write some kind of forum. A user can write posts and can vote them up or down.
-
-We will build a system which predicts if a new post is interesting to the user or if this post will bore him a sleep.
-
-In your system (an rails app of course) you haven a *Post* model with a text attribute containing the posts content. There are also two scopes on Post: *up_voted* and *down_voted*, which return all up/down voted posts.
-
-```ruby
-require 'NaiveText'
-
-interesting_examples = Post.up_voted
-boring_examples = Post.down_voted
-
-categories = [{name: 'interesting', examples: interesting_examples},
-                     {name: 'boring', examples: boring_examples}];
-
-classifier = NaiveText.build(categories: categories)
-
-category = classifier.classify(new_interesting_post.text)
-category.name
- => 'interesting'
-```
-Checkout the full example and some more in the
-[NaiveText-example repo](https://github.com/RicciFlowing/NaiveText-examples).
-Have fun using it!
+Can be found on the projects [homepage](https://ricciflowing.github.io/NaiveText/).
 
 ## Contributing
 

data/lib/NaiveText/CategoriesFactory.rb

@@ -3,7 +3,7 @@ class CategoriesFactory
     categories = []
     default = nil
     if config.is_a?(Array)
-      puts "The format [{name: name_of_category, path: path_to_trainings_data}] is deprecated and will be removed in future versions. Use the following arguments instead: categories: [name: 'the name', examples:'An example']"
+      puts "The format [{name: name_of_category, path: path_to_trainings_data}] is deprecated and will be removed in version 1.0.0 (due in Jan. 2016). Use the following arguments instead: categories: [name: 'the name', examples:'An example']"
       config.each do |category_config|
         begin
           examples = ExamplesFactory.from_files(category_config[:path])
@@ -20,7 +20,7 @@ class CategoriesFactory
     else
       config[:categories].each do |category_config|
         begin
-          group = ExamplesGroup.new(examples: category_config[:examples])
+          group = ExamplesGroup.new(examples: category_config[:examples], language_model: config[:language_model] )
           category = Category.new(name: category_config[:name], examples: group, weight: category_config[:weight])
           categories << category
           if category_config[:name] == config[:default]

data/lib/NaiveText/ExamplesFactory.rb

@@ -7,7 +7,7 @@ class ExamplesFactory
           examples.push FileExample.new(path: dir_path+'/'+file_path)
         end
       rescue
-        puts "Failed laoding" + dir_path
+        puts "Failed loading" + dir_path
       end
     examples
   end

data/lib/NaiveText/ExamplesGroup.rb

@@ -1,6 +1,7 @@
 class ExamplesGroup
   def initialize(args)
-    @examples = args[:examples].to_a || []
+    @examples       = args[:examples].to_a || []
+    @language_model = args[:language_model] || lambda {|str| str}
     load_text
     split_text_into_words
     format_words
@@ -10,7 +11,7 @@ class ExamplesGroup
   end
 
   def count(word)
-    @words.count(word.downcase)
+    @words.count(@language_model.call(word.downcase))
   end
 
   def word_count
@@ -32,5 +33,7 @@ class ExamplesGroup
 
     def format_words
       @words.map! {|word| word.downcase}
+      @words.map! {|word| @language_model.call(word)}
+      @words
     end
 end

data/lib/NaiveText/version.rb

@@ -1,3 +1,3 @@
 module NaiveText
-  VERSION = "0.5.1"
+  VERSION = "0.6.0"
 end

metadata

@@ -1,14 +1,14 @@
 --- !ruby/object:Gem::Specification
 name: NaiveText
 version: !ruby/object:Gem::Version
-  version: 0.5.1
+  version: 0.6.0
 platform: ruby
 authors:
 - RicciFlowing
 autorequire: 
 bindir: exe
 cert_chain: []
-date: 2015-11-21 00:00:00.000000000 Z
+date: 2015-12-01 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: bundler
@@ -38,48 +38,6 @@ dependencies:
     - - "~>"
       - !ruby/object:Gem::Version
         version: '10.0'
-- !ruby/object:Gem::Dependency
-  name: guard
-  requirement: !ruby/object:Gem::Requirement
-    requirements:
-    - - ">="
-      - !ruby/object:Gem::Version
-        version: '0'
-  type: :development
-  prerelease: false
-  version_requirements: !ruby/object:Gem::Requirement
-    requirements:
-    - - ">="
-      - !ruby/object:Gem::Version
-        version: '0'
-- !ruby/object:Gem::Dependency
-  name: guard-rspec
-  requirement: !ruby/object:Gem::Requirement
-    requirements:
-    - - ">="
-      - !ruby/object:Gem::Version
-        version: '0'
-  type: :development
-  prerelease: false
-  version_requirements: !ruby/object:Gem::Requirement
-    requirements:
-    - - ">="
-      - !ruby/object:Gem::Version
-        version: '0'
-- !ruby/object:Gem::Dependency
-  name: guard-rubocop
-  requirement: !ruby/object:Gem::Requirement
-    requirements:
-    - - ">="
-      - !ruby/object:Gem::Version
-        version: '0'
-  type: :development
-  prerelease: false
-  version_requirements: !ruby/object:Gem::Requirement
-    requirements:
-    - - ">="
-      - !ruby/object:Gem::Version
-        version: '0'
 description: NaiveText is a text classifier gem written in ruby and made to be easily
   integratable in your Rails app.
 email:
@@ -124,7 +82,7 @@ required_ruby_version: !ruby/object:Gem::Requirement
   requirements:
   - - ">="
     - !ruby/object:Gem::Version
-      version: '0'
+      version: 2.0.0
 required_rubygems_version: !ruby/object:Gem::Requirement
   requirements:
   - - ">="