text_profile_signature 0.0.1 → 0.1.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA1:
-  metadata.gz: b40d0d688520628dfb1b3ae43e936d4c454753b9
-  data.tar.gz: 14e32db1f6b8e993a4f59740f8a28aeeeace3234
+  metadata.gz: 70310b6de04e804854394814493932d8f67dad9b
+  data.tar.gz: 60456517f50a004cc609115e6b22f156cdc604eb
 SHA512:
-  metadata.gz: c3593a2de6b6162c85c28cb55b952ab84bd81991e10ea07634de9cecc6fbef2eb2364b1b80b948824882f3acd1ce9481f6b70bd62ca2313a1ae2ec8a5af21014
-  data.tar.gz: 5c8a4e9ec4a11208a4809cef022d22e6e6519513b7dcafad18f61695c405fd9fba7828521e7ff8d3f72122e7820cd1d514f2d22c0a5b6202be24d47f9393b9f4
+  metadata.gz: b4a321d0c6133b9e4873c3da426981dccf0ea7974c9e993f84604f92ee9db78bfbb11af3f218361ff15adf1368c28b7706bb1141d1a4ef43b5a439d9b3f651bc
+  data.tar.gz: 0218c10759f2ba6e38feb0d232e47ecd98e547c55466256b0eb5b7ac3dc78b58c77d64457f4527eb7e0aa7b8dbe407e38da96a900de9890c017e2ed5e23b0c2d

data/README.md

@@ -53,3 +53,20 @@ puts sign
 |:----------------:|:-----:|:----------------------------------------------------------------------------------:|---------------|
 | min_token_length |  int  | The minimum token length to consider                                               | 2             |
 |    quant_rate    | float | When multiplied by the maximum token frequency, this determines count quantization | 0.01          |
+
+## License
+
+Copyright (C) 2016  Hamed Ramezanian Nik
+
+This program is free software: you can redistribute it and/or modify
+it under the terms of the GNU Lesser General Public License as published by
+the Free Software Foundation, either version 3 of the License, or
+(at your option) any later version.
+
+This program is distributed in the hope that it will be useful,
+but WITHOUT ANY WARRANTY; without even the implied warranty of
+MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+GNU Lesser General Public License for more details.
+
+You should have received a copy of the GNU Lesser General Public License
+along with this program.  If not, see <http://www.gnu.org/licenses/>.

data/lib/text_profile_signature.rb

@@ -20,7 +20,7 @@ require 'digest'
 require 'unicode'
 
 class TextProfileSignature
-  VERSION = "0.0.1" unless defined? TextProfileSignature::VERSION
+  VERSION = "0.1.0" unless defined? TextProfileSignature::VERSION
   
   def initialize(options={})
     options[:min_token_length] ||= 2
@@ -93,13 +93,13 @@ class TextProfileSignature
     end
     
     # sort the list of tokens by decreasing frequency
-    profile = quantized_tokens.sort {|x, y| y[:count] <=> x[:count]}
+    profile = quantized_tokens.sort {|x, y| [y[:count], x[:term]] <=> [x[:count], y[:term]]}
 
     # create a list of tokens and their quantized frequency, 
     # separated by spaces, in the order of decreasing frequency
     quantized_frequency_str = profile.map do |a|
       "#{a[:term]} #{a[:count]}"
-    end.join('\n')
+    end.join("\n")
     
     Digest::MD5.hexdigest(quantized_frequency_str)
   end

data/test/fixtures/liberty_article_from_de_wikipedia.yaml

@@ -1,4 +1,4 @@
-:signature: 6a357987bbb275181328aec84aab0e00
+:signature: d1ac43af3977ae7ddebbc77a9f3724f7
 :article: |
   Freiheit (lateinisch libertas) wird in der Regel verstanden als die Möglichkeit, ohne Zwang zwischen unterschiedlichen Möglichkeiten auswählen und entscheiden zu können. Der Begriff benennt in Philosophie, Theologie und Recht der Moderne allgemein einen Zustand der Autonomie eines Subjekts.
   

data/test/fixtures/liberty_article_from_en_wikipedia.yaml

@@ -1,4 +1,4 @@
-:signature: f18022e6b522fa7249ab73498728c275
+:signature: 0d889fc281c5272f8362c6dc14f32ee2
 :article: |
   Liberty, in philosophy, involves free will as contrasted with determinism.[1] In politics, liberty consists of the social and political freedoms enjoyed by all citizens.[2] In theology, liberty is freedom from the bondage of sin.[3] Generally, liberty seems to be distinct from freedom in that freedom concerns itself primarily, if not exclusively, with the ability to do as one wills and what one has the power to do; whereas liberty also takes into account the rights of all involved. As such, liberty can be thought of as freedom limited by rights, and therefore cannot be abused.
 

data/test/fixtures/liberty_article_from_es_wikipedia.yaml

@@ -1,4 +1,4 @@
-:signature: 8cc2cf890f4632b55899a3184b7b4a96
+:signature: 76b4b0b6ace9f7c2a9139df8aba4febf
 :article: |
   La libertad (del latín: libertas, -ātis)1 es la capacidad de la conciencia para pensar y obrar según la propia voluntad de la persona pero en sujeción a un orden o regulación más elevados.
   

data/test/fixtures/liberty_article_from_fr_wikipedia.yaml

@@ -1,4 +1,4 @@
-:signature: 728ce35eacc5e3ac743d6931f422caf0
+:signature: fe41533829424ac5f98c69ee7b21fff5
 :article: |
   De façon générale, la liberté est un concept qui désigne la possibilité d'action ou de mouvement.
    En mécanique par exemple, on parle de degrés de liberté pour comptabiliser les mouvements possibles d'une pièce.

data/test/fixtures/liberty_article_from_it_wikipedia.yaml

@@ -1,4 +1,4 @@
-:signature: 4c8484da0faa43e345d956e13a4a61f4
+:signature: f2b993aadd71f422681f4ead5ea05755
 :article: |
   Per libertà s'intende la condizione per cui un individuo può decidere di pensare, esprimersi ed agire senza costrizioni, ricorrendo alla volontà di ideare e mettere in atto un'azione, mediante una libera scelta dei fini e degli strumenti che ritiene utili a realizzarla.
   

data/test/fixtures/liberty_article_from_pt_wikipedia.yaml

@@ -1,4 +1,4 @@
-:signature: f18022e6b522fa7249ab73498728c275
+:signature: 975727e5e36613bf6824063a127d9738
 :article: |
   Liberdade, em filosofia, pode ser compreendida sob uma perspectiva que denota a ausência de submissão e de servidão. Ou sob outra perspectiva que é a autonomia e a espontaneidade de um sujeito racional.
   

data/test/lib/text_profile_signature_unit_test.rb

@@ -56,7 +56,7 @@ class TextProfileSignatureGeneratorTest < TextProfileSignatureTest
   end
   
   def test_pt_lang
-    page = get_wikipedia_article("it")
+    page = get_wikipedia_article("pt")
     sign = @text_profile_signature.generate_sign(page[:article])
     assert_equal sign, page[:signature]
   end

metadata

@@ -1,14 +1,14 @@
 --- !ruby/object:Gem::Specification
 name: text_profile_signature
 version: !ruby/object:Gem::Version
-  version: 0.0.1
+  version: 0.1.0
 platform: ruby
 authors:
 - Hamed Ramezanian Nik
 autorequire: 
 bindir: bin
 cert_chain: []
-date: 2016-06-04 00:00:00.000000000 Z
+date: 2016-10-30 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: unicode