natto 0.3.0 → 0.4.0

data/.yardopts

@@ -4,3 +4,4 @@
 --markup-provider rdiscount
 -
 LICENSE
+CHANGELOG

data/CHANGELOG

@@ -0,0 +1,60 @@
+## CHANGELOG
+
+- __2011/01/26__: 0.4.0 release.
+    - Added support for mecab option input-buffer-size 
+    - Adding CHANGELOG file 
+    - Continuing update of documentation
+
+- __2011/01/22__: 0.3.0 release.
+    - Refactoring of Natto::Binding to make mecab methods available as class methods
+    - Refactoring of Natto::DictionaryInfo to override to_s method to return filename
+    - Refactoring of Natto::MeCab to use class methods in Natto::Binding
+    - Refactoring and logical separation of test cases
+    - Continuing update of documentation
+
+- __2011/01/19__: 0.2.0 release.
+    - Added support for mecab option allocate-sentence 
+    - Continuing update of documentation
+
+- __2011/01/15__: 0.1.1 release.
+    - Refactored Natto::DictionaryInfo#method_missing
+    - Continuing update of documentation
+
+- __2011/01/15__: 0.1.0 release.
+    - Added accessors to Natto::DictionaryInfo
+    - Added accessor for version in Natto::MeCab
+    - Continuing update of documentation
+
+- __2011/01/13__: 0.0.9 release.
+    - Further development and testing for mecab dictionary access/destruction
+    - Continuing update of documentation
+
+- __2011/01/07__: 0.0.8 release.
+    - Adding support for accessing dictionaries 
+    - Further tweaking of documentation with markdown
+
+- __2010/12/30__: 0.0.7 release.
+    - Adding support for all-morphs and partial options
+    - Further updating of documentation with markdown
+
+- __2010/12/28__: 0.0.6 release.
+    - Correction to natto.gemspec to include lib/natto/binding.rb
+
+- __2010/12/28__: 0.0.5 release. (yanked)
+    - On-going refactoring
+    - Project structure refactored for greater maintainability
+
+- __2010/12/26__: 0.0.4 release.
+    - On-going refactoring
+
+- __2010/12/23__: 0.0.3 release.
+    - On-going refactoring
+    - Adding documentation via yard
+
+- __2010/12/20__: 0.0.2 release.
+    - Continuing development on proper resource deallocation
+    - Adding options hash in object initializer 
+
+- __2010/12/13__: Released version 0.0.1. The objective is to provide
+  an easy-to-use, production-level Ruby binding to MeCab.
+    - Initial release 

data/LICENSE

@@ -1,4 +1,4 @@
-Copyright © 2010-2013, Brooke M. Fujita.
+Copyright © 2011, Brooke M. Fujita.
 All rights reserved.
 
 Redistribution and use in source and binary forms, with or without modification, are

data/README.md

@@ -4,6 +4,12 @@ A Tasty Ruby Binding with MeCab
 ## What is natto?
 natto combines the [Ruby programming language](http://www.ruby-lang.org/) with [MeCab](http://mecab.sourceforge.net/), the part-of-speech and morphological analyzer for the Japanese language.
 
+natto is a gem bridging Ruby and MeCab using FFI (foreign function interface). No compilation is necessary, and natto will run on CRuby (mri/yarv) and JRuby (jvm) equally well, on any OS.
+
+You can learn more about [natto at Google Code Projects](http://code.google.com/p/natto/).
+
+Comments and questions are welcome at the [natto-users Group](http://groups.google.com/group/natto-users).
+
 ## Requirements
 natto requires the following:
 
@@ -20,7 +26,7 @@ Install natto with the following gem command:
 -  In case of <tt>LoadError</tt>, please set the <tt>MECAB_PATH</tt> environment variable to the exact name/path to your <tt>mecab</tt> library.
 
 e.g., for bash on UNIX/Linux
-    export MECAB_PATH=mecab.so
+    export MECAB_PATH=/usr/local/lib/libmecab.so
 e.g., on Windows
     set MECAB_PATH=C:\Program Files\MeCab\bin\libmecab.dll
 e.g., for Cygwin
@@ -71,82 +77,7 @@ e.g., for Cygwin
 -  Please try not to mess with the Rakefile, version, or history. If you must have your own version, that is fine, but please isolate to its own commit so I can cherry-pick around it.
 
 ## Changelog
-
-- __2011/01/22: 0.3.0 release.
-    - Refactoring of Natto::Binding to make mecab methods available as class methods
-    - Refactoring of Natto::DictionaryInfo to override to_s method to return filename
-    - Refactoring of Natto::MeCab to use class methods in Natto::Binding
-    - Refactoring and logical separation of test cases
-    - Continuing update of documentation
-
-- __2011/01/19__: 0.2.0 release.
-    - Added support for mecab option allocate-sentence 
-    - Continuing update of documentation
-
-- __2011/01/15__: 0.1.1 release.
-    - Refactored Natto::DictionaryInfo#method_missing
-    - Continuing update of documentation
-
-- __2011/01/15__: 0.1.0 release.
-    - Added accessors to Natto::DictionaryInfo
-    - Added accessor for version in Natto::MeCab
-    - Continuing update of documentation
-
-- __2011/01/13__: 0.0.9 release.
-    - Further development and testing for mecab dictionary access/destruction
-    - Continuing update of documentation
-
-- __2011/01/07__: 0.0.8 release.
-    - Adding support for accessing dictionaries 
-    - Further tweaking of documentation with markdown
-
-- __2010/12/30__: 0.0.7 release.
-    - Adding support for all-morphs and partial options
-    - Further updating of documentation with markdown
-
-- __2010/12/28__: 0.0.6 release.
-    - Correction to natto.gemspec to include lib/natto/binding.rb
-
-- __2010/12/28__: 0.0.5 release. (yanked)
-    - On-going refactoring
-    - Project structure refactored for greater maintainability
-
-- __2010/12/26__: 0.0.4 release.
-    - On-going refactoring
-
-- __2010/12/23__: 0.0.3 release.
-    - On-going refactoring
-    - Adding documentation via yard
-
-- __2010/12/20__: 0.0.2 release.
-    - Continuing development on proper resource deallocation
-    - Adding options hash in object initializer 
-
-- __2010/12/13__: Released version 0.0.1. The objective is to provide
-  an easy-to-use, production-level Ruby binding to MeCab.
-    - Initial release 
+Please see the {file:CHANGELOG} for this gem's release history.
 
 ## Copyright
-Copyright &copy; 2010-2013, Brooke M. Fujita.
-All rights reserved.
- 
-Redistribution and use in source and binary forms, with or without modification, are
-permitted provided that the following conditions are met:
- 
-  * Redistributions of source code must retain the above
-    copyright notice, this list of conditions and the
-    following disclaimer.
- 
-  * Redistributions in binary form must reproduce the above
-    copyright notice, this list of conditions and the
-    following disclaimer in the documentation and/or other
-    materials provided with the distribution.
- 
-THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND ANY EXPRESS OR IMPLIED
-WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A
-PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR CONTRIBUTORS BE LIABLE FOR
-ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
-LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS
-INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR
-TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF
-ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+Copyright &copy; 2011, Brooke M. Fujita. All rights reserved. Please see the {file:LICENSE} file for further details. 

data/lib/natto.rb

@@ -14,21 +14,23 @@ module Natto
   #     require 'rubygems' if RUBY_VERSION.to_f < 1.9
   #     require 'natto'
   #
-  #     mecab = Natto::MeCab.new
-  #     => #<Natto::MeCab:0x289b88e0 @ptr=#<FFI::Pointer address=0x288865c8>, \
-  #                                  @options={}, \
+  #     mecab = Natto::MeCab.new(:output_format_type=>'wakati')
+  #     => #<Natto::MeCab:0x28dd471c @ptr=#<FFI::Pointer address=0x28a027d8>, \
+  #                                  @options={:output_format_type=>"wakati"}, \
   #                                  @version="0.98", \
   #                                  @dicts=[/usr/local/lib/mecab/dic/ipadic/sys.dic]>
   #
-  #     puts mecab.parse("ネバネバの組み合わせ美味しいです。")
-  #     ネバネバ      名詞,サ変接続,*,*,*,*,ネバネバ,ネバネバ,ネバネバ
-  #     の            助詞,連体化,*,*,*,*,の,ノ,ノ
-  #     組み合わせ    名詞,一般,*,*,*,*,組み合わせ,クミアワセ,クミアワセ
-  #     美味しい      形容詞,自立,*,*,形容詞・イ段,基本形,美味しい,オイシイ,オイシイ
-  #     です          助動詞,*,*,*,特殊・デス,基本形,です,デス,デス
-  #     。            デス記号,句点,*,*,*,*,。,。,。
-  #     EOS
-  #     => nil
+  #     output = mecab.parse('ネバネバの組み合わせ美味しいです。').split
+  #
+  #     output.each do |token|
+  #       puts token
+  #     end
+  #     => ネバネバ
+  #        の
+  #        組み合わせ
+  #        美味しい
+  #        です
+  #        。
   #
   class MeCab
     include Natto::Binding
@@ -40,7 +42,8 @@ module Natto
     SUPPORTED_OPTS = [  :rcfile, :dicdir, :userdic, :lattice_level, :all_morphs,
                         :output_format_type, :partial, :node_format, :unk_format, 
                         :bos_format, :eos_format, :eon_format, :unk_feature, 
-                        :allocate_sentence, :nbest, :theta, :cost_factor ].freeze
+                        :input_buffer_size, :allocate_sentence, :nbest, :theta, 
+                        :cost_factor ].freeze
 
     # Initializes the wrapped <tt>mecab</tt> instance with the
     # given <tt>options</tt> hash.
@@ -60,6 +63,7 @@ module Natto
     # - :eos_format --  user-defined end-of-sentence format
     # - :eon_format --  user-defined end-of-NBest format
     # - :unk_feature --  feature for unknown word
+    # - :input_buffer_size -- set input buffer size (default 8192) 
     # - :allocate_sentence -- allocate new memory for input sentence 
     # - :nbest --  output N best results (integer, default 1)
     # - :theta --  temperature parameter theta (float, default 0.75)
@@ -98,8 +102,8 @@ module Natto
       raise MeCabError.new("Could not initialize MeCab with options: '#{opt_str}'") if @ptr.address == 0x0
 
       @dicts << Natto::DictionaryInfo.new(Natto::Binding.mecab_dictionary_info(@ptr))
-      while @dicts.last[:next].address != 0x0
-        @dicts << Natto::DictionaryInfo.new(@dicts.last[:next])
+      while @dicts.last.next.address != 0x0
+        @dicts << Natto::DictionaryInfo.new(@dicts.last.next)
       end
 
       @version = self.mecab_version
@@ -229,13 +233,13 @@ module Natto
     # @raise [NoMethodError] if <tt>attr_name</tt> is not a member of this <tt>mecab</tt> dictionary <tt>FFI::Struct</tt> 
     def method_missing(attr_name)
       member_sym = attr_name.id2name.to_sym
-      if self.members.include?(member_sym)
-        self[member_sym]
-      else
-        raise(NoMethodError.new("undefined method '#{attr_name}' for #{self}"))
-      end
+      return self[member_sym] if self.members.include?(member_sym)
+      raise(NoMethodError.new("undefined method '#{attr_name}' for #{self}"))
     end
 
+    # Returns the full-path file name for this dictionary. Overrides <tt>Object#to_s</tt>.
+    #
+    # @return [String] full-path filename for this dictionary
     def to_s
       self[:filename]
     end

data/lib/natto/version.rb

@@ -16,5 +16,5 @@
 # which are made available via <tt>FFI</tt> bindings to <tt>mecab</tt>.
 module Natto
   # Version string for this Rubygem.
-  VERSION = "0.3.0"
+  VERSION = "0.4.0"
 end

data/test/natto/tc_dictionaryinfo.rb

@@ -23,6 +23,7 @@ class TestDictionaryInfo < Test::Unit::TestCase
     assert_equal('/usr/local/lib/mecab/dic/ipadic/sys.dic', sysdic[:filename])
     assert_equal('utf8', sysdic[:charset])
     assert_equal(0x0, sysdic[:next].address)
+    #assert_nil(sysdic.next)
   end
 
   # Tests the to_s method.
@@ -42,7 +43,7 @@ class TestDictionaryInfo < Test::Unit::TestCase
     
     # NoMethodError will be raised for anything else!
     assert_raise NoMethodError do
-      sysdic.send :nomethoderror
+      sysdic.send :unknown_attr
     end
   end
 end

data/test/natto/tc_mecab.rb

@@ -58,6 +58,9 @@ class TestMeCab < Test::Unit::TestCase
     res = Natto::MeCab.build_options_str(:unk_feature=>'%m\t%f[7]\n')
     assert_equal('--unk-feature=%m\t%f[7]\n', res)
 
+    res = Natto::MeCab.build_options_str(:input_buffer_size=>102400)
+    assert_equal('--input-buffer-size=102400', res)
+
     res = Natto::MeCab.build_options_str(:allocate_sentence=>true)
     assert_equal('--allocate-sentence', res)
 

metadata

@@ -1,12 +1,13 @@
 --- !ruby/object:Gem::Specification 
 name: natto
 version: !ruby/object:Gem::Version 
-  prerelease: false
+  hash: 15
+  prerelease: 
   segments: 
   - 0
-  - 3
+  - 4
   - 0
-  version: 0.3.0
+  version: 0.4.0
 platform: ruby
 authors: 
 - Brooke M. Fujita
@@ -14,7 +15,7 @@ autorequire:
 bindir: bin
 cert_chain: []
 
-date: 2011-01-22 00:00:00 +09:00
+date: 2011-01-26 00:00:00 +09:00
 default_executable: 
 dependencies: 
 - !ruby/object:Gem::Dependency 
@@ -25,6 +26,7 @@ dependencies:
     requirements: 
     - - ">="
       - !ruby/object:Gem::Version 
+        hash: 1
         segments: 
         - 0
         - 6
@@ -34,7 +36,7 @@ dependencies:
   version_requirements: *id001
 description: |
   natto is a gem bridging Ruby and MeCab using FFI (foreign function interface). 
-  No compilation is necessary, and natto works on any platform and on any OS. 
+  No compilation is necessary, and natto works on any Ruby platform and on any OS. 
   
   Find out more about natto by visiting the
   project homepage at http://code.google.com/p/natto/
@@ -54,8 +56,9 @@ files:
 - test/natto/tc_binding.rb
 - test/natto/tc_dictionaryinfo.rb
 - test/natto/tc_mecab.rb
-- LICENSE
 - README.md
+- LICENSE
+- CHANGELOG
 - .yardopts
 has_rdoc: true
 homepage: http://code.google.com/p/natto/
@@ -71,6 +74,7 @@ required_ruby_version: !ruby/object:Gem::Requirement
   requirements: 
   - - ">="
     - !ruby/object:Gem::Version 
+      hash: 57
       segments: 
       - 1
       - 8
@@ -81,6 +85,7 @@ required_rubygems_version: !ruby/object:Gem::Requirement
   requirements: 
   - - ">="
     - !ruby/object:Gem::Version 
+      hash: 3
       segments: 
       - 0
       version: "0"
@@ -88,7 +93,7 @@ requirements:
 - MeCab, 0.98 or greater
 - FFI, 0.6.3 or greater
 rubyforge_project: 
-rubygems_version: 1.3.7
+rubygems_version: 1.4.2
 signing_key: 
 specification_version: 3
 summary: natto combines the Ruby programming language with MeCab, the part-of-speech and morphological analyzer for the Japanese language.