rbtagger 0.3.2 → 0.4.0

data/COPYING

@@ -1,21 +0,0 @@
-The MIT License
-
-Copyright (c) 2008 Todd A. Fisher
-
-Permission is hereby granted, free of charge, to any person obtaining a copy
-of this software and associated documentation files (the "Software"), to deal
-in the Software without restriction, including without limitation the rights
-to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
-copies of the Software, and to permit persons to whom the Software is
-furnished to do so, subject to the following conditions:
-
-The above copyright notice and this permission notice shall be included in
-all copies or substantial portions of the Software.
-
-THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
-IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
-FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
-AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
-LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
-OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN
-THE SOFTWARE.

data/History.txt

@@ -1,4 +0,0 @@
-== 0.0.1 2008-05-14
-
-* 1 major enhancement:
-  * Initial release

data/License.txt

@@ -1,20 +0,0 @@
-Copyright (c) 2008 FIXME full name
-
-Permission is hereby granted, free of charge, to any person obtaining
-a copy of this software and associated documentation files (the
-"Software"), to deal in the Software without restriction, including
-without limitation the rights to use, copy, modify, merge, publish,
-distribute, sublicense, and/or sell copies of the Software, and to
-permit persons to whom the Software is furnished to do so, subject to
-the following conditions:
-
-The above copyright notice and this permission notice shall be
-included in all copies or substantial portions of the Software.
-
-THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
-EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
-MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
-NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE
-LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
-OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
-WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

data/Manifest.txt

@@ -1,82 +0,0 @@
-COPYING
-History.txt
-LICENSE
-License.txt
-Manifest.txt
-PostInstall.txt
-README
-README.txt
-Rakefile
-config/hoe.rb
-config/requirements.rb
-ext/rule_tagger/bool.h
-ext/rule_tagger/darray.c
-ext/rule_tagger/darray.h
-ext/rule_tagger/darrayP.h
-ext/rule_tagger/extconf.rb
-ext/rule_tagger/lex.c
-ext/rule_tagger/lex.h
-ext/rule_tagger/memory.c
-ext/rule_tagger/memory.h
-ext/rule_tagger/mkmf.log
-ext/rule_tagger/rbtagger.c
-ext/rule_tagger/registry.c
-ext/rule_tagger/registry.h
-ext/rule_tagger/registryP.h
-ext/rule_tagger/ruby-compat.h
-ext/rule_tagger/rules.c
-ext/rule_tagger/rules.h
-ext/rule_tagger/sysdep.h
-ext/rule_tagger/tagger.c
-ext/rule_tagger/tagger.h
-ext/rule_tagger/useful.c
-ext/rule_tagger/useful.h
-ext/word_tagger/extconf.rb
-ext/word_tagger/mkmf.log
-ext/word_tagger/porter_stemmer.c
-ext/word_tagger/porter_stemmer.h
-ext/word_tagger/rtagger.cc
-ext/word_tagger/tagger.cc
-ext/word_tagger/tagger.h
-ext/word_tagger/test.rb
-ext/word_tagger/test/Makefile
-ext/word_tagger/test/doc.txt
-ext/word_tagger/test/test.cc
-lib/brill/tagger.rb
-lib/rbtagger.rb
-lib/rbtagger/version.rb
-lib/word/tagger.rb
-lib/brill/brown/CONTEXTUALRULEFILE
-lib/brill/brown/LEXICALRULEFILE
-lib/brill/brown/LEXICON
-script/console
-script/destroy
-script/generate
-script/txt2html
-setup.rb
-tasks/deployment.rake
-tasks/environment.rake
-tasks/extconf.rake
-tasks/extconf/rule_tagger.rake
-tasks/extconf/word_tagger.rake
-tasks/website.rake
-test/docs/doc0.txt
-test/docs/doc1.txt
-test/docs/doc2.txt
-test/docs/doc3.txt
-test/docs/doc4.txt
-test/docs/doc5.txt
-test/docs/doc6.txt
-test/docs/doc7.txt
-test/docs/doc8.txt
-test/docs/doc9.txt
-test/fixtures/tags.txt
-test/test_helper.rb
-test/test_rule_tagger.rb
-test/test_word_tagger.rb
-tools/rakehelp.rb
-website/index.html
-website/index.txt
-website/javascripts/rounded_corners_lite.inc.js
-website/stylesheets/screen.css
-website/template.html.erb

data/PostInstall.txt

@@ -1 +0,0 @@
-For more information on rbtagger, see http://rbtagger.rubyforge.org

data/README.txt

@@ -1,51 +0,0 @@
-= rbtagger
-
-* http://github.com/taf2/rb-brill-tagger/tree/master
-
-== DESCRIPTION:
-
-A Simple Ruby Rule-Based Part of Speech Tagger
-
-This work is based on the work of Eric Brill
-
-Credit for extracting Eric's work into a reusable library goes to Ken Williams as part of his work in creating the Lingua::BrillTagger perl module
-
-This software is made available under the MIT License, see LICENSE
-
-== FEATURES/PROBLEMS:
-
-* Rule based tagger
-* Word matching tagger
-
-== SYNOPSIS:
-
- tagger = Brill::Tagger.new
-
-== INSTALL:
-
-* sudo gem install rbtagger
-
-== LICENSE:
-
-(The MIT License)
-
-Copyright (c) 2008 Todd A. Fisher
-
-Permission is hereby granted, free of charge, to any person obtaining
-a copy of this software and associated documentation files (the
-'Software'), to deal in the Software without restriction, including
-without limitation the rights to use, copy, modify, merge, publish,
-distribute, sublicense, and/or sell copies of the Software, and to
-permit persons to whom the Software is furnished to do so, subject to
-the following conditions:
-
-The above copyright notice and this permission notice shall be
-included in all copies or substantial portions of the Software.
-
-THE SOFTWARE IS PROVIDED 'AS IS', WITHOUT WARRANTY OF ANY KIND,
-EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
-MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT.
-IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY
-CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT,
-TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE
-SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

data/config/hoe.rb

@@ -1,74 +0,0 @@
-require 'rbtagger/version'
-
-AUTHOR = 'Todd A. Fisher'  # can also be an array of Authors
-EMAIL = 'todd.fisher@gmail.com'
-DESCRIPTION = "A Simple Ruby Rule-Based Part of Speech Tagger"
-GEM_NAME = 'rbtagger' # what ppl will type to install your gem
-RUBYFORGE_PROJECT = 'rbtagger' # The unix name for your project
-HOMEPATH = "http://#{RUBYFORGE_PROJECT}.rubyforge.org"
-DOWNLOAD_PATH = "http://rubyforge.org/projects/#{RUBYFORGE_PROJECT}"
-EXTRA_DEPENDENCIES = [
-#  ['activesupport', '>= 1.3.1']
-]    # An array of rubygem dependencies [name, version]
-
-@config_file = "~/.rubyforge/user-config.yml"
-@config = nil
-RUBYFORGE_USERNAME = "unknown"
-def rubyforge_username
-  unless @config
-    begin
-      @config = YAML.load(File.read(File.expand_path(@config_file)))
-    rescue
-      puts <<-EOS
-ERROR: No rubyforge config file found: #{@config_file}
-Run 'rubyforge setup' to prepare your env for access to Rubyforge
- - See http://newgem.rubyforge.org/rubyforge.html for more details
-      EOS
-      exit
-    end
-  end
-  RUBYFORGE_USERNAME.replace @config["username"]
-end
-
-
-REV = nil
-# UNCOMMENT IF REQUIRED:
-# REV = YAML.load(`svn info`)['Revision']
-VERS = RbTagger::VERSION::STRING + (REV ? ".#{REV}" : "")
-RDOC_OPTS = ['--quiet', '--title', 'ruletagger documentation',
-    "--opname", "index.html",
-    "--line-numbers",
-    "--main", "README",
-    "--inline-source"]
-
-class Hoe
-  def extra_deps
-    @extra_deps.reject! { |x| Array(x).first == 'hoe' }
-    @extra_deps
-  end
-end
-
-PATH    = (RUBYFORGE_PROJECT == GEM_NAME) ? RUBYFORGE_PROJECT : "#{RUBYFORGE_PROJECT}/#{GEM_NAME}"
-
-# Generate all the Rake tasks
-# Run 'rake -T' to see list of generated tasks (from gem root directory)
-$hoe = Hoe.new(GEM_NAME, VERS) do |p|
-  p.developer(AUTHOR, EMAIL)
-  p.description = DESCRIPTION
-  p.summary = DESCRIPTION
-  p.url = HOMEPATH
-  p.rubyforge_name = RUBYFORGE_PROJECT if RUBYFORGE_PROJECT
-  p.test_globs = ["test/**/test_*.rb"]
-  p.clean_globs |= ['**/.*.sw?', '*.gem', '.config', '**/.DS_Store']  #An array of file patterns to delete on clean.
-
-  # == Optional
-  p.changes = p.paragraphs_of("History.txt", 0..1).join("\n\n")
-  #p.extra_deps = EXTRA_DEPENDENCIES
-
-  #p.spec_extras = {}    # A hash of extra values to set in the gemspec.
-end
-
-CHANGES = $hoe.paragraphs_of('History.txt', 0..1).join("\\n\\n")
-$hoe.remote_rdoc_dir = File.join(PATH.gsub(/^#{RUBYFORGE_PROJECT}\/?/,''), 'rdoc')
-$hoe.rsync_args = '-av --delete --ignore-errors'
-$hoe.spec.post_install_message = File.open(File.dirname(__FILE__) + "/../PostInstall.txt").read rescue ""

data/config/requirements.rb

@@ -1,15 +0,0 @@
-require 'fileutils'
-include FileUtils
-
-require 'rubygems'
-%w[rake hoe newgem rubigen].each do |req_gem|
-  begin
-    require req_gem
-  rescue LoadError
-    puts "This Rakefile requires the '#{req_gem}' RubyGem."
-    puts "Installation: gem install #{req_gem} -y"
-    exit
-  end
-end
-
-$:.unshift(File.join(File.dirname(__FILE__), %w[.. lib]))

data/ext/rule_tagger/mkmf.log

@@ -1,46 +0,0 @@
-have_header: checking for stdlib.h... -------------------- yes
-
-"gcc -E -I. -I/usr/lib64/ruby/1.8/x86_64-linux -I.   -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -fno-strict-aliasing  -fPIC  conftest.c -o conftest.i"
-checked program was:
-/* begin */
-1: #include <stdlib.h>
-/* end */
-
---------------------
-
-have_header: checking for string.h... -------------------- yes
-
-"gcc -E -I. -I/usr/lib64/ruby/1.8/x86_64-linux -I.   -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -fno-strict-aliasing  -fPIC  conftest.c -o conftest.i"
-checked program was:
-/* begin */
-1: #include <string.h>
-/* end */
-
---------------------
-
-have_library: checking for main() in -lc... -------------------- yes
-
-"gcc -o conftest -I. -I/usr/lib64/ruby/1.8/x86_64-linux -I.   -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -fno-strict-aliasing  -fPIC conftest.c  -L. -L/usr/lib64 -L.  -rdynamic -Wl,-export-dynamic     -lruby-static -lc  -lpthread -ldl -lcrypt -lm   -lc"
-checked program was:
-/* begin */
-1: /*top*/
-2: int main() { return 0; }
-3: int t() { void ((*volatile p)()); p = (void ((*)()))main; return 0; }
-/* end */
-
---------------------
-
-have_func: checking for snprintf() in stdio.h... -------------------- yes
-
-"gcc -o conftest -I. -I/usr/lib64/ruby/1.8/x86_64-linux -I.   -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -fno-strict-aliasing  -fPIC conftest.c  -L. -L/usr/lib64 -L.  -rdynamic -Wl,-export-dynamic    -lc  -lruby-static -lc  -lpthread -ldl -lcrypt -lm   -lc"
-checked program was:
-/* begin */
-1: #include <stdio.h>
-2: 
-3: /*top*/
-4: int main() { return 0; }
-5: int t() { void ((*volatile p)()); p = (void ((*)()))snprintf; return 0; }
-/* end */
-
---------------------
-

data/ext/word_tagger/mkmf.log

@@ -1,24 +0,0 @@
-have_library: checking for main() in -lc... -------------------- yes
-
-"gcc -o conftest -I. -I/usr/lib64/ruby/1.8/x86_64-linux -I.   -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -fno-strict-aliasing  -fPIC -Wall conftest.c  -L. -L/usr/lib64 -L.  -rdynamic -Wl,-export-dynamic     -lruby-static -lc  -lpthread -ldl -lcrypt -lm   -lc"
-checked program was:
-/* begin */
-1: /*top*/
-2: int main() { return 0; }
-3: int t() { void ((*volatile p)()); p = (void ((*)()))main; return 0; }
-/* end */
-
---------------------
-
-have_library: checking for main() in -lstdc++... -------------------- yes
-
-"gcc -o conftest -I. -I/usr/lib64/ruby/1.8/x86_64-linux -I.   -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -fno-strict-aliasing  -fPIC -Wall conftest.c  -L. -L/usr/lib64 -L.  -rdynamic -Wl,-export-dynamic    -lc  -lruby-static -lstdc++ -lc  -lpthread -ldl -lcrypt -lm   -lc"
-checked program was:
-/* begin */
-1: /*top*/
-2: int main() { return 0; }
-3: int t() { void ((*volatile p)()); p = (void ((*)()))main; return 0; }
-/* end */
-
---------------------
-

data/ext/word_tagger/test/Makefile

@@ -1,22 +0,0 @@
-CFLAGS=-g -Wall #-fprofile-arcs -ftest-coverage
-
-all: porter_stemmer.o tagger.o test.o
-	g++ $(CFLAGS) -o testit $^
-	time ./testit doc.txt
-#	gcov -b tagger.cc
-#	valgrind --leak-check=full ./testit
-test.o: test.cc tagger.h
-	g++ $(CFLAGS) test.cc -c
-tagger.o: tagger.cc tagger.h porter_stemmer.h
-	g++ $(CFLAGS) tagger.cc -c
-porter_stemmer.o: porter_stemmer.c porter_stemmer.h
-	gcc $(CFLAGS) porter_stemmer.c -c
-
-setup:
-	ln -s ../tagger.h
-	ln -s ../tagger.cc
-	ln -s ../porter_stemmer.h
-	ln -s ../porter_stemmer.c
-
-clean:
-	rm -f tagger.o test.o testit

data/ext/word_tagger/test/doc.txt

@@ -1,87 +0,0 @@
-Allergies are diseases of the immune system that cause an overreaction to
-substances called "allergens." Allergies are grouped by the kind of trigger,
-time of year or where symptoms appear on the body: indoor andoutdoor allergies
-(also called "hay fever," "seasonal," "perennial" or "nasal" allergies), food
-and drug allergies, latex allergies, insect allergies, skin allergies and eye
-allergies. People who have allergies can live healthy and active lives.
-
-movieMultimedia Allergy Library
-GlossaryGlossary of Allergy Terms
-
-What are Allergies  |   What Causes Allergies  |   Diagnosis  |   Treatment  |
-Prevention  |  
-
-What Causes Allergies
-
-The substances that cause allergic disease in people are known as allergens.
-"Antigens," or protein particles like pollen, food or dander enter our bodies
-through a variety of ways. If the antigen causes an allergic reaction, that
-particle is considered an "allergen" – and antigen that triggers an allergic
-reaction. These allergens can get into our body in several ways:
-
-    * Inhaled into the nose and the lungs. Examples are airborne pollens of
-    * certain trees, grasses and weeds; house dust that include dust mite
-    * particles, mold spores, cat and dog dander and latex dust.
-        * Ingested by mouth. Frequent culprits include shrimp, peanuts and
-        * other nuts.
-            * Injected. Such as medications delivered by needle like
-            * penicillin or other injectable drugs, and venom from insect
-            * stings and bites.
-                * Absorbed through the skin. Plants such as poison ivy, sumac
-                * and oak and latex are examples.
-
-                What Makes Some Pollen Cause Allergies, and Not Others?
-
-                Plant pollens that are carried by the wind cause most
-                allergies of the nose, eyes and lungs. These plants (including
-                certain weeds, trees and grasses) are natural pollutants
-                produced at various times of the year when their small,
-                inconspicuous flowers discharge literally billions of pollen
-                particles.
-
-                Because the particles can be carried significant distances, it
-                is important for you not only to understand local
-                environmental conditions, but also conditions over the broader
-                area of the state or region in which you live. Unlike the
-                wind-pollinated plants, conspicuous wild flowers or flowers
-                used in most residential gardens are pollinated by bees,
-                wasps, and other insects and therefore are not widely capable
-                of producing allergic disease.
-
-                What is the Role of Heredity in Allergy?
-
-                Like baldness, height and eye color, the capacity to become
-                allergic is an inherited characteristic. Yet, although you may
-                be born with the genetic capability to become allergic, you
-                are not automatically allergic to specific allergens. Several
-                factors must be present for allergic sensitivity to be
-                developed:
-
-                    * The specific genes acquired from parents.
-                        * The exposure to one or more allergens to which you
-                        * have a genetically programmed response.
-                            * The degree and length of exposure.
-
-                            A baby born with the tendency to become allergic
-                            to cow's milk, for example, may show allergic
-                            symptoms several months after birth. A genetic
-                            capability to become allergic to cat dander may
-                            take three to four years of cat exposure before
-                            the person shows symptoms. These people may also
-                            become allergic to other environmental substances
-                            with age.
-
-                            On the other hand, poison ivy allergy (contact
-                            dermatitis) is an example of an allergy in which
-                            hereditary background does not play a part. The
-                            person with poison ivy allergy first has to be
-                            exposed to the oil from the plant. This usually
-                            occurs during youth, when a rash does not always
-                            appear. However, the first exposure may sensitize
-                            or cause the person to become allergic and, when
-                            subsequent exposure takes place, a contact
-                            dermatitis rash appears and can be quite severe.
-                            Many plants are capable of producing this type of
-                            rash. Substances other than plants, such as dyes,
-                            metals, and chemicals in deodorants and cosmetics,
-                            can also cause a similar dermatitis.