RubyGems - DRMacIver-term-extractor - Versions diffs - 0.0.0 - Mend

DRMacIver-term-extractor 0.0.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.

Files changed (28) hide show

data/LICENSE +25 -0
data/README.markdown +40 -0
data/Rakefile +56 -0
data/VERSION +1 -0
data/bin/terms.rb +8 -0
data/lib/term-extractor.rb +195 -0
data/lib/term-extractor/maxent-2.5.2.jar +0 -0
data/lib/term-extractor/nlp.rb +262 -0
data/lib/term-extractor/opennlp-tools.jar +0 -0
data/lib/term-extractor/snowball.jar +0 -0
data/lib/term-extractor/trove.jar +0 -0
data/licenses/Maxent +421 -0
data/licenses/OpenNLP +421 -0
data/licenses/Trove +504 -0
data/licenses/snowball.php +33 -0
data/models/chunk.bin.gz +0 -0
data/models/sd.bin.gz +0 -0
data/models/stopwords +567 -0
data/models/tag.bin.gz +0 -0
data/models/tagdict +16204 -0
data/models/tok.bin.gz +0 -0
data/term-extractor.gemspec +66 -0
data/test/examples_spec.rb +131 -0
data/test/files/1.email +37 -0
data/test/files/juries_seg_8_v1 +20 -0
data/test/nlp_spec.rb +231 -0
data/test/term_extractor_spec.rb +141 -0
metadata +83 -0

data/licenses/snowball.php ADDED Viewed

@@ -0,0 +1,33 @@
+<?php
+  require "menu.inc";
+  displayHeader("License");
+?>
+<TR><TD>
+<p>
+All the software given out on this Snowball site is covered by the BSD License (see
+<A HREF="http://www.opensource.org/licenses/bsd-license.html">
+http://www.opensource.org/licenses/bsd-license.html </A>), with
+Copyright (c) 2001, Dr Martin Porter,
+and (for the Java developments)
+Copyright (c) 2002, Richard Boulton.
+</p><p>
+Essentially, all this means is that you can do what you like with the code,
+except claim another Copyright for it, or claim that it is issued under a different
+license. The software is also issued without warranties, which means that if anyone
+suffers through its use, they cannot come back and sue you.
+You also have to alert anyone to whom you give the Snowball
+software to the fact that it is covered by the BSD license.
+</p><p>
+We have not bothered to insert the licensing arrangement into the
+text of the Snowball software.
+</p>
+</TD></TR>
+<?php displayFooter(); ?>

data/models/chunk.bin.gz ADDED Viewed

Binary file

data/models/sd.bin.gz ADDED Viewed

Binary file

data/models/stopwords ADDED Viewed

@@ -0,0 +1,567 @@
+# Derived from stopwords generated by Chris Buckley and Gerard Salton at Cornell University
+# Modified to remove numerals and add a few additional ones.
+a
+a's
+aah
+able
+about
+above
+according
+accordingly
+across
+actually
+after
+afterwards
+again
+against
+ah
+ain't
+all
+allow
+allows
+almost
+alone
+along
+already
+also
+although
+always
+am
+among
+amongst
+an
+and
+another
+any
+anybody
+anyhow
+anyone
+anything
+anyway
+anyways
+anywhere
+apart
+appear
+appreciate
+appropriate
+are
+aren't
+around
+as
+aside
+ask
+asking
+associated
+at
+available
+away
+awfully
+b
+bcc
+be
+became
+because
+become
+becomes
+becoming
+been
+before
+beforehand
+behind
+being
+believe
+below
+beside
+besides
+best
+better
+between
+beyond
+both
+brief
+but
+by
+c
+c'mon
+c's
+came
+can
+can't
+cannot
+cant
+cause
+causes
+cc
+certain
+certainly
+changes
+clearly
+co
+com
+come
+comes
+concerning
+consequently
+consider
+considering
+contain
+containing
+contains
+corresponding
+could
+couldn't
+course
+currently
+d
+definitely
+described
+despite
+did
+didn't
+different
+do
+does
+doesn't
+doing
+don't
+done
+down
+downwards
+during
+e
+each
+edu
+eg
+either
+else
+elsewhere
+enough
+entirely
+especially
+et
+etc
+even
+ever
+every
+everybody
+everyone
+everything
+everywhere
+ex
+exactly
+example
+except
+f
+far
+few
+followed
+following
+follows
+for
+former
+formerly
+from
+further
+furthermore
+fwd
+g
+get
+gets
+getting
+given
+gives
+go
+goes
+going
+gone
+got
+gotten
+greetings
+h
+had
+hadn't
+happens
+hardly
+has
+hasn't
+have
+haven't
+having
+he
+he's
+hello
+help
+hence
+her
+here
+here's
+hereafter
+hereby
+herein
+hereupon
+hers
+herself
+hi
+him
+himself
+his
+hither
+hm
+hmm
+hopefully
+how
+howbeit
+however
+i
+i'd
+i'll
+i'm
+i've
+ie
+if
+ignored
+immediate
+in
+inasmuch
+inc
+indeed
+indicate
+indicated
+indicates
+inner
+insofar
+instead
+into
+inward
+is
+isn't
+it
+it'd
+it'll
+it's
+its
+itself
+j
+just
+k
+keep
+keeps
+kept
+know
+knows
+known
+l
+last
+lately
+later
+latter
+latterly
+least
+less
+lest
+let
+let's
+like
+liked
+likely
+likewise
+little
+look
+looking
+looks
+ltd
+m
+mainly
+many
+may
+maybe
+me
+mean
+meanwhile
+merely
+might
+more
+moreover
+most
+mostly
+much
+must
+my
+myself
+n
+name
+namely
+nd
+near
+nearly
+necessary
+need
+needs
+neither
+never
+nevertheless
+new
+next
+no
+nobody
+non
+none
+noone
+nor
+normally
+not
+nothing
+novel
+now
+nowhere
+o
+obviously
+of
+off
+often
+oh
+ok
+okay
+old
+on
+once
+ones
+only
+onto
+or
+other
+others
+otherwise
+ought
+our
+ours
+ourselves
+out
+outside
+over
+overall
+own
+p
+particular
+particularly
+per
+perhaps
+placed
+please
+plus
+possible
+presumably
+probably
+provides
+q
+que
+quite
+qv
+r
+rather
+rd
+re
+really
+reasonably
+regarding
+regardless
+regards
+relatively
+respectively
+right
+s
+said
+same
+saw
+say
+saying
+says
+secondly
+see
+seeing
+seem
+seemed
+seeming
+seems
+seen
+self
+selves
+sensible
+sent
+serious
+seriously
+several
+shall
+she
+should
+shouldn't
+since
+so
+some
+somebody
+somehow
+someone
+something
+sometime
+sometimes
+somewhat
+somewhere
+soon
+sorry
+specified
+specify
+specifying
+still
+sub
+such
+sup
+sure
+t
+t's
+take
+taken
+tell
+tends
+th
+than
+thank
+thanks
+thanx
+that
+that's
+thats
+the
+their
+theirs
+them
+themselves
+then
+thence
+there
+there's
+thereafter
+thereby
+therefore
+therein
+theres
+thereupon
+these
+they
+they'd
+they'll
+they're
+they've
+think
+this
+thorough
+thoroughly
+those
+though
+through
+throughout
+thru
+thus
+to
+together
+too
+took
+toward
+towards
+tried
+tries
+truly
+try
+trying
+twice
+u
+un
+under
+unfortunately
+unless
+unlikely
+until
+unto
+up
+upon
+us
+use
+used
+useful
+uses
+using
+usually
+uucp
+v
+value
+various
+very
+via
+viz
+vs
+w
+want
+wants
+was
+wasn't
+way
+we
+we'd
+we'll
+we're
+we've
+welcome
+well
+went
+were
+weren't
+what
+what's
+whatever
+when
+whence
+whenever
+where
+where's
+whereafter
+whereas
+whereby
+wherein
+whereupon
+wherever
+whether
+which
+while
+whither
+who
+who's
+whoever
+whole
+whom
+whose
+why
+will
+willing
+wish
+with
+within
+without
+won't
+wonder
+would
+would
+wouldn't
+x
+y
+yes
+yet
+you
+you'd
+you'll
+you're
+you've
+your
+yours
+yourself
+yourselves
+z