RubyGems - pismo - Versions diffs - 0.2.0 - Mend

pismo 0.2.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.

Files changed (30) hide show

data/.document +5 -0
data/.gitignore +21 -0
data/LICENSE +32 -0
data/README.rdoc +68 -0
data/Rakefile +95 -0
data/VERSION +1 -0
data/bin/pismo +36 -0
data/lib/pismo/document.rb +50 -0
data/lib/pismo/external_attributes.rb +14 -0
data/lib/pismo/internal_attributes.rb +202 -0
data/lib/pismo/readability.rb +316 -0
data/lib/pismo/stopwords.txt +893 -0
data/lib/pismo.rb +44 -0
data/pismo.gemspec +92 -0
data/test/corpus/bbcnews.html +2131 -0
data/test/corpus/briancray.html +269 -0
data/test/corpus/cant_read.html +426 -0
data/test/corpus/factor.html +1362 -0
data/test/corpus/huffington.html +2932 -0
data/test/corpus/metadata_expected.yaml +81 -0
data/test/corpus/rubyinside.html +318 -0
data/test/corpus/rww.html +1351 -0
data/test/corpus/spolsky.html +298 -0
data/test/corpus/techcrunch.html +1285 -0
data/test/corpus/youtube.html +2348 -0
data/test/helper.rb +15 -0
data/test/test_corpus.rb +33 -0
data/test/test_pismo_document.rb +34 -0
data/test/test_readability.rb +152 -0
metadata +146 -0

data/lib/pismo/stopwords.txt ADDED Viewed

@@ -0,0 +1,893 @@
+a
+a's
+able
+about
+above
+according
+accordingly
+across
+actually
+after
+afterwards
+again
+against
+ain't
+all
+allow
+allows
+almost
+alone
+along
+already
+also
+although
+always
+am
+among
+amongst
+an
+and
+another
+any
+anybody
+anyhow
+anyone
+anything
+anyway
+anyways
+anywhere
+apart
+appear
+appreciate
+appropriate
+are
+aren't
+around
+as
+aside
+ask
+asking
+associated
+at
+available
+away
+awfully
+b
+be
+became
+because
+become
+becomes
+becoming
+been
+before
+beforehand
+behind
+being
+believe
+below
+beside
+besides
+best
+better
+between
+beyond
+both
+brief
+but
+by
+c
+c'mon
+c's
+came
+can
+can't
+cannot
+cant
+cause
+causes
+certain
+certainly
+changes
+clearly
+co
+com
+come
+comes
+concerning
+consequently
+consider
+considering
+contain
+containing
+contains
+corresponding
+could
+couldn't
+course
+currently
+d
+definitely
+described
+despite
+did
+didn't
+different
+do
+does
+doesn't
+doing
+don't
+done
+down
+downwards
+during
+e
+each
+edu
+eg
+eight
+either
+else
+elsewhere
+enough
+entirely
+especially
+et
+etc
+even
+ever
+every
+everybody
+everyone
+everything
+everywhere
+ex
+exactly
+example
+except
+f
+far
+few
+fifth
+first
+five
+followed
+following
+follows
+for
+former
+formerly
+forth
+four
+from
+further
+furthermore
+g
+get
+gets
+getting
+given
+gives
+go
+goes
+going
+gone
+got
+gotten
+greetings
+h
+had
+hadn't
+happens
+hardly
+has
+hasn't
+have
+haven't
+having
+he
+he's
+hello
+help
+hence
+her
+here
+here's
+hereafter
+hereby
+herein
+hereupon
+hers
+herself
+hi
+him
+himself
+his
+hither
+hopefully
+how
+howbeit
+however
+i
+i'd
+i'll
+i'm
+i've
+ie
+if
+ignored
+immediate
+in
+inasmuch
+inc
+indeed
+indicate
+indicated
+indicates
+inner
+insofar
+instead
+into
+inward
+is
+isn't
+it
+it'd
+it'll
+it's
+its
+itself
+j
+just
+k
+keep
+keeps
+kept
+know
+knows
+known
+l
+last
+lately
+later
+latter
+latterly
+least
+less
+lest
+let
+let's
+like
+liked
+likely
+little
+look
+looking
+looks
+ltd
+m
+mainly
+many
+may
+maybe
+me
+mean
+meanwhile
+merely
+might
+more
+moreover
+most
+mostly
+much
+must
+my
+myself
+n
+name
+namely
+nd
+near
+nearly
+necessary
+need
+needs
+neither
+never
+nevertheless
+new
+next
+nine
+no
+nobody
+non
+none
+noone
+nor
+normally
+not
+nothing
+novel
+now
+nowhere
+o
+obviously
+of
+off
+often
+oh
+ok
+okay
+old
+on
+once
+one
+ones
+only
+onto
+or
+other
+others
+otherwise
+ought
+our
+ours
+ourselves
+out
+outside
+over
+overall
+own
+p
+particular
+particularly
+per
+perhaps
+placed
+please
+plus
+possible
+presumably
+probably
+provides
+q
+que
+quite
+qv
+r
+rather
+rd
+re
+really
+reasonably
+regarding
+regardless
+regards
+relatively
+respectively
+right
+s
+said
+same
+saw
+say
+saying
+says
+second
+secondly
+see
+seeing
+seem
+seemed
+seeming
+seems
+seen
+self
+selves
+sensible
+sent
+serious
+seriously
+seven
+several
+shall
+she
+should
+shouldn't
+since
+six
+so
+some
+somebody
+somehow
+someone
+something
+sometime
+sometimes
+somewhat
+somewhere
+soon
+sorry
+specified
+specify
+specifying
+still
+sub
+such
+sup
+sure
+t
+t's
+take
+taken
+tell
+tends
+th
+than
+thank
+thanks
+thanx
+that
+that's
+thats
+the
+their
+theirs
+them
+themselves
+then
+thence
+there
+there's
+thereafter
+thereby
+therefore
+therein
+theres
+thereupon
+these
+they
+they'd
+they'll
+they're
+they've
+think
+third
+this
+thorough
+thoroughly
+those
+though
+three
+through
+throughout
+thru
+thus
+to
+together
+too
+took
+toward
+towards
+tried
+tries
+truly
+try
+trying
+twice
+two
+u
+un
+under
+unfortunately
+unless
+unlikely
+until
+unto
+up
+upon
+us
+use
+used
+useful
+uses
+using
+usually
+uucp
+v
+value
+various
+very
+via
+viz
+vs
+w
+want
+wants
+was
+wasn't
+way
+we
+we'd
+we'll
+we're
+we've
+welcome
+well
+went
+were
+weren't
+what
+what's
+whatever
+when
+whence
+whenever
+where
+where's
+whereafter
+whereas
+whereby
+wherein
+whereupon
+wherever
+whether
+which
+while
+whither
+who
+who's
+whoever
+whole
+whom
+whose
+why
+will
+willing
+wish
+with
+within
+without
+won't
+wonder
+would
+would
+wouldn't
+x
+y
+yes
+yet
+you
+you'd
+you'll
+you're
+you've
+your
+yours
+yourself
+yourselves
+z
+zero
+casually
+mentioned
+called
+eventually
+covered
+today
+proud
+reached
+1
+0
+10
+100
+20
+good
+feel
+great
+piece
+put
+online
+inside
+biggest
+solid
+unsurprisingly
+existing
+impromptu
+ultra
+check
+lot
+big
+goal
+provide
+highly
+lots
+walks
+live
+stand
+alongside
+meant
+suck
+awesome
+turn
+feeling
+continued
+play
+al
+tit
+tat
+started
+oriented
+imagine
+carefully
+built
+full
+moving
+products
+product
+spread
+mile
+benefit
+works
+fine
+related
+articles
+equals
+basically
+informative
+recently
+real
+simpler
+allowing
+perform
+allowed
+bother
+box
+shot
+typically
+requirements
+ago
+hours
+minutes
+seconds
+hour
+minute
+second
+high
+low
+drove
+extensive
+spoke
+pre
+Jacob
+Michael
+Joshua
+Matthew
+Christopher
+Andrew
+Daniel
+Ethan
+Joseph
+William
+Anthony
+Nicholas
+David
+Alexander
+Ryan
+Tyler
+James
+John
+Jonathan
+Brandon
+Christian
+Dylan
+Zachary
+Noah
+Samuel
+Benjamin
+Nathan
+Logan
+Justin
+Jose
+Gabriel
+Austin
+Kevin
+Caleb
+Robert
+Elijah
+Thomas
+Jordan
+Cameron
+Hunter
+Jack
+Angel
+Isaiah
+Jackson
+Evan
+Luke
+Jason
+Isaac
+Mason
+Aaron
+Connor
+Gavin
+Kyle
+Jayden
+Aidan
+Juan
+Luis
+Charles
+Aiden
+Adam
+Brian
+Eric
+Lucas
+Sean
+Nathaniel
+Alex
+Adrian
+Carlos
+Bryan
+Ian
+Jesus
+Owen
+Julian
+Cole
+Landon
+Diego
+Steven
+Chase
+Timothy
+Jeremiah
+Sebastian
+Xavier
+Devin
+Cody
+Seth
+Hayden
+Blake
+Richard
+Carter
+Wyatt
+Dominic
+Antonio
+Jaden
+Miguel
+Brayden
+Patrick
+Alejandro
+Carson
+Jesse
+Tristan
+Trevor
+Victor
+Henry
+Jake
+Liam
+Jared
+Bryce
+Riley
+Colin
+Mark
+Jeremy
+Garrett
+Caden
+Marcus
+Vincent
+Kenneth
+Parker
+Kaleb
+Brady
+Kaden
+Jorge
+Oscar
+Joel
+Colton
+Tanner
+Ashton
+Paul
+Josiah
+Eduardo
+Edward
+Ivan
+Cooper
+Emily
+Madison
+Emma
+Hannah
+Olivia
+Abigail
+Isabella
+Ashley
+Samantha
+Elizabeth
+Alexis
+Sarah
+Alyssa
+Grace
+Sophia
+Taylor
+Brianna
+Lauren
+Ava
+Kayla
+Jessica
+Natalie
+Chloe
+Anna
+Victoria
+Hailey
+Mia
+Sydney
+Jasmine
+Morgan
+Julia
+Destiny
+Rachel
+Megan
+Kaitlyn
+Katherine
+Jennifer
+Savannah
+Ella
+Alexandra
+Haley
+Allison
+Maria
+Nicole
+Mackenzie
+Brooke
+Makayla
+Kaylee
+Lily
+Stephanie
+Andrea
+Faith
+Amanda
+Katelyn
+Kimberly
+Madeline
+Gabrielle
+Zoe
+Trinity
+Alexa
+Mary
+Jenna
+Lillian
+Paige
+Kylie
+Gabriella
+Rebecca
+Jordan
+Sara
+Addison
+Michelle
+Riley
+Vanessa
+Angelina
+Leah
+Caroline
+Sofia
+Audrey
+Maya
+Avery
+Evelyn
+Autumn
+Amber
+Ariana
+Jocelyn
+Claire
+Jada
+Danielle
+Bailey
+Isabel
+Arianna
+Sierra
+Mariah
+Aaliyah
+Melanie
+Erin
+Nevaeh
+Brooklyn
+Marissa
+yeah