RubyGems - pismo - Versions diffs - 0.5.0 → 0.6.0 - Mend

pismo 0.5.0 → 0.6.0

Files changed (22) hide show

data/LICENSE +19 -28
data/NOTICE +4 -0
data/README.markdown +37 -40
data/Rakefile +3 -2
data/VERSION +1 -1
data/bin/pismo +15 -7
data/lib/pismo/document.rb +2 -2
data/lib/pismo/internal_attributes.rb +23 -16
data/lib/pismo/reader.rb +390 -0
data/lib/pismo.rb +3 -2
data/pismo.gemspec +23 -15
data/test/corpus/bbcnews2.html +1575 -0
data/test/corpus/gmane.html +138 -0
data/test/corpus/metadata_expected.yaml +20 -5
data/test/corpus/queness.html +919 -0
data/test/corpus/reader_expected.yaml +45 -0
data/test/corpus/tweet.html +360 -0
data/test/corpus/zefrank.html +535 -0
data/test/test_corpus.rb +9 -1
metadata +89 -34
data/lib/pismo/readability.rb +0 -342
data/test/test_readability.rb +0 -152

data/test/corpus/gmane.html ADDED Viewed

@@ -0,0 +1,138 @@
+<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
+<html>
+  <head>
+    <title>Gmane -- Mail To News And Back Again</title>
+    <link href="http://gmane.org/img/gmane.css" rel="stylesheet" type="text/css">
+    <link rel="SHORTCUT ICON" href="http://gmane.org/favicon.ico">
+</head>
+<body bgcolor=white text=black class=main>
+  <table cellpadding=5 cellspacing=10 class="main">
+  <tr valign=top>
+  <td class="maintd">
+  <div class="tdiv">
+  <div>
+  <a href="http://gmane.org/">Home</a><br>
+  <a href="http://dir.gmane.org/">Reading</a><br>
+  <a href="http://search.gmane.org">Searching</a><br>
+  <a href="http://gmane.org/subscribe.php">Subscribe</a><br>
+  <a href="http://gmane.org/sponsors.php">Sponsors</a><br>
+  <a href="http://gmane.org/stats.php">Statistics</a><br>
+  <a href="http://gmane.org/post.php">Posting</a><br>
+  <a href="http://gmane.org/contact.php">Contact</a><br>
+  <a href="http://gmane.org/spam-control.php">Spam</a><br>
+  <a href="http://gmane.org/find.php">Lists</a><br>
+  <a href="http://gmane.org/links.php">Links</a><br>
+<a href="http://gmane.org/about.php">About</a><br>
+<a href="http://gmane.org/host.php">Hosting</a><br>
+<a href="http://gmane.org/filter.php">Filtering</a><br>
+<a href="http://gmane.org/features.php">Features</a>
+<a href="http://gmane.org/dist.php">Download</a><br>
+<a href="http://gmane.org/logo.php">Marketing</a><br>
+<a href="http://gmane.org/import.php">Archives</a><br>
+<a href="http://weaver.gmane.org/">Weaver</a><br>
+  <a href="http://gmane.org/faq.php">FAQ</a><br>
+  &nbsp;<br>
+  </div>
+  <div class="ltd">
+  <!-- <img src="http://gmane.org/img/gmane-25.png" width=25 height=25 alt="Gmane"> -->
+  </div>
+  </div>
+  </td>
+  <td align=center class="maintd">
+  <a href="http://gmane.org/"><img src="http://gmane.org/img/gmane-rot.png" alt="Gmane" border=0></a>
+  </td>
+  <td class="bodytd">
+<div class="headers">
+<div class="face">
+<img border=0 alt="Favicon" src="http://cache.gmane.org/gmane/comp/gcc/devel/114407-favicon.png">
+</div>
+From: Mark Mitchell &lt;mark &lt;at&gt; codesourcery.com&gt;<br>
+Subject: <a target="_top" rel="nofollow" href="http://news.gmane.org/find-root.php?message_id=%3c4C030228.8020201%40codesourcery.com%3e">Using C++ in GCC is OK</a><br>
+Newsgroups: <a href="http://news.gmane.org/gmane.comp.gcc.devel" target="_top">gmane.comp.gcc.devel</a><br>
+Date: 2010-05-31 00:26:16 GMT
+ (1 week, 5 days, 5 hours and 22 minutes ago)<br></div>
+<pre>
+I am pleased to report that the GCC Steering Committee and the FSF have
+approved the use of C++ in GCC itself.  Of course, there's no reason for
+us to use C++ features just because we can.  The goal is a better
+compiler for users, not a C++ code base for its own sake.
+Before we start to actually use C++, we need to determine a set of
+coding standards that will apply to use of C++ within GCC.  At first, I
+believe that we should keep the set of C++ features permitted small, in
+part so that GCC developers not familiar with C++ are not rapidly
+overwhelmed by a major change in the implementation language for the
+compiler itself.  We can always use more of C++ later if it seems
+appropriate to do so, then.
+For example, I think it goes without question that at this point we are
+limiting ourselves to C++98 (plus "long long" so that we have a 64-bit
+integer type); C++0x features should not be used.  Using multiple
+inheritance, templates (other than when using the C++ standard library,
+e.g. std::list&lt;X&gt;), or exceptions also seems overly aggressive to me.
+We should use features that are relatively easy for C programmers to
+understand and relatively hard for new C++ programmers to misuse.  (For
+example, I think constructors and destructors are pretty easy and hard
+to misuse.)
+Because C++ is a big language, I think we should try to enumerate what
+is OK, rather than what is not OK.  But, at the same time, I don't think
+we should try to get overly legalistic about exactly what is in and what
+is out.  We need information guidelines, not an ISO standard.
+Is there anyone who would like to volunteer to develop the C++ coding
+standards?  I think that this could be done as a Wiki page.  (If nobody
+volunteers, I will volunteer myself.)  Whoever ends up doing this, I
+would urge the rest of us not to spend too much time in the C++
+coding-standards bikeshed; we're not going to win or lose too much
+because we do or do not permit default parameters.
+--
+Mark Mitchell
+CodeSourcery
+mark &lt;at&gt; codesourcery.com
+(650) 331-3385 x713
+</pre>
+<script type="text/javascript">
+document.domain = 'gmane.org';
+document.title = 'Using C   in GCC is OK';
+</script>
+<td rowspan=2 class="listid">
+<a href="http://dir.gmane.org/gmane.comp.gcc.devel">
+<img border=0 rel=nofollow src="http://gmane.org/paint-list-id.php?group=gmane.comp.gcc.devel">
+</a>
+</td>
+</td>
+</tr>
+<tr>
+<td class="bads" colspan=2>
+&nbsp;
+<!--
+Get rid of ads<br><a href="http://gmane.org/donate.php">Donate to Gmane</a>
+-->
+</td>
+<td class="maintd" colspan=1 align=left>
+<script type="text/javascript"><!--
+google_ad_client = "pub-5884878215917141";
+google_alternate_ad_url = "http://gmane.org/blank.php";
+google_ad_width = 728;
+google_ad_height = 90;
+google_ad_format = "728x90_as";
+google_ad_channel ="";
+google_page_url = document.location;
+google_color_border = "FFFFFF";
+google_color_bg = "FFFFFF";
+google_color_link = "002390";
+google_color_url = "000000";
+google_color_text = "000000";
+google_ad_type = "text_image";
+//--></script>
+<script type="text/javascript"
+  src="http://pagead2.googlesyndication.com/pagead/show_ads.js">
+</script>
+  </td>
+  </tr>
+  </table>
+  </body>
+</html>

data/test/corpus/metadata_expected.yaml CHANGED Viewed

@@ -2,6 +2,7 @@
 :rww:
   :title: "Cartoon: Apple Tablet: Now With Barometer and Bird Call Generator"
   :feed: http://www.readwriteweb.com/rss.xml
+  :lede: I'm just aching to know if the new Apple tablet (insert caveats, weasel words and qualifiers here) is a potential Cintiq competitor. I don't think it will be, but you never know.
   :feeds:
     - http://www.readwriteweb.com/rss.xml
     - http://www.readwriteweb.com/archives/2010/01/cartoon_apple_tablet_now_with_barometer_and_bird_c.xml
@@ -33,7 +34,6 @@
   :lede: "Separation of concerns between Factor VM and library codeThe Factor VM implements an abstract machine consisting of a data heap of objects, a code heap of machine code blocks, and a set of stacks. The VM loads an image file on startup, which becomes the data and code heap. "
   :ledes:
     - "Separation of concerns between Factor VM and library codeThe Factor VM implements an abstract machine consisting of a data heap of objects, a code heap of machine code blocks, and a set of stacks. The VM loads an image file on startup, which becomes the data and code heap. "
-    - Slava Pestov's weblog, primarily about Factor.
 :youtube:
   :title: YMO - Rydeen (Official Video)
   :author: ymo1965
@@ -42,8 +42,7 @@
 :spolsky:
   :title: The Absolute Minimum Every Software Developer Absolutely, Positively Must Know About Unicode and Character Sets (No Excuses!) - Joel on Software
   :description: Haven't mastered the basics of Unicode and character sets? Please don't write another line of code until you've read this article.
-  :ledes:
-    - Ever wonder about that mysterious Content-Type tag? You know, the one you're supposed to put in HTML and you never quite know what it should be?
+  :lede: I've been dismayed to discover just how many software developers aren't really completely up to speed on the mysterious world of character sets, encodings, Unicode, all that stuff. A couple of years ago, a beta tester for FogBUGZ was wondering whether it could handle incoming email in Japanese.
   :author: Joel Spolsky
   :favicon: /favicon.ico
   :feed: http://www.joelonsoftware.com/rss.xml
@@ -54,5 +53,21 @@
   :title: "CoffeeScript: A New Language With A Pure Ruby Compiler"
   :author: Peter Cooper
   :lede: CoffeeScript (GitHub repo) is a new programming language with a pure Ruby compiler. Creator Jeremy Ashkenas calls it "JavaScript's less ostentatious kid brother" - mostly because it compiles into JavaScript and shares most of the same constructs, but with a different, tighter syntax.
-  :body: "CoffeeScript (GitHub repo) is a new programming language with a pure Ruby compiler. Creator Jeremy Ashkenas calls it \"JavaScript's less ostentatious kid brother\" - mostly because it compiles into JavaScript and shares most of the same constructs, but with a different, tighter syntax.\nTo get a feel for the language, check out this example code (CoffeeScript on the left, resulting JavaScript on the right):\nAs a Ruby project, you can get the CoffeeScript compiler installed with a simple gem install coffee-script or check out the code from/on GitHub. The code is worth a look as it's notably quite vanilla with hand crafted Ruby covering the lexer and code generation and Racc built code for the parser.\n"
-  :feed: http://www.rubyinside.com/feed/
+  :feed: http://www.rubyinside.com/feed/
+:zefrank:
+  :sentences: If there's anyone who knows how to marshal an online audience, it's Ze Frank. Ze is best-known for his 2006 program "The Show," in which he made a new 2-3 minute video every day for 1 year. Topics ranged from "fingers in food" to the mysteries of airport signage to a tour de force summary of creatives' addiction to un-executed ideas, aka brain crack.
+  :title: "Ze Frank on Imaginary Audiences :: Articles :: The 99 Percent"
+  :description: We chat with the Internet's most notorious mass-collaboration instigator Ze Frank about idea execution and how to build armies of sportsracers.
+:tweet:
+  :lede: Gobsmacked that TeX/LaTeX (document formatting tools) for OS X is a 1.3GB (yes, GIGAbytes) download OS X. Wow..!
+  :sentences: Gobsmacked that TeX/LaTeX (document formatting tools) for OS X is a 1.3GB (yes, GIGAbytes) download OS Wow..!
+  :datetime: 2010-06-05 12:00:00 +01:00
+:cant_read:
+  :sentences: "For those of us who grew up as weird kids in the 1980s, the work of Berkeley Breathed was as important as those twin eternal pillars of weird-kid-dom: Monty Python and Mad magazine. In a word: seminal. In two words: fucking seminal."
+:gmane:
+  :sentences: I am pleased to report that the GCC Steering Committee and the FSF have approved the use of C++ in GCC itself. Of course, there's no reason for us to use C++ features just because we can. The goal is a better compiler for users, not a C++ code base for its own sake.
+:queness:
+  :title: 18 Incredible CSS3 Effects You Have Never Seen Before
+  :lede: "CSS3 is hot these days and will soon be available in most modern browser. Just recently, I started to become aware to the present of CSS3 around the web. "
+  :sentences: CSS3 is hot these days and will soon be available in most modern browser. Just recently, I started to become aware to the present of CSS3 around the web. I can see some of the websites such as twitter and designer portfolios websites are using it.
+  :datetime: 2010-06-02 12:00:00 +01:00