jsl-myzofeedtosis 0.0.1.2

data/LICENSE

@@ -0,0 +1,20 @@
+Copyright (c) 2009 Justin S. Leitgeb
+
+Permission is hereby granted, free of charge, to any person obtaining
+a copy of this software and associated documentation files (the
+"Software"), to deal in the Software without restriction, including
+without limitation the rights to use, copy, modify, merge, publish,
+distribute, sublicense, and/or sell copies of the Software, and to
+permit persons to whom the Software is furnished to do so, subject to
+the following conditions:
+
+The above copyright notice and this permission notice shall be
+included in all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
+EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
+MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
+NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE
+LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
+OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
+WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

data/README.rdoc

@@ -0,0 +1,109 @@
+= Description
+
+Myzofeedtosis is a library that helps you to efficiently process syndicated web resources.  It helps by automatically using 
+conditional HTTP GET requests, as well as by pointing out which entries are new in any given feed.
+
+== Name
+
+The name "myzofeedtosis" is based on the form of cellular digestion "myzocytosis".  According to Wikipedia [1], myzocytosis 
+is described as the process where "one cell pierces another using a feeding tube, and sucks out cytoplasm".  Myzofeedtosis is 
+kind of like that, except it works with RSS/Atom feeds instead of cytoplasm.
+
+1 - http://en.wikipedia.org/wiki/List_of_vores
+
+== Philosophy
+
+Myzofeedtosis is designed to help you with book-keeping about feed fetching details.  This is usually something that is
+mundane and not fundamentally related to the business logic of applications that deal with the consumption of syndicated
+content on the web.  Myzofeedtosis keeps track of these mundane details so you can just keep grabbing new content without
+wasting bandwidth in making unnecessary requests and programmer time in implementing algorithms to figure out which feed 
+entries are new.
+
+Myzofeedtosis fits into other frameworks to do the heavy lifting, including the Curb library which does HTTP requests through
+curl, and FeedNormalizer which abstracts the differences between syndication formats.  In the sense that it fits into these 
+existing, robust programs, Myzofeedtosis is a modular middleware piece that efficiently glues together disparate parts to create
+a helpful feed reader with a minimal (< 200 LOC), test-covered codebase.
+
+== Installation
+
+Assuming that you've followed the directions on gems.github.com to allow your computer to install gems from GitHub, the
+following command will install the Myzofeedtosis library:
+
+  sudo gem install jsl-myzofeedtosis
+
+== Usage
+
+Myzofeedtosis is easy to use.  Just create a client object, and invoke the "fetch" method:
+
+  require 'myzofeedtosis'
+  client = Myzofeedtosis::Client.new('http://feeds.feedburner.com/wooster')
+  result = client.fetch
+
++result+ will be a FeedNormalizer::Feed object, which responds to the method +entries+.  In this first case, Myzofeedtosis
+isn't much more useful than just using FeedNormalizer by itself.  On subsequent requests, though, it helps significantly.
+Invoke client.fetch again.  Instead of getting back an object that responds to +entries+, you'll probably get back a Curl::Easy
+object with a response code of 304, indicating that the resource hasn't changed since the last retrieval.  If you invoke 
+fetch again, assuming one entry was added, you would get back another FeedNormalizer::Feed object.  You'll also notice that 
+all of the FeedNormalizer::Feed objects respond not only to +entries+, but +new_entries+, which is a selection of the entries
+that haven't been seen before.
+
+Myzofeedtosis is designed for these situations where you have one or maybe thousands of feeds that you have to update on a 
+regular basis.  If the results that you receive respond to the method new_entries, iterate over the new entries, processing them 
+according to your business logic.
+
+You will most likely want to allow Myzofeedtosis to remember details about the last retrieval of a feed after the client is 
+removed from memory.  Myzofeedtosis uses Moneta, a unified interface to key-value storage systems to remember "summaries" of
+feeds that it has seen in the past.  See the document section on Customization for more details on how to configure this system.
+
+== Customization
+
+Myzofeedtosis stores summaries of feeds in a key-value storage system.  If no options are included when creating a new 
+Myzofeedtosis::Client object, the default is to use a "memory" storage system.  The memory system is just a basic ruby Hash, so it
+won't keep track of feeds after a particular Client is removed from memory.  To configure a different backend, pass an options hash
+to the Myzofeedtosis client initialization:
+
+  url = "http://newsrss.bbc.co.uk/rss/newsonline_world_edition/south_asia/rss.xml"
+  mf = Myzofeedtosis::Client.new(url, :backend => {:moneta_klass => 'Moneta::Memcache', :server => 'localhost:1978'})
+  res = mf.fetch
+  
+This example sets up a Memcache backend, which in this case points to Tokyo Tyrant on port 1978.  Note that Moneta::Memcache
+can be given as a string, in which case you don't have to manually require Moneta::Memcache before initializing the client.
+
+Generally, Myzofeedtosis supports all systems supported by Moneta, and any one of the supported systems can be given to the 
++moneta_klass+ parameter.  Other options following +backend+ are passed directly to Moneta for configuration.
+
+== Implementation
+
+Myzofeedtosis helps to identify new feed entries and to figure out when conditional GET can be used in retrieving resources.  In 
+order to accomplish this without having to require that the user store information such as etags and dates of the last retrieved entry,
+Myzofeedtosis stores a summary structure in the configured key-value store (backed by Moneta).  In order to do conditional GET
+requests, Myzofeedtosis stores the Last-Modified date, as well as the ETag of the last request in the summary structure, which is
+put in a namespaced element consisting of the term 'Myzofeedtosis' (bet you won't have to worry about name collisions on that one!) 
+and the MD5 of the URL retrieved.  
+
+It can also be a bit tricky to decipher which feed entries are new since many feed sources don't include unique ids with their
+feeds.  Myzofeedtosis reliably keeps track of which entries in a feed are new by storing (in the summary hash mentioned above) an 
+MD5 signature of each entry in a feed.  It takes elements such as the published-at date, title and content and generates the MD5 
+of these elements.  This allows Myzofeedtosis to cheaply compute (both in terms of computation and storage) which feed entries 
+should be presented to the user as "new".  Below is an example of a summary structure:
+
+  { 
+    :etag=>"4c8f-46ac09fbbe940", :last_modified=>"Mon, 25 May 2009 18:17:33 GMT",
+    :digests=>["f2993783ded928637ce5f2dc2d837f10", "da64efa6dd9ce34e5699b9efe73a37a7"] 
+  }
+    
+The data stored by Myzofeedtosis in the summary structure allows it to be helpful to the user without storing lots of 
+data that are unnecessary for efficient functioning.
+
+== HTML cleaning/sanitizing
+
+Myzofeedtosis doesn't do anything about feed sanitizing, as other libraries have been built for this purpose.  FeedNormalizer
+has methods for escaping entries, but to strip HTML I suggest that you look at the Ruby gem "sanitize".
+
+== Feedback
+
+Please let me know if you have any problems with or questions about Myzofeedtosis.
+
+= Author
+
+Justin S. Leitgeb, mailto:justin@phq.org

data/Rakefile

@@ -0,0 +1,28 @@
+require 'rubygems'
+require 'spec'
+
+require 'rake'
+require 'spec/rake/spectask'
+require 'rake/rdoctask'
+
+require 'lib/myzofeedtosis'
+
+desc 'Test the plugin.'
+Spec::Rake::SpecTask.new(:spec) do |t|
+  t.spec_opts  = ["--format", "progress", "--colour"]
+  t.libs << 'lib'
+  t.verbose = true
+end
+
+desc "Run all the tests"
+task :default => :spec
+
+desc 'Generate documentation'
+Rake::RDocTask.new(:rdoc) do |rdoc|
+  rdoc.rdoc_dir = 'rdoc'
+  rdoc.title    = 'Myzofeedtosis'
+  rdoc.options << '--line-numbers' << '--inline-source'
+  rdoc.rdoc_files.include('README.rdoc')
+  rdoc.rdoc_files.include('lib/myzofeedtosis/**/*.rb')
+end
+

data/lib/extensions/core/array.rb

@@ -0,0 +1,8 @@
+class Array
+    
+  # From Rails' ActiveSupport library
+  def extract_options!
+    last.is_a?(::Hash) ? pop : {}
+  end
+
+end

data/lib/extensions/core/hash.rb

@@ -0,0 +1,17 @@
+class Hash
+  # Returns a Hash containing only input keys.
+  # Method from merb-core.
+  def except(*rejected)
+    reject { |k,v| rejected.include?(k) }
+  end
+  
+  def reverse_merge(other_hash)
+    other_hash.merge(self)
+  end
+
+  # Returns a new hash containing only the input keys.
+  # Method from merb-core.
+  def only(*allowed)
+    reject { |k,v| !allowed.include?(k) }
+  end
+end

data/lib/extensions/feed_normalizer/feed_instance_methods.rb

@@ -0,0 +1,17 @@
+# Extends FeedNormalizer::Feed with method for detecting new_items (aliased as new_entries for 
+# convenience).
+module Myzofeedtosis
+  module FeedInstanceMethods
+    
+    # Returns only the feeds that are new.
+    def new_items
+      self.entries.select do |e| 
+        e.instance_variable_get(:@_seen) == false
+      end
+    end
+    
+    alias :new_entries :new_items
+  end
+end
+
+FeedNormalizer::Feed.__send__(:include, Myzofeedtosis::FeedInstanceMethods)

data/lib/myzofeedtosis.rb

@@ -0,0 +1,14 @@
+require 'rubygems'
+require 'curb'
+require 'hashback'
+require 'http_headers'
+require 'feed-normalizer'
+require 'md5'
+
+lib_dirs =  [ 'extensions', 'myzofeedtosis' ].map do |d|
+  File.join(File.dirname(__FILE__), d)
+end
+
+lib_dirs.each do |d|
+  Dir[File.join(d, "**", "*.rb")].each {|file| require file }
+end

data/lib/myzofeedtosis/client.rb

@@ -0,0 +1,147 @@
+module Myzofeedtosis
+  
+  # Myzofeedtosis::Client is the primary interface to the feed reader.  Call it with a url that was previously fetched while 
+  # connected to the configured backend, and it will 1) only do a retrieval if deemed necessary based on the etag and modified-at
+  # of the last etag and 2) mark all entries retrieved as either new or not new.  Entries retrieved are normalized using 
+  # the feed-normalizer gem.
+  class Client
+    attr_reader :options, :url
+
+    DEFAULTS = {
+      :backend => {
+        :moneta_klass => 'Moneta::Memory'
+      }
+    } unless defined?(DEFAULTS)
+
+    def initialize(url, options = { })
+      @url      = url
+      @options  = DEFAULTS.merge(options)
+      
+      @backend  = HashBack::Backend.new( 'Myzofeedtosis', 
+                    @options[:backend][:moneta_klass], 
+                    @options[:backend].except(:moneta_klass) )
+    end
+    
+    # Retrieves the latest entries from this feed.  Returns a Feednormalizer::Feed object with
+    # method +new_entries+ if the response was successful, otherwise returns the Curl::Easy object
+    # that we used to retrieve this resource.  Note that we also return this object if the request
+    # resulted in a 304 (Not Modified) response code since we don't have any new results.  Depending
+    # on your business logic, you may want to do something in this case, such as putting this 
+    # resource in a lower-priority queue if it is not frequently updated.
+    def fetch
+      curl = build_curl_easy
+      curl.perform
+      process_curl_response(curl)
+    end
+    
+    private
+
+    # Marks entries as either seen or not seen based on the unique signature of the entry, which
+    # is calculated by taking the MD5 of common attributes.
+    def mark_new_entries(response)
+      digests = if summary_for_feed.nil? || summary_for_feed[:digests].nil?
+        [ ]
+      else
+        summary_for_feed[:digests]
+      end
+            
+      # For each entry in the responses object, mark @_seen as false if the digest of this entry
+      # doesn't exist in the cached object.
+      response.entries.each do |e|
+        seen = digests.include?(digest_for(e))
+        e.instance_variable_set(:@_seen, seen)
+      end
+      
+      response
+    end
+
+    # Processes the results by identifying which entries are new if the response
+    # is a 200.  Otherwise, returns the Curl::Easy object for the user to inspect.
+    def process_curl_response(curl)
+      if curl.response_code == 200
+        response = parser_for_xml(curl.body_str)
+        response = mark_new_entries(response)
+        store_summary_to_backend(response, curl)
+        response
+      else
+        curl
+      end
+    end
+    
+    # Sets options for the Curl::Easy object, including parameters for HTTP conditional GET.
+    def build_curl_easy
+      curl = new_curl_easy(url)
+
+      # Many feeds have a 302 redirect to another URL.  For more recent versions of Curl, 
+      # we need to specify this.
+      curl.follow_location = true
+      
+      set_header_options(curl)
+    end
+
+    def new_curl_easy(url)
+      Curl::Easy.new(url)
+    end
+
+    # Returns the summary hash for this feed from the backend store.
+    def summary_for_feed
+      @backend[key_for_cached]
+    end
+
+    # Sets the headers from the backend, if available
+    def set_header_options(curl)
+      summary = summary_for_feed
+      
+      unless summary.nil?
+        # We should only try to populate the headers for a conditional GET if we know both
+        # of these values.
+        if summary[:etag] && summary[:last_modified]
+          curl.headers['If-None-Match']     = summary[:etag]
+          curl.headers['If-Modified-Since'] = summary[:last_modified]
+        end
+      end
+      
+      curl
+    end
+
+    def key_for_cached
+      MD5.hexdigest(@url)
+    end
+    
+    # Stores information about the retrieval, including ETag, Last-Modified, and MD5 digests of all 
+    # entries to the backend store.  This enables conditional GET usage on subsequent requests and 
+    # marking of entries as either new or seen.
+    def store_summary_to_backend(feed, curl)
+      headers = HttpHeaders.new(curl.header_str)
+      
+      # Store info about HTTP retrieval
+      summary = { }
+      
+      summary.merge!(:etag => headers.etag) unless headers.etag.nil?
+      summary.merge!(:last_modified => headers.last_modified) unless headers.last_modified.nil?
+      
+      # Store digest for each feed entry so we can detect new feeds on the next retrieval
+      digests = feed.entries.map do |e|
+        digest_for(e)
+      end
+      
+      summary.merge!(:digests => digests)
+      set_summary(summary)
+    end
+    
+    def set_summary(summary)
+      @backend[key_for_cached] = summary
+    end
+    
+    # Computes a unique signature for the FeedNormalizer::Entry object given.  This signature
+    # will be the MD5 of enough fields to have a reasonable probability of determining if the 
+    # entry is unique or not.
+    def digest_for(entry)      
+      MD5.hexdigest([entry.date_published, entry.url, entry.title, entry.content].join)
+    end
+    
+    def parser_for_xml(xml)
+      FeedNormalizer::FeedNormalizer.parse(xml)
+    end
+  end
+end

data/myzofeedtosis.gemspec

@@ -0,0 +1,42 @@
+Gem::Specification.new do |s|
+  s.name = %q{myzofeedtosis}
+  s.version = "0.0.1.2"
+
+  s.required_rubygems_version = Gem::Requirement.new(">= 0") if s.respond_to? :required_rubygems_version=
+  s.authors = ["Justin Leitgeb"]
+  s.date = %q{2009-05-22}
+  s.description = %q{Myzofeedtosis finds new information in feeds quickly using smart fetching and matching of previously read entries}
+  s.email = %q{justin@phq.org}
+  
+  s.files = ["lib/extensions/core/array.rb", "lib/extensions/core/hash.rb", 
+    "lib/extensions/feed_normalizer/feed_instance_methods.rb", "lib/myzofeedtosis/client.rb", "lib/myzofeedtosis.rb", 
+    "LICENSE", "myzofeedtosis.gemspec", "Rakefile", "README.rdoc", "spec/extensions/feed_normalizer/feed_instance_methods_spec.rb", 
+    "spec/fixtures/http_headers/wooster.txt", "spec/fixtures/xml/older_wooster.xml", "spec/fixtures/xml/wooster.xml", 
+    "spec/myzofeedtosis/client_spec.rb", "spec/myzofeedtosis_spec.rb", "spec/spec_helper.rb"]
+  
+  s.has_rdoc = true
+  s.homepage = %q{http://github.com/jsl/myzofeedtosis}
+  s.rdoc_options = ["--charset=UTF-8"]
+  s.require_paths = ["lib"]
+  s.rubygems_version = %q{1.3.1}
+  s.summary = %q{Retrieves feeds using conditional GET and marks entries that you haven't seen before}
+  s.test_files = ["spec/myzofeedtosis_spec.rb", "spec/spec_helper.rb", "spec/myzofeedtosis/client_spec.rb"]
+
+  s.extra_rdoc_files = [ "README.rdoc" ]
+  
+  s.rdoc_options += [
+    '--title', 'Myzofeedtosis',
+    '--main', 'README.rdoc',
+    '--line-numbers',
+    '--inline-source'
+   ]
+
+  %w[ taf2-curb wycats-moneta jsl-hashback jsl-http_headers feed-normalizer ].each do |dep|
+    s.add_dependency(dep)
+  end
+
+  if s.respond_to? :specification_version then
+    current_version = Gem::Specification::CURRENT_SPECIFICATION_VERSION
+    s.specification_version = 2
+  end
+end

data/spec/extensions/feed_normalizer/feed_instance_methods_spec.rb

@@ -0,0 +1,12 @@
+require File.join(File.dirname(__FILE__), %w[.. .. spec_helper])
+
+describe Myzofeedtosis::FeedInstanceMethods do
+  before do
+    @fn = FeedNormalizer::FeedNormalizer.parse(xml_fixture('wooster'))
+  end
+  
+  it "should respond to new_entries and new_items" do
+    @fn.should respond_to(:new_entries)
+    @fn.should respond_to(:new_items)
+  end
+end

data/spec/fixtures/http_headers/wooster.txt

@@ -0,0 +1,19 @@
+HTTP/1.1 302 Found
+Date: Mon, 25 May 2009 17:36:02 GMT
+Server: Apache/2.0.52 (Red Hat)
+Location: http://feeds.feedburner.com/wooster
+Content-Length: 311
+Connection: close
+Content-Type: text/html; charset=iso-8859-1
+
+HTTP/1.1 200 OK
+Last-Modified: Mon, 25 May 2009 16:38:49 GMT
+ETag: /YJUYmsYIcQeFAGy7OZQoaCQeXw
+Content-Type: text/xml; charset=utf-8
+Date: Mon, 25 May 2009 17:36:03 GMT
+Expires: Mon, 25 May 2009 17:36:03 GMT
+Cache-Control: private, max-age=0
+X-Content-Type-Options: nosniff
+Server: GFE/2.0
+Transfer-Encoding: chunked
+

data/spec/fixtures/xml/older_wooster.xml

@@ -0,0 +1,203 @@
+<?xml version="1.0" encoding="utf-8"?>
+<?xml-stylesheet type="text/xsl" media="screen" href="/~d/styles/rss2full.xsl"?>
+<?xml-stylesheet type="text/css" media="screen" href="http://feeds2.feedburner.com/~d/styles/itemcontent.css"?>
+<rss xmlns:feedburner="http://rssnamespace.org/feedburner/ext/1.0" version="2.0">
+	<channel>
+		<title>Wooster Collective</title>
+		<link>http://www.woostercollective.com/</link>
+		<description/>
+		<language>en</language>
+		<copyright>Copyright 2009</copyright>
+		<lastBuildDate>Mon, 25 May 2009 07:48:04 -0500</lastBuildDate>
+		<generator>http://www.sixapart.com/movabletype/?v=3.3</generator>
+		<docs>http://blogs.law.harvard.edu/tech/rss</docs>
+		<atom10:link xmlns:atom10="http://www.w3.org/2005/Atom" rel="self" href="www.woostercollective.com/rss/index.xml" type="application/rss+xml"/>
+		<feedburner:emailServiceId>wooster</feedburner:emailServiceId>
+		<feedburner:feedburnerHostname>http://feedburner.google.com</feedburner:feedburnerHostname>
+		<item>
+			<title>Seen In North London: Department of Urban Censorship</title>
+			<description><![CDATA[<p><a href="http://www.woostercollective.com/urbancensor.jpg"><img alt="urbancensor.jpg" src="http://www.woostercollective.com/urbancensor-thumb.jpg" width="500" height="444" /></a></p>
+
+<p>(Thanks, <a href="http://www.tupajumi.com/jonathan/">Jonathan</a>)<br />
+</p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/syiP17t0PKo/seen_in_north_london_department_of_urban.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/seen_in_north_london_department_of_urban.html</guid>
+			<category>Wheatpastes</category>
+			<pubDate>Mon, 25 May 2009 07:39:16 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/seen_in_north_london_department_of_urban.html</feedburner:origLink>
+		</item>
+		<item>
+			<title>Seen On The Steets Of Stockholm</title>
+			<description><![CDATA[<p><a href="http://www.woostercollective.com/poststock.jpg"><img alt="poststock.jpg" src="http://www.woostercollective.com/poststock-thumb.jpg" width="500" height="748" /></a></p>
+
+<p>Artist: <a href="http://vimeo.com/post">Post</a></p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/611KGRn-ZQE/seen_on_the_steets_of_stockholm.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/seen_on_the_steets_of_stockholm.html</guid>
+			<category>Wheatpastes</category>
+			<pubDate>Mon, 25 May 2009 07:29:55 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/seen_on_the_steets_of_stockholm.html</feedburner:origLink>
+		</item>
+		<item>
+			<title>Zevs' Electric Rainbows (2007)</title>
+			<description><![CDATA[<p>Zevs has updated <a href="http://www.gzzglz.com/">his website</a> with photos of past and recent project.  We love the Electric Rainbows that he exchanged for advertisements back 2007:</p>
+
+<p><a href="http://www.woostercollective.com/electric-rainbow-02.jpg"><img alt="electric-rainbow-02.jpg" src="http://www.woostercollective.com/electric-rainbow-02-thumb.jpg" width="500" height="335" /></a></p>
+
+<p><br />
+</p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/TpmlTS7y0f0/zevs_electric_rainbows_2007.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/zevs_electric_rainbows_2007.html</guid>
+			<category>Art</category>
+			<pubDate>Mon, 25 May 2009 07:19:27 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/zevs_electric_rainbows_2007.html</feedburner:origLink>
+		</item>
+		<item>
+			<title>Zephyr - An Introduction</title>
+			<description><![CDATA[<p><a href="http://www.woostercollective.com/zephydith.jpg"><img alt="zephydith.jpg" src="http://www.woostercollective.com/zephydith-thumb.jpg" width="500" height="347" /></a></p>
+
+<p><object width="320" height="265"><param name="movie" value="http://www.youtube.com/v/kqXXZcy-2JU&hl=en&fs=1&rel=0&hd=1"></param><param name="allowFullScreen" value="true"></param><param name="allowscriptaccess" value="always"></param><embed src="http://www.youtube.com/v/kqXXZcy-2JU&hl=en&fs=1&rel=0&hd=1" type="application/x-shockwave-flash" allowscriptaccess="always" allowfullscreen="true" width="320" height="265"></embed></object></p>
+
+<p>One of the first graffiti artists to "accept" Sara and I back in 2000 when we started the Wooster Collective was Zephyr.  This week <a href="http://www.upperplayground.com/">Upper Playground</a> posted a terrific interview with Zephyr filmed a few years ago for their Dithers DVD. </p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/32-ED1oPdYY/zephyr_in_introduction.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/zephyr_in_introduction.html</guid>
+			<category>Graffiti</category>
+			<pubDate>Sat, 23 May 2009 12:44:36 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/zephyr_in_introduction.html</feedburner:origLink>
+		</item>
+		<item>
+			<title>The Yes Men - An Introduction</title>
+			<description><![CDATA[<div><object width="512" height="322"><param name="movie" value="http://d.yimg.com/static.video.yahoo.com/yep/YV_YEP.swf?ver=2.2.40" /><param name="allowFullScreen" value="true" /><param name="AllowScriptAccess" VALUE="always" /><param name="bgcolor" value="#000000" /><param name="flashVars" value="id=13527850&vid=13527850&lang=en-us&intl=us&thumbUrl=&embed=1" /><embed src="http://d.yimg.com/static.video.yahoo.com/yep/YV_YEP.swf?ver=2.2.40" type="application/x-shockwave-flash" width="512" height="322" allowFullScreen="true" AllowScriptAccess="always" bgcolor="#000000" flashVars="id=13527850&vid=13527850&lang=en-us&intl=us&thumbUrl=&embed=1" ></embed></object><br /><a href="http://video.yahoo.com/watch/13527850/13527850"></a> @ <a href="http://video.yahoo.com" >Yahoo! Video</a></div>
+
+<p>If you're not familiar with <a href="http://theyesmen.org/">The Yes Men</a>, this video of their Poptech speech from 2006 is a fantastic introduction.</p>
+
+<p>(Hat tip to <a href="http://www.brainpickings.org/">Brain Pickings</a>)</p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/0yXb4Ui8C3I/the_yes_men_an_introduction.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/the_yes_men_an_introduction.html</guid>
+			<category>Activism</category>
+			<pubDate>Fri, 22 May 2009 11:24:26 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/the_yes_men_an_introduction.html</feedburner:origLink>
+		</item>
+		<item>
+			<title>A Great Example Of Site Specific Work: Carlsbad Sidewalk Surfer</title>
+			<description><![CDATA[<p><img alt="bryansurfer.jpg" src="http://www.woostercollective.com/bryansurfer.jpg" width="500" height="384" /></p>
+
+<p><object width="400" height="307"><param name="allowfullscreen" value="true" /><param name="allowscriptaccess" value="always" /><param name="movie" value="http://vimeo.com/moogaloop.swf?clip_id=4772503&amp;server=vimeo.com&amp;show_title=1&amp;show_byline=1&amp;show_portrait=0&amp;color=&amp;fullscreen=1" /><embed src="http://vimeo.com/moogaloop.swf?clip_id=4772503&amp;server=vimeo.com&amp;show_title=1&amp;show_byline=1&amp;show_portrait=0&amp;color=&amp;fullscreen=1" type="application/x-shockwave-flash" allowfullscreen="true" allowscriptaccess="always" width="400" height="307"></embed></object><p><a href="http://vimeo.com/4772503">Carlsbad Sidewalk Surfer by bryan snyder</a> from <a href="http://vimeo.com/bryansnyder">Bryan Snyder</a> on <a href="http://vimeo.com">Vimeo</a>.</p></p>
+
+<p>From <a href="http://www.snyderartdesign.com">Bryan</a>:</p>
+
+<p>Carlsbad Sidewalk Surfer interacts with its environment during mid day wind gusts. Like the waves that tumble upon our shore, the visibility of this art piece depends on the weather. Between the glassy conditions of the morning and the mellow winds at dusk, the Carlsbad Sidewalk Surfer sneaks into another ride. The goal of this project is to showcase the relationship between a piece of art and its environment when placed in the streets."</p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/oXfLFSd86cY/a_great_example_of_site_specific_work_ca.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/a_great_example_of_site_specific_work_ca.html</guid>
+			<category>Environmental</category>
+			<pubDate>Fri, 22 May 2009 07:54:36 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/a_great_example_of_site_specific_work_ca.html</feedburner:origLink>
+		</item>
+		<item>
+			<title>Herakut Beautifies The Streets Of New York</title>
+			<description><![CDATA[<p><img alt="9501466.jpg" src="http://www.woostercollective.com/9501466.jpg" width="480" height="640" /></p>
+
+<p>While they were in town this week for an opening at <a href="http://redflagg.com/">RedFlagg</a>, <a href="http://www.herakut.de/">Herakut</a> put up a wonderful piece outside <a href="http://eyebeam.org/">Eyebeam</a>    If you haven't head about the show in New York, here's the info:</p>
+
+<p>Herakut<br />
+No Placebos<br />
+May 21 – July 3, 2009</p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/rWAKvvkBDYY/herakut_beautifies_the_streets_of_new_yo.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/herakut_beautifies_the_streets_of_new_yo.html</guid>
+			<category>Walls</category>
+			<pubDate>Fri, 22 May 2009 07:40:04 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/herakut_beautifies_the_streets_of_new_yo.html</feedburner:origLink>
+		</item>
+		<item>
+			<title>Fresh Stuff From Cena7</title>
+			<description><![CDATA[<p><a href="http://www.woostercollective.com/cenared.jpg"><img alt="cenared.jpg" src="http://www.woostercollective.com/cenared-thumb.jpg" width="500" height="409" /></a></p>
+
+<p>More from Cena7 <a href="http://www.flickr.com/photos/cena7-mpc">here</a>. <br />
+</p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/x4y4ZuKBadg/fresh_stuff_from_cena7_1.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/fresh_stuff_from_cena7_1.html</guid>
+			<category>Walls</category>
+			<pubDate>Fri, 22 May 2009 07:37:33 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/fresh_stuff_from_cena7_1.html</feedburner:origLink>
+		</item>
+		<item>
+			<title>Wooster on Facebook</title>
+			<description><![CDATA[<p><img alt="woostfaceo.jpg" src="http://www.woostercollective.com/woostfaceo.jpg" width="500" height="376" /></p>
+
+<p>Each and every day we get more excited about the discussions that are taking place on our <a href="http://www.facebook.com/pages/Wooster-Collective/24080260389?ref=ts#/pages/Wooster-Collective/24080260389?ref=mf">Wooster Collective Facebook page</a>.  The responses to our recent questions:</p>
+
+<p>For those who risk getting arrested while putting up street art or writing graffiti: What motivates you to do it?</p>
+
+<p>What's currently inspiring you?</p>
+
+<p>How would you describe the "role" that graffiti or street art plays in your life? What does it "add" or subtract?</p>
+
+<p>If I gave you $50 today, with the condition that you had to spend it on "art", what would you do with it?</p>
+
+<p>If you haven't yet checked it out we can't recommend it more highly.  It's become an incredible companion to the Wooster blog.  </p>
+
+<p>Also, we are indeed on Twitter. Not as "Wooster Collective" but as <a href="http://www.twitter.com/MarcSchil">Marc</a> and <a href="http://www.twitter.com/saraschiller">Sara</a>.  </p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/4uAvR5rZn80/wooster_on_facebook.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/wooster_on_facebook.html</guid>
+			<category>Site Announcements</category>
+			<pubDate>Thu, 21 May 2009 08:05:18 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/wooster_on_facebook.html</feedburner:origLink>
+		</item>
+		<item>
+			<title>Wooster on Facebook</title>
+			<description><![CDATA[<p><img alt="woostfaceo.jpg" src="http://www.woostercollective.com/woostfaceo.jpg" width="500" height="376" /></p>
+
+<p>Each and every day we get more excited about the discussions that are taking place on our <a href="http://www.facebook.com/pages/Wooster-Collective/24080260389?ref=ts#/pages/Wooster-Collective/24080260389?ref=mf">Wooster Collective Facebook page</a>.  The responses to our recent questions:</p>
+
+<p>For those who risk getting arrested while putting up street art or writing graffiti: What motivates you to do it?</p>
+
+<p>What's currently inspiring you?</p>
+
+<p>How would you describe the "role" that graffiti or street art plays in your life? What does it "add" or subtract?</p>
+
+<p>If I gave you $50 today, with the condition that you had to spend it on "art", what would you do with it?</p>
+
+<p>If you haven't yet checked it out we can't recommend it more highly.  It's become an incredible companion to the Wooster blog.  </p>
+
+<p>Also, we are indeed on Twitter. Not as "Wooster Collective" but as <a href="http://www.twitter.com/MarcSchil">Marc</a> and <a href="http://www.twitter.com/saraschiller">Sara</a>.  </p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/CV9qfY3WZqM/wooster_on_facebook_1.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/wooster_on_facebook_1.html</guid>
+			<category>Site Announcements</category>
+			<pubDate>Thu, 21 May 2009 08:05:18 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/wooster_on_facebook_1.html</feedburner:origLink>
+		</item>
+		<item>
+			<title>Seen On The Steets Of Berlin</title>
+			<description><![CDATA[<p><a href="http://www.woostercollective.com/brownpaper1.jpg"><img alt="brownpaper1.jpg" src="http://www.woostercollective.com/brownpaper1-thumb.jpg" width="500" height="416" /></a><br />
+</p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/O-9kaseEs8I/seen_on_the_steets_of_berlin_1.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/seen_on_the_steets_of_berlin_1.html</guid>
+			<category>Wheatpastes</category>
+			<pubDate>Thu, 21 May 2009 07:57:05 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/seen_on_the_steets_of_berlin_1.html</feedburner:origLink>
+		</item>
+		<item>
+			<title>Checkin' In With... Lister</title>
+			<description><![CDATA[<p><a href="http://www.woostercollective.com/listcheck.jpg"><img alt="listcheck.jpg" src="http://www.woostercollective.com/listcheck-thumb.jpg" width="500" height="342" /></a></p>
+
+<p>"out onto this roof the other night. i wasnt even sure that i had finished this piece but when i returned the next day i was surprised that it looked like this. the wall was so big and high that i couldn't step back at all. i am still surprised the proportions were correct."... <a href="http://www.anthonylister.com">Lister</a></p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/xKfEO6qRHLY/checkin_in_with_lister.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/checkin_in_with_lister.html</guid>
+			<category>Walls</category>
+			<pubDate>Thu, 21 May 2009 07:45:54 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/checkin_in_with_lister.html</feedburner:origLink>
+		</item>
+		<item>
+			<title>Another Great Electronic Billboard Takeover From Poster Child</title>
+			<description><![CDATA[<p><a href="http://www.woostercollective.com/pixeljes.jpg"><img alt="pixeljes.jpg" src="http://www.woostercollective.com/pixeljes-thumb.jpg" width="500" height="375" /></a></p>
+
+<div><object width="480" height="381"><param name="movie" value="http://www.dailymotion.com/swf/x99ave_stained-glass-postpixelators_creation&related=1"></param><param name="allowFullScreen" value="true"></param><param name="allowScriptAccess" value="always"></param><embed src="http://www.dailymotion.com/swf/x99ave_stained-glass-postpixelators_creation&related=1" type="application/x-shockwave-flash" width="480" height="381" allowFullScreen="true" allowScriptAccess="always"></embed></object><br /><b><a href="http://www.dailymotion.com/video/x99ave_stained-glass-postpixelators_creation">Stained Glass Post-Pixelators</a></b><br /><i>Uploaded by <a href="http://www.dailymotion.com/posterchild">posterchild</a>. - <a href="http://www.dailymotion.com/channel/creation">Independent web videos.</a></i></div>
+
+<p>More from Poster Child <a href="http://www.bladediary.com/">here</a>. </p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/Rz_yYr1lijQ/another_great_electronic_billboard_takeo.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/another_great_electronic_billboard_takeo.html</guid>
+			<category>Billboard Liberations</category>
+			<pubDate>Wed, 20 May 2009 07:59:04 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/another_great_electronic_billboard_takeo.html</feedburner:origLink>
+		</item>
+	</channel>
+</rss>

data/spec/fixtures/xml/wooster.xml

@@ -0,0 +1,215 @@
+<?xml version="1.0" encoding="utf-8"?>
+<?xml-stylesheet type="text/xsl" media="screen" href="/~d/styles/rss2full.xsl"?><?xml-stylesheet type="text/css" media="screen" href="http://feeds2.feedburner.com/~d/styles/itemcontent.css"?><rss xmlns:feedburner="http://rssnamespace.org/feedburner/ext/1.0" version="2.0">
+   <channel>
+      <title>Wooster Collective</title>
+      <link>http://www.woostercollective.com/</link>
+      <description />
+      <language>en</language>
+      <copyright>Copyright 2009</copyright>
+      <lastBuildDate>Mon, 25 May 2009 07:48:04 -0500</lastBuildDate>
+      <generator>http://www.sixapart.com/movabletype/?v=3.3</generator>
+      <docs>http://blogs.law.harvard.edu/tech/rss</docs> 
+
+            <atom10:link xmlns:atom10="http://www.w3.org/2005/Atom" rel="self" href="www.woostercollective.com/rss/index.xml" type="application/rss+xml" /><feedburner:emailServiceId>wooster</feedburner:emailServiceId><feedburner:feedburnerHostname>http://feedburner.google.com</feedburner:feedburnerHostname><item>
+         <title>Fresh Stuff From Davide Zucco (aka Rekal)</title>
+         <description><![CDATA[<p><a href="http://www.woostercollective.com/rekalmonkey.jpg"><img alt="rekalmonkey.jpg" src="http://www.woostercollective.com/rekalmonkey-thumb.jpg" width="500" height="589" /></a></p>
+
+<p>From from Rekal<a href="http://www.rekal.org"> here</a>. </p>
+
+<p></p>
+
+<p></p>
+
+<p><br />
+</p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/rlRoUehLOSM/fresh_stuff_from_davide_zucco_aka_rekal_1.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/fresh_stuff_from_davide_zucco_aka_rekal_1.html</guid>
+         <category>Art</category>
+         <pubDate>Mon, 25 May 2009 07:48:04 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/fresh_stuff_from_davide_zucco_aka_rekal_1.html</feedburner:origLink></item>
+            <item>
+         <title>Fresh Stuff From Sten and Lex</title>
+         <description><![CDATA[<p><a href="http://www.woostercollective.com/stenlexpope.jpg"><img alt="stenlexpope.jpg" src="http://www.woostercollective.com/stenlexpope-thumb.jpg" width="500" height="364" /></a></p>
+
+<p>Location: Palermo in Piazza Magione.<br />
+Image: Pope Sergius, the first Pope born in Palermo</p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/RAHYCux58bs/fresh_stuff_from_sten_and_lex.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/fresh_stuff_from_sten_and_lex.html</guid>
+         <category>Walls</category>
+         <pubDate>Mon, 25 May 2009 07:44:48 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/fresh_stuff_from_sten_and_lex.html</feedburner:origLink></item>
+            <item>
+         <title>Seen In North London: Department of Urban Censorship</title>
+         <description><![CDATA[<p><a href="http://www.woostercollective.com/urbancensor.jpg"><img alt="urbancensor.jpg" src="http://www.woostercollective.com/urbancensor-thumb.jpg" width="500" height="444" /></a></p>
+
+<p>(Thanks, <a href="http://www.tupajumi.com/jonathan/">Jonathan</a>)<br />
+</p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/syiP17t0PKo/seen_in_north_london_department_of_urban.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/seen_in_north_london_department_of_urban.html</guid>
+         <category>Wheatpastes</category>
+         <pubDate>Mon, 25 May 2009 07:39:16 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/seen_in_north_london_department_of_urban.html</feedburner:origLink></item>
+            <item>
+         <title>Seen On The Steets Of Stockholm</title>
+         <description><![CDATA[<p><a href="http://www.woostercollective.com/poststock.jpg"><img alt="poststock.jpg" src="http://www.woostercollective.com/poststock-thumb.jpg" width="500" height="748" /></a></p>
+
+<p>Artist: <a href="http://vimeo.com/post">Post</a></p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/611KGRn-ZQE/seen_on_the_steets_of_stockholm.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/seen_on_the_steets_of_stockholm.html</guid>
+         <category>Wheatpastes</category>
+         <pubDate>Mon, 25 May 2009 07:29:55 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/seen_on_the_steets_of_stockholm.html</feedburner:origLink></item>
+            <item>
+         <title>Zevs' Electric Rainbows (2007)</title>
+         <description><![CDATA[<p>Zevs has updated <a href="http://www.gzzglz.com/">his website</a> with photos of past and recent project.  We love the Electric Rainbows that he exchanged for advertisements back 2007:</p>
+
+<p><a href="http://www.woostercollective.com/electric-rainbow-02.jpg"><img alt="electric-rainbow-02.jpg" src="http://www.woostercollective.com/electric-rainbow-02-thumb.jpg" width="500" height="335" /></a></p>
+
+<p><br />
+</p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/TpmlTS7y0f0/zevs_electric_rainbows_2007.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/zevs_electric_rainbows_2007.html</guid>
+         <category>Art</category>
+         <pubDate>Mon, 25 May 2009 07:19:27 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/zevs_electric_rainbows_2007.html</feedburner:origLink></item>
+            <item>
+         <title>Zephyr - An Introduction</title>
+         <description><![CDATA[<p><a href="http://www.woostercollective.com/zephydith.jpg"><img alt="zephydith.jpg" src="http://www.woostercollective.com/zephydith-thumb.jpg" width="500" height="347" /></a></p>
+
+<p><object width="320" height="265"><param name="movie" value="http://www.youtube.com/v/kqXXZcy-2JU&hl=en&fs=1&rel=0&hd=1"></param><param name="allowFullScreen" value="true"></param><param name="allowscriptaccess" value="always"></param><embed src="http://www.youtube.com/v/kqXXZcy-2JU&hl=en&fs=1&rel=0&hd=1" type="application/x-shockwave-flash" allowscriptaccess="always" allowfullscreen="true" width="320" height="265"></embed></object></p>
+
+<p>One of the first graffiti artists to "accept" Sara and I back in 2000 when we started the Wooster Collective was Zephyr.  This week <a href="http://www.upperplayground.com/">Upper Playground</a> posted a terrific interview with Zephyr filmed a few years ago for their Dithers DVD. </p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/32-ED1oPdYY/zephyr_in_introduction.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/zephyr_in_introduction.html</guid>
+         <category>Graffiti</category>
+         <pubDate>Sat, 23 May 2009 12:44:36 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/zephyr_in_introduction.html</feedburner:origLink></item>
+            <item>
+         <title>The Yes Men - An Introduction</title>
+         <description><![CDATA[<div><object width="512" height="322"><param name="movie" value="http://d.yimg.com/static.video.yahoo.com/yep/YV_YEP.swf?ver=2.2.40" /><param name="allowFullScreen" value="true" /><param name="AllowScriptAccess" VALUE="always" /><param name="bgcolor" value="#000000" /><param name="flashVars" value="id=13527850&vid=13527850&lang=en-us&intl=us&thumbUrl=&embed=1" /><embed src="http://d.yimg.com/static.video.yahoo.com/yep/YV_YEP.swf?ver=2.2.40" type="application/x-shockwave-flash" width="512" height="322" allowFullScreen="true" AllowScriptAccess="always" bgcolor="#000000" flashVars="id=13527850&vid=13527850&lang=en-us&intl=us&thumbUrl=&embed=1" ></embed></object><br /><a href="http://video.yahoo.com/watch/13527850/13527850"></a> @ <a href="http://video.yahoo.com" >Yahoo! Video</a></div>
+
+<p>If you're not familiar with <a href="http://theyesmen.org/">The Yes Men</a>, this video of their Poptech speech from 2006 is a fantastic introduction.</p>
+
+<p>(Hat tip to <a href="http://www.brainpickings.org/">Brain Pickings</a>)</p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/0yXb4Ui8C3I/the_yes_men_an_introduction.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/the_yes_men_an_introduction.html</guid>
+         <category>Activism</category>
+         <pubDate>Fri, 22 May 2009 11:24:26 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/the_yes_men_an_introduction.html</feedburner:origLink></item>
+            <item>
+         <title>A Great Example Of Site Specific Work: Carlsbad Sidewalk Surfer</title>
+         <description><![CDATA[<p><img alt="bryansurfer.jpg" src="http://www.woostercollective.com/bryansurfer.jpg" width="500" height="384" /></p>
+
+<p><object width="400" height="307"><param name="allowfullscreen" value="true" /><param name="allowscriptaccess" value="always" /><param name="movie" value="http://vimeo.com/moogaloop.swf?clip_id=4772503&amp;server=vimeo.com&amp;show_title=1&amp;show_byline=1&amp;show_portrait=0&amp;color=&amp;fullscreen=1" /><embed src="http://vimeo.com/moogaloop.swf?clip_id=4772503&amp;server=vimeo.com&amp;show_title=1&amp;show_byline=1&amp;show_portrait=0&amp;color=&amp;fullscreen=1" type="application/x-shockwave-flash" allowfullscreen="true" allowscriptaccess="always" width="400" height="307"></embed></object><p><a href="http://vimeo.com/4772503">Carlsbad Sidewalk Surfer by bryan snyder</a> from <a href="http://vimeo.com/bryansnyder">Bryan Snyder</a> on <a href="http://vimeo.com">Vimeo</a>.</p></p>
+
+<p>From <a href="http://www.snyderartdesign.com">Bryan</a>:</p>
+
+<p>Carlsbad Sidewalk Surfer interacts with its environment during mid day wind gusts. Like the waves that tumble upon our shore, the visibility of this art piece depends on the weather. Between the glassy conditions of the morning and the mellow winds at dusk, the Carlsbad Sidewalk Surfer sneaks into another ride. The goal of this project is to showcase the relationship between a piece of art and its environment when placed in the streets."</p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/oXfLFSd86cY/a_great_example_of_site_specific_work_ca.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/a_great_example_of_site_specific_work_ca.html</guid>
+         <category>Environmental</category>
+         <pubDate>Fri, 22 May 2009 07:54:36 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/a_great_example_of_site_specific_work_ca.html</feedburner:origLink></item>
+            <item>
+         <title>Herakut Beautifies The Streets Of New York</title>
+         <description><![CDATA[<p><img alt="9501466.jpg" src="http://www.woostercollective.com/9501466.jpg" width="480" height="640" /></p>
+
+<p>While they were in town this week for an opening at <a href="http://redflagg.com/">RedFlagg</a>, <a href="http://www.herakut.de/">Herakut</a> put up a wonderful piece outside <a href="http://eyebeam.org/">Eyebeam</a>    If you haven't head about the show in New York, here's the info:</p>
+
+<p>Herakut<br />
+No Placebos<br />
+May 21 – July 3, 2009</p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/rWAKvvkBDYY/herakut_beautifies_the_streets_of_new_yo.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/herakut_beautifies_the_streets_of_new_yo.html</guid>
+         <category>Walls</category>
+         <pubDate>Fri, 22 May 2009 07:40:04 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/herakut_beautifies_the_streets_of_new_yo.html</feedburner:origLink></item>
+            <item>
+         <title>Fresh Stuff From Cena7</title>
+         <description><![CDATA[<p><a href="http://www.woostercollective.com/cenared.jpg"><img alt="cenared.jpg" src="http://www.woostercollective.com/cenared-thumb.jpg" width="500" height="409" /></a></p>
+
+<p>More from Cena7 <a href="http://www.flickr.com/photos/cena7-mpc">here</a>. <br />
+</p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/x4y4ZuKBadg/fresh_stuff_from_cena7_1.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/fresh_stuff_from_cena7_1.html</guid>
+         <category>Walls</category>
+         <pubDate>Fri, 22 May 2009 07:37:33 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/fresh_stuff_from_cena7_1.html</feedburner:origLink></item>
+            <item>
+         <title>Wooster on Facebook</title>
+         <description><![CDATA[<p><img alt="woostfaceo.jpg" src="http://www.woostercollective.com/woostfaceo.jpg" width="500" height="376" /></p>
+
+<p>Each and every day we get more excited about the discussions that are taking place on our <a href="http://www.facebook.com/pages/Wooster-Collective/24080260389?ref=ts#/pages/Wooster-Collective/24080260389?ref=mf">Wooster Collective Facebook page</a>.  The responses to our recent questions:</p>
+
+<p>For those who risk getting arrested while putting up street art or writing graffiti: What motivates you to do it?</p>
+
+<p>What's currently inspiring you?</p>
+
+<p>How would you describe the "role" that graffiti or street art plays in your life? What does it "add" or subtract?</p>
+
+<p>If I gave you $50 today, with the condition that you had to spend it on "art", what would you do with it?</p>
+
+<p>If you haven't yet checked it out we can't recommend it more highly.  It's become an incredible companion to the Wooster blog.  </p>
+
+<p>Also, we are indeed on Twitter. Not as "Wooster Collective" but as <a href="http://www.twitter.com/MarcSchil">Marc</a> and <a href="http://www.twitter.com/saraschiller">Sara</a>.  </p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/4uAvR5rZn80/wooster_on_facebook.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/wooster_on_facebook.html</guid>
+         <category>Site Announcements</category>
+         <pubDate>Thu, 21 May 2009 08:05:18 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/wooster_on_facebook.html</feedburner:origLink></item>
+            <item>
+         <title>Wooster on Facebook</title>
+         <description><![CDATA[<p><img alt="woostfaceo.jpg" src="http://www.woostercollective.com/woostfaceo.jpg" width="500" height="376" /></p>
+
+<p>Each and every day we get more excited about the discussions that are taking place on our <a href="http://www.facebook.com/pages/Wooster-Collective/24080260389?ref=ts#/pages/Wooster-Collective/24080260389?ref=mf">Wooster Collective Facebook page</a>.  The responses to our recent questions:</p>
+
+<p>For those who risk getting arrested while putting up street art or writing graffiti: What motivates you to do it?</p>
+
+<p>What's currently inspiring you?</p>
+
+<p>How would you describe the "role" that graffiti or street art plays in your life? What does it "add" or subtract?</p>
+
+<p>If I gave you $50 today, with the condition that you had to spend it on "art", what would you do with it?</p>
+
+<p>If you haven't yet checked it out we can't recommend it more highly.  It's become an incredible companion to the Wooster blog.  </p>
+
+<p>Also, we are indeed on Twitter. Not as "Wooster Collective" but as <a href="http://www.twitter.com/MarcSchil">Marc</a> and <a href="http://www.twitter.com/saraschiller">Sara</a>.  </p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/CV9qfY3WZqM/wooster_on_facebook_1.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/wooster_on_facebook_1.html</guid>
+         <category>Site Announcements</category>
+         <pubDate>Thu, 21 May 2009 08:05:18 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/wooster_on_facebook_1.html</feedburner:origLink></item>
+            <item>
+         <title>Seen On The Steets Of Berlin</title>
+         <description><![CDATA[<p><a href="http://www.woostercollective.com/brownpaper1.jpg"><img alt="brownpaper1.jpg" src="http://www.woostercollective.com/brownpaper1-thumb.jpg" width="500" height="416" /></a><br />
+</p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/O-9kaseEs8I/seen_on_the_steets_of_berlin_1.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/seen_on_the_steets_of_berlin_1.html</guid>
+         <category>Wheatpastes</category>
+         <pubDate>Thu, 21 May 2009 07:57:05 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/seen_on_the_steets_of_berlin_1.html</feedburner:origLink></item>
+            <item>
+         <title>Checkin' In With... Lister</title>
+         <description><![CDATA[<p><a href="http://www.woostercollective.com/listcheck.jpg"><img alt="listcheck.jpg" src="http://www.woostercollective.com/listcheck-thumb.jpg" width="500" height="342" /></a></p>
+
+<p>"out onto this roof the other night. i wasnt even sure that i had finished this piece but when i returned the next day i was surprised that it looked like this. the wall was so big and high that i couldn't step back at all. i am still surprised the proportions were correct."... <a href="http://www.anthonylister.com">Lister</a></p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/xKfEO6qRHLY/checkin_in_with_lister.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/checkin_in_with_lister.html</guid>
+         <category>Walls</category>
+         <pubDate>Thu, 21 May 2009 07:45:54 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/checkin_in_with_lister.html</feedburner:origLink></item>
+            <item>
+         <title>Another Great Electronic Billboard Takeover From Poster Child</title>
+         <description><![CDATA[<p><a href="http://www.woostercollective.com/pixeljes.jpg"><img alt="pixeljes.jpg" src="http://www.woostercollective.com/pixeljes-thumb.jpg" width="500" height="375" /></a></p>
+
+<div><object width="480" height="381"><param name="movie" value="http://www.dailymotion.com/swf/x99ave_stained-glass-postpixelators_creation&related=1"></param><param name="allowFullScreen" value="true"></param><param name="allowScriptAccess" value="always"></param><embed src="http://www.dailymotion.com/swf/x99ave_stained-glass-postpixelators_creation&related=1" type="application/x-shockwave-flash" width="480" height="381" allowFullScreen="true" allowScriptAccess="always"></embed></object><br /><b><a href="http://www.dailymotion.com/video/x99ave_stained-glass-postpixelators_creation">Stained Glass Post-Pixelators</a></b><br /><i>Uploaded by <a href="http://www.dailymotion.com/posterchild">posterchild</a>. - <a href="http://www.dailymotion.com/channel/creation">Independent web videos.</a></i></div>
+
+<p>More from Poster Child <a href="http://www.bladediary.com/">here</a>. </p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/Rz_yYr1lijQ/another_great_electronic_billboard_takeo.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/another_great_electronic_billboard_takeo.html</guid>
+         <category>Billboard Liberations</category>
+         <pubDate>Wed, 20 May 2009 07:59:04 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/another_great_electronic_billboard_takeo.html</feedburner:origLink></item>
+      
+   </channel>
+</rss>

data/spec/myzofeedtosis/client_spec.rb

@@ -0,0 +1,90 @@
+require File.join(File.dirname(__FILE__), %w[.. spec_helper])
+
+describe Myzofeedtosis::Client do
+  before do
+    @url = "http://www.example.com/feed.rss"
+    @opts = { :user_agent => "My Cool Application" }
+    @fr = Myzofeedtosis::Client.new(@url, @opts)
+  end
+
+  describe "initialization" do    
+    it "should set #url to an Array when an Array is given" do
+      @fr.url.should == @url
+    end
+    
+    it "should set #options to the options hash given at end of list" do
+      @fr.options.should == Myzofeedtosis::Client::DEFAULTS.merge(@opts)
+    end
+    
+    it "should set the If-None-Match and If-Modified-Since headers to the value of the summary hash" do
+      curl_headers = mock('headers')
+      curl_headers.expects(:[]=).with('If-None-Match', '42ab')
+      curl_headers.expects(:[]=).with('If-Modified-Since', 'Mon, 25 May 2009 16:38:49 GMT')
+      
+      summary = { :etag => '42ab', :last_modified => 'Mon, 25 May 2009 16:38:49 GMT' }
+      
+      @fr.__send__(:set_summary, summary)
+      
+      curl_easy = mock('curl', :perform => true, :follow_location= => true, 
+        :response_code => 200, :body_str => xml_fixture('wooster'),
+        :header_str => http_header('wooster')
+      )
+      
+      curl_easy.expects(:headers).returns(curl_headers).times(2)
+      
+      @fr.expects(:new_curl_easy).returns(curl_easy)
+      @fr.fetch
+    end
+  end
+    
+  describe "#fetch" do
+    it "should call Curl::Easy.perform with the url, and #process_curl_response" do
+      curl_easy = mock('curl', :perform => true)
+      @fr.expects(:build_curl_easy).returns(curl_easy)
+      @fr.expects(:process_curl_response)
+      @fr.fetch
+    end
+    
+    describe "when the response code is not 200" do
+      it "should return the Curl::Easy object" do
+        curl = mock('curl', :perform => true, :response_code => 304)
+        @fr.expects(:build_curl_easy).returns(curl)
+        @fr.fetch.should == curl
+      end
+    end
+
+    describe "when the response code is 200" do
+      describe "when an identical resource has been retrieved previously" do
+        before do
+          curl = mock('curl', :perform => true, :response_code => 200,
+            :body_str => xml_fixture('wooster'), :header_str => http_header('wooster'))
+          @fr.expects(:build_curl_easy).returns(curl)
+          @fr.fetch          
+        end
+        
+        it "should have an empty array for new_entries" do
+          curl = mock('curl', :perform => true, :response_code => 200,
+            :body_str => xml_fixture('wooster'), :header_str => http_header('wooster'))
+          @fr.expects(:build_curl_easy).returns(curl)
+          @fr.fetch.new_entries.should == []          
+        end
+      end
+      
+      describe "when the resource has been previously retrieved minus two entries" do
+        before do
+          curl = mock('curl', :perform => true, :response_code => 200,
+            :body_str => xml_fixture('older_wooster'), :header_str => http_header('wooster'))
+          @fr.expects(:build_curl_easy).returns(curl)
+          @fr.fetch        
+        end
+        
+        it "should have two elements in new_entries" do
+          curl = mock('curl', :perform => true, :response_code => 200,
+            :body_str => xml_fixture('wooster'), :header_str => http_header('wooster'))
+          @fr.expects(:build_curl_easy).returns(curl)
+          @fr.fetch.new_entries.size.should == 2
+        end
+      end
+    end
+  end  
+end

data/spec/myzofeedtosis_spec.rb

@@ -0,0 +1,5 @@
+require File.join(File.dirname(__FILE__),  'spec_helper')
+
+describe Myzofeedtosis do
+  
+end

data/spec/spec_helper.rb

@@ -0,0 +1,28 @@
+require 'rubygems'
+require 'mocha'
+require 'spec'
+
+require File.join(File.dirname(__FILE__), %w[.. lib myzofeedtosis])
+
+Spec::Runner.configure do |config|
+  config.mock_with(:mocha)
+end
+
+# Returns the xml fixture identified by +name+.
+def xml_fixture(name)
+  File.read(File.join(File.dirname(__FILE__), 'fixtures', 'xml', "#{name}.xml"))
+end
+
+def http_header(name)
+  File.read(File.join(File.dirname(__FILE__), 'fixtures', 'http_headers', "#{name}.txt"))
+end
+
+shared_examples_for "all backends" do
+  it "should respond to #get" do
+    @backend.should respond_to(:get)
+  end
+  
+  it "should respond to #set" do
+    @backend.should respond_to(:set)
+  end  
+end

metadata

@@ -0,0 +1,125 @@
+--- !ruby/object:Gem::Specification 
+name: jsl-myzofeedtosis
+version: !ruby/object:Gem::Version 
+  version: 0.0.1.2
+platform: ruby
+authors: 
+- Justin Leitgeb
+autorequire: 
+bindir: bin
+cert_chain: []
+
+date: 2009-05-22 00:00:00 -07:00
+default_executable: 
+dependencies: 
+- !ruby/object:Gem::Dependency 
+  name: taf2-curb
+  type: :runtime
+  version_requirement: 
+  version_requirements: !ruby/object:Gem::Requirement 
+    requirements: 
+    - - ">="
+      - !ruby/object:Gem::Version 
+        version: "0"
+    version: 
+- !ruby/object:Gem::Dependency 
+  name: wycats-moneta
+  type: :runtime
+  version_requirement: 
+  version_requirements: !ruby/object:Gem::Requirement 
+    requirements: 
+    - - ">="
+      - !ruby/object:Gem::Version 
+        version: "0"
+    version: 
+- !ruby/object:Gem::Dependency 
+  name: jsl-hashback
+  type: :runtime
+  version_requirement: 
+  version_requirements: !ruby/object:Gem::Requirement 
+    requirements: 
+    - - ">="
+      - !ruby/object:Gem::Version 
+        version: "0"
+    version: 
+- !ruby/object:Gem::Dependency 
+  name: jsl-http_headers
+  type: :runtime
+  version_requirement: 
+  version_requirements: !ruby/object:Gem::Requirement 
+    requirements: 
+    - - ">="
+      - !ruby/object:Gem::Version 
+        version: "0"
+    version: 
+- !ruby/object:Gem::Dependency 
+  name: feed-normalizer
+  type: :runtime
+  version_requirement: 
+  version_requirements: !ruby/object:Gem::Requirement 
+    requirements: 
+    - - ">="
+      - !ruby/object:Gem::Version 
+        version: "0"
+    version: 
+description: Myzofeedtosis finds new information in feeds quickly using smart fetching and matching of previously read entries
+email: justin@phq.org
+executables: []
+
+extensions: []
+
+extra_rdoc_files: 
+- README.rdoc
+files: 
+- lib/extensions/core/array.rb
+- lib/extensions/core/hash.rb
+- lib/extensions/feed_normalizer/feed_instance_methods.rb
+- lib/myzofeedtosis/client.rb
+- lib/myzofeedtosis.rb
+- LICENSE
+- myzofeedtosis.gemspec
+- Rakefile
+- README.rdoc
+- spec/extensions/feed_normalizer/feed_instance_methods_spec.rb
+- spec/fixtures/http_headers/wooster.txt
+- spec/fixtures/xml/older_wooster.xml
+- spec/fixtures/xml/wooster.xml
+- spec/myzofeedtosis/client_spec.rb
+- spec/myzofeedtosis_spec.rb
+- spec/spec_helper.rb
+has_rdoc: true
+homepage: http://github.com/jsl/myzofeedtosis
+post_install_message: 
+rdoc_options: 
+- --charset=UTF-8
+- --title
+- Myzofeedtosis
+- --main
+- README.rdoc
+- --line-numbers
+- --inline-source
+require_paths: 
+- lib
+required_ruby_version: !ruby/object:Gem::Requirement 
+  requirements: 
+  - - ">="
+    - !ruby/object:Gem::Version 
+      version: "0"
+  version: 
+required_rubygems_version: !ruby/object:Gem::Requirement 
+  requirements: 
+  - - ">="
+    - !ruby/object:Gem::Version 
+      version: "0"
+  version: 
+requirements: []
+
+rubyforge_project: 
+rubygems_version: 1.2.0
+signing_key: 
+specification_version: 2
+summary: Retrieves feeds using conditional GET and marks entries that you haven't seen before
+test_files: 
+- spec/myzofeedtosis_spec.rb
+- spec/spec_helper.rb
+- spec/myzofeedtosis/client_spec.rb