jsl-feedtosis 0.0.2.3

data/LICENSE

@@ -0,0 +1,20 @@
+Copyright (c) 2009 Justin S. Leitgeb
+
+Permission is hereby granted, free of charge, to any person obtaining
+a copy of this software and associated documentation files (the
+"Software"), to deal in the Software without restriction, including
+without limitation the rights to use, copy, modify, merge, publish,
+distribute, sublicense, and/or sell copies of the Software, and to
+permit persons to whom the Software is furnished to do so, subject to
+the following conditions:
+
+The above copyright notice and this permission notice shall be
+included in all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
+EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
+MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
+NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE
+LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
+OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
+WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

data/README.rdoc

@@ -0,0 +1,141 @@
+= Description
+
+Feedtosis is a library that helps you to efficiently process syndicated web
+resources. It helps by automatically using conditional HTTP GET requests, as
+well as by pointing out which entries are new in any given feed.
+
+== Philosophy
+
+Feedtosis is designed to help you with book-keeping about feed fetching
+details. This is usually something that is mundane and not fundamentally related
+to the business logic of applications that deal with the consumption of
+syndicated content on the web. Feedtosis keeps track of these mundane
+details so you can just keep grabbing new content without wasting bandwidth in
+making unnecessary requests and programmer time in implementing algorithms to
+figure out which feed entries are new.
+
+Feedtosis fits into other frameworks to do the heavy lifting, including the
+Curb library which does HTTP requests through curl, and FeedNormalizer which
+abstracts the differences between syndication formats. In the sense that it fits
+into these existing, robust programs, Feedtosis is a modular middleware
+piece that efficiently glues together disparate parts to create a helpful feed
+reader with a minimal (< 200 LOC), test-covered codebase.
+
+== Installation
+
+Assuming that you've followed the directions on gems.github.com to allow your
+computer to install gems from GitHub, the following command will install the
+Feedtosis library:
+
+  sudo gem install jsl-feedtosis
+
+== Usage
+
+Feedtosis is easy to use. Just create a client object, and invoke the
+"fetch" method:
+
+  require 'feedtosis' 
+  client = Feedtosis::Client.new('http://feeds.feedburner.com/wooster') 
+  result = client.fetch
+
++result+ will be a Feedtosis::Result object which delegates methods to 
+the FeedNormalizer::Feed object as well as the Curl::Easy object used to fetch
+the feed.  Useful methods on this object include +entries+, +new_entries+ and
++response_code+ among many others (basically all of the methods that 
+FeedNormalizer::Feed and Curl::Easy objects respond to are implemented and can
+be called directly, minus the setter methods for these objects).
+
+Note that since Feedtosis uses HTTP conditional GET, it may not actually 
+have received a full XML response from the server suitable for being parsed 
+into entries.  In this case, methods such as +entries+ on the Feedtosis::Result
+will return +nil+.  Depending on your application logic, you may want to inspect
+the methods that are delegated to the Curl::Easy object, such as +response_code+,
+for more information on what happened in these cases.
+
+On subsequent requests of a particular resource, Feedtosis will update 
++new_entries+ to contain the feed entries that we haven't seen yet.  In most
+applications, your program will probably call the same batch of URLS multiple 
+times, and process the elements in +new_entries+.
+
+You will most likely want to allow Feedtosis to remember details about the
+last retrieval of a feed after the client is removed from memory. Feedtosis
+uses Moneta, a unified interface to key-value storage systems to remember
+"summaries" of feeds that it has seen in the past. See the document section on
+Customization for more details on how to configure this system.
+
+== Customization
+
+Feedtosis stores summaries of feeds in a key-value storage system. If no
+options are included when creating a new Feedtosis::Client object, the
+default is to use a "memory" storage system. The memory system is just a basic
+ruby Hash, so it won't keep track of feeds after a particular Client is removed
+from memory. To configure a different backend, pass an options hash to the
+Feedtosis client initialization:
+
+  url = "http://newsrss.bbc.co.uk/rss/newsonline_world_edition/south_asia/rss.xml" 
+  mf = Feedtosis::Client.new(url, :backend => {:moneta_klass => 'Moneta::Memcache', :server => 'localhost:1978'}) 
+  res = mf.fetch
+
+This example sets up a Memcache backend, which in this case points to Tokyo
+Tyrant on port 1978. Note that Moneta::Memcache can be given as a string, in
+which case you don't have to manually require Moneta::Memcache before
+initializing the client.
+
+Generally, Feedtosis supports all systems supported by Moneta, and any one
+of the supported systems can be given to the +moneta_klass+ parameter. Other
+options following +backend+ are passed directly to Moneta for configuration.
+
+== Implementation
+
+Feedtosis helps to identify new feed entries and to figure out when
+conditional GET can be used in retrieving resources. In order to accomplish this
+without having to require that the user store information such as etags and
+dates of the last retrieved entry, Feedtosis stores a summary structure in
+the configured key-value store (backed by Moneta). In order to do conditional
+GET requests, Feedtosis stores the Last-Modified date, as well as the ETag
+of the last request in the summary structure, which is put in a namespaced
+element consisting of the term 'Feedtosis' (bet you won't have to worry
+about name collisions on that one!) and the MD5 of the URL retrieved.
+
+It can also be a bit tricky to decipher which feed entries are new since many
+feed sources don't include unique ids with their feeds. Feedtosis reliably
+keeps track of which entries in a feed are new by storing (in the summary hash
+mentioned above) an MD5 signature of each entry in a feed. It takes elements
+such as the published-at date, title and content and generates the MD5 of these
+elements. This allows Feedtosis to cheaply compute (both in terms of
+computation and storage) which feed entries should be presented to the user as
+"new". Below is an example of a summary structure:
+
+  { 
+    :etag => "4c8f-46ac09fbbe940", 
+    :last_modified => "Mon, 25 May 2009 18:17:33 GMT",
+    :digests => ["f2993783ded928637ce5f2dc2d837f10", "da64efa6dd9ce34e5699b9efe73a37a7"] 
+  }
+
+The data stored by Feedtosis in the summary structure allows it to be
+helpful to the user without storing lots of data that are unnecessary for
+efficient functioning.
+
+== HTML cleaning/sanitizing
+
+Feedtosis doesn't do anything about feed sanitizing, as other libraries have
+been built for this purpose. FeedNormalizer has methods for escaping entries,
+but to strip HTML I suggest that you look at the Ruby gem "sanitize".
+
+== Credits
+
+Thanks to Sander Hartlage (GitHub: Sander6) for useful feedback early in the 
+development of Feedtosis.
+
+== Feedback
+
+Please let me know if you have any problems with or questions about
+Feedtosis.
+
+= References
+
+  (1) http://en.wikipedia.org/wiki/List_of_vores
+
+= Author
+
+Justin S. Leitgeb, mailto:justin@phq.org

data/Rakefile

@@ -0,0 +1,28 @@
+require 'rubygems'
+require 'spec'
+
+require 'rake'
+require 'spec/rake/spectask'
+require 'rake/rdoctask'
+
+require 'lib/feedtosis'
+
+desc 'Test the plugin.'
+Spec::Rake::SpecTask.new(:spec) do |t|
+  t.spec_opts  = ["--format", "progress", "--colour"]
+  t.libs << 'lib'
+  t.verbose = true
+end
+
+desc "Run all the tests"
+task :default => :spec
+
+desc 'Generate documentation'
+Rake::RDocTask.new(:rdoc) do |rdoc|
+  rdoc.rdoc_dir = 'rdoc'
+  rdoc.title    = 'Feedtosis'
+  rdoc.options << '--line-numbers' << '--inline-source'
+  rdoc.rdoc_files.include('README.rdoc')
+  rdoc.rdoc_files.include('lib/feedtosis/**/*.rb')
+end
+

data/feedtosis.gemspec

@@ -0,0 +1,49 @@
+Gem::Specification.new do |s|
+  s.name = %q{feedtosis}
+  s.version = "0.0.2.3"
+
+  s.required_rubygems_version = Gem::Requirement.new(">= 0") if s.respond_to? :required_rubygems_version=
+  s.authors = ["Justin Leitgeb"]
+  s.date = %q{2009-05-22}
+  s.description = %q{Feedtosis finds new information in feeds quickly using smart fetching and matching of previously read entries}
+  s.email = %q{justin@phq.org}
+  
+  s.files = ["lib/extensions/core/array.rb", "lib/extensions/core/hash.rb", 
+    "lib/extensions/feed_normalizer/feed_instance_methods.rb", 
+    "lib/feedtosis/result.rb",
+    "lib/feedtosis/client.rb", "lib/feedtosis.rb", "LICENSE", 
+    "feedtosis.gemspec", "Rakefile", "README.rdoc", 
+    "spec/extensions/feed_normalizer/feed_instance_methods_spec.rb", 
+    "spec/fixtures/http_headers/wooster.txt", 
+    "spec/fixtures/xml/older_wooster.xml", "spec/fixtures/xml/wooster.xml", 
+    "spec/feedtosis/client_spec.rb", "spec/feedtosis_spec.rb", 
+    "spec/feedtosis/result_spec.rb",
+    "spec/spec_helper.rb"]
+  
+  s.has_rdoc = true
+  s.homepage = %q{http://github.com/jsl/feedtosis}
+  s.rdoc_options = ["--charset=UTF-8"]
+  s.require_paths = ["lib"]
+  s.rubygems_version = %q{1.3.1}
+  s.summary = %q{Retrieves feeds using conditional GET and marks entries that you haven't seen before}
+  s.test_files = ["spec/feedtosis_spec.rb", "spec/spec_helper.rb", "spec/feedtosis/client_spec.rb",
+    "spec/feedtosis/result_spec.rb" ]
+
+  s.extra_rdoc_files = [ "README.rdoc" ]
+  
+  s.rdoc_options += [
+    '--title', 'Feedtosis',
+    '--main', 'README.rdoc',
+    '--line-numbers',
+    '--inline-source'
+   ]
+
+  %w[ taf2-curb jsl-moneta jsl-http_headers namelessjon-feed_me ].each do |dep|
+    s.add_dependency(dep)
+  end
+
+  if s.respond_to? :specification_version then
+    current_version = Gem::Specification::CURRENT_SPECIFICATION_VERSION
+    s.specification_version = 2
+  end
+end

data/lib/extensions/core/array.rb

@@ -0,0 +1,8 @@
+class Array
+    
+  # From Rails' ActiveSupport library
+  def extract_options!
+    last.is_a?(::Hash) ? pop : {}
+  end
+
+end

data/lib/extensions/core/hash.rb

@@ -0,0 +1,17 @@
+class Hash
+  # Returns a Hash containing only input keys.
+  # Method from merb-core.
+  def except(*rejected)
+    reject { |k,v| rejected.include?(k) }
+  end
+  
+  def reverse_merge(other_hash)
+    other_hash.merge(self)
+  end
+
+  # Returns a new hash containing only the input keys.
+  # Method from merb-core.
+  def only(*allowed)
+    reject { |k,v| !allowed.include?(k) }
+  end
+end

data/lib/extensions/feed_normalizer/feed_instance_methods.rb

@@ -0,0 +1,17 @@
+# Extends FeedNormalizer::Feed with method for detecting new_items (aliased as new_entries for 
+# convenience).
+module Feedtosis
+  module FeedInstanceMethods
+    
+    # Returns only the feeds that are new.
+    def new_items
+      self.entries.select do |e| 
+        e.instance_variable_get(:@_seen) == false
+      end
+    end
+    
+    alias :new_entries :new_items
+  end
+end
+
+FeedNormalizer::Feed.__send__(:include, Feedtosis::FeedInstanceMethods)

data/lib/feedtosis/client.rb

@@ -0,0 +1,146 @@
+module Feedtosis
+  
+  # Feedtosis::Client is the primary interface to the feed reader.  Call it 
+  # with a url that was previously fetched while connected to the configured 
+  # backend, and it will 1) only do a retrieval if deemed necessary based on the 
+  # etag and modified-at of the last etag and 2) mark all entries retrieved as 
+  # either new or not new.  Entries retrieved are normalized using the 
+  # feed-normalizer gem.
+  class Client
+    attr_reader :options, :url
+
+    # Initializes a new feedtosis library.  The backend can be a hash of options, in 
+    # which case we initialize a new HashBack::Backend.  Or, it may be a pre-initialized
+    # backend, in which case we set the backend to the given HashBack::Backend object.
+    def initialize(url, backend = Moneta::Memory.new)
+      @url      = url
+      @backend  = backend
+      
+      unless @backend.respond_to?(:[]) && @backend.respond_to?(:[]=)
+        raise ArgumentError, "Backend needs to be a key-value store"
+      end
+    end
+    
+    # Retrieves the latest entries from this feed.  Returns a Feedtosis::Result
+    # object which delegates methods to the Curl::Easy object making the request
+    # and the FeedNormalizer::Feed object that may have been created from the 
+    # HTTP response body.
+    def fetch
+      curl = build_curl_easy
+      curl.perform
+      feed = process_curl_response(curl)
+      Feedtosis::Result.new(curl, feed)
+    end
+    
+    private
+
+    # Marks entries as either seen or not seen based on the unique signature of 
+    # the entry, which is calculated by taking the MD5 of common attributes.
+    def mark_new_entries(response)
+      digests = if summary_for_feed.nil? || summary_for_feed[:digests].nil?
+        [ ]
+      else
+        summary_for_feed[:digests]
+      end
+            
+      # For each entry in the responses object, mark @_seen as false if the 
+      # digest of this entry doesn't exist in the cached object.
+      response.entries.each do |e|
+        seen = digests.include?(digest_for(e))
+        e.instance_variable_set(:@_seen, seen)
+      end
+      
+      response
+    end
+
+    # Processes the results by identifying which entries are new if the response
+    # is a 200.  Otherwise, returns the Curl::Easy object for the user to inspect.
+    def process_curl_response(curl)
+      if curl.response_code == 200
+        response = parser_for_xml(curl.body_str)
+        response = mark_new_entries(response)
+        store_summary_to_backend(response, curl)
+        response
+      end
+    end
+    
+    # Sets options for the Curl::Easy object, including parameters for HTTP 
+    # conditional GET.
+    def build_curl_easy
+      curl = new_curl_easy(url)
+
+      # Many feeds have a 302 redirect to another URL.  For more recent versions 
+      # of Curl, we need to specify this.
+      curl.follow_location = true
+      
+      set_header_options(curl)
+    end
+
+    def new_curl_easy(url)
+      Curl::Easy.new(url)
+    end
+
+    # Returns the summary hash for this feed from the backend store.
+    def summary_for_feed
+      @backend[key_for_cached]
+    end
+
+    # Sets the headers from the backend, if available
+    def set_header_options(curl)
+      summary = summary_for_feed
+      
+      unless summary.nil?
+        # We should only try to populate the headers for a conditional GET if 
+        # we know both of these values.
+        if summary[:etag] && summary[:last_modified]
+          curl.headers['If-None-Match']     = summary[:etag]
+          curl.headers['If-Modified-Since'] = summary[:last_modified]
+        end
+      end
+      
+      curl
+    end
+
+    def key_for_cached
+      MD5.hexdigest(@url)
+    end
+    
+    # Stores information about the retrieval, including ETag, Last-Modified, 
+    # and MD5 digests of all entries to the backend store.  This enables 
+    # conditional GET usage on subsequent requests and marking of entries as 
+    # either new or seen.
+    def store_summary_to_backend(feed, curl)
+      headers = HttpHeaders.new(curl.header_str)
+      
+      # Store info about HTTP retrieval
+      summary = { }
+      
+      summary.merge!(:etag => headers.etag) unless headers.etag.nil?
+      summary.merge!(:last_modified => headers.last_modified) unless headers.last_modified.nil?
+      
+      # Store digest for each feed entry so we can detect new feeds on the next 
+      # retrieval
+      digests = feed.entries.map do |e|
+        digest_for(e)
+      end
+      
+      summary.merge!(:digests => digests)
+      set_summary(summary)
+    end
+    
+    def set_summary(summary)
+      @backend[key_for_cached] = summary
+    end
+    
+    # Computes a unique signature for the FeedNormalizer::Entry object given.  
+    # This signature will be the MD5 of enough fields to have a reasonable 
+    # probability of determining if the entry is unique or not.
+    def digest_for(entry)      
+      MD5.hexdigest( [ entry.title, entry.content ].join )
+    end
+    
+    def parser_for_xml(xml)
+      FeedNormalizer::FeedNormalizer.parse(xml)
+    end
+  end
+end

data/lib/feedtosis/result.rb

@@ -0,0 +1,48 @@
+module Feedtosis
+  
+  # Makes the response components both from the Curl::Easy object and the 
+  # FeedNormalizer::Feed object available to the user by delegating appropriate
+  # method calls to the correct object.  If FeedNormalizer wasn't able to process
+  # the response, calls which would be delegated to this object return nil.  In
+  # these cases, depending on your business logic you may want to inspect the 
+  # state of the Curl::Easy object by using methods forwarded to it.
+  class Result
+    
+    # Methods which should be delegated to the FeedNormalizer::Feed object.
+    FEED_METHODS = [ :title, :description, :last_updated, :copyright, :authors, 
+      :author, :urls, :url, :image, :generator, :items, :entries, :new_items, 
+      :new_entries, :channel, :ttl, :skip_hours, :skip_days 
+    ] unless defined?(FEED_METHODS)
+    
+    # Precompiled regexp for detecting removing setter methods from collection 
+    # of methods to be delegated to the Curl::Easy object.
+    SETTER_METHOD_RE = /=$/o unless defined?(SETTER_METHOD_RE)
+    
+    def initialize(curl, feed)
+      @curl = curl
+      @feed = feed
+      
+      raise ArgumentError, "Curl object must not be nil" if curl.nil?
+    end
+    
+    # See what the Curl::Easy object responds to, and send any appropriate
+    # messages its way.  We don't worry about setter methods, since those
+    # aren't really useful to delegate.
+    Curl::Easy.instance_methods(false).reject do |m| 
+      m =~ SETTER_METHOD_RE
+    end.each do |meth|                  # Example method:
+      define_method meth do |*args|     # def title
+        @curl.__send__(meth, *args)     #   @curl.title
+      end                               # end
+    end
+    
+    # Send methods through to the feed object unless it is nil.  If feed
+    # object is nil, return nil in response to method call.
+    FEED_METHODS.each do |meth|                         # Example method:
+      define_method meth do |*args|                     # def author
+        @feed.nil? ? nil : @feed.__send__(meth, *args)  #   @feed.nil? nil : @feed.author
+      end                                               # end
+    end    
+    
+  end
+end

data/lib/feedtosis.rb

@@ -0,0 +1,17 @@
+require 'rubygems'
+require 'curb'
+require 'moneta'
+require 'moneta/memory'
+require 'http_headers'
+require 'feed-normalizer'
+require 'md5'
+
+lib_dirs =  [ 'extensions', 'feedtosis' ].map do |d|
+  File.join(File.dirname(__FILE__), d)
+end
+
+lib_dirs.each do |d|
+  Dir[File.join(d, "**", "*.rb")].each do |file| 
+    require file
+  end
+end

data/spec/extensions/feed_normalizer/feed_instance_methods_spec.rb

@@ -0,0 +1,12 @@
+require File.join(File.dirname(__FILE__), %w[.. .. spec_helper])
+
+describe Feedtosis::FeedInstanceMethods do
+  before do
+    @fn = FeedNormalizer::FeedNormalizer.parse(xml_fixture('wooster'))
+  end
+  
+  it "should respond to new_entries and new_items" do
+    @fn.should respond_to(:new_entries)
+    @fn.should respond_to(:new_items)
+  end
+end

data/spec/feedtosis/client_spec.rb

@@ -0,0 +1,110 @@
+require File.join(File.dirname(__FILE__), %w[.. spec_helper])
+
+describe Feedtosis::Client do
+  before do
+    @url      = "http://www.example.com/feed.rss"
+    @backend  = Moneta::Memory.new
+    @fr       = Feedtosis::Client.new(@url, @backend)
+  end
+
+  describe "initialization" do    
+    it "should set #url to an Array when an Array is given" do
+      @fr.url.should == @url
+    end
+    
+    it "should set the If-None-Match and If-Modified-Since headers to the value of the summary hash" do
+      curl_headers = mock('headers')
+      curl_headers.expects(:[]=).with('If-None-Match', '42ab')
+      curl_headers.expects(:[]=).with('If-Modified-Since', 'Mon, 25 May 2009 16:38:49 GMT')
+      
+      summary = { :etag => '42ab', :last_modified => 'Mon, 25 May 2009 16:38:49 GMT' }
+      
+      @fr.__send__(:set_summary, summary)
+      
+      curl_easy = mock('curl', :perform => true, :follow_location= => true, 
+        :response_code => 200, :body_str => xml_fixture('wooster'),
+        :header_str => http_header('wooster')
+      )
+      
+      curl_easy.expects(:headers).returns(curl_headers).times(2)
+      
+      @fr.expects(:new_curl_easy).returns(curl_easy)
+      @fr.fetch
+    end
+    
+    describe "when given a pre-initialized backend" do
+      it "should set the @backend to the pre-initialized structure" do
+        h   = Moneta::Memory.new
+        fc  = Feedtosis::Client.new(@url, h)
+        fc.__send__(:instance_variable_get, :@backend).should == h
+      end
+      
+      it "should raise an error if the backend is not a key-value store based on behavior" do
+        o = Object.new
+        
+        lambda {
+          Feedtosis::Client.new(@url, o)          
+        }.should raise_error(ArgumentError)
+      end
+    end
+  end
+    
+  describe "#fetch" do
+    it "should call Curl::Easy.perform with the url, and #process_curl_response" do
+      curl_easy = mock('curl', :perform => true)
+      @fr.expects(:build_curl_easy).returns(curl_easy)
+      @fr.expects(:process_curl_response)
+      @fr.fetch
+    end
+    
+    describe "when the response code is not 200" do
+      it "should return nil for feed methods such as #title and #author" do
+        curl = mock('curl', :perform => true, :response_code => 304)
+        @fr.expects(:build_curl_easy).returns(curl)
+        res = @fr.fetch
+        res.title.should be_nil
+        res.author.should be_nil
+      end
+      
+      it "should return a Feedtosis::Result object" do
+        curl = mock('curl', :perform => true, :response_code => 304)
+        @fr.expects(:build_curl_easy).returns(curl)
+        @fr.fetch.should be_a(Feedtosis::Result)
+      end
+    end
+
+    describe "when the response code is 200" do
+      describe "when an identical resource has been retrieved previously" do
+        before do
+          curl = mock('curl', :perform => true, :response_code => 200,
+            :body_str => xml_fixture('wooster'), :header_str => http_header('wooster'))
+          @fr.expects(:build_curl_easy).returns(curl)
+          @fr.fetch
+        end
+        
+        it "should have an empty array for new_entries" do
+          curl = mock('curl', :perform => true, :response_code => 200,
+            :body_str => xml_fixture('wooster'), :header_str => http_header('wooster'))
+          @fr.expects(:build_curl_easy).returns(curl)
+          @fr.fetch.new_entries.should == []          
+        end
+      end
+      
+      describe "when the resource has been previously retrieved minus two entries" do
+        before do
+          curl = mock('curl', :perform => true, :response_code => 200,
+            :body_str => xml_fixture('older_wooster'), :header_str => http_header('wooster'))
+          @fr.expects(:build_curl_easy).returns(curl)
+          @fr.fetch        
+        end
+        
+        it "should have two elements in new_entries" do
+          curl = mock('curl', :perform => true, :response_code => 200,
+            :body_str => xml_fixture('wooster'), :header_str => http_header('wooster'))
+          @fr.expects(:build_curl_easy).returns(curl)
+          @fr.fetch.new_entries.size.should == 2
+        end
+      end
+    end
+  end  
+end

data/spec/feedtosis/result_spec.rb

@@ -0,0 +1,34 @@
+require File.join(File.dirname(__FILE__), %w[.. spec_helper])
+
+describe Feedtosis::Result do
+  before do
+    @c = mock('curl')
+    @f = mock('feed')
+    @r = Feedtosis::Result.new(@c, @f)
+  end
+  
+  it "should raise an ArgumentError if the Curl object is nil" do
+    lambda {
+      Feedtosis::Result.new(nil, nil)
+    }.should raise_error(ArgumentError)
+  end
+  
+  it "should send author to the Feed object" do
+    @f.expects(:author)
+    @r.author
+  end
+  
+  it "should send body_str to the curl object" do
+    @c.expects(:body_str)
+    @r.body_str
+  end
+  
+  it "should not respond to setter methods common in the Curl::Easy class" do
+    @r.should_not respond_to(:encoding=)
+  end
+  
+  it "should return nil for author if the Feed is nil" do
+    r = Feedtosis::Result.new(@c, nil)
+    r.author
+  end
+end

data/spec/feedtosis_spec.rb

@@ -0,0 +1,5 @@
+require File.join(File.dirname(__FILE__),  'spec_helper')
+
+describe Feedtosis do
+  
+end

data/spec/fixtures/http_headers/wooster.txt

@@ -0,0 +1,19 @@
+HTTP/1.1 302 Found
+Date: Mon, 25 May 2009 17:36:02 GMT
+Server: Apache/2.0.52 (Red Hat)
+Location: http://feeds.feedburner.com/wooster
+Content-Length: 311
+Connection: close
+Content-Type: text/html; charset=iso-8859-1
+
+HTTP/1.1 200 OK
+Last-Modified: Mon, 25 May 2009 16:38:49 GMT
+ETag: /YJUYmsYIcQeFAGy7OZQoaCQeXw
+Content-Type: text/xml; charset=utf-8
+Date: Mon, 25 May 2009 17:36:03 GMT
+Expires: Mon, 25 May 2009 17:36:03 GMT
+Cache-Control: private, max-age=0
+X-Content-Type-Options: nosniff
+Server: GFE/2.0
+Transfer-Encoding: chunked
+

data/spec/fixtures/xml/older_wooster.xml

@@ -0,0 +1,203 @@
+<?xml version="1.0" encoding="utf-8"?>
+<?xml-stylesheet type="text/xsl" media="screen" href="/~d/styles/rss2full.xsl"?>
+<?xml-stylesheet type="text/css" media="screen" href="http://feeds2.feedburner.com/~d/styles/itemcontent.css"?>
+<rss xmlns:feedburner="http://rssnamespace.org/feedburner/ext/1.0" version="2.0">
+	<channel>
+		<title>Wooster Collective</title>
+		<link>http://www.woostercollective.com/</link>
+		<description/>
+		<language>en</language>
+		<copyright>Copyright 2009</copyright>
+		<lastBuildDate>Mon, 25 May 2009 07:48:04 -0500</lastBuildDate>
+		<generator>http://www.sixapart.com/movabletype/?v=3.3</generator>
+		<docs>http://blogs.law.harvard.edu/tech/rss</docs>
+		<atom10:link xmlns:atom10="http://www.w3.org/2005/Atom" rel="self" href="www.woostercollective.com/rss/index.xml" type="application/rss+xml"/>
+		<feedburner:emailServiceId>wooster</feedburner:emailServiceId>
+		<feedburner:feedburnerHostname>http://feedburner.google.com</feedburner:feedburnerHostname>
+		<item>
+			<title>Seen In North London: Department of Urban Censorship</title>
+			<description><![CDATA[<p><a href="http://www.woostercollective.com/urbancensor.jpg"><img alt="urbancensor.jpg" src="http://www.woostercollective.com/urbancensor-thumb.jpg" width="500" height="444" /></a></p>
+
+<p>(Thanks, <a href="http://www.tupajumi.com/jonathan/">Jonathan</a>)<br />
+</p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/syiP17t0PKo/seen_in_north_london_department_of_urban.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/seen_in_north_london_department_of_urban.html</guid>
+			<category>Wheatpastes</category>
+			<pubDate>Mon, 25 May 2009 07:39:16 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/seen_in_north_london_department_of_urban.html</feedburner:origLink>
+		</item>
+		<item>
+			<title>Seen On The Steets Of Stockholm</title>
+			<description><![CDATA[<p><a href="http://www.woostercollective.com/poststock.jpg"><img alt="poststock.jpg" src="http://www.woostercollective.com/poststock-thumb.jpg" width="500" height="748" /></a></p>
+
+<p>Artist: <a href="http://vimeo.com/post">Post</a></p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/611KGRn-ZQE/seen_on_the_steets_of_stockholm.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/seen_on_the_steets_of_stockholm.html</guid>
+			<category>Wheatpastes</category>
+			<pubDate>Mon, 25 May 2009 07:29:55 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/seen_on_the_steets_of_stockholm.html</feedburner:origLink>
+		</item>
+		<item>
+			<title>Zevs' Electric Rainbows (2007)</title>
+			<description><![CDATA[<p>Zevs has updated <a href="http://www.gzzglz.com/">his website</a> with photos of past and recent project.  We love the Electric Rainbows that he exchanged for advertisements back 2007:</p>
+
+<p><a href="http://www.woostercollective.com/electric-rainbow-02.jpg"><img alt="electric-rainbow-02.jpg" src="http://www.woostercollective.com/electric-rainbow-02-thumb.jpg" width="500" height="335" /></a></p>
+
+<p><br />
+</p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/TpmlTS7y0f0/zevs_electric_rainbows_2007.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/zevs_electric_rainbows_2007.html</guid>
+			<category>Art</category>
+			<pubDate>Mon, 25 May 2009 07:19:27 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/zevs_electric_rainbows_2007.html</feedburner:origLink>
+		</item>
+		<item>
+			<title>Zephyr - An Introduction</title>
+			<description><![CDATA[<p><a href="http://www.woostercollective.com/zephydith.jpg"><img alt="zephydith.jpg" src="http://www.woostercollective.com/zephydith-thumb.jpg" width="500" height="347" /></a></p>
+
+<p><object width="320" height="265"><param name="movie" value="http://www.youtube.com/v/kqXXZcy-2JU&hl=en&fs=1&rel=0&hd=1"></param><param name="allowFullScreen" value="true"></param><param name="allowscriptaccess" value="always"></param><embed src="http://www.youtube.com/v/kqXXZcy-2JU&hl=en&fs=1&rel=0&hd=1" type="application/x-shockwave-flash" allowscriptaccess="always" allowfullscreen="true" width="320" height="265"></embed></object></p>
+
+<p>One of the first graffiti artists to "accept" Sara and I back in 2000 when we started the Wooster Collective was Zephyr.  This week <a href="http://www.upperplayground.com/">Upper Playground</a> posted a terrific interview with Zephyr filmed a few years ago for their Dithers DVD. </p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/32-ED1oPdYY/zephyr_in_introduction.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/zephyr_in_introduction.html</guid>
+			<category>Graffiti</category>
+			<pubDate>Sat, 23 May 2009 12:44:36 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/zephyr_in_introduction.html</feedburner:origLink>
+		</item>
+		<item>
+			<title>The Yes Men - An Introduction</title>
+			<description><![CDATA[<div><object width="512" height="322"><param name="movie" value="http://d.yimg.com/static.video.yahoo.com/yep/YV_YEP.swf?ver=2.2.40" /><param name="allowFullScreen" value="true" /><param name="AllowScriptAccess" VALUE="always" /><param name="bgcolor" value="#000000" /><param name="flashVars" value="id=13527850&vid=13527850&lang=en-us&intl=us&thumbUrl=&embed=1" /><embed src="http://d.yimg.com/static.video.yahoo.com/yep/YV_YEP.swf?ver=2.2.40" type="application/x-shockwave-flash" width="512" height="322" allowFullScreen="true" AllowScriptAccess="always" bgcolor="#000000" flashVars="id=13527850&vid=13527850&lang=en-us&intl=us&thumbUrl=&embed=1" ></embed></object><br /><a href="http://video.yahoo.com/watch/13527850/13527850"></a> @ <a href="http://video.yahoo.com" >Yahoo! Video</a></div>
+
+<p>If you're not familiar with <a href="http://theyesmen.org/">The Yes Men</a>, this video of their Poptech speech from 2006 is a fantastic introduction.</p>
+
+<p>(Hat tip to <a href="http://www.brainpickings.org/">Brain Pickings</a>)</p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/0yXb4Ui8C3I/the_yes_men_an_introduction.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/the_yes_men_an_introduction.html</guid>
+			<category>Activism</category>
+			<pubDate>Fri, 22 May 2009 11:24:26 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/the_yes_men_an_introduction.html</feedburner:origLink>
+		</item>
+		<item>
+			<title>A Great Example Of Site Specific Work: Carlsbad Sidewalk Surfer</title>
+			<description><![CDATA[<p><img alt="bryansurfer.jpg" src="http://www.woostercollective.com/bryansurfer.jpg" width="500" height="384" /></p>
+
+<p><object width="400" height="307"><param name="allowfullscreen" value="true" /><param name="allowscriptaccess" value="always" /><param name="movie" value="http://vimeo.com/moogaloop.swf?clip_id=4772503&amp;server=vimeo.com&amp;show_title=1&amp;show_byline=1&amp;show_portrait=0&amp;color=&amp;fullscreen=1" /><embed src="http://vimeo.com/moogaloop.swf?clip_id=4772503&amp;server=vimeo.com&amp;show_title=1&amp;show_byline=1&amp;show_portrait=0&amp;color=&amp;fullscreen=1" type="application/x-shockwave-flash" allowfullscreen="true" allowscriptaccess="always" width="400" height="307"></embed></object><p><a href="http://vimeo.com/4772503">Carlsbad Sidewalk Surfer by bryan snyder</a> from <a href="http://vimeo.com/bryansnyder">Bryan Snyder</a> on <a href="http://vimeo.com">Vimeo</a>.</p></p>
+
+<p>From <a href="http://www.snyderartdesign.com">Bryan</a>:</p>
+
+<p>Carlsbad Sidewalk Surfer interacts with its environment during mid day wind gusts. Like the waves that tumble upon our shore, the visibility of this art piece depends on the weather. Between the glassy conditions of the morning and the mellow winds at dusk, the Carlsbad Sidewalk Surfer sneaks into another ride. The goal of this project is to showcase the relationship between a piece of art and its environment when placed in the streets."</p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/oXfLFSd86cY/a_great_example_of_site_specific_work_ca.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/a_great_example_of_site_specific_work_ca.html</guid>
+			<category>Environmental</category>
+			<pubDate>Fri, 22 May 2009 07:54:36 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/a_great_example_of_site_specific_work_ca.html</feedburner:origLink>
+		</item>
+		<item>
+			<title>Herakut Beautifies The Streets Of New York</title>
+			<description><![CDATA[<p><img alt="9501466.jpg" src="http://www.woostercollective.com/9501466.jpg" width="480" height="640" /></p>
+
+<p>While they were in town this week for an opening at <a href="http://redflagg.com/">RedFlagg</a>, <a href="http://www.herakut.de/">Herakut</a> put up a wonderful piece outside <a href="http://eyebeam.org/">Eyebeam</a>    If you haven't head about the show in New York, here's the info:</p>
+
+<p>Herakut<br />
+No Placebos<br />
+May 21 – July 3, 2009</p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/rWAKvvkBDYY/herakut_beautifies_the_streets_of_new_yo.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/herakut_beautifies_the_streets_of_new_yo.html</guid>
+			<category>Walls</category>
+			<pubDate>Fri, 22 May 2009 07:40:04 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/herakut_beautifies_the_streets_of_new_yo.html</feedburner:origLink>
+		</item>
+		<item>
+			<title>Fresh Stuff From Cena7</title>
+			<description><![CDATA[<p><a href="http://www.woostercollective.com/cenared.jpg"><img alt="cenared.jpg" src="http://www.woostercollective.com/cenared-thumb.jpg" width="500" height="409" /></a></p>
+
+<p>More from Cena7 <a href="http://www.flickr.com/photos/cena7-mpc">here</a>. <br />
+</p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/x4y4ZuKBadg/fresh_stuff_from_cena7_1.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/fresh_stuff_from_cena7_1.html</guid>
+			<category>Walls</category>
+			<pubDate>Fri, 22 May 2009 07:37:33 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/fresh_stuff_from_cena7_1.html</feedburner:origLink>
+		</item>
+		<item>
+			<title>Wooster on Facebook</title>
+			<description><![CDATA[<p><img alt="woostfaceo.jpg" src="http://www.woostercollective.com/woostfaceo.jpg" width="500" height="376" /></p>
+
+<p>Each and every day we get more excited about the discussions that are taking place on our <a href="http://www.facebook.com/pages/Wooster-Collective/24080260389?ref=ts#/pages/Wooster-Collective/24080260389?ref=mf">Wooster Collective Facebook page</a>.  The responses to our recent questions:</p>
+
+<p>For those who risk getting arrested while putting up street art or writing graffiti: What motivates you to do it?</p>
+
+<p>What's currently inspiring you?</p>
+
+<p>How would you describe the "role" that graffiti or street art plays in your life? What does it "add" or subtract?</p>
+
+<p>If I gave you $50 today, with the condition that you had to spend it on "art", what would you do with it?</p>
+
+<p>If you haven't yet checked it out we can't recommend it more highly.  It's become an incredible companion to the Wooster blog.  </p>
+
+<p>Also, we are indeed on Twitter. Not as "Wooster Collective" but as <a href="http://www.twitter.com/MarcSchil">Marc</a> and <a href="http://www.twitter.com/saraschiller">Sara</a>.  </p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/4uAvR5rZn80/wooster_on_facebook.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/wooster_on_facebook.html</guid>
+			<category>Site Announcements</category>
+			<pubDate>Thu, 21 May 2009 08:05:18 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/wooster_on_facebook.html</feedburner:origLink>
+		</item>
+		<item>
+			<title>Wooster on Facebook</title>
+			<description><![CDATA[<p><img alt="woostfaceo.jpg" src="http://www.woostercollective.com/woostfaceo.jpg" width="500" height="376" /></p>
+
+<p>Each and every day we get more excited about the discussions that are taking place on our <a href="http://www.facebook.com/pages/Wooster-Collective/24080260389?ref=ts#/pages/Wooster-Collective/24080260389?ref=mf">Wooster Collective Facebook page</a>.  The responses to our recent questions:</p>
+
+<p>For those who risk getting arrested while putting up street art or writing graffiti: What motivates you to do it?</p>
+
+<p>What's currently inspiring you?</p>
+
+<p>How would you describe the "role" that graffiti or street art plays in your life? What does it "add" or subtract?</p>
+
+<p>If I gave you $50 today, with the condition that you had to spend it on "art", what would you do with it?</p>
+
+<p>If you haven't yet checked it out we can't recommend it more highly.  It's become an incredible companion to the Wooster blog.  </p>
+
+<p>Also, we are indeed on Twitter. Not as "Wooster Collective" but as <a href="http://www.twitter.com/MarcSchil">Marc</a> and <a href="http://www.twitter.com/saraschiller">Sara</a>.  </p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/CV9qfY3WZqM/wooster_on_facebook_1.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/wooster_on_facebook_1.html</guid>
+			<category>Site Announcements</category>
+			<pubDate>Thu, 21 May 2009 08:05:18 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/wooster_on_facebook_1.html</feedburner:origLink>
+		</item>
+		<item>
+			<title>Seen On The Steets Of Berlin</title>
+			<description><![CDATA[<p><a href="http://www.woostercollective.com/brownpaper1.jpg"><img alt="brownpaper1.jpg" src="http://www.woostercollective.com/brownpaper1-thumb.jpg" width="500" height="416" /></a><br />
+</p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/O-9kaseEs8I/seen_on_the_steets_of_berlin_1.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/seen_on_the_steets_of_berlin_1.html</guid>
+			<category>Wheatpastes</category>
+			<pubDate>Thu, 21 May 2009 07:57:05 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/seen_on_the_steets_of_berlin_1.html</feedburner:origLink>
+		</item>
+		<item>
+			<title>Checkin' In With... Lister</title>
+			<description><![CDATA[<p><a href="http://www.woostercollective.com/listcheck.jpg"><img alt="listcheck.jpg" src="http://www.woostercollective.com/listcheck-thumb.jpg" width="500" height="342" /></a></p>
+
+<p>"out onto this roof the other night. i wasnt even sure that i had finished this piece but when i returned the next day i was surprised that it looked like this. the wall was so big and high that i couldn't step back at all. i am still surprised the proportions were correct."... <a href="http://www.anthonylister.com">Lister</a></p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/xKfEO6qRHLY/checkin_in_with_lister.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/checkin_in_with_lister.html</guid>
+			<category>Walls</category>
+			<pubDate>Thu, 21 May 2009 07:45:54 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/checkin_in_with_lister.html</feedburner:origLink>
+		</item>
+		<item>
+			<title>Another Great Electronic Billboard Takeover From Poster Child</title>
+			<description><![CDATA[<p><a href="http://www.woostercollective.com/pixeljes.jpg"><img alt="pixeljes.jpg" src="http://www.woostercollective.com/pixeljes-thumb.jpg" width="500" height="375" /></a></p>
+
+<div><object width="480" height="381"><param name="movie" value="http://www.dailymotion.com/swf/x99ave_stained-glass-postpixelators_creation&related=1"></param><param name="allowFullScreen" value="true"></param><param name="allowScriptAccess" value="always"></param><embed src="http://www.dailymotion.com/swf/x99ave_stained-glass-postpixelators_creation&related=1" type="application/x-shockwave-flash" width="480" height="381" allowFullScreen="true" allowScriptAccess="always"></embed></object><br /><b><a href="http://www.dailymotion.com/video/x99ave_stained-glass-postpixelators_creation">Stained Glass Post-Pixelators</a></b><br /><i>Uploaded by <a href="http://www.dailymotion.com/posterchild">posterchild</a>. - <a href="http://www.dailymotion.com/channel/creation">Independent web videos.</a></i></div>
+
+<p>More from Poster Child <a href="http://www.bladediary.com/">here</a>. </p>]]></description>
+			<link>http://feedproxy.google.com/~r/wooster/~3/Rz_yYr1lijQ/another_great_electronic_billboard_takeo.html</link>
+			<guid isPermaLink="false">http://www.woostercollective.com/2009/05/another_great_electronic_billboard_takeo.html</guid>
+			<category>Billboard Liberations</category>
+			<pubDate>Wed, 20 May 2009 07:59:04 -0500</pubDate>
+			<feedburner:origLink>http://www.woostercollective.com/2009/05/another_great_electronic_billboard_takeo.html</feedburner:origLink>
+		</item>
+	</channel>
+</rss>

data/spec/fixtures/xml/wooster.xml

@@ -0,0 +1,215 @@
+<?xml version="1.0" encoding="utf-8"?>
+<?xml-stylesheet type="text/xsl" media="screen" href="/~d/styles/rss2full.xsl"?><?xml-stylesheet type="text/css" media="screen" href="http://feeds2.feedburner.com/~d/styles/itemcontent.css"?><rss xmlns:feedburner="http://rssnamespace.org/feedburner/ext/1.0" version="2.0">
+   <channel>
+      <title>Wooster Collective</title>
+      <link>http://www.woostercollective.com/</link>
+      <description />
+      <language>en</language>
+      <copyright>Copyright 2009</copyright>
+      <lastBuildDate>Mon, 25 May 2009 07:48:04 -0500</lastBuildDate>
+      <generator>http://www.sixapart.com/movabletype/?v=3.3</generator>
+      <docs>http://blogs.law.harvard.edu/tech/rss</docs> 
+
+            <atom10:link xmlns:atom10="http://www.w3.org/2005/Atom" rel="self" href="www.woostercollective.com/rss/index.xml" type="application/rss+xml" /><feedburner:emailServiceId>wooster</feedburner:emailServiceId><feedburner:feedburnerHostname>http://feedburner.google.com</feedburner:feedburnerHostname><item>
+         <title>Fresh Stuff From Davide Zucco (aka Rekal)</title>
+         <description><![CDATA[<p><a href="http://www.woostercollective.com/rekalmonkey.jpg"><img alt="rekalmonkey.jpg" src="http://www.woostercollective.com/rekalmonkey-thumb.jpg" width="500" height="589" /></a></p>
+
+<p>From from Rekal<a href="http://www.rekal.org"> here</a>. </p>
+
+<p></p>
+
+<p></p>
+
+<p><br />
+</p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/rlRoUehLOSM/fresh_stuff_from_davide_zucco_aka_rekal_1.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/fresh_stuff_from_davide_zucco_aka_rekal_1.html</guid>
+         <category>Art</category>
+         <pubDate>Mon, 25 May 2009 07:48:04 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/fresh_stuff_from_davide_zucco_aka_rekal_1.html</feedburner:origLink></item>
+            <item>
+         <title>Fresh Stuff From Sten and Lex</title>
+         <description><![CDATA[<p><a href="http://www.woostercollective.com/stenlexpope.jpg"><img alt="stenlexpope.jpg" src="http://www.woostercollective.com/stenlexpope-thumb.jpg" width="500" height="364" /></a></p>
+
+<p>Location: Palermo in Piazza Magione.<br />
+Image: Pope Sergius, the first Pope born in Palermo</p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/RAHYCux58bs/fresh_stuff_from_sten_and_lex.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/fresh_stuff_from_sten_and_lex.html</guid>
+         <category>Walls</category>
+         <pubDate>Mon, 25 May 2009 07:44:48 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/fresh_stuff_from_sten_and_lex.html</feedburner:origLink></item>
+            <item>
+         <title>Seen In North London: Department of Urban Censorship</title>
+         <description><![CDATA[<p><a href="http://www.woostercollective.com/urbancensor.jpg"><img alt="urbancensor.jpg" src="http://www.woostercollective.com/urbancensor-thumb.jpg" width="500" height="444" /></a></p>
+
+<p>(Thanks, <a href="http://www.tupajumi.com/jonathan/">Jonathan</a>)<br />
+</p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/syiP17t0PKo/seen_in_north_london_department_of_urban.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/seen_in_north_london_department_of_urban.html</guid>
+         <category>Wheatpastes</category>
+         <pubDate>Mon, 25 May 2009 07:39:16 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/seen_in_north_london_department_of_urban.html</feedburner:origLink></item>
+            <item>
+         <title>Seen On The Steets Of Stockholm</title>
+         <description><![CDATA[<p><a href="http://www.woostercollective.com/poststock.jpg"><img alt="poststock.jpg" src="http://www.woostercollective.com/poststock-thumb.jpg" width="500" height="748" /></a></p>
+
+<p>Artist: <a href="http://vimeo.com/post">Post</a></p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/611KGRn-ZQE/seen_on_the_steets_of_stockholm.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/seen_on_the_steets_of_stockholm.html</guid>
+         <category>Wheatpastes</category>
+         <pubDate>Mon, 25 May 2009 07:29:55 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/seen_on_the_steets_of_stockholm.html</feedburner:origLink></item>
+            <item>
+         <title>Zevs' Electric Rainbows (2007)</title>
+         <description><![CDATA[<p>Zevs has updated <a href="http://www.gzzglz.com/">his website</a> with photos of past and recent project.  We love the Electric Rainbows that he exchanged for advertisements back 2007:</p>
+
+<p><a href="http://www.woostercollective.com/electric-rainbow-02.jpg"><img alt="electric-rainbow-02.jpg" src="http://www.woostercollective.com/electric-rainbow-02-thumb.jpg" width="500" height="335" /></a></p>
+
+<p><br />
+</p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/TpmlTS7y0f0/zevs_electric_rainbows_2007.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/zevs_electric_rainbows_2007.html</guid>
+         <category>Art</category>
+         <pubDate>Mon, 25 May 2009 07:19:27 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/zevs_electric_rainbows_2007.html</feedburner:origLink></item>
+            <item>
+         <title>Zephyr - An Introduction</title>
+         <description><![CDATA[<p><a href="http://www.woostercollective.com/zephydith.jpg"><img alt="zephydith.jpg" src="http://www.woostercollective.com/zephydith-thumb.jpg" width="500" height="347" /></a></p>
+
+<p><object width="320" height="265"><param name="movie" value="http://www.youtube.com/v/kqXXZcy-2JU&hl=en&fs=1&rel=0&hd=1"></param><param name="allowFullScreen" value="true"></param><param name="allowscriptaccess" value="always"></param><embed src="http://www.youtube.com/v/kqXXZcy-2JU&hl=en&fs=1&rel=0&hd=1" type="application/x-shockwave-flash" allowscriptaccess="always" allowfullscreen="true" width="320" height="265"></embed></object></p>
+
+<p>One of the first graffiti artists to "accept" Sara and I back in 2000 when we started the Wooster Collective was Zephyr.  This week <a href="http://www.upperplayground.com/">Upper Playground</a> posted a terrific interview with Zephyr filmed a few years ago for their Dithers DVD. </p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/32-ED1oPdYY/zephyr_in_introduction.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/zephyr_in_introduction.html</guid>
+         <category>Graffiti</category>
+         <pubDate>Sat, 23 May 2009 12:44:36 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/zephyr_in_introduction.html</feedburner:origLink></item>
+            <item>
+         <title>The Yes Men - An Introduction</title>
+         <description><![CDATA[<div><object width="512" height="322"><param name="movie" value="http://d.yimg.com/static.video.yahoo.com/yep/YV_YEP.swf?ver=2.2.40" /><param name="allowFullScreen" value="true" /><param name="AllowScriptAccess" VALUE="always" /><param name="bgcolor" value="#000000" /><param name="flashVars" value="id=13527850&vid=13527850&lang=en-us&intl=us&thumbUrl=&embed=1" /><embed src="http://d.yimg.com/static.video.yahoo.com/yep/YV_YEP.swf?ver=2.2.40" type="application/x-shockwave-flash" width="512" height="322" allowFullScreen="true" AllowScriptAccess="always" bgcolor="#000000" flashVars="id=13527850&vid=13527850&lang=en-us&intl=us&thumbUrl=&embed=1" ></embed></object><br /><a href="http://video.yahoo.com/watch/13527850/13527850"></a> @ <a href="http://video.yahoo.com" >Yahoo! Video</a></div>
+
+<p>If you're not familiar with <a href="http://theyesmen.org/">The Yes Men</a>, this video of their Poptech speech from 2006 is a fantastic introduction.</p>
+
+<p>(Hat tip to <a href="http://www.brainpickings.org/">Brain Pickings</a>)</p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/0yXb4Ui8C3I/the_yes_men_an_introduction.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/the_yes_men_an_introduction.html</guid>
+         <category>Activism</category>
+         <pubDate>Fri, 22 May 2009 11:24:26 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/the_yes_men_an_introduction.html</feedburner:origLink></item>
+            <item>
+         <title>A Great Example Of Site Specific Work: Carlsbad Sidewalk Surfer</title>
+         <description><![CDATA[<p><img alt="bryansurfer.jpg" src="http://www.woostercollective.com/bryansurfer.jpg" width="500" height="384" /></p>
+
+<p><object width="400" height="307"><param name="allowfullscreen" value="true" /><param name="allowscriptaccess" value="always" /><param name="movie" value="http://vimeo.com/moogaloop.swf?clip_id=4772503&amp;server=vimeo.com&amp;show_title=1&amp;show_byline=1&amp;show_portrait=0&amp;color=&amp;fullscreen=1" /><embed src="http://vimeo.com/moogaloop.swf?clip_id=4772503&amp;server=vimeo.com&amp;show_title=1&amp;show_byline=1&amp;show_portrait=0&amp;color=&amp;fullscreen=1" type="application/x-shockwave-flash" allowfullscreen="true" allowscriptaccess="always" width="400" height="307"></embed></object><p><a href="http://vimeo.com/4772503">Carlsbad Sidewalk Surfer by bryan snyder</a> from <a href="http://vimeo.com/bryansnyder">Bryan Snyder</a> on <a href="http://vimeo.com">Vimeo</a>.</p></p>
+
+<p>From <a href="http://www.snyderartdesign.com">Bryan</a>:</p>
+
+<p>Carlsbad Sidewalk Surfer interacts with its environment during mid day wind gusts. Like the waves that tumble upon our shore, the visibility of this art piece depends on the weather. Between the glassy conditions of the morning and the mellow winds at dusk, the Carlsbad Sidewalk Surfer sneaks into another ride. The goal of this project is to showcase the relationship between a piece of art and its environment when placed in the streets."</p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/oXfLFSd86cY/a_great_example_of_site_specific_work_ca.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/a_great_example_of_site_specific_work_ca.html</guid>
+         <category>Environmental</category>
+         <pubDate>Fri, 22 May 2009 07:54:36 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/a_great_example_of_site_specific_work_ca.html</feedburner:origLink></item>
+            <item>
+         <title>Herakut Beautifies The Streets Of New York</title>
+         <description><![CDATA[<p><img alt="9501466.jpg" src="http://www.woostercollective.com/9501466.jpg" width="480" height="640" /></p>
+
+<p>While they were in town this week for an opening at <a href="http://redflagg.com/">RedFlagg</a>, <a href="http://www.herakut.de/">Herakut</a> put up a wonderful piece outside <a href="http://eyebeam.org/">Eyebeam</a>    If you haven't head about the show in New York, here's the info:</p>
+
+<p>Herakut<br />
+No Placebos<br />
+May 21 – July 3, 2009</p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/rWAKvvkBDYY/herakut_beautifies_the_streets_of_new_yo.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/herakut_beautifies_the_streets_of_new_yo.html</guid>
+         <category>Walls</category>
+         <pubDate>Fri, 22 May 2009 07:40:04 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/herakut_beautifies_the_streets_of_new_yo.html</feedburner:origLink></item>
+            <item>
+         <title>Fresh Stuff From Cena7</title>
+         <description><![CDATA[<p><a href="http://www.woostercollective.com/cenared.jpg"><img alt="cenared.jpg" src="http://www.woostercollective.com/cenared-thumb.jpg" width="500" height="409" /></a></p>
+
+<p>More from Cena7 <a href="http://www.flickr.com/photos/cena7-mpc">here</a>. <br />
+</p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/x4y4ZuKBadg/fresh_stuff_from_cena7_1.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/fresh_stuff_from_cena7_1.html</guid>
+         <category>Walls</category>
+         <pubDate>Fri, 22 May 2009 07:37:33 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/fresh_stuff_from_cena7_1.html</feedburner:origLink></item>
+            <item>
+         <title>Wooster on Facebook</title>
+         <description><![CDATA[<p><img alt="woostfaceo.jpg" src="http://www.woostercollective.com/woostfaceo.jpg" width="500" height="376" /></p>
+
+<p>Each and every day we get more excited about the discussions that are taking place on our <a href="http://www.facebook.com/pages/Wooster-Collective/24080260389?ref=ts#/pages/Wooster-Collective/24080260389?ref=mf">Wooster Collective Facebook page</a>.  The responses to our recent questions:</p>
+
+<p>For those who risk getting arrested while putting up street art or writing graffiti: What motivates you to do it?</p>
+
+<p>What's currently inspiring you?</p>
+
+<p>How would you describe the "role" that graffiti or street art plays in your life? What does it "add" or subtract?</p>
+
+<p>If I gave you $50 today, with the condition that you had to spend it on "art", what would you do with it?</p>
+
+<p>If you haven't yet checked it out we can't recommend it more highly.  It's become an incredible companion to the Wooster blog.  </p>
+
+<p>Also, we are indeed on Twitter. Not as "Wooster Collective" but as <a href="http://www.twitter.com/MarcSchil">Marc</a> and <a href="http://www.twitter.com/saraschiller">Sara</a>.  </p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/4uAvR5rZn80/wooster_on_facebook.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/wooster_on_facebook.html</guid>
+         <category>Site Announcements</category>
+         <pubDate>Thu, 21 May 2009 08:05:18 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/wooster_on_facebook.html</feedburner:origLink></item>
+            <item>
+         <title>Wooster on Facebook</title>
+         <description><![CDATA[<p><img alt="woostfaceo.jpg" src="http://www.woostercollective.com/woostfaceo.jpg" width="500" height="376" /></p>
+
+<p>Each and every day we get more excited about the discussions that are taking place on our <a href="http://www.facebook.com/pages/Wooster-Collective/24080260389?ref=ts#/pages/Wooster-Collective/24080260389?ref=mf">Wooster Collective Facebook page</a>.  The responses to our recent questions:</p>
+
+<p>For those who risk getting arrested while putting up street art or writing graffiti: What motivates you to do it?</p>
+
+<p>What's currently inspiring you?</p>
+
+<p>How would you describe the "role" that graffiti or street art plays in your life? What does it "add" or subtract?</p>
+
+<p>If I gave you $50 today, with the condition that you had to spend it on "art", what would you do with it?</p>
+
+<p>If you haven't yet checked it out we can't recommend it more highly.  It's become an incredible companion to the Wooster blog.  </p>
+
+<p>Also, we are indeed on Twitter. Not as "Wooster Collective" but as <a href="http://www.twitter.com/MarcSchil">Marc</a> and <a href="http://www.twitter.com/saraschiller">Sara</a>.  </p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/CV9qfY3WZqM/wooster_on_facebook_1.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/wooster_on_facebook_1.html</guid>
+         <category>Site Announcements</category>
+         <pubDate>Thu, 21 May 2009 08:05:18 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/wooster_on_facebook_1.html</feedburner:origLink></item>
+            <item>
+         <title>Seen On The Steets Of Berlin</title>
+         <description><![CDATA[<p><a href="http://www.woostercollective.com/brownpaper1.jpg"><img alt="brownpaper1.jpg" src="http://www.woostercollective.com/brownpaper1-thumb.jpg" width="500" height="416" /></a><br />
+</p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/O-9kaseEs8I/seen_on_the_steets_of_berlin_1.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/seen_on_the_steets_of_berlin_1.html</guid>
+         <category>Wheatpastes</category>
+         <pubDate>Thu, 21 May 2009 07:57:05 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/seen_on_the_steets_of_berlin_1.html</feedburner:origLink></item>
+            <item>
+         <title>Checkin' In With... Lister</title>
+         <description><![CDATA[<p><a href="http://www.woostercollective.com/listcheck.jpg"><img alt="listcheck.jpg" src="http://www.woostercollective.com/listcheck-thumb.jpg" width="500" height="342" /></a></p>
+
+<p>"out onto this roof the other night. i wasnt even sure that i had finished this piece but when i returned the next day i was surprised that it looked like this. the wall was so big and high that i couldn't step back at all. i am still surprised the proportions were correct."... <a href="http://www.anthonylister.com">Lister</a></p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/xKfEO6qRHLY/checkin_in_with_lister.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/checkin_in_with_lister.html</guid>
+         <category>Walls</category>
+         <pubDate>Thu, 21 May 2009 07:45:54 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/checkin_in_with_lister.html</feedburner:origLink></item>
+            <item>
+         <title>Another Great Electronic Billboard Takeover From Poster Child</title>
+         <description><![CDATA[<p><a href="http://www.woostercollective.com/pixeljes.jpg"><img alt="pixeljes.jpg" src="http://www.woostercollective.com/pixeljes-thumb.jpg" width="500" height="375" /></a></p>
+
+<div><object width="480" height="381"><param name="movie" value="http://www.dailymotion.com/swf/x99ave_stained-glass-postpixelators_creation&related=1"></param><param name="allowFullScreen" value="true"></param><param name="allowScriptAccess" value="always"></param><embed src="http://www.dailymotion.com/swf/x99ave_stained-glass-postpixelators_creation&related=1" type="application/x-shockwave-flash" width="480" height="381" allowFullScreen="true" allowScriptAccess="always"></embed></object><br /><b><a href="http://www.dailymotion.com/video/x99ave_stained-glass-postpixelators_creation">Stained Glass Post-Pixelators</a></b><br /><i>Uploaded by <a href="http://www.dailymotion.com/posterchild">posterchild</a>. - <a href="http://www.dailymotion.com/channel/creation">Independent web videos.</a></i></div>
+
+<p>More from Poster Child <a href="http://www.bladediary.com/">here</a>. </p>]]></description>
+         <link>http://feedproxy.google.com/~r/wooster/~3/Rz_yYr1lijQ/another_great_electronic_billboard_takeo.html</link>
+         <guid isPermaLink="false">http://www.woostercollective.com/2009/05/another_great_electronic_billboard_takeo.html</guid>
+         <category>Billboard Liberations</category>
+         <pubDate>Wed, 20 May 2009 07:59:04 -0500</pubDate>
+      <feedburner:origLink>http://www.woostercollective.com/2009/05/another_great_electronic_billboard_takeo.html</feedburner:origLink></item>
+      
+   </channel>
+</rss>

data/spec/spec_helper.rb

@@ -0,0 +1,28 @@
+require 'rubygems'
+require 'mocha'
+require 'spec'
+
+require File.join(File.dirname(__FILE__), %w[.. lib feedtosis])
+
+Spec::Runner.configure do |config|
+  config.mock_with(:mocha)
+end
+
+# Returns the xml fixture identified by +name+.
+def xml_fixture(name)
+  File.read(File.join(File.dirname(__FILE__), 'fixtures', 'xml', "#{name}.xml"))
+end
+
+def http_header(name)
+  File.read(File.join(File.dirname(__FILE__), 'fixtures', 'http_headers', "#{name}.txt"))
+end
+
+shared_examples_for "all backends" do
+  it "should respond to #get" do
+    @backend.should respond_to(:get)
+  end
+  
+  it "should respond to #set" do
+    @backend.should respond_to(:set)
+  end  
+end

metadata

@@ -0,0 +1,118 @@
+--- !ruby/object:Gem::Specification 
+name: jsl-feedtosis
+version: !ruby/object:Gem::Version 
+  version: 0.0.2.3
+platform: ruby
+authors: 
+- Justin Leitgeb
+autorequire: 
+bindir: bin
+cert_chain: []
+
+date: 2009-05-22 00:00:00 -07:00
+default_executable: 
+dependencies: 
+- !ruby/object:Gem::Dependency 
+  name: taf2-curb
+  type: :runtime
+  version_requirement: 
+  version_requirements: !ruby/object:Gem::Requirement 
+    requirements: 
+    - - ">="
+      - !ruby/object:Gem::Version 
+        version: "0"
+    version: 
+- !ruby/object:Gem::Dependency 
+  name: jsl-moneta
+  type: :runtime
+  version_requirement: 
+  version_requirements: !ruby/object:Gem::Requirement 
+    requirements: 
+    - - ">="
+      - !ruby/object:Gem::Version 
+        version: "0"
+    version: 
+- !ruby/object:Gem::Dependency 
+  name: jsl-http_headers
+  type: :runtime
+  version_requirement: 
+  version_requirements: !ruby/object:Gem::Requirement 
+    requirements: 
+    - - ">="
+      - !ruby/object:Gem::Version 
+        version: "0"
+    version: 
+- !ruby/object:Gem::Dependency 
+  name: namelessjon-feed_me
+  type: :runtime
+  version_requirement: 
+  version_requirements: !ruby/object:Gem::Requirement 
+    requirements: 
+    - - ">="
+      - !ruby/object:Gem::Version 
+        version: "0"
+    version: 
+description: Feedtosis finds new information in feeds quickly using smart fetching and matching of previously read entries
+email: justin@phq.org
+executables: []
+
+extensions: []
+
+extra_rdoc_files: 
+- README.rdoc
+files: 
+- lib/extensions/core/array.rb
+- lib/extensions/core/hash.rb
+- lib/extensions/feed_normalizer/feed_instance_methods.rb
+- lib/feedtosis/result.rb
+- lib/feedtosis/client.rb
+- lib/feedtosis.rb
+- LICENSE
+- feedtosis.gemspec
+- Rakefile
+- README.rdoc
+- spec/extensions/feed_normalizer/feed_instance_methods_spec.rb
+- spec/fixtures/http_headers/wooster.txt
+- spec/fixtures/xml/older_wooster.xml
+- spec/fixtures/xml/wooster.xml
+- spec/feedtosis/client_spec.rb
+- spec/feedtosis_spec.rb
+- spec/feedtosis/result_spec.rb
+- spec/spec_helper.rb
+has_rdoc: true
+homepage: http://github.com/jsl/feedtosis
+post_install_message: 
+rdoc_options: 
+- --charset=UTF-8
+- --title
+- Feedtosis
+- --main
+- README.rdoc
+- --line-numbers
+- --inline-source
+require_paths: 
+- lib
+required_ruby_version: !ruby/object:Gem::Requirement 
+  requirements: 
+  - - ">="
+    - !ruby/object:Gem::Version 
+      version: "0"
+  version: 
+required_rubygems_version: !ruby/object:Gem::Requirement 
+  requirements: 
+  - - ">="
+    - !ruby/object:Gem::Version 
+      version: "0"
+  version: 
+requirements: []
+
+rubyforge_project: 
+rubygems_version: 1.2.0
+signing_key: 
+specification_version: 2
+summary: Retrieves feeds using conditional GET and marks entries that you haven't seen before
+test_files: 
+- spec/feedtosis_spec.rb
+- spec/spec_helper.rb
+- spec/feedtosis/client_spec.rb
+- spec/feedtosis/result_spec.rb