csexton-twitter_archive 0.0.1

data/History

@@ -0,0 +1,4 @@
+== 0.0.1 2008-12-28
+
+* 1 major enhancement:
+  * Initial release

data/LICENSE

@@ -0,0 +1,22 @@
+(The MIT License)
+
+Copyright (c) 2009 Christopher Sexton
+
+Permission is hereby granted, free of charge, to any person obtaining
+a copy of this software and associated documentation files (the
+'Software'), to deal in the Software without restriction, including
+without limitation the rights to use, copy, modify, merge, publish,
+distribute, sublicense, and/or sell copies of the Software, and to
+permit persons to whom the Software is furnished to do so, subject to
+the following conditions:
+
+The above copyright notice and this permission notice shall be
+included in all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED 'AS IS', WITHOUT WARRANTY OF ANY KIND,
+EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
+MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT.
+IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY
+CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT,
+TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE
+SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

data/Manifest

@@ -0,0 +1,29 @@
+bin/twitter_archive
+CHANGELOG
+config/test.yml
+lib/twitter_archive/backends/blogger/base.rb
+lib/twitter_archive/backends/blogger/blogger.rb
+lib/twitter_archive/backends/blogger/post_body.html.erb
+lib/twitter_archive/backends/blogger/README
+lib/twitter_archive/backends/blogger_archive.rb
+lib/twitter_archive/backends/yaml_archive.rb
+lib/twitter_archive/base.rb
+lib/twitter_archive/runner.rb
+lib/twitter_archive/version.rb
+lib/twitter_archive.rb
+LICENSE
+Manifest
+Rakefile
+README.rdoc
+script/console
+script/destroy
+script/generate
+spec/backends/blogger_archive_spec.rb
+spec/backends/yaml_archive_spec.rb
+spec/fixtures/blogger_authenticate_response.yml
+spec/fixtures/twitter_response.yml
+spec/spec.opts
+spec/spec_helper.rb
+spec/twitter_archive_spec.rb
+tasks/rspec.rake
+twitter_archive.gemspec

data/README.rdoc

@@ -0,0 +1,91 @@
+= twitter_archive
+
+* http://github.com/csexton/twitter_archive
+
+== DESCRIPTION:
+
+An archiving utility for Twitter.  
+
+I use my blog as a way to chronicle the things in my life, and I noticed with the introduction of Twitter into my normal routine I found that I was not blogging as much.  What I wanted to be able to do is incorporate the twitters into my blog timeline. And while I was able to do some JavaScript trickery to display the twitters on my blog, they were not *in* the blog.  Now if I ever want to go back and look up exactly what day my son got his second tooth, I can do so by digging through the blog archives. 
+
+twitter_archive supports multiple backends.  I use Blogger, so I have support for that, as well as a very simple yaml archive backend that was intended for testing, but would provide a pretty good (and easy to parse) plan text backup of Twitter.
+
+
+== FEATURES/PROBLEMS:
+
+Archive your Twitter messages.
+
+== SYNOPSIS:
+
+=== YAML ARCHIVE BACKEND:
+
+This requires a config file placed in the user's home directory:
+
+Example ~/twitter_archive.yml for use with the yaml archive backend:
+
+	accounts: 
+	- name: fuzzymonk
+	- name: amperecat
+	- name: jnunemaker
+	yaml_file: /home/your-user-name/twitter_archive/posts.yml
+
+You can enter mutiple twitter accounts, and it will simply interate through them. You should know that twitter_archive will make seperate requests for each account, so unles you have been {IP whitelisted}[http://twitter.com/help/request_whitelisting] by Twitter you can hit their rate limits pretty easily.
+
+=== BLOGGER ARCHIVE BACKEND:
+
+This requires a config file placed in the user's home directory:
+
+Example ~/twitter_archive.yml for use with the Blogger archive backend:
+
+	accounts: 
+	- name: fuzzymonk
+	blogger_user: blogger-user # Normally your gmail address
+	blogger_pass: blogger-password 
+	blogger_title: Twitter # The title you want for you blog post
+	blogger_id: 1234567891234567890 # 
+	backend: blogger
+
+To find your Blogger Blog ID refer to the {Blogger Help Center}[http://help.blogger.com/bin/answer.py?hl=en&answer=42191]
+
+twitter_archive was intended to be run as a cron job, prolly once a day. It will post in a digest format, collecting all the twitters into one blog post. 
+
+== INSTALL:
+
+Get the gem:
+
+	sudo gem install twitter_archive
+
+Edit crontab to add twitter_archive:
+
+	$ crontab -e
+
+Then Add a line like the following:
+
+	0 0  *    *   *    twitter_archive > /home/your-user-name/logs/twitter_archive.log 
+
+This will run everyday at midnight. You can leave off the "> /home/.../twitter_archive.log" if you don't want to keep logs.
+
+== LICENSE:
+
+(The MIT License)
+
+Copyright (c) 2009 Christopher Sexton
+
+Permission is hereby granted, free of charge, to any person obtaining
+a copy of this software and associated documentation files (the
+'Software'), to deal in the Software without restriction, including
+without limitation the rights to use, copy, modify, merge, publish,
+distribute, sublicense, and/or sell copies of the Software, and to
+permit persons to whom the Software is furnished to do so, subject to
+the following conditions:
+
+The above copyright notice and this permission notice shall be
+included in all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED 'AS IS', WITHOUT WARRANTY OF ANY KIND,
+EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
+MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT.
+IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY
+CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT,
+TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE
+SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

data/Rakefile

@@ -0,0 +1,30 @@
+ProjectName = 'twitter_archive'
+ 
+require 'rubygems'
+require 'rake'
+require 'echoe'
+require 'spec/rake/spectask'
+require "lib/#{ProjectName}/version"
+ 
+Echoe.new(ProjectName, TwitterArchive::VERSION) do |p|
+  p.description     = "Twitter archive utility"
+  p.url             = "http://github.com/csexton/twitter_archive"
+  p.author          = "Christohper Sexton"
+  p.email           = "csexton@gmail.com"
+  p.extra_deps      = [['twitter', '>= 0.4'], ['hpricot', '>= 0.6']]
+  p.need_tar_gz     = false
+  p.docs_host       = "http://github.com/csexton/twitter_archive/wikis"
+end
+ 
+desc 'Preps the gem for a new release'
+task :prepare do
+  %w[manifest build_gemspec].each do |task|
+    Rake::Task[task].invoke
+  end
+end
+ 
+Dir['tasks/**/*.rake'].each { |t| load t }
+
+Rake::Task[:default].prerequisites.clear
+task :default => :spec
+

data/bin/twitter_archive

@@ -0,0 +1,4 @@
+#!/usr/bin/env ruby
+require "#{File.dirname(__FILE__)}/../lib/twitter_archive"
+
+TwitterArchive::Runner::runner

data/config/test.yml

@@ -0,0 +1,5 @@
+--- 
+accounts: 
+- name: fuzzymonk
+- name: jnunemaker
+backend: yaml

data/lib/twitter_archive/backends/blogger/README

@@ -0,0 +1,31 @@
+This was taken from GDataRuby Gem by Dion Almaer. 
+
+Mostly because it was not current on rubyforge, and I could get more recent source on github.
+
+http://gdata-ruby.rubyforge.net
+
+LICENSE
+
+(The MIT License)
+
+Copyright (c) 2007 FIX
+
+Permission is hereby granted, free of charge, to any person obtaining
+a copy of this software and associated documentation files (the
+'Software'), to deal in the Software without restriction, including
+without limitation the rights to use, copy, modify, merge, publish,
+distribute, sublicense, and/or sell copies of the Software, and to
+permit persons to whom the Software is furnished to do so, subject to
+the following conditions:
+
+The above copyright notice and this permission notice shall be
+included in all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED 'AS IS', WITHOUT WARRANTY OF ANY KIND,
+EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
+MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT.
+IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY
+CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT,
+TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE
+SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
+

data/lib/twitter_archive/backends/blogger/base.rb

@@ -0,0 +1,76 @@
+require 'net/http'
+require 'net/https'
+require 'uri'
+require 'rubygems'
+require 'hpricot'
+
+#
+# Make it east to use some of the convenience methods using https
+#
+module Net
+  class HTTPS < HTTP
+    def initialize(address, port = nil)
+      super(address, port)
+      self.use_ssl = true
+    end
+  end
+end
+
+module GData
+  GOOGLE_LOGIN_URL = URI.parse('https://www.google.com/accounts/ClientLogin')
+
+  class Base
+    
+    attr_reader :service, :source, :url
+    
+    def initialize(service, source, url)
+      @service = service
+      @source = source
+      @url = url
+    end
+    
+    def authenticate(email, password)
+      $VERBOSE = nil
+      response = Net::HTTPS.post_form(GOOGLE_LOGIN_URL,
+        {'Email'   => email,
+         'Passwd'  => password,
+         'source'  => source,
+         'service' => service })
+
+      response.error! unless response.kind_of? Net::HTTPSuccess
+
+      @headers = {
+       'Authorization' => "GoogleLogin auth=#{response.body.split(/=/).last}",
+       'GData-Version' => '2',
+       'Content-Type'  => 'application/atom+xml'
+      }
+    end
+
+    def request(path)
+      response, data = get(path)
+      data
+    end
+
+    def get(path)
+      response, data = http.get(path, @headers)
+    end
+
+    def post(path, entry)
+      http.post(path, entry, @headers)
+    end
+
+    def put(path, entry)
+      h = @headers
+      h['X-HTTP-Method-Override'] = 'PUT' # just to be nice, add the method override
+  
+      http.put(path, entry, h)
+    end
+
+    def http
+      conn = Net::HTTP.new(url, 80)
+      #conn.set_debug_output $stderr
+      conn
+    end
+
+  end
+end

data/lib/twitter_archive/backends/blogger/blogger.rb

@@ -0,0 +1,72 @@
+require File.dirname(__FILE__) + '/base'
+require 'builder'
+
+module GData
+
+  class Blogger < GData::Base
+
+    def initialize(blog_id, entry_id=nil)
+      @blog_id = blog_id
+      @entry_id = entry_id
+      super 'blogger', 'gdata-ruby', 'www.blogger.com'
+    end
+
+    def feed
+      request "/feeds/#{@blog_id}/posts/default"
+    end
+
+    def list_blogs(profile_id)
+      request "/feeds/#{profile_id}/blogs"
+    end
+
+    def entry
+      @entry ||= Hpricot(request("/feeds/#{@blog_id}/posts/default/#{@entry_id}"))
+    end
+
+    def enclosure
+      entry.search('//link[@rel="enclosure"]')
+    end
+
+    def enclosure?
+      enclosure.any?
+    end
+  
+    def add_enclosure(enclosure_url, enclosure_length)
+      raise "An enclosure has already been added to this entry" if enclosure?
+      # todo(stevejenson): replace with builder
+      entry.search('//entry').append(%Q{<link rel="enclosure" type="audio/mpeg" title="MP3" href="#{enclosure_url}" length="#{enclosure_length}" />})
+      save_entry
+    end
+
+    def remove_enclosure
+      if enclosure?
+        enclosure.remove
+        save_entry
+      end
+    end
+
+    def save_entry
+      path = "/feeds/#{@blog_id}/posts/default/#{@entry_id}"
+  
+      put(path, entry.to_s)
+    end
+
+    # Creates a new entry with the given title and body
+    def entry(title, body)
+      x = Builder::XmlMarkup.new :indent => 2
+      @entry = x.entry 'xmlns' => 'http://www.w3.org/2005/Atom' do
+        x.title title, 'type' => 'text'
+        x.content 'type' => 'xhtml' do
+          x.div 'xmlns' => 'http://www.w3.org/1999/xhtml' do
+            x << body
+          end
+        end
+      end
+      
+      path = "/feeds/#{@blog_id}/posts/default"
+      post(path, @entry)
+    end
+
+  end
+
+end

data/lib/twitter_archive/backends/blogger/post_body.html.erb

@@ -0,0 +1,32 @@
+<%
+  # time format
+%>  
+<table class="twitter">
+<tbody class="twitter">
+  <% results.each do |result| %>
+  <tr class="twitter-status u-<%= result['from_user'] %>">
+      <td class="">
+        <a href="http://twitter.com/<%= result['from_user'] %>" class="url">
+          <img alt="Tom Dougherty" class="twitter-avatar" height="48" src="<%= result['profile_image_url'] %>" width="48" />
+        </a>
+      </td>
+      <td class="twitter-body">
+        <div>
+          <strong>
+          <a href="http://twitter.com/<%= result['from_user'] %>" class="twitter-user" title="<%= result['from_user'] %>">
+            <%= result['from_user'] %>
+          </a>
+          </strong> 
+          <span class="twitter-text">
+            <%= result['text'] %>
+          </span> 
+          <span class="twitter-date" style="font-style: italic; font-size:smaller;">
+            <%= format_time(result['created_at']) %>
+          </span> 
+        </div>
+      </td>
+    </tr>
+  <% end %>
+  </tbody>
+
+</table>

data/lib/twitter_archive/backends/blogger_archive.rb

@@ -0,0 +1,31 @@
+require 'erb'
+require File.dirname(__FILE__) + '/blogger/blogger'
+
+module TwitterArchive
+  module Backends
+    class BloggerArchive
+      def archive(twitter_results, opts=nil)
+        if twitter_results.length > 0
+          blogger = GData::Blogger.new(opts['blogger_id'])
+          blogger.authenticate(opts['blogger_user'], opts['blogger_pass'])
+          blogger.entry(opts['blogger_title'] || 'Twitter', format_post(twitter_results))
+          "Posting to blogger id #{opts['blogger_id']}, user #{opts['blogger_user']}"
+        else
+          "Nothing to post to blogger"
+        end
+      end
+
+      def format_post(results)
+        results 
+        template = ERB.new(File.open(File.dirname(__FILE__) + '/blogger/post_body.html.erb') {|f| f.read})
+        template.result(binding)
+      end
+
+      def format_time (date_str)
+        time = Time.gm(*ParseDate.parsedate(date_str)[0..4])
+        time.strftime("%m/%d/%Y at %I:%M%p")
+      end
+    end
+  end
+end
+

data/lib/twitter_archive/backends/yaml_archive.rb

@@ -0,0 +1,9 @@
+module TwitterArchive
+  module Backends
+    class YamlArchive
+      def archive(results, opts=nil)
+        results.to_yaml
+      end
+    end
+  end
+end

data/lib/twitter_archive/base.rb

@@ -0,0 +1,53 @@
+require 'parsedate'
+Dir.glob(File.dirname(__FILE__)+ '/backends/*.rb').each {|f| require f }
+
+module TwitterArchive
+
+  class Base
+    attr_accessor :config_file, :config
+
+    def initialize(config_file = nil)
+      @config_file = config_file || ENV['HOME'] + '/.twitter_archive.yml'
+    end
+
+    def get_latest
+      all_results = []
+      last_max_id = 0
+      @config['accounts'].each do |account|
+        twitter_response = fetch_from_account(account['name'], config['last_max_id'] || 0)
+        config['current_twitter_account'] = account['name']
+        puts "Collected #{twitter_response['results'].length} tweets from #{account['name']}"
+
+        all_results = all_results + twitter_response['results']
+        last_max_id =  twitter_response['max_id']
+      end
+
+      config['last_max_id'] = last_max_id
+
+      all_results.sort! {|a, b| b['created_at'] <=> a['created_at'] }
+
+      backend = load_backend(config['backend'])
+
+      backend.archive(all_results, config)
+    end
+
+    def fetch_from_account(name, last_max_id=0)
+      Twitter::Search.new.from(name).since(last_max_id).fetch
+    end
+
+    def load_config
+      @config = YAML::load_file(@config_file)
+    end
+
+    def save_config
+      File.open(@config_file, 'w') do |out|
+        YAML.dump(config, out)
+      end
+    end
+
+    def load_backend(backend_name)
+      eval "TwitterArchive::Backends::#{backend_name.capitalize}Archive.new"
+    end
+    
+  end
+end

data/lib/twitter_archive/runner.rb

@@ -0,0 +1,12 @@
+module TwitterArchive
+  class Runner
+    def self.runner
+      puts "Running Twitter Archiver"
+
+      ta = TwitterArchive::Base.new
+      ta.load_config
+      puts ta.get_latest
+      ta.save_config
+    end
+  end
+end

data/lib/twitter_archive/version.rb

@@ -0,0 +1,3 @@
+module TwitterArchive
+  VERSION = '0.0.1'
+end

data/lib/twitter_archive.rb

@@ -0,0 +1,13 @@
+#$:.unshift(File.dirname(__FILE__)) unless
+#  $:.include?(File.dirname(__FILE__)) || $:.include?(File.expand_path(File.dirname(__FILE__)))
+
+require 'yaml'
+require 'rubygems'
+require 'twitter'
+
+$:.unshift(File.dirname(__FILE__))
+require 'twitter_archive/base'
+require 'twitter_archive/runner'
+require 'twitter_archive/version'
+
+module TwitterArchive; end

data/script/console

@@ -0,0 +1,10 @@
+#!/usr/bin/env ruby
+# File: script/console
+irb = RUBY_PLATFORM =~ /(:?mswin|mingw)/ ? 'irb.bat' : 'irb'
+
+libs =  " -r irb/completion"
+# Perhaps use a console_lib to store any extra methods I may want available in the cosole
+# libs << " -r #{File.dirname(__FILE__) + '/../lib/console_lib/console_logger.rb'}"
+libs <<  " -r #{File.dirname(__FILE__) + '/../lib/twitter_archive.rb'}"
+puts "Loading twitter_archive gem"
+exec "#{irb} #{libs} --simple-prompt"

data/script/destroy

@@ -0,0 +1,14 @@
+#!/usr/bin/env ruby
+APP_ROOT = File.expand_path(File.join(File.dirname(__FILE__), '..'))
+
+begin
+  require 'rubigen'
+rescue LoadError
+  require 'rubygems'
+  require 'rubigen'
+end
+require 'rubigen/scripts/destroy'
+
+ARGV.shift if ['--help', '-h'].include?(ARGV[0])
+RubiGen::Base.use_component_sources! [:rubygems, :newgem, :newgem_theme, :test_unit]
+RubiGen::Scripts::Destroy.new.run(ARGV)

data/script/generate

@@ -0,0 +1,14 @@
+#!/usr/bin/env ruby
+APP_ROOT = File.expand_path(File.join(File.dirname(__FILE__), '..'))
+
+begin
+  require 'rubigen'
+rescue LoadError
+  require 'rubygems'
+  require 'rubigen'
+end
+require 'rubigen/scripts/generate'
+
+ARGV.shift if ['--help', '-h'].include?(ARGV[0])
+RubiGen::Base.use_component_sources! [:rubygems, :newgem, :newgem_theme, :test_unit]
+RubiGen::Scripts::Generate.new.run(ARGV)

data/spec/backends/blogger_archive_spec.rb

@@ -0,0 +1,42 @@
+require File.dirname(__FILE__) + '/../spec_helper.rb'
+require File.dirname(__FILE__) + '/../../lib/twitter_archive/backends/blogger_archive.rb'
+
+describe TwitterArchive::Backends::BloggerArchive do
+  before(:all) do 
+      puts " WARNING Not testing with live blogger, set TEST_BLOGGER to enable" unless ENV['TEST_BLOGGER']
+  end
+
+  before(:each) do
+    @ba = TwitterArchive::Backends::BloggerArchive.new
+    @config = YAML::load_file(ENV['HOME'] + '/.twitter_archive.yml')
+    @twitter_response = YAML::load_file File.dirname(__FILE__) +'/../fixtures/twitter_response.yml'
+
+    if(ENV['TEST_BLOGGER'])
+      Net::HTTPS.stub!(:post_form).and_return(YAML::load_file(
+        File.dirname(__FILE__) + '/../../fixtures/blogger_authenticate_response.yml'))
+      GData
+    end
+
+  end
+
+  it "should create an instance" do
+    @ba.should be_an_instance_of(TwitterArchive::Backends::BloggerArchive)
+  end
+
+  it "should test post to blogger" do
+    @config['blogger_title'] = "Testing twitter_archive"
+    @ba.archive(@twitter_response['results'], @config)
+  end
+
+  it "should format html from the tweets" do
+    body = @ba.format_post(@twitter_response['results'])
+
+    body.should_not be_nil
+  end
+
+  it "should format time like google" do
+    @ba.format_time("Sun, 28 Dec 2008 23:38:46 +0000").should eql "12/28/2008 at 11:38PM"
+  end
+
+  
+end

data/spec/backends/yaml_archive_spec.rb

@@ -0,0 +1,13 @@
+require File.dirname(__FILE__) + '/../spec_helper.rb'
+require File.dirname(__FILE__) + '/../../lib/twitter_archive/backends/yaml_archive.rb'
+
+describe TwitterArchive::Backends::YamlArchive do
+  before(:each) do
+    @ya = TwitterArchive::Backends::YamlArchive.new
+  end
+
+  it "should create an instance" do
+    @ya.should be_an_instance_of(TwitterArchive::Backends::YamlArchive)
+  end
+  
+end

data/spec/fixtures/blogger_authenticate_response.yml

@@ -0,0 +1,30 @@
+--- !ruby/object:Net::HTTPOK 
+body: |
+  SID=DQAAAH4AAAAK5SScZgxeJS9BP03rjNP0EeUm0X8jvFKb6vXpRBMG-4aIkON6mbjjlqvpip7vxS8H_9_bNonFN-6PDEw8-xuTtszBogb7qRe4-gzhMc7dDX65VHEw-QmCmyYr5gGvWUP5x_5E0zh-XWef-viVNvbnCx7agwI-CCvBwAzl7fQQVw
+  LSID=DQAAAIAAAACZDlUEEuBRdQt9oEgJI2rjL9PJUNLnoDPTQA0duvmtRf3cxhh5DDcPXpfGI6tF-2K7-8ZHubK_4FiShCGhoKTE6d4vzTs0SWz5Itk8MpF_qZoye7AwCb3YVG4tgjALpI0RNl8SEuWTg2Jtiqn2So2mlxzivHeOv8rAE-s01p1qHA
+  Auth=DQAAAH8AAACZDlUEEuBRdQt9oEgJI2rjL9PJUNLnoDPTQA0duvmtRf3cxhh5DDcPXpfGI6tF-2J0oYw6koUPpBpn3QOJoJ3ps7lCYCqwPeCc64e265o4UyYgEYFivgbDrI7akWGSkmVvO2hFw6NGxZyGx6-MrKSKFph4MgORs57vPRnrj2UjJw
+
+body_exist: true
+code: "200"
+header: 
+  cache-control: 
+  - no-cache, no-store
+  x-content-type-options: 
+  - nosniff
+  expires: 
+  - Mon, 01-Jan-1990 00:00:00 GMT
+  date: 
+  - Wed, 31 Dec 2008 20:50:14 GMT
+  content-type: 
+  - text/plain
+  server: 
+  - GFE/1.3
+  content-length: 
+  - "563"
+  pragma: 
+  - no-cache
+http_version: "1.1"
+message: OK
+read: true
+socket: 
+

data/spec/fixtures/twitter_response.yml

@@ -0,0 +1,132 @@
+--- 
+max_id: 1083275701
+since_id: 0
+results: 
+- text: "@beejpowers glad it was working for you!"
+  from_user: fuzzymonk
+  to_user: beejpowers
+  to_user_id: 2203390
+  id: 1083002747
+  iso_language_code: en
+  from_user_id: 44397
+  created_at: Sun, 28 Dec 2008 23:38:46 +0000
+  profile_image_url: http://s3.amazonaws.com/twitter_production/profile_images/30300852/TaylorandMcLauren-jabber_normal.jpg
+- text: Testing my twitter app.
+  from_user: fuzzymonk
+  to_user_id: 
+  id: 1082726875
+  iso_language_code: en
+  from_user_id: 44397
+  created_at: Sun, 28 Dec 2008 20:14:53 +0000
+  profile_image_url: http://s3.amazonaws.com/twitter_production/profile_images/30300852/TaylorandMcLauren-jabber_normal.jpg
+- text: Chicken nugget picnic FTW!
+  from_user: fuzzymonk
+  to_user_id: 
+  id: 1082568072
+  iso_language_code: de
+  from_user_id: 44397
+  created_at: Sun, 28 Dec 2008 18:12:25 +0000
+  profile_image_url: http://s3.amazonaws.com/twitter_production/profile_images/30300852/TaylorandMcLauren-jabber_normal.jpg
+- text: Riding trikes.
+  from_user: fuzzymonk
+  to_user_id: 
+  id: 1082523321
+  iso_language_code: nl
+  from_user_id: 44397
+  created_at: Sun, 28 Dec 2008 17:36:59 +0000
+  profile_image_url: http://s3.amazonaws.com/twitter_production/profile_images/30300852/TaylorandMcLauren-jabber_normal.jpg
+- text: Nursery duty. 9:5 helper to toddler ratio.  Why did we wake up so early?
+  from_user: fuzzymonk
+  to_user_id: 
+  id: 1082306470
+  iso_language_code: en
+  from_user_id: 44397
+  created_at: Sun, 28 Dec 2008 14:24:12 +0000
+  profile_image_url: http://s3.amazonaws.com/twitter_production/profile_images/30300852/TaylorandMcLauren-jabber_normal.jpg
+- text: "@beejpowers I need to go back to work to recover from the holiday."
+  from_user: fuzzymonk
+  to_user: beejpowers
+  to_user_id: 2203390
+  id: 1081719755
+  iso_language_code: en
+  from_user_id: 44397
+  created_at: Sun, 28 Dec 2008 03:00:30 +0000
+  profile_image_url: http://s3.amazonaws.com/twitter_production/profile_images/30300852/TaylorandMcLauren-jabber_normal.jpg
+- text: Where can I get one? http://tinyurl.com/7dxzrv
+  from_user: fuzzymonk
+  to_user_id: 
+  id: 1081473926
+  iso_language_code: en
+  from_user_id: 44397
+  created_at: Sat, 27 Dec 2008 23:35:21 +0000
+  profile_image_url: http://s3.amazonaws.com/twitter_production/profile_images/30300852/TaylorandMcLauren-jabber_normal.jpg
+- text: Don't like pandemonium. Go away
+  from_user: fuzzymonk
+  to_user_id: 
+  id: 1081233677
+  iso_language_code: en
+  from_user_id: 44397
+  created_at: Sat, 27 Dec 2008 20:08:54 +0000
+  profile_image_url: http://s3.amazonaws.com/twitter_production/profile_images/30300852/TaylorandMcLauren-jabber_normal.jpg
+- text: "[dotfiles] http://is.gd/dBpg Christopher Sexton - Removing the os specific scripts"
+  from_user: fuzzymonk
+  to_user_id: 
+  id: 1079851223
+  iso_language_code: en
+  from_user_id: 44397
+  created_at: Fri, 26 Dec 2008 21:18:11 +0000
+  profile_image_url: http://s3.amazonaws.com/twitter_production/profile_images/30300852/TaylorandMcLauren-jabber_normal.jpg
+- text: "[dotfiles] http://is.gd/dBpf Christopher Sexton - Auto linking files in home/"
+  from_user: fuzzymonk
+  to_user_id: 
+  id: 1079851212
+  iso_language_code: en
+  from_user_id: 44397
+  created_at: Fri, 26 Dec 2008 21:18:10 +0000
+  profile_image_url: http://s3.amazonaws.com/twitter_production/profile_images/30300852/TaylorandMcLauren-jabber_normal.jpg
+- text: "[dotfiles] http://is.gd/dBph Christopher Sexton - Added colors and fixed link if"
+  from_user: fuzzymonk
+  to_user_id: 
+  id: 1079851233
+  iso_language_code: en
+  from_user_id: 44397
+  created_at: Fri, 26 Dec 2008 21:18:09 +0000
+  profile_image_url: http://s3.amazonaws.com/twitter_production/profile_images/30300852/TaylorandMcLauren-jabber_normal.jpg
+- text: "[dotfiles] http://is.gd/dAcc Christopher Sexton - Added check if the file exists before trying to rename it."
+  from_user: fuzzymonk
+  to_user_id: 
+  id: 1079644342
+  iso_language_code: en
+  from_user_id: 44397
+  created_at: Fri, 26 Dec 2008 18:31:37 +0000
+  profile_image_url: http://s3.amazonaws.com/twitter_production/profile_images/30300852/TaylorandMcLauren-jabber_normal.jpg
+- text: "'Nene' is a derivative of 'Neal'"
+  from_user: fuzzymonk
+  to_user_id: 
+  id: 1079585237
+  iso_language_code: it
+  from_user_id: 44397
+  created_at: Fri, 26 Dec 2008 17:45:34 +0000
+  profile_image_url: http://s3.amazonaws.com/twitter_production/profile_images/30300852/TaylorandMcLauren-jabber_normal.jpg
+- text: "[cookbook] http://is.gd/dzKL Christopher Sexton - Fixed link_to in application"
+  from_user: fuzzymonk
+  to_user_id: 
+  id: 1079579679
+  iso_language_code: en
+  from_user_id: 44397
+  created_at: Fri, 26 Dec 2008 17:41:05 +0000
+  profile_image_url: http://s3.amazonaws.com/twitter_production/profile_images/30300852/TaylorandMcLauren-jabber_normal.jpg
+- text: "[cookbook] http://is.gd/dzKJ Christopher Sexton - Freezing to rails 2.1.1"
+  from_user: fuzzymonk
+  to_user_id: 
+  id: 1079579667
+  iso_language_code: en
+  from_user_id: 44397
+  created_at: Fri, 26 Dec 2008 17:41:03 +0000
+  profile_image_url: http://s3.amazonaws.com/twitter_production/profile_images/30300852/TaylorandMcLauren-jabber_normal.jpg
+results_per_page: 15
+refresh_url: ?since_id=1083275701&q=from%3Afuzzymonk
+next_page: ?page=2&max_id=1083275701&q=from%3Afuzzymonk
+completed_in: 0.01725
+query: from%3Afuzzymonk
+page: 1

data/spec/spec.opts

@@ -0,0 +1,4 @@
+--colour
+--format specdoc
+--loadby mtime
+--reverse

data/spec/spec_helper.rb

@@ -0,0 +1,10 @@
+begin
+  require 'spec'
+rescue LoadError
+  require 'rubygems'
+  gem 'rspec'
+  require 'spec'
+end
+
+$:.unshift(File.dirname(__FILE__) + '/../lib')
+require 'twitter_archive'

data/spec/twitter_archive_spec.rb

@@ -0,0 +1,53 @@
+require File.dirname(__FILE__) + '/spec_helper.rb'
+
+describe TwitterArchive::Base do
+  before(:each) do
+    @ta = TwitterArchive::Base.new
+    @ta.stub!(:fetch_from_account).and_return(YAML::load_file(
+      File.dirname(__FILE__) + '/fixtures/twitter_response.yml'))
+    @ta.stub!(:save_config).and_return(true)
+    @ta.config_file = File.dirname(__FILE__) + '/../config/test.yml'
+    # TODO stubb out backend
+  end
+
+  it "should create an instance" do
+    @ta.should be_an_instance_of(TwitterArchive::Base)
+  end
+  
+  it "should load the yaml file" do 
+    @ta.load_config
+    @ta.config['backend'].should eql('yaml')
+    @ta.config['accounts'][0]['name'].should eql('fuzzymonk')
+  end
+
+  it "should stub the fetch method" do
+    @ta.fetch_from_account['max_id'].should eql(1083275701)
+  end
+
+  it "should stub the save_config" do 
+    @ta.load_config
+    @ta.config['joe'] = "test"
+    @ta.save_config
+
+    @ta.load_config
+    @ta.config['joe'].should be_nil
+  end
+
+  it "should update the last_max_id in the config file" do
+    @ta.load_config
+    @ta.get_latest
+    @ta.config['last_max_id'].should_not eql(@ta.load_config['last_max_id'])
+  end
+
+  it "should load the yaml backend dynamically" do
+    @ta.load_backend('yaml').should be_an_instance_of TwitterArchive::Backends::YamlArchive
+  end
+
+  it "should raise an error when loading an invalid backend" do
+   lambda do 
+     @ta.load_backend('poopie')
+     @processor.process(StringIO.new("z"*31))
+   end.should raise_error(NameError)
+    
+  end
+end

data/tasks/rspec.rake

@@ -0,0 +1,21 @@
+begin
+  require 'spec'
+rescue LoadError
+  require 'rubygems'
+  require 'spec'
+end
+begin
+  require 'spec/rake/spectask'
+rescue LoadError
+  puts <<-EOS
+To use rspec for testing you must install rspec gem:
+    gem install rspec
+EOS
+  exit(0)
+end
+
+desc "Run the specs under spec/models"
+Spec::Rake::SpecTask.new do |t|
+  t.spec_opts = ['--options', "spec/spec.opts"]
+  t.spec_files = FileList['spec/**/*_spec.rb']
+end

data/twitter_archive.gemspec

@@ -0,0 +1,42 @@
+# -*- encoding: utf-8 -*-
+
+Gem::Specification.new do |s|
+  s.name = %q{twitter_archive}
+  s.version = "0.0.1"
+
+  s.required_rubygems_version = Gem::Requirement.new(">= 1.2") if s.respond_to? :required_rubygems_version=
+  s.authors = ["Christohper Sexton"]
+  s.date = %q{2009-01-02}
+  s.default_executable = %q{twitter_archive}
+  s.description = %q{Twitter archive utility}
+  s.email = %q{csexton@gmail.com}
+  s.executables = ["twitter_archive"]
+  s.extra_rdoc_files = ["bin/twitter_archive", "lib/twitter_archive/backends/blogger/base.rb", "lib/twitter_archive/backends/blogger/blogger.rb", "lib/twitter_archive/backends/blogger/post_body.html.erb", "lib/twitter_archive/backends/blogger/README", "lib/twitter_archive/backends/blogger_archive.rb", "lib/twitter_archive/backends/yaml_archive.rb", "lib/twitter_archive/base.rb", "lib/twitter_archive/runner.rb", "lib/twitter_archive/version.rb", "lib/twitter_archive.rb", "LICENSE", "README.rdoc", "tasks/rspec.rake"]
+  s.files = ["bin/twitter_archive", "config/test.yml", "History", "lib/twitter_archive/backends/blogger/base.rb", "lib/twitter_archive/backends/blogger/blogger.rb", "lib/twitter_archive/backends/blogger/post_body.html.erb", "lib/twitter_archive/backends/blogger/README", "lib/twitter_archive/backends/blogger_archive.rb", "lib/twitter_archive/backends/yaml_archive.rb", "lib/twitter_archive/base.rb", "lib/twitter_archive/runner.rb", "lib/twitter_archive/version.rb", "lib/twitter_archive.rb", "LICENSE", "Manifest", "Rakefile", "README.rdoc", "script/console", "script/destroy", "script/generate", "spec/backends/blogger_archive_spec.rb", "spec/backends/yaml_archive_spec.rb", "spec/fixtures/blogger_authenticate_response.yml", "spec/fixtures/twitter_response.yml", "spec/spec.opts", "spec/spec_helper.rb", "spec/twitter_archive_spec.rb", "tasks/rspec.rake", "twitter_archive.gemspec"]
+  s.has_rdoc = true
+  s.homepage = %q{http://github.com/csexton/twitter_archive}
+  s.rdoc_options = ["--line-numbers", "--inline-source", "--title", "Twitter_archive", "--main", "README.rdoc"]
+  s.require_paths = ["lib"]
+  s.rubyforge_project = %q{twitter_archive}
+  s.rubygems_version = %q{1.3.1}
+  s.summary = %q{Twitter archive utility}
+
+  if s.respond_to? :specification_version then
+    current_version = Gem::Specification::CURRENT_SPECIFICATION_VERSION
+    s.specification_version = 2
+
+    if Gem::Version.new(Gem::RubyGemsVersion) >= Gem::Version.new('1.2.0') then
+      s.add_runtime_dependency(%q<twitter>, [">= 0.4"])
+      s.add_runtime_dependency(%q<hpricot>, [">= 0.6"])
+      s.add_development_dependency(%q<echoe>, [">= 0"])
+    else
+      s.add_dependency(%q<twitter>, [">= 0.4"])
+      s.add_dependency(%q<hpricot>, [">= 0.6"])
+      s.add_dependency(%q<echoe>, [">= 0"])
+    end
+  else
+    s.add_dependency(%q<twitter>, [">= 0.4"])
+    s.add_dependency(%q<hpricot>, [">= 0.6"])
+    s.add_dependency(%q<echoe>, [">= 0"])
+  end
+end

metadata

@@ -0,0 +1,125 @@
+--- !ruby/object:Gem::Specification 
+name: csexton-twitter_archive
+version: !ruby/object:Gem::Version 
+  version: 0.0.1
+platform: ruby
+authors: 
+- Christohper Sexton
+autorequire: 
+bindir: bin
+cert_chain: []
+
+date: 2009-01-02 00:00:00 -08:00
+default_executable: twitter_archive
+dependencies: 
+- !ruby/object:Gem::Dependency 
+  name: twitter
+  version_requirement: 
+  version_requirements: !ruby/object:Gem::Requirement 
+    requirements: 
+    - - ">="
+      - !ruby/object:Gem::Version 
+        version: "0.4"
+    version: 
+- !ruby/object:Gem::Dependency 
+  name: hpricot
+  version_requirement: 
+  version_requirements: !ruby/object:Gem::Requirement 
+    requirements: 
+    - - ">="
+      - !ruby/object:Gem::Version 
+        version: "0.6"
+    version: 
+- !ruby/object:Gem::Dependency 
+  name: echoe
+  version_requirement: 
+  version_requirements: !ruby/object:Gem::Requirement 
+    requirements: 
+    - - ">="
+      - !ruby/object:Gem::Version 
+        version: "0"
+    version: 
+description: Twitter archive utility
+email: csexton@gmail.com
+executables: 
+- twitter_archive
+extensions: []
+
+extra_rdoc_files: 
+- bin/twitter_archive
+- lib/twitter_archive/backends/blogger/base.rb
+- lib/twitter_archive/backends/blogger/blogger.rb
+- lib/twitter_archive/backends/blogger/post_body.html.erb
+- lib/twitter_archive/backends/blogger/README
+- lib/twitter_archive/backends/blogger_archive.rb
+- lib/twitter_archive/backends/yaml_archive.rb
+- lib/twitter_archive/base.rb
+- lib/twitter_archive/runner.rb
+- lib/twitter_archive/version.rb
+- lib/twitter_archive.rb
+- LICENSE
+- README.rdoc
+- tasks/rspec.rake
+files: 
+- bin/twitter_archive
+- config/test.yml
+- History
+- lib/twitter_archive/backends/blogger/base.rb
+- lib/twitter_archive/backends/blogger/blogger.rb
+- lib/twitter_archive/backends/blogger/post_body.html.erb
+- lib/twitter_archive/backends/blogger/README
+- lib/twitter_archive/backends/blogger_archive.rb
+- lib/twitter_archive/backends/yaml_archive.rb
+- lib/twitter_archive/base.rb
+- lib/twitter_archive/runner.rb
+- lib/twitter_archive/version.rb
+- lib/twitter_archive.rb
+- LICENSE
+- Manifest
+- Rakefile
+- README.rdoc
+- script/console
+- script/destroy
+- script/generate
+- spec/backends/blogger_archive_spec.rb
+- spec/backends/yaml_archive_spec.rb
+- spec/fixtures/blogger_authenticate_response.yml
+- spec/fixtures/twitter_response.yml
+- spec/spec.opts
+- spec/spec_helper.rb
+- spec/twitter_archive_spec.rb
+- tasks/rspec.rake
+- twitter_archive.gemspec
+has_rdoc: true
+homepage: http://github.com/csexton/twitter_archive
+post_install_message: 
+rdoc_options: 
+- --line-numbers
+- --inline-source
+- --title
+- Twitter_archive
+- --main
+- README.rdoc
+require_paths: 
+- lib
+required_ruby_version: !ruby/object:Gem::Requirement 
+  requirements: 
+  - - ">="
+    - !ruby/object:Gem::Version 
+      version: "0"
+  version: 
+required_rubygems_version: !ruby/object:Gem::Requirement 
+  requirements: 
+  - - ">="
+    - !ruby/object:Gem::Version 
+      version: "1.2"
+  version: 
+requirements: []
+
+rubyforge_project: twitter_archive
+rubygems_version: 1.2.0
+signing_key: 
+specification_version: 2
+summary: Twitter archive utility
+test_files: []
+