market_bot 0.6.3 → 0.6.4

data/README.markdown

@@ -1,6 +1,8 @@
-# Market Bot - High performance Ruby scraper for Google's Android Market
+# Market Bot - Ruby scraper for Google Play (Android Market)
 
 Market Bot is a high performance Ruby scraper for Google's Android Market with a simple to use API.
+Currently it supports scraping apps, leaderboards, and app searches.
+Books, music, movies, etc aren't currently supported.
 It is built on top of Nokogiri and Typhoeus.
 Used in production to power [www.droidmeter.com](http://www.droidmeter.com/?t=github).
 
@@ -13,7 +15,7 @@ Used in production to power [www.droidmeter.com](http://www.droidmeter.com/?t=gi
 
     gem install market_bot
 
-## Basic Examples
+## Simple API Examples
 
     require 'rubygems'
     require 'market_bot'
@@ -35,7 +37,7 @@ Used in production to power [www.droidmeter.com](http://www.droidmeter.com/?t=gi
     sq.update
     puts "Results found: #{sq.results.count}"
 
-## Advanced Examples
+## Advanced API Examples
 
     require 'rubygems'
     require 'market_bot'
@@ -61,23 +63,6 @@ Used in production to power [www.droidmeter.com](http://www.droidmeter.com/?t=gi
     puts "First place app (#{first_app.title}) price: #{first_app.price}" unless first_app.error
     puts "Last place app (#{last_app.title}) price: #{last_app.price}" unless last_app.error
 
-## Benchmarks
-
-Below are fairly typical results using 20 http workers (Typhoeus::Hydra.new(:max_concurrency => 20).  The first benchmark downloads/parses a leaderboard containing 504 entries.  The second benchmark takes those 504 entries, converts them to MarketBot::Android::App objects and then downloads/parses their details.  Note that 20 workers are used to prevent DOSing the market servers.  Higher values may work, but I don't recommend it.
-
-    $ rake benchmark:android
-    ----------------------------------------------------
-    Benchmark Leaderboard: Top Selling Paid Apps
-    ----------------------------------------------------
-    app count: 504
-    time: 3.16 seconds
-
-    ----------------------------------------------------
-    Benchmark Apps: top Selling Paid Apps
-    ----------------------------------------------------
-    app count: 504
-    time: 35.685 seconds
-
 ## Contributing to Market Bot
 
 1. Check out the latest master to make sure the feature hasn't been implemented or the bug hasn't been fixed yet.
@@ -90,6 +75,6 @@ Below are fairly typical results using 20 http workers (Typhoeus::Hydra.new(:max
 
 ## Copyright
 
-Copyright (c) 2011 Chad Remesch. See LICENSE.txt for
+Copyright (c) 2011 - 2012 Chad Remesch. See LICENSE.txt for
 further details.
 

data/VERSION

@@ -1 +1 @@
-0.6.3
+0.6.4

data/lib/market_bot/android/app.rb

@@ -145,6 +145,9 @@ module MarketBot
         request = Typhoeus::Request.new(market_url)
 
         request.on_complete do |response|
+          # HACK: Typhoeus <= 0.4.2 returns a response, 0.5.0pre returns the request.
+          response = response.response if response.is_a?(Typhoeus::Request)
+
           result = nil
 
           begin

data/lib/market_bot/android/leaderboard.rb

@@ -131,6 +131,9 @@ module MarketBot
       def process_page(url, page_num)
         request = Typhoeus::Request.new(url)
         request.on_complete do |response|
+          # HACK: Typhoeus <= 0.4.2 returns a response, 0.5.0pre returns the request.
+          response = response.response if response.is_a?(Typhoeus::Request)
+
           result = Leaderboard.parse(response.body)
           update_callback(result, page_num)
         end

data/market_bot.gemspec

@@ -5,7 +5,7 @@
 
 Gem::Specification.new do |s|
   s.name = "market_bot"
-  s.version = "0.6.3"
+  s.version = "0.6.4"
 
   s.required_rubygems_version = Gem::Requirement.new(">= 0") if s.respond_to? :required_rubygems_version=
   s.authors = ["Chad Remesch"]

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: market_bot
 version: !ruby/object:Gem::Version
-  version: 0.6.3
+  version: 0.6.4
   prerelease: 
 platform: ruby
 authors:
@@ -240,7 +240,7 @@ required_ruby_version: !ruby/object:Gem::Requirement
       version: '0'
       segments:
       - 0
-      hash: 1001334864545958244
+      hash: 895662135504160235
 required_rubygems_version: !ruby/object:Gem::Requirement
   none: false
   requirements: