movieDB 1.0.0 → 1.0.1

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA1:
-  metadata.gz: 18eb3efc3ad17c7cb5b6134a951402964af0b5da
-  data.tar.gz: 7eeb628cab2588293f92aa458eeabb903cbfb6ec
+  metadata.gz: 15142fe8cad1d00faba9deef3d9b9968a0abca47
+  data.tar.gz: 5f0faa23b644c40f564eb658902ba22d1b4cffdc
 SHA512:
-  metadata.gz: 09c390931150038ca9b18d52ffdd084a805b344c4272876c9ff6880ee2c4ae3da5623be445cc9b3ad6e7f192e60594fb62a682ebad4168f68d08f8e07b3629b5
-  data.tar.gz: 4b559dcc3e841b450187b87f1060039033109bdce2cd4791ae5c9628bea929db875acff15748e807f9e6444b2eeddcd03ff37b0b2b62d4b324bffdf30468d068
+  metadata.gz: b754c6573573f84c74dbe11ff5190f5c6cf218f432370e61c2698d2d32ebd0155cd0f6a58893c241fb033793ac61822ec0fd732c8dfb223daf1e58b1118f3104
+  data.tar.gz: 5cc88caeaef20a8a0357a817319354df47ab802f3a805e3479608c9e74e341e5a8e35bc43956bf97aee2ceda7eb0ec03ba98907452562800b970e9690eb3fa78

data/README.md

@@ -1,6 +1,6 @@
 # MovieDB
 
- MovieDB is a multi-threaded ruby wrapper for performing advance statistical computation and high-level data analysis on Movie or TV Data from IMDb.
+ MovieDB is a multi-threaded ruby wrapper for performing advance statistical computation and high-level data analysis on Movie Data from IMDb.
  The objective and usage of this tool is to allow producers, directors, writers to make logical business decisions that will generate profitable ROI.
 
 ## Badges
@@ -15,8 +15,8 @@
 ## Technology
 * SciRuby is used for all statistical and scientific computations.
 * Redis is used to store all data.
-* IMDb and TMDb is the source for all film / TV data.
-* BoxOfficeMojo is where we will be scraping future film / TV data.
+* IMDb and TMDb is the source for all film.
+* BoxOfficeMojo is where we will be scraping future film.
 * Celluloid is used to build the fault-tolerant concurrent programs. Note, if you are using MRI or YARV,
 multi-threading won't work since these types of interpreters have Global Interpreter Lock (GIL).
 Fortunately, you can use JRuby or Rubinius, since they don’t have a GIL and support real parallel threading.
@@ -26,20 +26,6 @@ ruby-2.2.2 or higher
 
 jruby-9.0.0.0
 
-## Category
-movieDB is broken down into 3 components namely:
-
-* Statistics
-* Visualizations (Work in progress)
-* DataMining (Work in progress)
-
-# Statistics
-
-Simple statistical analysis on numeric data.
-The corresponding computation is performed on
-both numeric and string vectors within the
-collected data.
-
 ## Installation
 
 Redis Installation
@@ -84,7 +70,7 @@ m = MovieDB::Movie.pool(size: 2)
 ```
 ## Step Process
 
-Fetching and analysing movie / TV data using movieDB is a simple 2 step process.
+Fetching and analysing movie data using movieDB is a simple 2 step process.
 
 First, fetch the data from IMDb.
 
@@ -94,13 +80,33 @@ That's it! It is that simple.
 
 ## Part 1 - Fetch Data from IMDb
 
-There are 2 ways to find IMDb ids.
+There are 3 ways to find IMDb ids.
+
+* Search IMDb id via API
+
+* Search IMDb id via Website
 
-* Finding specific IMDb ids
+* Generate random IMDb ids.
 
-* Finding random IMDb ids.
+### Search IMDb id via API
 
-### Fetching specific IMDb ids
+You can read the [documentation](http://rubydoc.info/github/ariejan/imdb/master/frames) for IMDb API to see all that you can do with this gem.
+
+``` ruby
+i = Imdb::Search.new("Star Trek")
+
+i.movies.size  #=> 97
+```
+This will return 97 objects related to 'Star Trek'
+
+To collect all the IMDb ids
+
+``` ruby
+ids = i.movies.collect(&:id).uniq
+
+#=> ["0796366", "0060028", "0079945" ...]
+```
+### Search IMDb id via Website
 
 To find IMDb id for specific movies, you must go to:
 
@@ -116,8 +122,9 @@ http://www.imdb.com/title/tt0369610/
 ```
 0369610 is the IMDb id.
 
-### Fetching random IMDb ids (multi-thread setup)
-You can fetch IMDb ids random.
+### Generate random IMDb ids (multi-thread setup)
+
+You can fetch IMDb ids random. This approach will probably run you into some problems, see Disclaimer.
 
 ``` ruby
 r = Random.new
@@ -133,7 +140,7 @@ Note: IMDB has a rate limit of 40 requests every 10 seconds and are limited by I
 If you exceed the limit, you will receive a 429 HTTP status with a 'Retry-After' header.
 As soon your cool down period expires, you are free to continue making requests.
 
-Also, movieDB will throw a NameError if the randomly generated IMDb id in invalid.
+Also, movieDB will throw a NameError if the randomly generated IMDb id is invalid.
 
 ### Get Movie Data
 
@@ -227,7 +234,7 @@ plot_summa        373        298        311
 
 When performing statistics on an object, movieDB by default processes all fields.
 
-Contrary, to this default approach, you now have the option of filtering what fields you want processed with the following 2 filters.
+However, you now have the option of filtering what fields you want processed using the following filters:
 
 * only
 * except
@@ -287,10 +294,18 @@ m.all_ids
 Gets the remaining time to live of a movie.
 
 ``` ruby
-m.ttl("0369610)
+m.ttl("0369610")
 # => 120
 ```
 
+* DELETE key
+deletes a single movie object stored in redis.
+
+``` ruby
+m.del("0369610")
+# => # => ["3079380"...]
+```
+
 * DELETE_ALL key
 deletes all movie objects stored in redis.
 
@@ -298,11 +313,6 @@ deletes all movie objects stored in redis.
 m.delete_all
 # => []
 ```
-# Visualizations
-(Work in progress)
-
-# Data mining
-(Work in progress)
 
 ## Contact me
 
@@ -312,5 +322,10 @@ You can also contact me at albertmck@gmail.com
 
 ## Disclaimer
 This software is provided “as is” and without any express or implied warranties, including, without limitation, the implied warranties of merchantibility and fitness for a particular purpose.
+Neither I, nor any developer who contributed to this project, accept any kind of liability for your use of this library.
+
+IMDB does not permit use of its data by third parties without their consent.
+
+Using this library for anything other than limited personal use may result in an IP ban to the IMDB website.
 
 ###### Copyright (c) 2013 - 2015 Albert McKeever, released under MIT license

data/lib/movieDB.rb

@@ -42,5 +42,4 @@ module MovieDB
       return arr.flatten
     end
   end
-end
-
+end

data/lib/movieDB/data_analysis/statistics.rb

@@ -1,4 +1,5 @@
 require 'daru'
+require 'json'
 
 module MovieDB
   module DataAnalysis
@@ -11,9 +12,12 @@ module MovieDB
 
       stats = [:mean, :std, :sum, :count, :max, :min, :min, :product, :standardize, :describe, :covariance, :correlation, :worksheet]
 
+      $collect_vals = {}
+
       stats.each do |method_name|
         define_method method_name do |**args|
-          dataframes_stats(method_name, args)
+          $collect_vals[:method] = method_name.to_s
+          $collect_vals[:vals] = dataframes_stats(method_name, args)
         end
       end
 
@@ -22,16 +26,16 @@ module MovieDB
         def dataframes_stats(method, filters = {})
           raise ArgumentError, 'Please provide 2 or more IMDd ids.' if $movie_data.length <= 1
 
-          @data_key = {}
-          @index = []
+          $data_key = {}
+          $index = []
 
           if filters.empty?
             $movie_data.each_with_index do |movie, _|
               value_count = []
 
               movie.each_pair do |k, v|
-                @data_key[(movie['title'].sub(" ", "_").downcase)] = value_count << (MovieDB::DataAnalysis::Statistics.numeric_vals.any? { |word| word == k } ? v.to_i : v.split(' ').count)
-                @index << k.to_sym
+                $data_key[(movie['title'].sub(" ", "_").downcase)] = value_count << (MovieDB::DataAnalysis::Statistics.numeric_vals.any? { |word| word == k } ? v.to_i : v.split(' ').count)
+                $index << k.to_sym
               end
             end
           else
@@ -45,8 +49,8 @@ module MovieDB
                   mr = movie.reject { |k, _| k != filter.to_s }
 
                   mr.each_pair do |k, v|
-                    @data_key[(movie['title'].sub(" ", "_").downcase)] = value_count << (MovieDB::DataAnalysis::Statistics.numeric_vals.any? { |word| word == k } ? v.to_i : v.join(' ').split(' ').count)
-                    @index << k.to_sym
+                    $data_key[(movie['title'].sub(" ", "_").downcase)] = value_count << (MovieDB::DataAnalysis::Statistics.numeric_vals.any? { |word| word == k } ? v.to_i : v.join(' ').split(' ').count)
+                    $index << k.to_sym
                   end
                 end
               end
@@ -58,8 +62,8 @@ module MovieDB
                   value_count = []
 
                   mr.each_pair do |k, v|
-                    @data_key[(movie['title'].sub(" ", "_").downcase)] = value_count << (MovieDB::DataAnalysis::Statistics.numeric_vals.any? { |word| word == k } ? v.to_i : v.join(' ').split(' ').count)
-                    @index << k.to_sym
+                    $data_key[(movie['title'].sub(" ", "_").downcase)] = value_count << (MovieDB::DataAnalysis::Statistics.numeric_vals.any? { |word| word == k } ? v.to_i : v.join(' ').split(' ').count)
+                    $index << k.to_sym
                   end
                 end
               end
@@ -68,9 +72,9 @@ module MovieDB
             end
           end
 
-          index = @index.uniq
+          index = $index.uniq
 
-          movie_numeric_vector = Hash[@data_key.map { |k, v| [k.to_s.gsub('-', '_').to_sym, v] }]
+          movie_numeric_vector = Hash[$data_key.map { |k, v| [k.to_s.gsub('-', '_').to_sym, v] }]
           compute_stats(method, movie_numeric_vector, index )
         end
 

data/lib/movieDB/data_store.rb

@@ -74,6 +74,8 @@ module MovieDB
           return @redis_db.hgetall("#{id}")
         when :ttl
           return @redis_db.ttl("#{id}")
+        when :del
+          return @redis_db.del("#{id}")
       else
         raise ArgumentError, "The method #{method} is invalid."
       end

data/lib/movieDB/relation/query_methods.rb

@@ -48,7 +48,7 @@ module MovieDB
       #   m.fetch("0369610", "3079380", "0478970")
       #
       #   m.hgetall("0369610")
-      [:all, :hkeys, :hvals, :flushall, :ttl].each do |method_name|
+      [:all, :hkeys, :hvals, :flushall, :ttl, :del].each do |method_name|
         define_method method_name do |arg|
           MovieDB::DataStore.get_data(method_name, arg)
         end
@@ -56,6 +56,7 @@ module MovieDB
 
       alias hgetall all
 
+      # No argument is required.
       [:scan, :flushall].each do |method_name|
         define_method method_name do
          mn = MovieDB::DataStore.get_data(method_name)

data/lib/movieDB/version.rb

@@ -1,3 +1,3 @@
 module MovieDB
-  VERSION = "1.0.0"
+  VERSION = "1.0.1"
 end

data/movieDB.gemspec

@@ -26,4 +26,5 @@ Gem::Specification.new do |spec|
   spec.add_dependency 'imdb'
   spec.add_dependency 'json'
   spec.add_dependency 'celluloid'
+  spec.add_dependency 'nyaplot'
 end

data/spec/movieDB/data_analysis/statistics_spec.rb

@@ -9,8 +9,8 @@ describe MovieDB  do
 
     context '#mean' do
        it 'should calculate mean of all values' do
-         # expect(m.mean.round(2)).to eq(Daru::Vector.new([ 2891127.4, 36972648.98, 1445963.96],
-         #                                                 index: ['ant-man', :jurassic_world, :spy]))
+         expect(m.mean.round(2)).to eq(Daru::Vector.new([ 2891127.4, 36972648.98, 1445963.96],
+                                                         index: ['ant-man', :jurassic_world, :spy]))
        end
     end
 

metadata

@@ -1,14 +1,14 @@
 --- !ruby/object:Gem::Specification
 name: movieDB
 version: !ruby/object:Gem::Version
-  version: 1.0.0
+  version: 1.0.1
 platform: ruby
 authors:
 - Albert McKeever
 autorequire: 
 bindir: bin
 cert_chain: []
-date: 2015-08-18 00:00:00.000000000 Z
+date: 2015-08-20 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: bundler
@@ -122,6 +122,20 @@ dependencies:
     - - ">="
       - !ruby/object:Gem::Version
         version: '0'
+- !ruby/object:Gem::Dependency
+  name: nyaplot
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
 description: Perform Data Analysis on IMDB Movies
 email:
 - kotn_ep1@hotmail.com
@@ -139,6 +153,7 @@ files:
 - LICENSE.txt
 - README.md
 - Rakefile
+- images/sampbar.png
 - lib/movieDB.rb
 - lib/movieDB/.DS_Store
 - lib/movieDB/base.rb