autoaudio 0.0.3 → 0.0.4

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA1:
-  metadata.gz: cec5b85de4f30b18b7eade498b1461f5c9c15747
-  data.tar.gz: 369e5d5c2b9b3b0a1d28efb3662390ec1b5b35db
+  metadata.gz: 171b6ac2299bc99f246e08efe0f9dcb6cd65c86d
+  data.tar.gz: 4ff98406573ab4a6f98041f92e0c50fd7550bb8f
 SHA512:
-  metadata.gz: c19f6ac9800dbc959f8809c5b03da6baa1e216406cb24fad5dc8d0899c10df7b612947997ed20ec261bd13ce14037a095e115e34ea41d868cd66e21bd6a17b54
-  data.tar.gz: 925c4642159d6ab1a7228f62b59027d017a67fa70bbc81a602d7514e99ecfba23e2c11960e176bd80096d7830332a1912f7ee6436b076063ff3ec5e4e7429003
+  metadata.gz: f5eb67480752847ebc713230c708cdf36aac0690ed30339380c3fab6820f70a8c11ebc306c0ea951c250754bf3c12786315f2896a3f5bf119e8a5024ebd40046
+  data.tar.gz: fe4b1a730c4875c65a98341f72d8366d8d67c4be14acc2e8ba5d14759d7d01c020279aedc1c3096b600b55d3e489b917ac459610081e3a3c2ed4c51ee1cc0495

data/.gitignore

@@ -16,13 +16,4 @@ test/tmp
 test/version_tmp
 tmp
 
-*.log
-.idea
-.DS_Store
-.DS_Store?
-._*
-.Spotlight-V100
-.Trashes
-Thumbs.db
-
-tmp/*
+hold/*

data/README.md

@@ -1,43 +1,33 @@
 # Autoaudio
 
-Autoaudio parses [http://nfodb.net.ru/rss.php](http://nfodb.net.ru/rss.php) for the latest Scene audio releases. Then, it queries [http://nzbindex.nl/](http://nzbindex.nl/) for the release and creates an `.nzb`.
 
-Releases are sorted by genre and album title and folders are created which hold `.nfo` and `.nzb` files for each release. A zip is created of each folder and is uploaded to [https://anonfiles.com/](https://anonfiles.com/). The resulting list is uploaded as an anonymous gist. A file called `download.thor`, which is a tiny robot that parses the anonymous gist and redownloads the files from [https://anonfiles.com/](https://anonfiles.com/), is uploaded with the album links. Finally, the gist url is tweeted.
-
-![alt text](https://raw.github.com/GeneLocklin/autoaudio/master/etc/aa.jpg "Autoaudio")
-
-## Installation
-
-    $ gem install autoaudio
-
-## Usage
+## THESE INSTRUCTIONS ARE NO LONGER VALID. ```audioaudio list``` for a list of commands. Proper readme coming soon.
 
-Setings can be found in `/lib/autoaudio/settings.rb`. `NZB_DOWNLOAD_LOCATION` is where to set where you want to store your `.nzb` and `.nfo` files. `TWITTER_SETTINGS` has two options. Set `:tweet_nzbs` to true, if you want to tweet your results. And your Twitter username is stored in `:username`.
+### It's ugly as hell, but it 100% works.
 
-Autoaudio has a set of terminal commands:
+![alt text](https://raw.github.com/GeneLocklin/autoaudio/master/etc/aa.jpg "Autoaudio")
 
-* `autoaudio setup` Opens the config file in your editor of choice.
-* `autoaudio display_configuration_settings` Displays application configuration settings.
-* `autoaudio make_feeds` Downloads all feeds into the database.
-* `autoaudio display_feeds` Displays all feeds.
-* `autoaudio download` Downloads all feeds, creates `.nzb` and `.nfo` files, zips and uploads to [https://anonfiles.com/](https://anonfiles.com/), creates a list of upload urls and tweets an the url of anonymous gist containing the upload urls.
-* `autoaudio download_genre GENRE` <- Where GENRE is your chosen genre. This command will open a single genre's `.nzb` files in your chosen newsreader, and update the database to reflect the change.
+Autoaudio parses [http://nfodb.net.ru/rss.php](http://nfodb.net.ru/rss.php) for the latest Scene audio releases. Then, it queries [http://nzbindex.nl/](http://nzbindex.nl/) for the release and creates a `.nzb`.
 
-If you wish to tweet your results, you will need to install and set up [t](https://github.com/sferik/t). Autoaudio will automatically set your Twitter username, before tweeting.
+Releases are sorted by genre and album title and folders are created which hold `.nfo` and `.nzb` files for each release. A zip is created of each folder and is uploaded to [https://anonfiles.com/](https://anonfiles.com/). The resulting list is uploaded as an anonymous gist. A file called `download.thor`, which is a tiny robot that parses the anonymous gist and redownloads the files from [https://anonfiles.com/](https://anonfiles.com/), is uploaded with the album links. Finally, the gist url is tweeted.
 
-## Gems Used
+## Gems Used:
 
-  * [mongoid](https://github.com/mongoid/mongoid)
   * [mechanize](https://github.com/sparklemotion/mechanize/)
+  * [mongoid](https://github.com/mongoid/mongoid)
   * [gist](https://github.com/defunkt/gist)
   * [thor](https://github.com/erikhuda/thor)
-  * [t](https://github.com/sferik/t)
+  * and, indirectly, [t](https://github.com/sferik/t)
+
+## Basic Usage:
+
+Run `Thor list` for a list of basic commands.
 
 ## To do:
 
   * help
   * write a more understandable readme
-  * add more thor commands as well as more descriptions
+  * add more thor commands as well as more and better descriptions
   * clean up the code - at the moment, it's a huge ball of crap
   * error handling
   * multithreading
@@ -47,7 +37,7 @@ If you wish to tweet your results, you will need to install and set up [t](https
   * more search and source options
   * [tor-privoxy](https://github.com/pirj/tor-privoxy)
 
-## License
+## License:
 
 Copyright (c) 2014 Gene Locklin
 
@@ -72,7 +62,7 @@ LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
 OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
 WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
 
-## Contributing
+## Contributing:
 
 1. Fork it
 2. Create your feature branch (`git checkout -b my-new-feature`)

data/Thorfile

@@ -0,0 +1,10 @@
+$:.unshift File.expand_path("../lib", __FILE__)
+$:.unshift File.expand_path("../config", __FILE__)
+
+require 'settings'
+require 'autoaudio'
+require 'thor'
+
+Dir.glob("./tasks/*.thor") { |name| Thor::Util.load_thorfile(name) }
+
+

data/autoaudio.gemspec

@@ -20,10 +20,11 @@ Gem::Specification.new do |spec|
   spec.require_paths = %w[lib]
 
   spec.add_dependency 'mechanize'
+  spec.add_dependency 'awesome_print'
   spec.add_dependency 'mongoid'
+  spec.add_dependency 'retries'
   spec.add_dependency 'thor'
   spec.add_dependency 'gist'
-  spec.add_dependency 't'
 
   spec.add_development_dependency 'bundler', '~> 1.3'
   spec.add_development_dependency 'rake'
@@ -33,3 +34,6 @@ Gem::Specification.new do |spec|
   spec.add_development_dependency 'guard-bundler'
 end
 
+
+
+

data/bin/autoaudio

@@ -2,4 +2,7 @@
 
 require 'autoaudio'
 
-Autoaudio::Cli::Application.start(ARGV)
+Autoaudio::Cli.start(ARGV)
+
+
+

data/config/mongoid.yml

@@ -1,6 +1,6 @@
 development:
   sessions:
     default:
-      database: autoaudio
+      database: atst2
       hosts:
         - localhost:27017

data/config/settings.rb

@@ -0,0 +1,13 @@
+require 'autoaudio'
+
+module Autoaudio
+  Settings.config do
+    download_location    "#{Dir.home}/Downloads/Test/Albums"
+    maximum_retention    900
+    nzb_client           'Unison.app'
+    zip_files            true
+    share_files          true
+    tweet_files          true
+    twitter_username     'usenetdecoded'
+  end
+end

data/lib/autoaudio.rb

@@ -1,21 +1,35 @@
-require 'mechanize'
+$:.unshift File.expand_path("../../config", __FILE__)
+require 'autoaudio/settings_setup'
+require 'settings'
+
+require 'rubygems'
 require 'open-uri'
+require 'date'
+
+require 'thor'
 require 'mongoid'
-require 'gist'
-require 't'
+require 'retries'
+require 'nokogiri'
+require 'mechanize'
+require 'awesome_print'
+
+require 'gist' if Autoaudio::Settings.share_files
 
 require 'autoaudio/version'
-require 'autoaudio/settings'
-require 'autoaudio/cli/application'
+require 'autoaudio/utils'
+require 'autoaudio/genre'
+require 'autoaudio/release_date'
+require 'autoaudio/release'
 
-require 'autoaudio/utility'
-require 'autoaudio/feed'
+require 'autoaudio/setup'
+require 'autoaudio/make'
 require 'autoaudio/download'
+require 'autoaudio/destroy'
+require 'autoaudio/stats'
+require 'autoaudio/cli'
 
 module Autoaudio
-  extend self
-  Mongoid.load!("./config/mongoid.yml", :development)
+  Mongoid.load!('config/mongoid.yml', :development)
 end
 
 
-

data/lib/autoaudio/cli.rb

@@ -0,0 +1,30 @@
+module Autoaudio
+  class Cli < Thor
+    include Autoaudio::Utils
+
+#    unless Settings.initialized
+#      Setup.new.setup
+#    end
+
+    desc 'make SUBCOMMAND', 'make'
+    subcommand 'make', Autoaudio::Make
+
+    desc 'download SUBCOMMAND', 'download'
+    subcommand 'download', Autoaudio::Download
+
+    desc 'destroy SUBCOMMAND', 'destroy'
+    subcommand 'destroy', Autoaudio::Destroy
+
+    desc 'stats SUBCOMMAND', 'stats'
+    subcommand 'stats', Autoaudio::Stats
+
+    desc 'setup', 'setup'
+    subcommand 'setup', Autoaudio::Setup
+
+    desc 'list', 'list all autoaudio commands'
+    def list
+      system('thor list')
+    end
+
+  end
+end

data/lib/autoaudio/destroy.rb

@@ -0,0 +1,47 @@
+require 'thor'
+
+module Autoaudio
+  class Destroy < Thor
+
+    desc 'everything', 'destroys all genres, releases and release dates'
+    def everything
+      if yes?("Preparing to destroy Everything. Are you sure? [yN]")
+        invoke :genres
+        invoke :release_dates
+        invoke :releases
+      else
+        say "That's probably for the best..."
+      end
+    end
+
+    desc 'releases', 'destroys all releases'
+    def releases
+      if yes?("Preparing to destroy all releases. Are you sure? [yN]")
+        Release.destroy_all
+        say "BOOM!", :red
+      else
+        say "That's probably for the best..."
+      end
+    end
+
+    desc 'genres', 'destroys all genres'
+    def genres
+      if yes?("Preparing to destroy all genres. Are you sure? [yN]")
+        Genre.destroy_all
+        say "BOOM!", :red
+      else
+        say "That's probably for the best..."
+      end
+    end
+
+    desc 'release_dates', 'destroys all release dates'
+    def release_dates
+      if yes?("Preparing to destroy all release dates. Are you sure? [yN]")
+        ReleaseDate.destroy_all
+        say "BOOM!", :red
+      else
+        say "That's probably for the best..."
+      end
+    end
+  end
+end

data/lib/autoaudio/download.rb

@@ -1,126 +1,181 @@
-require 'autoaudio/utility'
-
 module Autoaudio
-  class Download
-    extend Utility
-    def self.album(feed)
-
-      hash_regex          = Regexp.new('\b[A-Za-z0-9]{32}\b')
-      psydealer_regex     = Regexp.new('PsyDealer')
-      town_regex          = Regexp.new('town\.ag')
-      flac_regex          = Regexp.new('a\.b\.flac|a\.b\.sounds\.flac')
-
-      download_location   = "#{Autoaudio::Config::NZB_DOWNLOAD_LOCATION[:directory]}/#{feed.genre_formatted}/#{sanitize_filename(feed.album_title)}"
-      nzb                 = "#{download_location}/#{sanitize_filename(feed.album_title)}.nzb"
-      nfo                 = "#{download_location}/#{sanitize_filename(feed.album_title)}.nfo"
-      zip                 = "#{download_location}/#{sanitize_filename(feed.album_title)}.zip"
-
-      agent  = Mechanize.new { |agent| agent.user_agent_alias = 'Mac Safari' }
-      cookie = HTTP::Cookie.new(
-        :domain  => 'nzbindex.nl',
-        :name    => "agreed",
-        :value   => "true",
-        :path    => '/',
-        :expires => (Date.today + 1).to_s)
-      agent.cookie_jar.add(cookie)
-
-      page          = agent.get('http://nzbindex.nl/')
-      search_form   = page.form
-      search_form.q = feed.album_title
-      results_page  = agent.submit(search_form, search_form.buttons.first)
-
-      if !feed.downloaded && results_page.links_with(:text => 'Download', :href => town_regex).any? do |link|
-        agent.get(link.click).save! nzb
-        puts success("Town = #{feed.album_title}")
-        feed.update_attributes(
-          downloaded: true,
-          download_method: "Town",
-          nzb: nzb
-        )
+  class Download < Thor
+    include Autoaudio::Utils
+
+    desc 'download_releases LOGGER, DOWNLOAD ATTEMPTS', 'download nfo and nzb files LOGGER, DOWNLOAD ATTEMPTS'
+    def download_releases(logger="nolog", release_nzb_download_attempts=1)
+      if logger == "log"
+        if yes?("Do you want to wipe the old .log file? [yN]")
+          File.truncate('./log/agent.log', 0)
         end
       end
-      if results_page.links_with(:text => 'Download', :href => hash_regex).any? do |link|
-        search_term = hash_regex.match(link.href)
-        page = agent.get("http://nzbindex.nl/groups/alt.binaries.inner-sanctum/?q=#{search_term}")
-        form = page.form_with(:action => 'http://nzbindex.nl/download/')
-        form.checkboxes.each { |checkbox| checkbox.check if hash_regex.match(checkbox.text) }
-        form.submit.save! nzb
-        puts success("inner-sanctum => #{hash_regex.match(link.href)} = #{feed.album_title}")
-        feed.update_attributes(
-          downloaded: true,
-          download_method: "inner-sanctum #{hash_regex.match(link.href)}",
-          nzb: nzb
-        )
+      Make.new.releases
+      Release.where(release_nzb_downloaded: false, :release_nzb_download_attempts.lte => release_nzb_download_attempts).each do |release|
+        with_retries(:max_tries => 20, :base_sleep_seconds => 0.1, :max_sleep_seconds => 6.0) do
+          make_release(logger, release)
         end
       end
-      if !feed.downloaded && results_page.links_with(:text => 'Download', :href => hash_regex).any? do |link|
+      gist_tweet_releases if Settings.share_files
+      say ""
+      say "Thank you. Come again.", :white
+    end
+
+    no_commands do
+      def make_release(logger, release)
+        hash_regex          = Regexp.new('\b[A-Za-z0-9]{32}\b')
+        psydealer_regex     = Regexp.new('PsyDealer')
+        town_regex          = Regexp.new('town\.ag')
+        flac_regex          = Regexp.new('a\.b\.flac|a\.b\.sounds\.flac|a\.b\.flacEFNet')
+
+        download_location   = "#{Settings.download_location}/#{release.release_genre_formatted}/#{sanitize_filename(release.release_name)}"
+        nzb                 = "#{download_location}/#{sanitize_filename(release.release_name)}.nzb"
+        nfo                 = "#{download_location}/#{sanitize_filename(release.release_name)}.nfo"
+        zip                 = "#{download_location}/#{sanitize_filename(release.release_name)}.zip"
+
+        agent = Mechanize.new
+        agent.user_agent_alias = 'Mac Safari'
+        agent.log = Logger.new('./log/agent.log') if logger == "log"
+        cookie = HTTP::Cookie.new(
+          :domain  => 'nzbindex.nl',
+          :name    => "agreed",
+          :value   => "true",
+          :path    => '/',
+          :expires => (Date.today + 1).to_s)
+        agent.cookie_jar.add(cookie)
+
+        page          = agent.get('http://nzbindex.nl/')
         search_form   = page.form
-        search_form.q = hash_regex.match(link.href)
+        search_form.q = release.release_name
         results_page  = agent.submit(search_form, search_form.buttons.first)
-        form          = results_page.form_with(:action => 'http://nzbindex.nl/download/')
-        form.checkboxes.each { |checkbox| checkbox.check if hash_regex.match(checkbox.text) }
-        form.submit.save! nzb
-        puts success("#{hash_regex.match(link.href)} = #{feed.album_title}")
-        feed.update_attributes(
-          downloaded: true,
-          download_method: hash_regex.match(link.href),
-          nzb: nzb
-        )
+
+        if !release.release_nzb_downloaded && results_page.links_with(:text => 'Download', :href => hash_regex).any? do |link|
+          search_term = hash_regex.match(link.href)
+          page        = agent.get("http://nzbindex.nl/groups/alt.binaries.inner-sanctum/?q=#{search_term}")
+          form        = page.form_with(:action => 'http://nzbindex.nl/download/')
+          form.checkboxes.each { |checkbox| checkbox.check if hash_regex.match(checkbox.text) }
+          form.submit.save! nzb
+          say "inner-sanctum => #{hash_regex.match(link.href)} = #{release.release_name}", :green
+          release.update_attributes(
+            release_nzb_downloaded: true,
+            release_nzb_download_method: "inner-sanctum #{hash_regex.match(link.href)}",
+            release_nzb_location: nzb
+          )
+          end
         end
-      end
-      if !feed.downloaded && results_page.links_with(:text => 'Download', :href => psydealer_regex).any? do |link|
-        agent.get(link.click).save! nzb
-        puts success("Town = #{feed.album_title}")
-        feed.update_attributes(
-          downloaded: true,
-          download_method: "Psydealer",
-          nzb: nzb
-        )
+
+        if !release.release_nzb_downloaded && results_page.links_with(:text => 'Download', :href => town_regex).any? do |link|
+          agent.get(link.click).save! nzb
+          say "Town = #{release.release_name}", :green
+          release.update_attributes(
+            release_nzb_release_nzb_downloaded: true,
+            release_nzb_download_method: "Town",
+            release_nzb_location: nzb
+          )
+          end
         end
-      end
-      if !feed.downloaded && results_page.links_with(:text => 'Download', :href => flac_regex).each do |link|
-        form = results_page.form_with(:action => 'http://nzbindex.nl/download/')
-        form.checkboxes.each { |checkbox| checkbox.check if flac_regex.match(link.href) }
-        form.submit.save! nzb
-        puts success("FLAC = #{feed.album_title}")
-        feed.update_attributes(
-          downloaded: true,
-          download_method: "FLAC",
-          nzb: nzb
-        )
+
+        if !release.release_nzb_downloaded && results_page.links_with(:text => 'Download', :href => hash_regex).any? do |link|
+          search_form.q = hash_regex.match(link.href)
+          results_page  = agent.submit(search_form, search_form.buttons.first)
+          form          = results_page.form_with(:action => 'http://nzbindex.nl/download/')
+          form.checkboxes.each { |checkbox| checkbox.check if hash_regex.match(checkbox.text) }
+          form.submit.save! nzb
+          say "#{hash_regex.match(link.href)} = #{release.release_name}", :green
+          release.update_attributes(
+            release_nzb_downloaded: true,
+            release_nzb_download_method: "hash_regex #{hash_regex.match(link.href)}",
+            release_nzb_location: nzb
+          )
+          end
+        end
+
+        if !release.release_nzb_downloaded && results_page.links_with(:text => 'Download', :href => psydealer_regex).any? do |link|
+          agent.get(link.click).save! nzb
+          say "Psydealer = #{release.release_name}", :green
+          release.update_attributes(
+            release_nzb_downloaded: true,
+            release_nzb_download_method: "Psydealer",
+            release_nzb_location: nzb
+          )
+          end
+        end
+
+        if !release.release_nzb_downloaded && results_page.links_with(:text => 'Download', :href => flac_regex).each do |link|
+          form = results_page.form_with(:action => 'http://nzbindex.nl/download/')
+          form.checkboxes.each { |checkbox| checkbox.check if flac_regex.match(link.href) }
+          form.submit.save! nzb
+          say "FLAC = #{release.release_name}", :green
+          release.update_attributes(
+            release_nzb_downloaded: true,
+            release_nzb_download_method: "FLAC",
+            release_nzb_location: nzb
+          )
+          end
+        end
+
+        if !release.release_nzb_downloaded
+          release.update_attribute(:release_nzb_download_attempts, (release.release_nzb_download_attempts + 1))
+          say "NOPE = #{release.release_name}", :red
+        end
+
+        # ToDo: from here down, rewrite.
+
+        if release.release_nzb_downloaded
+          nfo_agent = Mechanize.new { |agent| agent.user_agent_alias = 'Mac Safari' }
+          nfo_page  = nfo_agent.get("http://nfodb.net.ru/get_nfo-#{release.release_number}.php")
+          nfo_page.save! nfo
+          say ".nfo created - #{release.release_name}", :green
+          release.update_attributes(
+            release_nfo_downloaded: true,
+            release_nfo_location: nfo
+          )
         end
-      end
-      if !feed.downloaded
-        feed.update_attribute(:download_attempts, (feed.download_attempts + 1))
-        puts failure("NOPE = #{feed.album_title}")
-      end
 
-      if feed.downloaded
-        nfo_agent = Mechanize.new { |agent| agent.user_agent_alias = 'Mac Safari' }
-        nfo_page = nfo_agent.get("http://nfodb.net.ru/get_nfo-#{feed.release_number}.php")
-        nfo_page.save! nfo
-        puts success(".nfo created - #{feed.album_title}")
-        feed.update_attribute(:nfo, nfo)
+        if release.release_nzb_downloaded && release.release_nfo_downloaded
+          system("zip -vjr #{zip} #{download_location}/* -x \"*.DS_Store\"" )
+          release.update_attributes(
+            release_zip_location: zip,
+            release_zip_created: true
+          )
+          say ".zip created - #{release.release_name}", :green
+        end
+
+        if release.release_zip_created
+          reply = './etc/reply.txt'
+          system("curl -kF \"file=@#{zip}\" https://anonfiles.com/api/v1/upload -o \"#{reply}\"")
+          zip_location = IO.readlines(reply)[0]
+          anon_hash    = /\b[A-Za-z0-9]{32}\b/.match(zip_location)
+          release.update_attribute(:release_zip_uploaded_url, "https://anonfiles.com/file/#{anon_hash}")
+          say "#{release.release_name} = https://anonfiles.com/file/#{anon_hash}", :green
+          File.open('./etc/gist.txt', 'a') { |f| f.write "* #{release.release_name} = https://anonfiles.com/file/#{anon_hash}\n" }
+          File.truncate(reply, 0)
+        end
       end
 
-      if feed.nzb && feed.nfo
-        system("zip -vjr #{zip} #{download_location}/* -x \"*.DS_Store\"" )
-        feed.update_attribute(:zip, zip)
-        puts success(".zip created - #{feed.album_title}")
-
-        reply = './log/reply.txt'
-        system("curl -kF \"file=@#{zip}\" https://anonfiles.com/api/hotlink -o \"#{reply}\"")
-        zip_location = IO.readlines(reply)[0]
-        anon_hash = /\b[A-Za-z0-9]{32}\b/.match(zip_location)
-        feed.update_attribute(:zip_uploaded_url, "https://anonfiles.com/file/#{anon_hash}")
-        puts success("#{feed.album_title} = https://anonfiles.com/file/#{anon_hash}")
-        if Autoaudio::Config::TWITTER_SETTINGS[:tweet_nzbs] == true
-          write_gist("#{feed.album_title} = https://anonfiles.com/file/#{anon_hash}")
+      def gist_tweet_releases
+        unless File.zero?('./etc/gist.txt')
+          system("gist -c -p -d \"#{DateTime.now}\" -f \"#{DateTime.now}\" './etc/gist.txt' -f download.thor './etc/download.thor'")
+          system("t set active \"#{Settings.twitter_username}\"")
+          system("t update `pbpaste`")
+          File.truncate('./etc/gist.txt', 0)
         end
-        File.truncate(reply, 0)
       end
+    end
 
+    desc 'open_nzbs GENRE AUDIO_FORMAT', 'Download a specific genre\'s .nzb\'s. Defaults to FLAC and MP3'
+    def open_nzbs(release_genre_formatted, release_audio_format="MP3|FLAC")
+      Release.where(
+        release_audio_format: %r(#{release_audio_format}),
+        release_genre_formatted: release_genre_formatted,
+        release_nzb_opened: false
+      ).each do |release|
+        system("open #{release.release_nzb_location}")
+        release.update_attribute(:release_nzb_opened, true)
+        say "#{release.release_name}", :cyan
+      end
     end
 
   end
 end
+
+

data/lib/autoaudio/genre.rb

@@ -0,0 +1,14 @@
+module Autoaudio
+
+  class Genre
+    include Autoaudio::Utils
+    include Mongoid::Document
+
+    field :genre_name,            type: String
+    field :genre_name_formatted,  type: String,  default: -> { format_string(self.genre_name) }
+    field :genre_number,          type: Integer
+    field :genre_url,             type: String,  default: -> { "http://nfodb.net.ru/index.php?genreid=#{self.genre_number}" }
+    field :genre_rss_url,         type: String,  default: -> { "http://nfodb.net.ru/rss.php?type=#{self.genre_number}" }
+  end
+
+end

data/lib/autoaudio/make.rb

@@ -0,0 +1,102 @@
+module Autoaudio
+  class Make < Thor
+  include Autoaudio::Utils
+
+    desc 'releases', 'make all releases'
+    method_option :initial, :type => :boolean, :aliases => "-i"
+    def releases
+      if options.initial?
+        if yes?("This could take quite a while. Are you sure? [yN]")
+          say "Making Genres...", :white
+          say ""
+          say ""
+          genres
+          say "Making Release Dates...", :white
+          say ""
+          say ""
+          release_dates
+          say "Making Releases...", :white
+          say ""
+          say ""
+          ReleaseDate.each { |release_date| parse_single_page(release_date.release_date_url) }
+        end
+      end
+      say "Parsing Latest Feed...", :white
+      say ""
+      say ""
+      parse_feed
+      if options.initial?
+        say "Phew..."
+      end
+    end
+
+    desc 'genres', 'makes all genres'
+    def genres
+      doc = Nokogiri::HTML(open('http://nfodb.net.ru/index.php?genreid=0'))
+      doc.xpath('//*[@id="content"]/div[1]/form/select').children.map do |child|
+        unless Genre.where(genre_name: child.text).exists?
+          genre = Genre.create(
+            :genre_name           => child.text,
+            :genre_number         => child['value']
+          )
+          say "#{genre}", :green
+        end
+      end
+    end
+
+    desc 'release_dates', 'makes all release dates'
+    def release_dates
+      doc = Nokogiri::HTML(open("http://nfodb.net.ru/"))
+      doc.xpath('//*[@id="content"]/form[2]/select').children.map do |child|
+        unless ReleaseDate.where(release_date_string: child.text).exists?
+          release_date_string = child.text
+          r_date              = Date.parse(child.text.gsub(/\./, '-'))
+          max_r_date          = Date.today - Settings.maximum_retention
+          if r_date > max_r_date
+            release_date = ReleaseDate.create(
+              :release_date_string => release_date_string,
+              :release_date        => r_date
+            )
+            say "#{release_date}", :green
+          end
+        end
+      end
+    end
+
+    no_commands do
+      def parse_single_page(url="http://nfodb.net.ru/")
+        doc = Nokogiri::HTML(open(url))
+        release_row = doc.css("html > body > div:nth-of-type(4) > div > table > tr").map do |r|
+          unless r.css('td:nth-of-type(2) > a').empty?
+            unless Release.where(release_name: r.css('td:nth-of-type(2) > a').text).exists?
+              release = Release.create(
+                :release_name              => r.css('td:nth-of-type(2) > a').text,
+                :release_date              => Date.parse(r.css('td:nth-of-type(1) > b').text.gsub(/\./, '-')),
+                :release_genre             => r.css('td:nth-of-type(3) > a').text,
+                :release_number            => r.css('td:nth-of-type(5) > a').map { |a| a['href'].match(/get_nfo-(.*?)\.php/)[1] }.join
+              )
+            say "#{release}", :green
+            end
+          end
+        end
+      end
+
+      def parse_feed
+        doc = Nokogiri::XML(open("http://nfodb.net.ru/rss.php"))
+        doc.search('item').map do |doc_item|
+          unless Release.where(release_name: doc_item.at('title').text.gsub(/\[(.*?)\]./, '')).exists?
+            release = Release.create(
+              :release_name    => doc_item.at('title').text.gsub(/\[(.*?)\]./, ''),
+              :release_date    => Date.parse(doc_item.at('description').text.gsub(/Date:./,'').gsub(/\./, '-')),
+              :release_genre   => doc_item.at('title').text[/[^\[]+[^\\]\]/].gsub(/[\[(.*?)\]]/,''),
+              :release_number  => doc_item.at('link').text.match(/(http:\/\/nfodb.net.ru\/nfo-)(.*?)(.html)/)[2]
+            )
+            say "#{release}", :green
+          end
+        end
+      end
+    end
+
+
+  end
+end

data/lib/autoaudio/release.rb

@@ -0,0 +1,30 @@
+module Autoaudio
+
+  class Release
+    include Autoaudio::Utils
+    include Mongoid::Document
+    include Mongoid::Timestamps
+
+    field :release_name,            type: String
+    field :release_date,            type: Date
+    field :release_genre,           type: String
+    field :release_genre_formatted, type: String,  default: -> { format_string(self.release_genre) }
+    field :release_number,          type: Integer
+    field :release_nfo_url,         type: String,  default: -> { "http://nfodb.net.ru/get_nfo-#{self.release_number}.php" }
+    field :release_audio_format,    type: String,  default: -> { test_audio_format(self.release_name) }
+
+    field :release_nfo_downloaded,        type: Boolean, default: false
+    field :release_nfo_location,          type: String,  default: nil
+
+    field :release_nzb_downloaded,        type: Boolean, default: false
+    field :release_nzb_location,          type: String,  default: nil
+    field :release_nzb_download_method,   type: String,  default: nil
+    field :release_nzb_download_attempts, type: Integer, default: 0
+    field :release_nzb_opened,            type: Boolean, default: false
+
+    field :release_zip_location,          type: String,  default: nil
+    field :release_zip_uploaded_url,      type: String,  default: nil
+    field :release_zip_created,           type: Boolean, default: false
+  end
+
+end

data/lib/autoaudio/release_date.rb

@@ -0,0 +1,11 @@
+module Autoaudio
+
+  class ReleaseDate
+    include Mongoid::Document
+
+    field :release_date_string, type: String
+    field :release_date,        type: Date
+    field :release_date_url,    type: String, default: -> { "http://nfodb.net.ru/index.php?rlsday=#{self.release_date_string}&do_search=Show" }
+
+  end
+end

data/lib/autoaudio/settings_setup.rb

@@ -0,0 +1,33 @@
+module Autoaudio
+
+  module Settings
+    extend self
+
+    def parameter(*names)
+      names.each do |name|
+        attr_accessor name
+
+        define_method name do |*values|
+          value = values.first
+          value ? self.send("#{name}=", value) : instance_variable_get("@#{name}")
+        end
+      end
+    end
+
+    def config(&block)
+      instance_eval &block
+    end
+  end
+
+end
+
+Autoaudio::Settings.config do
+  parameter :download_location
+  parameter :maximum_retention
+  parameter :nzb_client
+  parameter :zip_files
+  parameter :share_files
+  parameter :tweet_files
+  parameter :twitter_username
+end
+

data/lib/autoaudio/setup.rb

@@ -0,0 +1,25 @@
+module Autoaudio
+  class Setup < Thor
+
+    desc 'setup', 'initial settings'
+    def setup
+      if yes?("Autoaudio is not initialized. Do you want to enter settings now? [yN]")
+        # say ""
+        # say "instructions:"
+        # say ""
+        # say ""
+        # say "Change initialized to true"
+        # say ""
+        # say "download_location is where your nfo and nzb files will go"
+        # say "maximum_retention is how long your usenet provider holds on to files"
+        # say "nzb_client is, um, your nzb client"
+        # say "zip files, zips files"
+        # say "share_files allows your nzbs and nfo files to be gisted and tweeted"
+        # say "tweet_files, tweets files"
+        # say "twitter_username is your twitter username"
+        system("open './config/settings.rb'")
+      end
+    end
+
+  end
+end

data/lib/autoaudio/stats.rb

@@ -0,0 +1,12 @@
+module Autoaudio
+  class Stats < Thor
+
+    desc 'audio_format_count', 'audio format count'
+    def audio_format_count
+      puts "#{Release.count} Releases"
+      puts "#{Release.where(release_audio_format: 'MP3').count} MP3 Releases"
+      puts "#{Release.where(release_audio_format: 'FLAC').count} FLAC Releases"
+    end
+
+  end
+end

data/lib/autoaudio/utils.rb

@@ -0,0 +1,29 @@
+module Autoaudio
+  module Utils
+    def write_gist(string)
+      File.open('./log/gist.txt', 'a') { |f| f.write "* #{string}\n" }
+    end
+
+    def sanitize_filename(filename)
+      fn = filename.split(/(?<=.)\.(?=[^.])(?!.*\.[^.])/m)
+      fn.map! { |s| s.gsub( /[^a-z0-9\-]+/i, '_') }
+      return fn.join('.')
+    end
+
+    def test_audio_format(string)
+      string = string.dup
+      string.match(/FLAC/) ? string = "FLAC" : string = "MP3"
+    end
+
+    def format_string(string)
+      string = string.dup
+      string.gsub!(/&/, '_and_') if string.match(/\w&\w/)
+      string.gsub!(/\+/, '_and_')
+      string.gsub!(/&/, 'and')
+      string.gsub!(/-/, '_')
+      string.gsub!(/ / ,'_')
+      string.downcase!
+      string
+    end
+  end
+end

data/lib/autoaudio/version.rb

@@ -1,3 +1,3 @@
 module Autoaudio
-  VERSION = "0.0.3"
+  VERSION = "0.0.4"
 end

data/tasks/gem.thor

@@ -0,0 +1,22 @@
+require 'bundler'
+
+class Gem < Thor
+  include Thor::RakeCompat
+  Bundler::GemHelper.install_tasks
+
+  desc 'build', "Build autoaudio-#{Autoaudio::VERSION}.gem into the pkg directory"
+  def build
+    Rake::Task['build'].execute
+  end
+
+  desc 'install', "Build and install autoaudio-#{Autoaudio::VERSION}.gem into system gems"
+  def install
+    Rake::Task['install'].execute
+  end
+
+  desc 'release', "Create tag v#{Autoaudio::VERSION} and build and push autoaudio-#{Autoaudio::VERSION}.gem to Rubygems"
+  def release
+    Rake::Task['release'].execute
+  end
+end
+

data/tasks/tests.thor

@@ -0,0 +1,7 @@
+class Tests < Thor
+
+  desc 'empty_test', 'empty test'
+  def empty_test
+  end
+
+end

metadata

@@ -1,14 +1,14 @@
 --- !ruby/object:Gem::Specification
 name: autoaudio
 version: !ruby/object:Gem::Version
-  version: 0.0.3
+  version: 0.0.4
 platform: ruby
 authors:
 - Gene Locklin
 autorequire: 
 bindir: bin
 cert_chain: []
-date: 2014-01-18 00:00:00.000000000 Z
+date: 2014-04-15 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: mechanize
@@ -24,6 +24,20 @@ dependencies:
     - - ">="
       - !ruby/object:Gem::Version
         version: '0'
+- !ruby/object:Gem::Dependency
+  name: awesome_print
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - ">="
+      - !ruby/object:Gem::Version
+        version: '0'
 - !ruby/object:Gem::Dependency
   name: mongoid
   requirement: !ruby/object:Gem::Requirement
@@ -39,7 +53,7 @@ dependencies:
       - !ruby/object:Gem::Version
         version: '0'
 - !ruby/object:Gem::Dependency
-  name: thor
+  name: retries
   requirement: !ruby/object:Gem::Requirement
     requirements:
     - - ">="
@@ -53,7 +67,7 @@ dependencies:
       - !ruby/object:Gem::Version
         version: '0'
 - !ruby/object:Gem::Dependency
-  name: gist
+  name: thor
   requirement: !ruby/object:Gem::Requirement
     requirements:
     - - ">="
@@ -67,7 +81,7 @@ dependencies:
       - !ruby/object:Gem::Version
         version: '0'
 - !ruby/object:Gem::Dependency
-  name: t
+  name: gist
   requirement: !ruby/object:Gem::Requirement
     requirements:
     - - ">="
@@ -176,21 +190,31 @@ files:
 - Gemfile
 - LICENSE.txt
 - README.md
-- Rakefile
+- Thorfile
 - autoaudio.gemspec
 - bin/autoaudio
 - config/mongoid.yml
-- etc/aa.jpg
+- config/settings.rb
 - etc/download.thor
+- etc/gist.txt
+- etc/reply.txt
+- images/aa.jpg
 - lib/autoaudio.rb
-- lib/autoaudio/cli/application.rb
+- lib/autoaudio/cli.rb
+- lib/autoaudio/destroy.rb
 - lib/autoaudio/download.rb
-- lib/autoaudio/feed.rb
-- lib/autoaudio/settings.rb
-- lib/autoaudio/utility.rb
+- lib/autoaudio/genre.rb
+- lib/autoaudio/make.rb
+- lib/autoaudio/release.rb
+- lib/autoaudio/release_date.rb
+- lib/autoaudio/settings_setup.rb
+- lib/autoaudio/setup.rb
+- lib/autoaudio/stats.rb
+- lib/autoaudio/utils.rb
 - lib/autoaudio/version.rb
-- log/gist.txt
-- log/reply.txt
+- log/.gitkeep
+- tasks/gem.thor
+- tasks/tests.thor
 homepage: https://github.com/GeneLocklin/autoaudio
 licenses:
 - MIT
@@ -211,7 +235,7 @@ required_rubygems_version: !ruby/object:Gem::Requirement
       version: '0'
 requirements: []
 rubyforge_project: 
-rubygems_version: 2.1.11
+rubygems_version: 2.2.2
 signing_key: 
 specification_version: 4
 summary: Automatically download scene .nfo and .nzb files

data/Rakefile

@@ -1 +0,0 @@
-require "bundler/gem_tasks"

data/lib/autoaudio/cli/application.rb

@@ -1,83 +0,0 @@
-require 'thor'
-
-module Autoaudio
-  module Cli
-    class Application < Thor
-
-      desc 'setup', 'Opens the application settings'
-      def setup
-        system("open #{File.expand_path("../../settings.rb", __FILE__)}")
-      end
-
-      desc 'display_configuration_settings', 'Displays the application configuration settings'
-      def display_configuration_settings
-        puts "Autoaudio::VERSION = #{Autoaudio::VERSION}"
-        puts "Download location = #{Autoaudio::Config::NZB_DOWNLOAD_LOCATION[:directory]}"
-        puts "Tweet = #{Autoaudio::Config::TWITTER_SETTINGS[:tweet_nzbs]}"
-        if Autoaudio::Config::TWITTER_SETTINGS[:tweet_nzbs] == true
-          puts "Twitter Username = #{Autoaudio::Config::TWITTER_SETTINGS[:username]}"
-        end
-      end
-
-      desc 'make_feeds', 'Make all feeds'
-      def make_feeds
-        Feed.make
-      end
-
-      desc 'destroy_feeds', 'Destroy all feeds'
-      def destroy_feeds
-        Feed.destroy_all
-      end
-
-      desc 'count_feeds', 'Count all feeds'
-      def count_feeds
-        Feed.count
-      end
-
-      desc 'display_feeds', 'Display all feeds'
-      def display_feeds
-        Feed.each { |f| pp f }
-      end
-
-      desc 'download', 'Downloads all feeds'
-      def download
-        Feed.make
-        feeds = Feed.where(downloaded: false).each.to_a
-        i = (feeds.length / 5)
-        while i > 0
-          new_array = Array.new
-          5.times do
-            new_array << feeds.pop
-          end
-          new_array.each { |feed| Download.album(feed) }
-          sleep 20
-          i -= 1
-        end
-        unless File.zero?('./log/gist.txt')
-          system("gist -c -p -d \"#{DateTime.now}\" -f \"#{DateTime.now}\" './log/gist.txt' -f download.thor './etc/download.thor'")
-          if Autoaudio::Config::TWITTER_SETTINGS[:tweet_nzbs] == true
-            system("t set active #{Autoaudio::Config::TWITTER_SETTINGS[:username]}")
-            system("t update `pbpaste`")
-          end
-        end
-        File.truncate('./log/gist.txt', 0)
-      end
-
-      desc 'download_genre GENRE', 'Download a specific genre'
-      def download_genre(genre_formatted)
-        genre = Feed.where(
-          # audio_format: "MP3",
-          genre_formatted: genre_formatted,
-          nzb_opened: false
-        )
-        genre.each do |feed|
-          if feed.nzb != nil
-            system("open #{feed.nzb}")
-            feed.update_attribute(:nzb_opened, true)
-          end
-        end
-      end
-
-    end
-  end
-end

data/lib/autoaudio/feed.rb

@@ -1,77 +0,0 @@
-module Autoaudio
-  class Feed
-    include Mongoid::Document
-    include Mongoid::Timestamps
-
-    field :release_date,      type: DateTime
-    field :release_number,    type: Integer
-    field :genre,             type: String
-    field :genre_formatted,   type: String
-    field :album_title,       type: String
-    field :downloaded,        type: Boolean
-    field :download_attempts, type: Integer
-    field :download_method,   type: String
-    field :audio_format,      type: String
-    field :nzb,               type: String
-    field :nzb_opened,        type: Boolean
-    field :nfo,               type: String
-    field :zip,               type: String
-    field :zip_uploaded_url,  type: String
-
-    def self.make
-      feeds = parse
-      feeds.each do |f|
-        unless Feed.where(album_title: f[:album]).exists?
-          feed = Feed.create(
-            :release_date      => f[:date],
-            :release_number    => f[:release_number],
-            :genre             => f[:genre],
-            :genre_formatted   => format_string(f[:genre]),
-            :album_title       => f[:album],
-            :downloaded        => false,
-            :download_attempts => 0,
-            :download_method   => nil,
-            :audio_format      => test_audio_format(f[:album]),
-            :nzb               => nil,
-            :nzb_opened        => false,
-            :nfo               => nil,
-            :zip               => nil,
-            :zip_uploaded_url  => nil
-          )
-          feed.save
-        end
-      end
-    end
-
-    class << self
-      private
-
-      def parse(feed="http://nfodb.net.ru/rss.php")
-        doc = Nokogiri::XML(open(feed))
-        doc.search('item').map do |doc_item|
-          item = {}
-          item[:link]            = doc_item.at('link').text
-          item[:album]           = doc_item.at('title').text.gsub(/\[(.*?)\]./, '')
-          item[:genre]           = doc_item.at('title').text[/[^\[]+[^\\]\]/].gsub(/[\[(.*?)\]]/,'')
-          item[:date]            = doc_item.at('description').text.gsub(/Date:./,'')
-          item[:release_number]  = doc_item.at('link').text.match(/(http:\/\/nfodb.net.ru\/nfo-)(.*?)(.html)/)[2]
-          item
-        end
-      end
-      def format_string(string)
-        string = string.dup
-        string.gsub!(/&/, '_and_') if string.match(/\w&\w/)
-        string.gsub!(/\+/, '_and_')
-        string.gsub!(/&/, 'and')
-        string.gsub!(/-/, '_')
-        string.gsub!(/ / ,'_')
-        string.downcase!
-        string
-      end
-      def test_audio_format(string)
-        string = string.dup
-        string.match(/FLAC/) ? string = "FLAC" : string = "MP3"
-      end
-    end
-  end
-end

data/lib/autoaudio/settings.rb

@@ -1,6 +0,0 @@
-module Autoaudio
-  module Config
-    NZB_DOWNLOAD_LOCATION = {:directory => "#{Dir.home}/Downloads/Albums"}
-    TWITTER_SETTINGS      = {:tweet_nzbs => true, :username => 'usenetdecoded'}
-  end
-end

data/lib/autoaudio/utility.rb

@@ -1,24 +0,0 @@
-require 'autoaudio'
-
-module Utility
-
-  def success(string)
-    %Q(\e[32m#{string}\e[0m)
-  end
-
-  def failure(string)
-    %Q(\e[1;41;37m#{string}\e[0m)
-  end
-
-  def write_gist(string)
-    File.open('./log/gist.txt', 'a') { |f| f.write "* #{string}\n" }
-  end
-
-  def sanitize_filename(filename)
-    fn = filename.split(/(?<=.)\.(?=[^.])(?!.*\.[^.])/m)
-    fn.map! { |s| s.gsub( /[^a-z0-9\-]+/i, '_') }
-    return fn.join('.')
-  end
-
-end
-