eztv_scraper 0.1.6

checksums.yaml

@@ -0,0 +1,7 @@
+---
+SHA256:
+  metadata.gz: 21c20f4cdafc7389a10141ffb21bb2688a1f875c1f9d83e81aee8b8d9b6a0681
+  data.tar.gz: 26b2b237f2132f32d12f687d804300a3532139cb017a5ae0bc3274277107bb8d
+SHA512:
+  metadata.gz: d07848e4bc4d2eb00d076a6bc97a97b44f6dac827cda87ee03342d8db6ef9d1a926910f59bb851c42fe170ee9f4e3b7692ddf428cea601b08825474aba4677a2
+  data.tar.gz: 01046e70701c10a1acfcb3ba212168aba826a0586fdf0f7fa5c3601b8d9fbb821e76f53204eae97e5be356fda7ec2dbcaa11f87c8fd70c0f8bcb3b827bc3e2ce

data/Gemfile

@@ -0,0 +1,3 @@
+source 'https://rubygems.org'
+
+gemspec

data/README.md

@@ -0,0 +1,112 @@
+# EZTV Scraper
+
+> EZTV-Scraper looks for any selected show on eztv.io and saves magnet links of every single available episode  into a JSON file.
+
+## Quick Start
+
+Install the gem from RubyGems
+`gem install eztv_scraper`
+
+Run it anywhere
+`eztv_scraper`
+
+---
+
+![Welcome](https://imgur.com/rhkE4jp.png)
+
+The app heavily uses assets from TTY to beautify the interface.
+
+![welcome code](https://imgur.com/EGjUZD7.png)
+
+Most of the app doesn't pass any values or parameters to each other. They simply take your selections and downloads the data you want.
+
+![Parsing the page](https://imgur.com/YdQC0Iu.png)
+
+This module parses the websites.
+
+![enter image description here](https://imgur.com/NXXTvhZ.png)
+
+As there are over 6500 shows listed on EZTV, I've filtered the program to parse only the Top 500 show, as ranked by IMDb. You can easily change this in the `./lib/eztv-scraper/ui.rb` file, by changing the loop to the number of shows you want. If you want the app to parse the entire site, you need to change `500` to `all_shows`  and un-comment when we declare `all_shows`
+
+![List of Options](https://imgur.com/MHlgxy1.png)![Showlist](https://imgur.com/qfPEPb7.png)
+
+The app goes through a sequence of methods to grab parse a new page, look for episodes, and downloads them into a file.
+
+![Downloading](https://imgur.com/IMB9mgL.png)
+
+Here's how a JSON file looks like of the scraped page. The first item is a hash of details on the show, and every following item is a hash of every available episode.
+
+![JSON](https://imgur.com/G99jav0.png)
+
+
+
+## Built With
+
+- [Ruby](https://www.ruby-lang.org/en/)
+- [httparty](https://github.com/jnunemaker/httparty)
+- [nokogiri](https://nokogiri.org/)
+- [nikkou](https://github.com/tombenner/nikkou)
+- [tty](https://ttytoolkit.org)
+- [io/console](https://github.com/ruby/io-console)
+- [json](https://rubygems.org/gems/json/versions/1.8.3)
+- [byebug](https://github.com/deivid-rodriguez/byebug)
+- [rspec](https://github.com/rspec/rspec)
+- [vcr](https://github.com/vcr/vcr)
+
+
+## Getting Started
+
+
+### Prerequisites
+You will need **Ruby 2.5** or above.
+Visit https://www.ruby-lang.org/en/downloads/ to get your copy.
+
+### Setup
+Clone this repo onto your local machine. Make sure you have [git](https://git-scm.com/) installed or use [GiHub Desktop](https://desktop.github.com/).
+```
+$ git clone https://github.com/simonpeterdebbarma/eztv-scraper.git
+```
+
+### Install
+This command will install all necessary gems into your system to run this app.
+```
+$ bundle install
+```
+
+### Usage/Deployment
+In your terminal, run this command.
+```
+$ ruby bin/eztv-scraper.rb
+```
+### Run tests
+```
+$ gem install rspec
+$ rspec
+```
+
+## Authors
+
+👤 **Simon Peter Debbarma**
+
+- Github: [@simonpeterdebbarma](https://github.com/simonpeterdebbarma)
+- Twitter: [@SimonLikelySaid](https://twitter.com/SimonLikelySaid)
+- Linkedin: [Simon](https://www.linkedin.com/in/simon-peter-debbarma/)
+
+## 🤝 Contributing
+
+Contributions, issues and feature requests are welcome!
+
+Feel free to check the [issues page](issues/).
+
+## Show your support
+
+Give a ⭐️ if you like this project!
+
+## Acknowledgments
+
+- [Microverse](https://www.microverse.org/)
+
+## 📝 License
+
+This project is [GNU General Public License v3.0](https://www.gnu.org/licenses/gpl-3.0.en.html) licensed.
+

data/bin/eztv_scraper

@@ -0,0 +1,5 @@
+#!/usr/bin/env ruby
+
+require_relative '../lib/eztv_scraper'
+
+EZTVScraper.new

data/lib/eztv_scraper.rb

@@ -0,0 +1,28 @@
+require 'nokogiri'
+require 'httparty'
+require 'byebug'
+require 'json'
+require 'tty-prompt'
+require 'nikkou'
+require 'tty-progressbar'
+require 'pastel'
+require 'tty-spinner'
+require 'tty-font'
+require 'io/console'
+
+require_relative './eztv_scraper/user_interface'
+require_relative './eztv_scraper/parser'
+require_relative './eztv_scraper/showlist'
+require_relative './eztv_scraper/output'
+
+class EZTVScraper
+  include UserInterface
+  include Parser
+  include Showlist
+  include Output
+
+  def initialize
+    @pastel = Pastel.new
+    welcome
+  end
+end

data/lib/eztv_scraper/output.rb

@@ -0,0 +1,23 @@
+class EZTVScraper
+  module Output
+    def json_output
+      puts
+      spinner = TTY::Spinner.new('[:spinner] Writing to /eztv-scraped', format: :dots, success_mark: '+')
+      spinner.auto_spin
+      magnets = JSON.pretty_generate(@output)
+      page_title = @parsed_page.css('td.section_post_header span').text.gsub(/\W/, '')
+      Dir.mkdir('./eztv-scraped') unless Dir.exist? './eztv-scraped'
+      local_fname = './eztv-scraped/' + page_title + '.json'
+      local_file = File.open(local_fname, 'w')
+      local_file.write(magnets)
+      local_file.close
+      spinner.success(@pastel.blue('(✔)'))
+      spinner.error(@pastel.red('(✖)'))
+      puts
+      puts ' All Tasks Completed Successfully!'
+      puts
+      puts ' ---'
+      puts
+    end
+  end
+end

data/lib/eztv_scraper/parser.rb

@@ -0,0 +1,25 @@
+class EZTVScraper
+  module Parser
+    def list_parser
+      puts
+      spinner = TTY::Spinner.new('[:spinner] Parsing EZTV', format: :dots, success_mark: '+')
+      spinner.auto_spin
+      @eztvurl = 'https://eztv.io/showlist/rating/'
+      unparsed_showlist = HTTParty.get(@eztvurl)
+      @parsed_showlist = Nokogiri::HTML(unparsed_showlist.body)
+      spinner.success(@pastel.blue('(✔)'))
+      spinner.error(@pastel.red('(✖)'))
+      puts
+    end
+
+    def parsed_show
+      spinner = TTY::Spinner.new('[:spinner] Looking for episodes', format: :dots, success_mark: '+')
+      spinner.auto_spin
+      @showurl = @series_link
+      unparsed_page = HTTParty.get(@showurl)
+      @parsed_page = Nokogiri::HTML(unparsed_page.body)
+      spinner.success(@pastel.blue('(✔)'))
+      spinner.error(@pastel.red('(✖ Something went wrong)'))
+    end
+  end
+end

data/lib/eztv_scraper/showlist.rb

@@ -0,0 +1,56 @@
+class EZTVScraper
+  module Showlist
+    def showlist
+      list_parser
+      @shows = []
+      complete = @pastel.on_green(' ')
+      incomplete = @pastel.on_red(' ')
+      # all_shows =  @output.css('td.forum_thread_post').count / 3
+      bar = TTY::ProgressBar.new('Grabbing your favorite shows [:bar]', total: 500, width: 50, complete: complete, incomplete: incomplete)
+      500.times do |n|
+        @shows << @parsed_showlist.css('td.forum_thread_post')[n * 3].text
+        bar.advance(1)
+      end
+      puts
+      show_prompt
+    end
+
+    def show_info
+      parsed_show
+      puts
+      spinner = TTY::Spinner.new('[:spinner] Grabbing show details', format: :dots, success_mark: '+')
+      spinner.auto_spin
+      @output = []
+      show_info = {
+        title: @parsed_page.css('td.section_post_header span')&.text,
+        description: @parsed_page.css('td.show_info_banner_logo p')&.text,
+        poster: '' + @parsed_page.css('td.show_info_main_logo').children.css('img')&.attribute('src')&.value,
+        imdb_rating: @parsed_page.css('td.show_info_rating_score div')[1].css('b span')&.text
+      }
+      @output << show_info
+      spinner.success(@pastel.blue('(✔)'))
+      spinner.error(@pastel.red('(✖)'))
+    end
+
+    def episodes_info
+      spinner = TTY::Spinner.new('[:spinner] Pulling magnets', format: :dots, success_mark: '+')
+      spinner.auto_spin
+      episodes = @parsed_page.css('tr.forum_header_border')
+      episodes.size.times do |n|
+        thread_posts = episodes[n].css('td.forum_thread_post')
+        ep = {
+          episode_name: thread_posts[1].css('a')&.text,
+          magnet: thread_posts[2].css('a').first&.attribute('href')&.value.to_s,
+          size: thread_posts[3]&.text,
+          released: thread_posts[4]&.text,
+          seeds: episodes[n].css('td.forum_thread_post_end')&.text
+        }
+        @output << ep
+      end
+      spinner.success(@pastel.blue('(✔)'))
+      spinner.error(@pastel.red('(✖)'))
+      json_output
+      choice_search
+    end
+  end
+end

data/lib/eztv_scraper/user_interface.rb

@@ -0,0 +1,68 @@
+class EZTVScraper
+  module UserInterface
+    def welcome
+      titlefont = TTY::Font.new(:starwars)
+      subtitlefont = TTY::Font.new(:straight)
+      puts @pastel.blue(titlefont.write(' EZTV'))
+      puts @pastel.blue(titlefont.write(' Scraper'))
+      puts @pastel.blue(titlefont.write('                                      v0.1.5'))
+      sleep(2)
+      puts @pastel.red(subtitlefont.write(' Fork me on GitHub'))
+      puts @pastel.yellow(' https://github.com/simonpeterdebbarma/eztv-scraper')
+      eztv_scrapper_info
+      continue_seq
+      showlist
+    end
+
+    def show_prompt
+      @prompt = TTY::Prompt.new
+      show = @prompt.select(@pastel.magenta('Select a TV show?' + @pastel.red(' (Filter only accepts 1 word)')), @shows, filter: true, per_page: 20, keys: [:return])
+      @series_link = 'https://eztv.io' + @parsed_showlist.search('a').text_includes(show).attribute('href').value
+      puts
+      puts ' Fantastic Choice!'
+      puts
+      show_info
+      puts
+      episodes_info
+    end
+
+    def eztv_scrapper_info
+      puts
+      puts ' EZTV Scraper parses https://eztv.io and helps you download'
+      puts ' the magnets of all available episodes into a JSON file.'
+      puts
+      puts ' As there are over 6500+ shows on the website, parsing them can'
+      puts ' take a lot of time. To save time when using this project,'
+      puts ' you are limited to only the Top 500 Shows of All Time (IMDb).'
+      puts ' Check the README for instructions on changing the parameter.'
+      puts
+      puts @pastel.red(' It may take about 3 minutes to parse all the data.')
+      puts
+      puts ' How about a bit of exurb1a in the meantime?'
+      puts @pastel.blue(' https://www.youtube.com/watch?v=V_Ac-SVYI48')
+    end
+
+    def choice_search
+      choice = @prompt.yes?(' Would you like download another series?')
+      if choice
+        puts
+        show_prompt
+      else
+        goodbye
+      end
+    end
+
+    def goodbye
+      puts
+      puts @pastel.green('      ~ Thank you for using eztv-scraper! ~')
+      puts @pastel.green(' ~ Star this project on Github if you liked it ~')
+    end
+
+    def continue_seq
+      puts
+      print ' Press any key to continue...'
+      STDIN.getch
+      puts "\n"
+    end
+  end
+end

metadata

@@ -0,0 +1,206 @@
+--- !ruby/object:Gem::Specification
+name: eztv_scraper
+version: !ruby/object:Gem::Version
+  version: 0.1.6
+platform: ruby
+authors:
+- Simon Peter Debbarma
+autorequire: 
+bindir: bin
+cert_chain: []
+date: 2020-02-20 00:00:00.000000000 Z
+dependencies:
+- !ruby/object:Gem::Dependency
+  name: httparty
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 0.17.3
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 0.17.3
+- !ruby/object:Gem::Dependency
+  name: json
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 2.3.0
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 2.3.0
+- !ruby/object:Gem::Dependency
+  name: nikkou
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 0.0.5
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 0.0.5
+- !ruby/object:Gem::Dependency
+  name: nokogiri
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 1.10.8
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 1.10.8
+- !ruby/object:Gem::Dependency
+  name: pastel
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 0.7.3
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 0.7.3
+- !ruby/object:Gem::Dependency
+  name: tty-font
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 0.5.0
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 0.5.0
+- !ruby/object:Gem::Dependency
+  name: tty-progressbar
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 0.17.0
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 0.17.0
+- !ruby/object:Gem::Dependency
+  name: tty-prompt
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 0.20.0
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 0.20.0
+- !ruby/object:Gem::Dependency
+  name: tty-spinner
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 0.9.3
+  type: :runtime
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 0.9.3
+- !ruby/object:Gem::Dependency
+  name: rspec
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 3.9.0
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 3.9.0
+- !ruby/object:Gem::Dependency
+  name: byebug
+  requirement: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 11.1.1
+  type: :development
+  prerelease: false
+  version_requirements: !ruby/object:Gem::Requirement
+    requirements:
+    - - "~>"
+      - !ruby/object:Gem::Version
+        version: 11.1.1
+description: 
+email: 
+executables:
+- eztv_scraper
+extensions: []
+extra_rdoc_files: []
+files:
+- Gemfile
+- README.md
+- bin/eztv_scraper
+- lib/eztv_scraper.rb
+- lib/eztv_scraper/output.rb
+- lib/eztv_scraper/parser.rb
+- lib/eztv_scraper/showlist.rb
+- lib/eztv_scraper/user_interface.rb
+homepage: 
+licenses:
+- GPL-3.0
+metadata: {}
+post_install_message: 
+rdoc_options: []
+require_paths:
+- lib
+required_ruby_version: !ruby/object:Gem::Requirement
+  requirements:
+  - - ">="
+    - !ruby/object:Gem::Version
+      version: '0'
+required_rubygems_version: !ruby/object:Gem::Requirement
+  requirements:
+  - - ">="
+    - !ruby/object:Gem::Version
+      version: '0'
+requirements: []
+rubygems_version: 3.0.3
+signing_key: 
+specification_version: 4
+summary: eztv_scraper looks for any selected show on eztv.io and saves magnet links
+  of every single available episode into a JSON file.
+test_files: []