hail_hydra 0.1.0

Sign up to get free protection for your applications and to get access to all the features.
checksums.yaml ADDED
@@ -0,0 +1,7 @@
1
+ ---
2
+ SHA1:
3
+ metadata.gz: 9c6ed1698f46bb4598f4e91f5ebd335a5155d4fb
4
+ data.tar.gz: 0c7335b17c730177f3c60dba65283d0573104969
5
+ SHA512:
6
+ metadata.gz: 4da19eaf1f311576ec0fdca2ce7f2aab561882eb86ed811c6490deafdcbfea3ca3cb290b0fa6b7adddaaf244a35b33d6bfd729c2b128627d69bfa8b3e7a0188b
7
+ data.tar.gz: b2c74fdb664b48f26225c73862e1d48c6cee44fa2f7236462a4b4aa9cdd830abc99af78603d5de325102db14d036048f12ce73c1e0ebb37912a091cfc5eff6a0
data/.gitignore ADDED
@@ -0,0 +1,11 @@
1
+ /.bundle/
2
+ /.yardoc
3
+ /_yardoc/
4
+ /coverage/
5
+ /doc/
6
+ /pkg/
7
+ /spec/reports/
8
+ /tmp/
9
+
10
+ # rspec failure tracking
11
+ .rspec_status
data/.rspec ADDED
@@ -0,0 +1,3 @@
1
+ --format documentation
2
+ --color
3
+ --require spec_helper
@@ -0,0 +1,74 @@
1
+ # Contributor Covenant Code of Conduct
2
+
3
+ ## Our Pledge
4
+
5
+ In the interest of fostering an open and welcoming environment, we as
6
+ contributors and maintainers pledge to making participation in our project and
7
+ our community a harassment-free experience for everyone, regardless of age, body
8
+ size, disability, ethnicity, gender identity and expression, level of experience,
9
+ nationality, personal appearance, race, religion, or sexual identity and
10
+ orientation.
11
+
12
+ ## Our Standards
13
+
14
+ Examples of behavior that contributes to creating a positive environment
15
+ include:
16
+
17
+ * Using welcoming and inclusive language
18
+ * Being respectful of differing viewpoints and experiences
19
+ * Gracefully accepting constructive criticism
20
+ * Focusing on what is best for the community
21
+ * Showing empathy towards other community members
22
+
23
+ Examples of unacceptable behavior by participants include:
24
+
25
+ * The use of sexualized language or imagery and unwelcome sexual attention or
26
+ advances
27
+ * Trolling, insulting/derogatory comments, and personal or political attacks
28
+ * Public or private harassment
29
+ * Publishing others' private information, such as a physical or electronic
30
+ address, without explicit permission
31
+ * Other conduct which could reasonably be considered inappropriate in a
32
+ professional setting
33
+
34
+ ## Our Responsibilities
35
+
36
+ Project maintainers are responsible for clarifying the standards of acceptable
37
+ behavior and are expected to take appropriate and fair corrective action in
38
+ response to any instances of unacceptable behavior.
39
+
40
+ Project maintainers have the right and responsibility to remove, edit, or
41
+ reject comments, commits, code, wiki edits, issues, and other contributions
42
+ that are not aligned to this Code of Conduct, or to ban temporarily or
43
+ permanently any contributor for other behaviors that they deem inappropriate,
44
+ threatening, offensive, or harmful.
45
+
46
+ ## Scope
47
+
48
+ This Code of Conduct applies both within project spaces and in public spaces
49
+ when an individual is representing the project or its community. Examples of
50
+ representing a project or community include using an official project e-mail
51
+ address, posting via an official social media account, or acting as an appointed
52
+ representative at an online or offline event. Representation of a project may be
53
+ further defined and clarified by project maintainers.
54
+
55
+ ## Enforcement
56
+
57
+ Instances of abusive, harassing, or otherwise unacceptable behavior may be
58
+ reported by contacting the project team at Gr3atWh173@users.noreply.github.com. All
59
+ complaints will be reviewed and investigated and will result in a response that
60
+ is deemed necessary and appropriate to the circumstances. The project team is
61
+ obligated to maintain confidentiality with regard to the reporter of an incident.
62
+ Further details of specific enforcement policies may be posted separately.
63
+
64
+ Project maintainers who do not follow or enforce the Code of Conduct in good
65
+ faith may face temporary or permanent repercussions as determined by other
66
+ members of the project's leadership.
67
+
68
+ ## Attribution
69
+
70
+ This Code of Conduct is adapted from the [Contributor Covenant][homepage], version 1.4,
71
+ available at [http://contributor-covenant.org/version/1/4][version]
72
+
73
+ [homepage]: http://contributor-covenant.org
74
+ [version]: http://contributor-covenant.org/version/1/4/
data/Gemfile ADDED
@@ -0,0 +1,6 @@
1
+ source "https://rubygems.org"
2
+
3
+ git_source(:github) {|repo_name| "https://github.com/#{repo_name}" }
4
+
5
+ # Specify your gem's dependencies in hail_hydra.gemspec
6
+ gemspec
data/Gemfile.lock ADDED
@@ -0,0 +1,43 @@
1
+ PATH
2
+ remote: .
3
+ specs:
4
+ hail_hydra (0.1.0)
5
+ httparty
6
+ nokogiri
7
+
8
+ GEM
9
+ remote: https://rubygems.org/
10
+ specs:
11
+ diff-lcs (1.3)
12
+ httparty (0.16.2)
13
+ multi_xml (>= 0.5.2)
14
+ mini_portile2 (2.3.0)
15
+ multi_xml (0.6.0)
16
+ nokogiri (1.8.4-x64-mingw32)
17
+ mini_portile2 (~> 2.3.0)
18
+ rake (10.5.0)
19
+ rspec (3.7.0)
20
+ rspec-core (~> 3.7.0)
21
+ rspec-expectations (~> 3.7.0)
22
+ rspec-mocks (~> 3.7.0)
23
+ rspec-core (3.7.1)
24
+ rspec-support (~> 3.7.0)
25
+ rspec-expectations (3.7.0)
26
+ diff-lcs (>= 1.2.0, < 2.0)
27
+ rspec-support (~> 3.7.0)
28
+ rspec-mocks (3.7.0)
29
+ diff-lcs (>= 1.2.0, < 2.0)
30
+ rspec-support (~> 3.7.0)
31
+ rspec-support (3.7.1)
32
+
33
+ PLATFORMS
34
+ x64-mingw32
35
+
36
+ DEPENDENCIES
37
+ bundler (~> 1.16)
38
+ hail_hydra!
39
+ rake (~> 10.0)
40
+ rspec (~> 3.0)
41
+
42
+ BUNDLED WITH
43
+ 1.16.1
data/LICENSE.txt ADDED
@@ -0,0 +1,21 @@
1
+ The MIT License (MIT)
2
+
3
+ Copyright (c) 2018 Gr3atWh173
4
+
5
+ Permission is hereby granted, free of charge, to any person obtaining a copy
6
+ of this software and associated documentation files (the "Software"), to deal
7
+ in the Software without restriction, including without limitation the rights
8
+ to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
9
+ copies of the Software, and to permit persons to whom the Software is
10
+ furnished to do so, subject to the following conditions:
11
+
12
+ The above copyright notice and this permission notice shall be included in
13
+ all copies or substantial portions of the Software.
14
+
15
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
16
+ IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
17
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
18
+ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
19
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
20
+ OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN
21
+ THE SOFTWARE.
data/README.md ADDED
@@ -0,0 +1,60 @@
1
+ # HailHydra
2
+
3
+ <img src="logo.jpg"></img><brs>
4
+
5
+ HailHydra is an unofficial pseudo-API for ThePirateBay.
6
+
7
+ ## Installation
8
+
9
+ Add this line to your application's Gemfile:
10
+
11
+ ```ruby
12
+ gem 'hail_hydra'
13
+ ```
14
+
15
+ And then execute:
16
+
17
+ $ bundle
18
+
19
+ Or install it yourself as:
20
+
21
+ $ gem install hail_hydra
22
+
23
+ ## Usage
24
+
25
+ From the command line:
26
+ ```
27
+ $ thepiratebay totallynotillegal
28
+ ```
29
+
30
+ From code
31
+ ```ruby
32
+ s = HailHydra::TPB.new("https://thepiratebay.org")
33
+
34
+ res = s.search('totallynotillegal')
35
+ res.each do |torrent|
36
+ puts torrent.name + " " + torrent.url
37
+ end
38
+
39
+ ```
40
+
41
+ ## Future releases
42
+ 1. Scrape more info about the torrents
43
+ 2. Add functionality to allow uploading torrents
44
+ 3. Add user auth?
45
+ 4. Add ability to comment
46
+
47
+ ## Contributing
48
+
49
+ Bug reports and pull requests are welcome on GitHub at https://github.com/Gr3atWh173/hail_hydra. This project is intended to be a safe, welcoming space for collaboration, and contributors are expected to adhere to the [Contributor Covenant](http://contributor-covenant.org) code of conduct.
50
+
51
+ ## License
52
+
53
+ The gem is available as open source under the terms of the [MIT License](https://opensource.org/licenses/MIT).
54
+
55
+ ## Code of Conduct
56
+
57
+ Everyone interacting in the HailHydra project’s codebases, issue trackers, chat rooms and mailing lists is expected to follow the [code of conduct](https://github.com/Gr3atWh173/hail_hydra/blob/master/CODE_OF_CONDUCT.md).
58
+
59
+ ## DISCLAIMER
60
+ Neither this project or its author are related to ThePirateBay in any way.
data/Rakefile ADDED
@@ -0,0 +1,6 @@
1
+ require "bundler/gem_tasks"
2
+ require "rspec/core/rake_task"
3
+
4
+ RSpec::Core::RakeTask.new(:spec)
5
+
6
+ task :default => :spec
data/bin/setup ADDED
@@ -0,0 +1,8 @@
1
+ #!/usr/bin/env bash
2
+ set -euo pipefail
3
+ IFS=$'\n\t'
4
+ set -vx
5
+
6
+ bundle install
7
+
8
+ # Do any other automated setup that you need to do here
@@ -0,0 +1,16 @@
1
+ #!/usr/bin/env ruby
2
+
3
+ require 'hail_hydra'
4
+
5
+ domain = "https://thepiratebay.org"
6
+ search = ARGV[0]
7
+ pages = 1
8
+
9
+ HailHydra::TPB.new(domain).search(search, pages).each do |result|
10
+ puts ""
11
+ puts "NAME: " + result.name
12
+ puts "URL: " + result.url
13
+ puts "SEEDERS: " + result.seeders
14
+ puts "LEECHERS: " + result.leechers
15
+ puts "MAGNET: " + result.magnet_link
16
+ end
@@ -0,0 +1,29 @@
1
+
2
+ lib = File.expand_path("../lib", __FILE__)
3
+ $LOAD_PATH.unshift(lib) unless $LOAD_PATH.include?(lib)
4
+ require "hail_hydra/version"
5
+
6
+ Gem::Specification.new do |spec|
7
+ spec.name = "hail_hydra"
8
+ spec.version = HailHydra::VERSION
9
+ spec.authors = ["Gr3atWh173"]
10
+ spec.email = ["Gr3atWh173@users.noreply.github.com"]
11
+
12
+ spec.summary = %q{Unofficial pseudo-API for ThePirateBay}
13
+ spec.homepage = "https://github.com/Gr3atWh173/hail_hydra"
14
+ spec.license = "MIT"
15
+
16
+ spec.files = `git ls-files -z`.split("\x0").reject do |f|
17
+ f.match(%r{^(test|spec|features)/})
18
+ end
19
+ spec.bindir = "bin"
20
+ spec.executables = spec.files.grep(%r{^bin/}) { |f| File.basename(f) }
21
+ spec.require_paths = ["lib"]
22
+
23
+ spec.add_development_dependency "bundler", "~> 1.16"
24
+ spec.add_development_dependency "rake", "~> 10.0"
25
+ spec.add_development_dependency "rspec", "~> 3.0"
26
+
27
+ spec.add_dependency "nokogiri"
28
+ spec.add_dependency "httparty"
29
+ end
data/lib/client.rb ADDED
@@ -0,0 +1,69 @@
1
+ require "httparty"
2
+ require "nokogiri"
3
+ require_relative "torrent.rb"
4
+
5
+ module HailHydra
6
+ # The TPB class provides the main client to connect to and scrape the
7
+ # results. This may be broken into a 'client' and 'parser' in the future.
8
+ class TPB
9
+ # remember the domain name and get the cookie to use from the TPB server
10
+ def initialize(domain_name)
11
+ @domain = domain_name
12
+ @headers = get_query_headers
13
+ end
14
+
15
+ # search torrents
16
+ def search(query, pages=1, orderby=99)
17
+ get = make_search_request(query, pages, orderby)
18
+ raise "Invalid response: #{get.response.code}" unless get.response.code == "200"
19
+ return parse_search_results(get.response.body)
20
+ end
21
+
22
+ private
23
+
24
+ def parse_search_results(html_text)
25
+ nodes = Nokogiri::HTML(html_text)
26
+ cells = []
27
+ table = nodes.search('table')
28
+ #require 'pry'
29
+ #binding.pry
30
+ table.search('tr').each do |tr|
31
+ cells.push(tr.search('th, td'))
32
+ end
33
+ torrents = []
34
+ 1.upto cells.length-1 do |i|
35
+ torrent = HailHydra::Torrent.new()
36
+
37
+ torrent.name = cells[i][1].children[1].children[1].children[0].content
38
+ torrent.url = @domain + cells[i][1].children[1].children[1].attributes["href"].value
39
+ torrent.magnet_link = cells[i][1].children[3].attributes["href"].value
40
+ torrent.seeders = cells[i][2].children[0].content
41
+ torrent.leechers = cells[i][3].children[0].content
42
+
43
+ torrents.push torrent
44
+ end
45
+ return torrents
46
+ end
47
+
48
+ def make_search_request(query, pages, orderby)
49
+ query = {
50
+ "q" => query,
51
+ "page" => 0.to_s,
52
+ "orderby" => orderby.to_s
53
+ }
54
+
55
+ # not sure why HTTParty doesn't do this already
56
+ encoded_uri = URI.encode(@domain+"/search/" + query["q"] + "/0/" + query["orderby"] + "/0")
57
+ HTTParty.get(encoded_uri, headers: @headers)
58
+ end
59
+
60
+ def get_query_headers()
61
+ cookie = HTTParty.get(@domain).response['set-cookie']
62
+ return {
63
+ 'User-Agent' => 'Mozilla/5.0 (Windows 10; WOW64; rv:10.0) Gecko/20100101 Firefox/10.0',
64
+ 'Referer' => @domain,
65
+ 'Cookie' => cookie
66
+ }
67
+ end
68
+ end
69
+ end
@@ -0,0 +1,3 @@
1
+ module HailHydra
2
+ VERSION = "0.1.0"
3
+ end
data/lib/hail_hydra.rb ADDED
@@ -0,0 +1,7 @@
1
+ require_relative "./hail_hydra/version.rb"
2
+ require_relative "client.rb"
3
+
4
+ # HailHydra is a pseudo-API for ThePirateBay which works
5
+ # by scraping the HTML pages served by ThePirateBay
6
+ module HailHydra
7
+ end
data/lib/torrent.rb ADDED
@@ -0,0 +1,21 @@
1
+ module HailHydra
2
+ class Torrent
3
+ attr_accessor :name
4
+ attr_accessor :url
5
+ attr_accessor :seeders
6
+ attr_accessor :leechers
7
+ attr_accessor :uploaded_at
8
+ attr_accessor :uploaded_by
9
+ attr_accessor :magnet_link
10
+
11
+ def initialize(args={})
12
+ self.name = args[:name]
13
+ self.url = args[:url]
14
+ self.seeders = args[:seeders]
15
+ self.leechers = args[:leechers]
16
+ self.uploaded_at = args[:uploaded_at]
17
+ self.uploaded_by = args[:uploaded_by]
18
+ self.magnet_link = args[:magnet_link]
19
+ end
20
+ end
21
+ end
data/logo.jpg ADDED
Binary file
metadata ADDED
@@ -0,0 +1,132 @@
1
+ --- !ruby/object:Gem::Specification
2
+ name: hail_hydra
3
+ version: !ruby/object:Gem::Version
4
+ version: 0.1.0
5
+ platform: ruby
6
+ authors:
7
+ - Gr3atWh173
8
+ autorequire:
9
+ bindir: bin
10
+ cert_chain: []
11
+ date: 2018-07-30 00:00:00.000000000 Z
12
+ dependencies:
13
+ - !ruby/object:Gem::Dependency
14
+ name: bundler
15
+ requirement: !ruby/object:Gem::Requirement
16
+ requirements:
17
+ - - "~>"
18
+ - !ruby/object:Gem::Version
19
+ version: '1.16'
20
+ type: :development
21
+ prerelease: false
22
+ version_requirements: !ruby/object:Gem::Requirement
23
+ requirements:
24
+ - - "~>"
25
+ - !ruby/object:Gem::Version
26
+ version: '1.16'
27
+ - !ruby/object:Gem::Dependency
28
+ name: rake
29
+ requirement: !ruby/object:Gem::Requirement
30
+ requirements:
31
+ - - "~>"
32
+ - !ruby/object:Gem::Version
33
+ version: '10.0'
34
+ type: :development
35
+ prerelease: false
36
+ version_requirements: !ruby/object:Gem::Requirement
37
+ requirements:
38
+ - - "~>"
39
+ - !ruby/object:Gem::Version
40
+ version: '10.0'
41
+ - !ruby/object:Gem::Dependency
42
+ name: rspec
43
+ requirement: !ruby/object:Gem::Requirement
44
+ requirements:
45
+ - - "~>"
46
+ - !ruby/object:Gem::Version
47
+ version: '3.0'
48
+ type: :development
49
+ prerelease: false
50
+ version_requirements: !ruby/object:Gem::Requirement
51
+ requirements:
52
+ - - "~>"
53
+ - !ruby/object:Gem::Version
54
+ version: '3.0'
55
+ - !ruby/object:Gem::Dependency
56
+ name: nokogiri
57
+ requirement: !ruby/object:Gem::Requirement
58
+ requirements:
59
+ - - ">="
60
+ - !ruby/object:Gem::Version
61
+ version: '0'
62
+ type: :runtime
63
+ prerelease: false
64
+ version_requirements: !ruby/object:Gem::Requirement
65
+ requirements:
66
+ - - ">="
67
+ - !ruby/object:Gem::Version
68
+ version: '0'
69
+ - !ruby/object:Gem::Dependency
70
+ name: httparty
71
+ requirement: !ruby/object:Gem::Requirement
72
+ requirements:
73
+ - - ">="
74
+ - !ruby/object:Gem::Version
75
+ version: '0'
76
+ type: :runtime
77
+ prerelease: false
78
+ version_requirements: !ruby/object:Gem::Requirement
79
+ requirements:
80
+ - - ">="
81
+ - !ruby/object:Gem::Version
82
+ version: '0'
83
+ description:
84
+ email:
85
+ - Gr3atWh173@users.noreply.github.com
86
+ executables:
87
+ - setup
88
+ - thepiratebay.rb
89
+ extensions: []
90
+ extra_rdoc_files: []
91
+ files:
92
+ - ".gitignore"
93
+ - ".rspec"
94
+ - CODE_OF_CONDUCT.md
95
+ - Gemfile
96
+ - Gemfile.lock
97
+ - LICENSE.txt
98
+ - README.md
99
+ - Rakefile
100
+ - bin/setup
101
+ - bin/thepiratebay.rb
102
+ - hail_hydra.gemspec
103
+ - lib/client.rb
104
+ - lib/hail_hydra.rb
105
+ - lib/hail_hydra/version.rb
106
+ - lib/torrent.rb
107
+ - logo.jpg
108
+ homepage: https://github.com/Gr3atWh173/hail_hydra
109
+ licenses:
110
+ - MIT
111
+ metadata: {}
112
+ post_install_message:
113
+ rdoc_options: []
114
+ require_paths:
115
+ - lib
116
+ required_ruby_version: !ruby/object:Gem::Requirement
117
+ requirements:
118
+ - - ">="
119
+ - !ruby/object:Gem::Version
120
+ version: '0'
121
+ required_rubygems_version: !ruby/object:Gem::Requirement
122
+ requirements:
123
+ - - ">="
124
+ - !ruby/object:Gem::Version
125
+ version: '0'
126
+ requirements: []
127
+ rubyforge_project:
128
+ rubygems_version: 2.6.14.1
129
+ signing_key:
130
+ specification_version: 4
131
+ summary: Unofficial pseudo-API for ThePirateBay
132
+ test_files: []