metainspector 5.6.0 → 5.7.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- checksums.yaml +5 -5
- data/.travis.yml +1 -1
- data/CHANGELOG.md +27 -16
- data/README.md +3 -2
- data/lib/meta_inspector/document.rb +1 -1
- data/lib/meta_inspector/errors.rb +2 -0
- data/lib/meta_inspector/parsers/images.rb +6 -4
- data/lib/meta_inspector/url.rb +7 -5
- data/lib/meta_inspector/version.rb +1 -1
- data/meta_inspector.gemspec +15 -15
- data/spec/document_spec.rb +2 -2
- data/spec/fixtures/guardian.co.uk.response +1 -1
- data/spec/meta_inspector/images_spec.rb +6 -0
- metadata +41 -42
checksums.yaml
CHANGED
@@ -1,7 +1,7 @@
|
|
1
1
|
---
|
2
|
-
|
3
|
-
metadata.gz:
|
4
|
-
data.tar.gz:
|
2
|
+
SHA256:
|
3
|
+
metadata.gz: 860350c6b4704259715f0a0eea047893134d774928b0bf78c9633f5afec480ff
|
4
|
+
data.tar.gz: d0abcb709893e63be252886723f8f202137dae3d02b506173a59b3368dcda7f7
|
5
5
|
SHA512:
|
6
|
-
metadata.gz:
|
7
|
-
data.tar.gz:
|
6
|
+
metadata.gz: ab74dde15e1864f4c747be953a512278578ab231bea4637e1fb752234766c5b895b47405bd8572c06fd421cd16170e69c4331fb3462a7177ea4c6c521748e1f9
|
7
|
+
data.tar.gz: fde5cf878c7320d49c82aa430b2fc422044a07168e4b6e6cce53d3b33655b28f6ee811cc535ffca06be46c19403b83e7c453aa942895b9e77c675468fa3fea12
|
data/.travis.yml
CHANGED
data/CHANGELOG.md
CHANGED
@@ -1,48 +1,59 @@
|
|
1
1
|
# MetaInpector Changelog
|
2
2
|
|
3
|
+
## [Changes in 5.6](https://github.com/jaimeiniesta/metainspector/compare/v5.5.0...v5.6.0)
|
4
|
+
|
5
|
+
* New feature: `:encoding` option for force encoding of a parsed document.
|
6
|
+
* Improvement: make `best_title` and `best_author` work by order of preference, rather than length.
|
7
|
+
|
8
|
+
## [Changes in 5.5](https://github.com/jaimeiniesta/metainspector/compare/v5.4.0...v5.5.0)
|
9
|
+
|
10
|
+
* New feature: adds `author`, `best_author`.
|
11
|
+
* Bugfix: adds presence validation for empty string on meta tag image values.
|
12
|
+
* Improves spider and links checker examples.
|
13
|
+
* Uses WebMock instead of FakeWeb in tests.
|
14
|
+
|
3
15
|
## [Changes in 5.4](https://github.com/jaimeiniesta/metainspector/compare/v5.3.0...v5.4.0)
|
4
16
|
|
5
|
-
Supports Gzipped responses.
|
6
|
-
Adds method `best_description` and makes `description` return just the meta description.
|
7
|
-
Removes support for Ruby 2.0.0 and adds support for 2.4.0.
|
17
|
+
* Supports Gzipped responses.
|
18
|
+
* Adds method `best_description` and makes `description` return just the meta description.
|
19
|
+
* Removes support for Ruby 2.0.0 and adds support for 2.4.0.
|
8
20
|
|
9
21
|
## [Changes in 5.3](https://github.com/jaimeiniesta/metainspector/compare/v5.2.0...v5.3.0)
|
10
22
|
|
11
|
-
Returns secondary description if meta description is empty.
|
12
|
-
Adds a custom timeout on top of the ones for Faraday, and sets defaults for timeouts.
|
13
|
-
Eliminates possible NULL char in HTML which breaks nokogiri.
|
23
|
+
* Returns secondary description if meta description is empty.
|
24
|
+
* Adds a custom timeout on top of the ones for Faraday, and sets defaults for timeouts.
|
25
|
+
* Eliminates possible NULL char in HTML which breaks nokogiri.
|
14
26
|
|
15
27
|
## [Changes in 5.2](https://github.com/jaimeiniesta/metainspector/compare/v5.1.0...v5.2.0)
|
16
28
|
|
17
|
-
Removes the deprecated `html_content_only` option, and replaces it by `allow_non_html_content`, by default `false`.
|
29
|
+
* Removes the deprecated `html_content_only` option, and replaces it by `allow_non_html_content`, by default `false`.
|
18
30
|
|
19
31
|
## [Changes in 5.1](https://github.com/jaimeiniesta/metainspector/compare/v5.0.0...v5.1.0)
|
20
32
|
|
21
|
-
Deprecates the `html_content_only` option, and turns it on by default.
|
33
|
+
* Deprecates the `html_content_only` option, and turns it on by default.
|
22
34
|
|
23
35
|
## [Changes in 5.0](https://github.com/jaimeiniesta/metainspector/compare/v4.7.1...v5.0.0)
|
24
36
|
|
25
|
-
Removes the ExceptionLog, all exceptions are now encapsulated in our own exception classes and
|
37
|
+
* Removes the ExceptionLog, all exceptions are now encapsulated in our own exception classes and
|
26
38
|
always raised.
|
27
39
|
|
28
40
|
## [Changes in 4.7](https://github.com/jaimeiniesta/metainspector/compare/v4.6.0...v4.7.1)
|
29
41
|
|
30
|
-
MetaInspector can be configured to use [Faraday::HttpCache](https://github.com/plataformatec/faraday-http-cache) to cache page responses. For that you should pass the `faraday_http_cache` option with at least the `:store` key, for example:
|
42
|
+
* MetaInspector can be configured to use [Faraday::HttpCache](https://github.com/plataformatec/faraday-http-cache) to cache page responses. For that you should pass the `faraday_http_cache` option with at least the `:store` key, for example:
|
31
43
|
|
32
44
|
```ruby
|
33
45
|
cache = ActiveSupport::Cache.lookup_store(:file_store, '/tmp/cache')
|
34
46
|
page = MetaInspector.new('http://example.com', faraday_http_cache: { store: cache })
|
35
47
|
```
|
36
48
|
|
37
|
-
Bugfixes:
|
38
|
-
|
39
|
-
* Parsing of the document is done as soon as it is initialized (just like we do with the request), so
|
49
|
+
* Bugfixes:
|
50
|
+
* Parsing of the document is done as soon as it is initialized (just like we do with the request), so
|
40
51
|
that parsing errors will be catched earlier.
|
41
|
-
* Rescues from Faraday::SSLError.
|
52
|
+
* Rescues from Faraday::SSLError.
|
42
53
|
|
43
54
|
## [Changes in 4.6](https://github.com/jaimeiniesta/metainspector/compare/v4.5.0...v4.6.0)
|
44
55
|
|
45
|
-
Faraday can be passed options via `:faraday_options`. This is useful in cases where we need to
|
56
|
+
* Faraday can be passed options via `:faraday_options`. This is useful in cases where we need to
|
46
57
|
customize the way we request the page, like for example disabling SSL verification, like this:
|
47
58
|
|
48
59
|
```ruby
|
@@ -70,7 +81,7 @@ MetaInpector.new('https://example.com', faraday_options: { ssl: { verify: false
|
|
70
81
|
|
71
82
|
## [Changes in 4.4](https://github.com/jaimeiniesta/metainspector/compare/v4.3.0...v4.4.0)
|
72
83
|
|
73
|
-
The default headers now include `'Accept-Encoding' => 'identity'` to minimize trouble with servers that respond with malformed compressed responses, [as explained here](https://github.com/lostisland/faraday/issues/337).
|
84
|
+
* The default headers now include `'Accept-Encoding' => 'identity'` to minimize trouble with servers that respond with malformed compressed responses, [as explained here](https://github.com/lostisland/faraday/issues/337).
|
74
85
|
|
75
86
|
## [Changes in 4.3](https://github.com/jaimeiniesta/metainspector/compare/v4.3.0...v4.4.0)
|
76
87
|
|
data/README.md
CHANGED
@@ -1,4 +1,4 @@
|
|
1
|
-
# MetaInspector [](http://travis-ci.org/jaimeiniesta/metainspector) [](http://travis-ci.org/jaimeiniesta/metainspector) [](https://codeclimate.com/github/jaimeiniesta/metainspector)
|
2
2
|
|
3
3
|
MetaInspector is a gem for web scraping purposes.
|
4
4
|
|
@@ -396,7 +396,8 @@ Web page scraping is tricky, you can expect to find different exceptions during
|
|
396
396
|
|
397
397
|
* `MetaInspector::TimeoutError`. When fetching a web page has taken too long.
|
398
398
|
* `MetaInspector::RequestError`. When there has been an error on the request phase. Examples: page not found, SSL failure, invalid URI.
|
399
|
-
* `MetaInspector::ParserError`. When there has been an error parsing the contents of the page.
|
399
|
+
* `MetaInspector::ParserError`. When there has been an error parsing the contents of the page.
|
400
|
+
* `MetaInspector::NonHtmlError`. When the contents of the page was not HTML. See also the `allow_non_html_content` option
|
400
401
|
|
401
402
|
## Examples
|
402
403
|
|
@@ -105,7 +105,7 @@ module MetaInspector
|
|
105
105
|
|
106
106
|
def document
|
107
107
|
@document ||= if !allow_non_html_content && !content_type.nil? && content_type != 'text/html'
|
108
|
-
fail MetaInspector::
|
108
|
+
fail MetaInspector::NonHtmlError.new "The url provided contains #{content_type} content instead of text/html content"
|
109
109
|
else
|
110
110
|
@request.read
|
111
111
|
end
|
@@ -29,14 +29,16 @@ module MetaInspector
|
|
29
29
|
# If none found, tries with Twitter image
|
30
30
|
def owner_suggested
|
31
31
|
suggested_img = content_of(meta['og:image']) || content_of(meta['twitter:image'])
|
32
|
-
URL.absolutify(suggested_img, base_url) if suggested_img
|
32
|
+
URL.absolutify(suggested_img, base_url, normalize: false) if suggested_img
|
33
33
|
end
|
34
34
|
|
35
35
|
# Returns an array of [img_url, width, height] sorted by image area (width * height)
|
36
36
|
def with_size
|
37
37
|
@with_size ||= begin
|
38
38
|
img_nodes = parsed.search('//img').select{ |img_node| img_node['src'] }
|
39
|
-
imgs_with_size = img_nodes.map
|
39
|
+
imgs_with_size = img_nodes.map do |img_node|
|
40
|
+
[URL.absolutify(img_node['src'], base_url, normalize: false), img_node['width'], img_node['height']]
|
41
|
+
end
|
40
42
|
imgs_with_size.uniq! { |url, width, height| url }
|
41
43
|
if @download_images
|
42
44
|
imgs_with_size.map! do |url, width, height|
|
@@ -71,7 +73,7 @@ module MetaInspector
|
|
71
73
|
def favicon
|
72
74
|
query = '//link[@rel="icon" or contains(@rel, "shortcut")]'
|
73
75
|
value = parsed.xpath(query)[0].attributes['href'].value
|
74
|
-
@favicon ||= URL.absolutify(value, base_url)
|
76
|
+
@favicon ||= URL.absolutify(value, base_url, normalize: false)
|
75
77
|
rescue
|
76
78
|
nil
|
77
79
|
end
|
@@ -83,7 +85,7 @@ module MetaInspector
|
|
83
85
|
end
|
84
86
|
|
85
87
|
def absolutified_images
|
86
|
-
parsed_images.map { |i| URL.absolutify(i, base_url) }
|
88
|
+
parsed_images.map { |i| URL.absolutify(i, base_url, normalize: false) }
|
87
89
|
end
|
88
90
|
|
89
91
|
def parsed_images
|
data/lib/meta_inspector/url.rb
CHANGED
@@ -5,7 +5,7 @@ module MetaInspector
|
|
5
5
|
attr_reader :url
|
6
6
|
|
7
7
|
def initialize(initial_url, options = {})
|
8
|
-
options = defaults.merge(options)
|
8
|
+
options = self.class.defaults.merge(options)
|
9
9
|
|
10
10
|
@normalize = options[:normalize]
|
11
11
|
|
@@ -56,11 +56,13 @@ module MetaInspector
|
|
56
56
|
# http:, ftp:, telnet:, mailto:, javascript: ...
|
57
57
|
# Protocol-relative URLs are also resolved to use the same
|
58
58
|
# schema as the base_url
|
59
|
-
def self.absolutify(url, base_url)
|
59
|
+
def self.absolutify(url, base_url, options = {})
|
60
|
+
options = defaults.merge(options)
|
60
61
|
if url =~ /^\w*\:/i
|
61
|
-
MetaInspector::URL.new(url).url
|
62
|
+
MetaInspector::URL.new(url, options).url
|
62
63
|
else
|
63
|
-
Addressable::URI.join(base_url, url)
|
64
|
+
uri = Addressable::URI.join(base_url, url)
|
65
|
+
options[:normalize] ? uri.normalize.to_s : uri.to_s
|
64
66
|
end
|
65
67
|
rescue MetaInspector::ParserError, Addressable::URI::InvalidURIError, ArgumentError
|
66
68
|
nil
|
@@ -68,7 +70,7 @@ module MetaInspector
|
|
68
70
|
|
69
71
|
private
|
70
72
|
|
71
|
-
def defaults
|
73
|
+
def self.defaults
|
72
74
|
{ :normalize => true }
|
73
75
|
end
|
74
76
|
|
data/meta_inspector.gemspec
CHANGED
@@ -14,20 +14,20 @@ Gem::Specification.new do |gem|
|
|
14
14
|
gem.require_paths = ["lib"]
|
15
15
|
gem.version = MetaInspector::VERSION
|
16
16
|
|
17
|
-
gem.add_dependency 'nokogiri', '~> 1.
|
18
|
-
gem.add_dependency 'faraday', '~> 0.
|
19
|
-
gem.add_dependency 'faraday_middleware', '~> 0.
|
20
|
-
gem.add_dependency 'faraday-cookie_jar', '~> 0.0'
|
21
|
-
gem.add_dependency 'faraday-http-cache', '~> 2.0'
|
22
|
-
gem.add_dependency 'faraday-encoding', '~> 0.0'
|
23
|
-
gem.add_dependency 'addressable', '~> 2.5'
|
24
|
-
gem.add_dependency 'fastimage', '~> 2.1'
|
25
|
-
gem.add_dependency 'nesty', '~> 1.0'
|
17
|
+
gem.add_dependency 'nokogiri', '~> 1.10.4'
|
18
|
+
gem.add_dependency 'faraday', '~> 0.15.3'
|
19
|
+
gem.add_dependency 'faraday_middleware', '~> 0.12.2'
|
20
|
+
gem.add_dependency 'faraday-cookie_jar', '~> 0.0.6'
|
21
|
+
gem.add_dependency 'faraday-http-cache', '~> 2.0.0'
|
22
|
+
gem.add_dependency 'faraday-encoding', '~> 0.0.5'
|
23
|
+
gem.add_dependency 'addressable', '~> 2.5.2'
|
24
|
+
gem.add_dependency 'fastimage', '~> 2.1.4'
|
25
|
+
gem.add_dependency 'nesty', '~> 1.0.2'
|
26
26
|
|
27
|
-
gem.add_development_dependency 'rspec', '~> 3.0'
|
28
|
-
gem.add_development_dependency 'webmock'
|
29
|
-
gem.add_development_dependency 'awesome_print'
|
30
|
-
gem.add_development_dependency 'rake', '~>
|
31
|
-
gem.add_development_dependency 'pry'
|
32
|
-
gem.add_development_dependency 'rubocop'
|
27
|
+
gem.add_development_dependency 'rspec', '~> 3.8.0'
|
28
|
+
gem.add_development_dependency 'webmock', '~> 3.7.6'
|
29
|
+
gem.add_development_dependency 'awesome_print', '~> 1.8.0'
|
30
|
+
gem.add_development_dependency 'rake', '~> 12.3.1'
|
31
|
+
gem.add_development_dependency 'pry', '~> 0.12.2'
|
32
|
+
gem.add_development_dependency 'rubocop', '~> 0.60.0'
|
33
33
|
end
|
data/spec/document_spec.rb
CHANGED
@@ -82,14 +82,14 @@ describe MetaInspector::Document do
|
|
82
82
|
expect do
|
83
83
|
image_url = MetaInspector::Document.new('http://pagerankalert.com/image.png')
|
84
84
|
image_url.title
|
85
|
-
end.to raise_error(MetaInspector::
|
85
|
+
end.to raise_error(MetaInspector::NonHtmlError)
|
86
86
|
end
|
87
87
|
|
88
88
|
it "should not allow non-html content type when explicitly disallowed" do
|
89
89
|
expect do
|
90
90
|
image_url = MetaInspector::Document.new('http://pagerankalert.com/image.png', allow_non_html_content: false)
|
91
91
|
image_url.title
|
92
|
-
end.to raise_error(MetaInspector::
|
92
|
+
end.to raise_error(MetaInspector::NonHtmlError)
|
93
93
|
end
|
94
94
|
|
95
95
|
it "should allow non-html content type when explicitly allowed" do
|
@@ -57,7 +57,7 @@ Connection: keep-alive
|
|
57
57
|
<meta property="og:title" content="More TechCrunch drama as Arrington-backed startup wins blog's contest"/>
|
58
58
|
<meta property="og:type" content="article"/>
|
59
59
|
<meta property="og:url" content="http://www.guardian.co.uk/media/pda/2011/sep/15/techcrunch-arrington-startups"/>
|
60
|
-
<meta property="og:image" content="https://
|
60
|
+
<meta property="og:image" content="https://i.guim.co.uk/img/media/020bf03ae1d259626803b6c83ac57fd57382f285/0_102_5760_3456/master/5760.jpg?width=1200&height=630&quality=85&auto=format&fit=crop&overlay-align=bottom%2Cleft&overlay-width=100p&overlay-base64=L2ltZy9zdGF0aWMvb3ZlcmxheXMvdGctZGVmYXVsdC5wbmc&s=46e054247285bdf48a7621d371fc5070"/>
|
61
61
|
<meta property="og:site_name" content="the Guardian"/>
|
62
62
|
<meta property="fb:app_id" content="180444840287"/>
|
63
63
|
<meta property="og:description" content="Despite claiming transparency, TechCrunch readers are not convinced that a 'Habbo Hotel for Facebook' was a deserving winner of a coveted award. By Jemima Kiss"/>
|
@@ -126,6 +126,12 @@ describe MetaInspector do
|
|
126
126
|
|
127
127
|
expect(page.images.owner_suggested).to be nil
|
128
128
|
end
|
129
|
+
|
130
|
+
it "should not normalize image" do
|
131
|
+
page = MetaInspector.new("http://www.guardian.co.uk/media/pda/2011/sep/15/techcrunch-arrington-startups")
|
132
|
+
|
133
|
+
expect(page.images.owner_suggested).to eq("https://i.guim.co.uk/img/media/020bf03ae1d259626803b6c83ac57fd57382f285/0_102_5760_3456/master/5760.jpg?width=1200&height=630&quality=85&auto=format&fit=crop&overlay-align=bottom%2Cleft&overlay-width=100p&overlay-base64=L2ltZy9zdGF0aWMvb3ZlcmxheXMvdGctZGVmYXVsdC5wbmc&s=46e054247285bdf48a7621d371fc5070")
|
134
|
+
end
|
129
135
|
end
|
130
136
|
|
131
137
|
describe "images.with_size" do
|
metadata
CHANGED
@@ -1,14 +1,14 @@
|
|
1
1
|
--- !ruby/object:Gem::Specification
|
2
2
|
name: metainspector
|
3
3
|
version: !ruby/object:Gem::Version
|
4
|
-
version: 5.
|
4
|
+
version: 5.7.0
|
5
5
|
platform: ruby
|
6
6
|
authors:
|
7
7
|
- Jaime Iniesta
|
8
8
|
autorequire:
|
9
9
|
bindir: bin
|
10
10
|
cert_chain: []
|
11
|
-
date:
|
11
|
+
date: 2019-10-01 00:00:00.000000000 Z
|
12
12
|
dependencies:
|
13
13
|
- !ruby/object:Gem::Dependency
|
14
14
|
name: nokogiri
|
@@ -16,210 +16,210 @@ dependencies:
|
|
16
16
|
requirements:
|
17
17
|
- - "~>"
|
18
18
|
- !ruby/object:Gem::Version
|
19
|
-
version:
|
19
|
+
version: 1.10.4
|
20
20
|
type: :runtime
|
21
21
|
prerelease: false
|
22
22
|
version_requirements: !ruby/object:Gem::Requirement
|
23
23
|
requirements:
|
24
24
|
- - "~>"
|
25
25
|
- !ruby/object:Gem::Version
|
26
|
-
version:
|
26
|
+
version: 1.10.4
|
27
27
|
- !ruby/object:Gem::Dependency
|
28
28
|
name: faraday
|
29
29
|
requirement: !ruby/object:Gem::Requirement
|
30
30
|
requirements:
|
31
31
|
- - "~>"
|
32
32
|
- !ruby/object:Gem::Version
|
33
|
-
version:
|
33
|
+
version: 0.15.3
|
34
34
|
type: :runtime
|
35
35
|
prerelease: false
|
36
36
|
version_requirements: !ruby/object:Gem::Requirement
|
37
37
|
requirements:
|
38
38
|
- - "~>"
|
39
39
|
- !ruby/object:Gem::Version
|
40
|
-
version:
|
40
|
+
version: 0.15.3
|
41
41
|
- !ruby/object:Gem::Dependency
|
42
42
|
name: faraday_middleware
|
43
43
|
requirement: !ruby/object:Gem::Requirement
|
44
44
|
requirements:
|
45
45
|
- - "~>"
|
46
46
|
- !ruby/object:Gem::Version
|
47
|
-
version:
|
47
|
+
version: 0.12.2
|
48
48
|
type: :runtime
|
49
49
|
prerelease: false
|
50
50
|
version_requirements: !ruby/object:Gem::Requirement
|
51
51
|
requirements:
|
52
52
|
- - "~>"
|
53
53
|
- !ruby/object:Gem::Version
|
54
|
-
version:
|
54
|
+
version: 0.12.2
|
55
55
|
- !ruby/object:Gem::Dependency
|
56
56
|
name: faraday-cookie_jar
|
57
57
|
requirement: !ruby/object:Gem::Requirement
|
58
58
|
requirements:
|
59
59
|
- - "~>"
|
60
60
|
- !ruby/object:Gem::Version
|
61
|
-
version:
|
61
|
+
version: 0.0.6
|
62
62
|
type: :runtime
|
63
63
|
prerelease: false
|
64
64
|
version_requirements: !ruby/object:Gem::Requirement
|
65
65
|
requirements:
|
66
66
|
- - "~>"
|
67
67
|
- !ruby/object:Gem::Version
|
68
|
-
version:
|
68
|
+
version: 0.0.6
|
69
69
|
- !ruby/object:Gem::Dependency
|
70
70
|
name: faraday-http-cache
|
71
71
|
requirement: !ruby/object:Gem::Requirement
|
72
72
|
requirements:
|
73
73
|
- - "~>"
|
74
74
|
- !ruby/object:Gem::Version
|
75
|
-
version:
|
75
|
+
version: 2.0.0
|
76
76
|
type: :runtime
|
77
77
|
prerelease: false
|
78
78
|
version_requirements: !ruby/object:Gem::Requirement
|
79
79
|
requirements:
|
80
80
|
- - "~>"
|
81
81
|
- !ruby/object:Gem::Version
|
82
|
-
version:
|
82
|
+
version: 2.0.0
|
83
83
|
- !ruby/object:Gem::Dependency
|
84
84
|
name: faraday-encoding
|
85
85
|
requirement: !ruby/object:Gem::Requirement
|
86
86
|
requirements:
|
87
87
|
- - "~>"
|
88
88
|
- !ruby/object:Gem::Version
|
89
|
-
version:
|
89
|
+
version: 0.0.5
|
90
90
|
type: :runtime
|
91
91
|
prerelease: false
|
92
92
|
version_requirements: !ruby/object:Gem::Requirement
|
93
93
|
requirements:
|
94
94
|
- - "~>"
|
95
95
|
- !ruby/object:Gem::Version
|
96
|
-
version:
|
96
|
+
version: 0.0.5
|
97
97
|
- !ruby/object:Gem::Dependency
|
98
98
|
name: addressable
|
99
99
|
requirement: !ruby/object:Gem::Requirement
|
100
100
|
requirements:
|
101
101
|
- - "~>"
|
102
102
|
- !ruby/object:Gem::Version
|
103
|
-
version:
|
103
|
+
version: 2.5.2
|
104
104
|
type: :runtime
|
105
105
|
prerelease: false
|
106
106
|
version_requirements: !ruby/object:Gem::Requirement
|
107
107
|
requirements:
|
108
108
|
- - "~>"
|
109
109
|
- !ruby/object:Gem::Version
|
110
|
-
version:
|
110
|
+
version: 2.5.2
|
111
111
|
- !ruby/object:Gem::Dependency
|
112
112
|
name: fastimage
|
113
113
|
requirement: !ruby/object:Gem::Requirement
|
114
114
|
requirements:
|
115
115
|
- - "~>"
|
116
116
|
- !ruby/object:Gem::Version
|
117
|
-
version:
|
117
|
+
version: 2.1.4
|
118
118
|
type: :runtime
|
119
119
|
prerelease: false
|
120
120
|
version_requirements: !ruby/object:Gem::Requirement
|
121
121
|
requirements:
|
122
122
|
- - "~>"
|
123
123
|
- !ruby/object:Gem::Version
|
124
|
-
version:
|
124
|
+
version: 2.1.4
|
125
125
|
- !ruby/object:Gem::Dependency
|
126
126
|
name: nesty
|
127
127
|
requirement: !ruby/object:Gem::Requirement
|
128
128
|
requirements:
|
129
129
|
- - "~>"
|
130
130
|
- !ruby/object:Gem::Version
|
131
|
-
version:
|
131
|
+
version: 1.0.2
|
132
132
|
type: :runtime
|
133
133
|
prerelease: false
|
134
134
|
version_requirements: !ruby/object:Gem::Requirement
|
135
135
|
requirements:
|
136
136
|
- - "~>"
|
137
137
|
- !ruby/object:Gem::Version
|
138
|
-
version:
|
138
|
+
version: 1.0.2
|
139
139
|
- !ruby/object:Gem::Dependency
|
140
140
|
name: rspec
|
141
141
|
requirement: !ruby/object:Gem::Requirement
|
142
142
|
requirements:
|
143
143
|
- - "~>"
|
144
144
|
- !ruby/object:Gem::Version
|
145
|
-
version:
|
145
|
+
version: 3.8.0
|
146
146
|
type: :development
|
147
147
|
prerelease: false
|
148
148
|
version_requirements: !ruby/object:Gem::Requirement
|
149
149
|
requirements:
|
150
150
|
- - "~>"
|
151
151
|
- !ruby/object:Gem::Version
|
152
|
-
version:
|
152
|
+
version: 3.8.0
|
153
153
|
- !ruby/object:Gem::Dependency
|
154
154
|
name: webmock
|
155
155
|
requirement: !ruby/object:Gem::Requirement
|
156
156
|
requirements:
|
157
|
-
- - "
|
157
|
+
- - "~>"
|
158
158
|
- !ruby/object:Gem::Version
|
159
|
-
version:
|
159
|
+
version: 3.7.6
|
160
160
|
type: :development
|
161
161
|
prerelease: false
|
162
162
|
version_requirements: !ruby/object:Gem::Requirement
|
163
163
|
requirements:
|
164
|
-
- - "
|
164
|
+
- - "~>"
|
165
165
|
- !ruby/object:Gem::Version
|
166
|
-
version:
|
166
|
+
version: 3.7.6
|
167
167
|
- !ruby/object:Gem::Dependency
|
168
168
|
name: awesome_print
|
169
169
|
requirement: !ruby/object:Gem::Requirement
|
170
170
|
requirements:
|
171
|
-
- - "
|
171
|
+
- - "~>"
|
172
172
|
- !ruby/object:Gem::Version
|
173
|
-
version:
|
173
|
+
version: 1.8.0
|
174
174
|
type: :development
|
175
175
|
prerelease: false
|
176
176
|
version_requirements: !ruby/object:Gem::Requirement
|
177
177
|
requirements:
|
178
|
-
- - "
|
178
|
+
- - "~>"
|
179
179
|
- !ruby/object:Gem::Version
|
180
|
-
version:
|
180
|
+
version: 1.8.0
|
181
181
|
- !ruby/object:Gem::Dependency
|
182
182
|
name: rake
|
183
183
|
requirement: !ruby/object:Gem::Requirement
|
184
184
|
requirements:
|
185
185
|
- - "~>"
|
186
186
|
- !ruby/object:Gem::Version
|
187
|
-
version:
|
187
|
+
version: 12.3.1
|
188
188
|
type: :development
|
189
189
|
prerelease: false
|
190
190
|
version_requirements: !ruby/object:Gem::Requirement
|
191
191
|
requirements:
|
192
192
|
- - "~>"
|
193
193
|
- !ruby/object:Gem::Version
|
194
|
-
version:
|
194
|
+
version: 12.3.1
|
195
195
|
- !ruby/object:Gem::Dependency
|
196
196
|
name: pry
|
197
197
|
requirement: !ruby/object:Gem::Requirement
|
198
198
|
requirements:
|
199
|
-
- - "
|
199
|
+
- - "~>"
|
200
200
|
- !ruby/object:Gem::Version
|
201
|
-
version:
|
201
|
+
version: 0.12.2
|
202
202
|
type: :development
|
203
203
|
prerelease: false
|
204
204
|
version_requirements: !ruby/object:Gem::Requirement
|
205
205
|
requirements:
|
206
|
-
- - "
|
206
|
+
- - "~>"
|
207
207
|
- !ruby/object:Gem::Version
|
208
|
-
version:
|
208
|
+
version: 0.12.2
|
209
209
|
- !ruby/object:Gem::Dependency
|
210
210
|
name: rubocop
|
211
211
|
requirement: !ruby/object:Gem::Requirement
|
212
212
|
requirements:
|
213
|
-
- - "
|
213
|
+
- - "~>"
|
214
214
|
- !ruby/object:Gem::Version
|
215
|
-
version:
|
215
|
+
version: 0.60.0
|
216
216
|
type: :development
|
217
217
|
prerelease: false
|
218
218
|
version_requirements: !ruby/object:Gem::Requirement
|
219
219
|
requirements:
|
220
|
-
- - "
|
220
|
+
- - "~>"
|
221
221
|
- !ruby/object:Gem::Version
|
222
|
-
version:
|
222
|
+
version: 0.60.0
|
223
223
|
description: MetaInspector lets you scrape a web page and get its links, images, texts,
|
224
224
|
meta tags...
|
225
225
|
email:
|
@@ -348,8 +348,7 @@ required_rubygems_version: !ruby/object:Gem::Requirement
|
|
348
348
|
- !ruby/object:Gem::Version
|
349
349
|
version: '0'
|
350
350
|
requirements: []
|
351
|
-
|
352
|
-
rubygems_version: 2.6.8
|
351
|
+
rubygems_version: 3.0.4
|
353
352
|
signing_key:
|
354
353
|
specification_version: 4
|
355
354
|
summary: MetaInspector is a ruby gem for web scraping purposes, that returns metadata
|