metainspector 4.5.0 → 4.6.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA1:
-  metadata.gz: d8b2f4cf8526bd14a55d879334ff9bf14c95180f
-  data.tar.gz: 0d39ceedb495d19a761fd7f6bcfdae767d1e1c26
+  metadata.gz: 6ee8411bb9ed926d53b27d0723f07ffb1ccf21d3
+  data.tar.gz: cb45f0aed52790578cc841f1caf35c933b290c80
 SHA512:
-  metadata.gz: b9b8a345bb8f935bfe5a5fb74d4e86a92893c8d44066f87cdffbe029fc5746841c290c366fd94fc2a84edb73edbbf43c491189f6b82e754f4bc0c494eaed6591
-  data.tar.gz: f559c11756c34406d5083a58c8cd80fdf5665fd79f4a204fdd22eee9eed6bbb65553c3a0b47f16962623ef4c4903adb74b6ac503893b0cb6ea66ee84513e85d4
+  metadata.gz: 7c64e3088e40204c2e32a6a00b2531828f5610fddbac8addb1f8032944562c25bd8fb7fb68c54149adc5cc279fbca2633901d4e927ff2a783c73df1eb083bb37
+  data.tar.gz: 72bf81478a0efd1cb57c22311aa13568f78cd57409f3dd54e3d32af46651e5cbed3b5d7e996d921b2b5de9d5454b92cda8d2bf271171aa97ff927dda44a7b1e4

data/CHANGELOG.md

@@ -1,6 +1,19 @@
 # MetaInpector Changelog
 
-## Changes in 4.5
+## [Changes in 4.6](https://github.com/jaimeiniesta/metainspector/compare/v4.5.0...v4.6.0)
+
+Faraday can be passed options via `:faraday_options`. This is useful in cases where we need to
+customize the way we request the page, like for example disabling SSL verification, like this:
+
+```ruby
+MetaInspector.new('https://example.com')
+# Faraday::SSLError: SSL_connect returned=1 errno=0 state=SSLv3 read server certificate B: certificate verify failed
+
+MetaInpector.new('https://example.com', faraday_options: { ssl: { verify: false } })
+# Now we can access the page
+```
+
+## [Changes in 4.5](https://github.com/jaimeiniesta/metainspector/compare/v4.4.0...v4.5.0)
 
 * The Document API now includes access to head/link elements
     * `page.head_links` returns an array of hashes of all head/links.
@@ -15,16 +28,16 @@
 * The images API has been extended:
     * `page.images.with_size` returns a sorted array (by descending area) of [image_url, width, height]
 
-## Changes in 4.4
+## [Changes in 4.4](https://github.com/jaimeiniesta/metainspector/compare/v4.3.0...v4.4.0)
 
 The default headers now include `'Accept-Encoding' => 'identity'` to minimize trouble with servers that respond with malformed compressed responses, [as explained here](https://github.com/lostisland/faraday/issues/337).
 
-## Changes in 4.3
+## [Changes in 4.3](https://github.com/jaimeiniesta/metainspector/compare/v4.3.0...v4.4.0)
 
 * The Document API has been extended with one new method `page.best_title` that returns the longest text available from a selection of candidates.
 * `to_hash` now includes `scheme`, `host`, `root_url`, `best_title` and `description`.
 
-## Changes in 4.2
+## [Changes in 4.2](https://github.com/jaimeiniesta/metainspector/compare/v4.1.0...v4.2.0)
 
 * The images API has been extended, with two new methods:
 
@@ -33,11 +46,11 @@ The default headers now include `'Accept-Encoding' => 'identity'` to minimize tr
 
 * The criteria for `page.images.best` has changed slightly, we'll now return the largest image instead of the first image if no owner-suggested image is found.
 
-## Changes in 4.1
+## [Changes in 4.1](https://github.com/jaimeiniesta/metainspector/compare/v4.0.0...v4.1.0)
 
 * Introduces the `:normalize_url` option, which allows to disable URL normalization.
 
-## Changes in 4.0
+## [Changes in 4.0](https://github.com/jaimeiniesta/metainspector/compare/v3.0.0...v4.0.0)
 
 * The links API has been changed, now instead of `page.links`, `page.internal_links` and `page.external_links` we have:
 
@@ -56,7 +69,7 @@ page.links.external # Returns all external HTTP links found
 
 * You can now specify 2 different timeouts, `connection_timeout` and `read_timeout`, instead of the previous single `timeout`.
 
-## Changes in 3.0
+## [Changes in 3.0](https://github.com/jaimeiniesta/metainspector/compare/v2.0.0...v3.0.0)
 
 * The redirect API has been changed, now the `:allow_redirections` option will expect only a boolean, which by default is `true`. That is, no more specifying `:safe`, `:unsafe` or `:all`.
 * We've dropped support for Ruby < 2.

data/README.md

@@ -311,6 +311,21 @@ If you want to override the default headers then use the `headers` option:
 page = MetaInspector.new('example.com', :headers => {'User-Agent' => 'My custom User-Agent'})
 ```
 
+### Disabling SSL verification (or any other Faraday options)
+
+Faraday can be passed options via `:faraday_options`.
+
+This is useful in cases where we need to
+customize the way we request the page, like for example disabling SSL verification, like this:
+
+```ruby
+MetaInspector.new('https://example.com')
+# Faraday::SSLError: SSL_connect returned=1 errno=0 state=SSLv3 read server certificate B: certificate verify failed
+
+MetaInpector.new('https://example.com', faraday_options: { ssl: { verify: false } })
+# Now we can access the page
+```
+
 ### HTML Content Only
 
 MetaInspector will try to parse all URLs by default. If you want to raise an exception when trying to parse a non-html URL (one that has a content-type different than text/html), you can state it like this:

data/lib/meta_inspector/document.rb

@@ -18,6 +18,7 @@ module MetaInspector
     #   Can be :warn, :raise or nil
     # * headers: object containing custom headers for the request
     # * normalize_url: true by default
+    # * faraday_options: an optional hash of options to pass to Faraday on the request
     def initialize(initial_url, options = {})
       options             = defaults.merge(options)
       @connection_timeout = options[:connection_timeout]
@@ -31,6 +32,7 @@ module MetaInspector
       @warn_level         = options[:warn_level]
       @exception_log      = options[:exception_log] || MetaInspector::ExceptionLog.new(warn_level: warn_level)
       @normalize_url      = options[:normalize_url]
+      @faraday_options    = options[:faraday_options]
       @url                = MetaInspector::URL.new(initial_url, exception_log:      @exception_log,
                                                                 normalize:          @normalize_url)
       @request            = MetaInspector::Request.new(@url,    allow_redirections: @allow_redirections,
@@ -38,7 +40,8 @@ module MetaInspector
                                                                 read_timeout:       @read_timeout,
                                                                 retries:            @retries,
                                                                 exception_log:      @exception_log,
-                                                                headers:            @headers) unless @document
+                                                                headers:            @headers,
+                                                                faraday_options:    @faraday_options) unless @document
       @parser             = MetaInspector::Parser.new(self,     exception_log:      @exception_log,
                                                                 download_images:    @download_images)
     end

data/lib/meta_inspector/request.rb

@@ -17,6 +17,7 @@ module MetaInspector
       @retries            = options[:retries]
       @exception_log      = options[:exception_log]
       @headers            = options[:headers]
+      @faraday_options    = options[:faraday_options] || {}
 
       response            # request early so we can fail early
     end
@@ -44,7 +45,9 @@ module MetaInspector
     private
 
     def fetch
-      session = Faraday.new(:url => url) do |faraday|
+      @faraday_options.merge!(:url => url)
+
+      session = Faraday.new(@faraday_options) do |faraday|
         faraday.request :retry, max: @retries
 
         if @allow_redirections

data/lib/meta_inspector/version.rb

@@ -1,3 +1,3 @@
 module MetaInspector
-  VERSION = '4.5.0'
+  VERSION = '4.6.0'
 end

metadata

@@ -1,14 +1,14 @@
 --- !ruby/object:Gem::Specification
 name: metainspector
 version: !ruby/object:Gem::Version
-  version: 4.5.0
+  version: 4.6.0
 platform: ruby
 authors:
 - Jaime Iniesta
 autorequire: 
 bindir: bin
 cert_chain: []
-date: 2015-05-29 00:00:00.000000000 Z
+date: 2015-06-11 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: nokogiri