wgit 0.10.7 → 0.10.8

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: cd1829ff2dda87e2b88fb738c18ba3a31765a8e3afbe82874e804b58b6c094fb
-  data.tar.gz: 8085a6ab3da61aea02fea4bb1f7e7c18caf3edca0d4d11161df3e3a0255293e6
+  metadata.gz: 66e8b435303d07b2f81d260badc96662936599c9782916f7f014b74a7c617499
+  data.tar.gz: 7b55890c66ec09efd8d5749bd66605a4cb43d5091416f072f8fcc5aaaa85fbe7
 SHA512:
-  metadata.gz: add6099d1433baebf93b4ad9471a5a35fb0a551e28eded322c46dfa4cfc45eea059284c8645bc2eb8bf33dd91c55060969f15ce6b24567445ffb737ae8a9afc4
-  data.tar.gz: 787830ce4f6eea9c7270542c36718c54f48beb7f33e26feb06abbf72d0ad0750943542de051ff7b43caced904ea83550e877631b1ecb936c8f3b6ee211713282
+  metadata.gz: fe1b605224f6682ac504f17b55ab83518556f1320f0410741af8f95bf3a669918c69b48832fb413ca1f78482fdbb7e0d2e7d6f57841c6a562b7f926f7511cdd7
+  data.tar.gz: 856be2111709bc96488b7d43abbc49c563a9a56330344adb4b9ec40fc263cb91e63465c3c3dab317c0d8930965a609a43102d53d80bbc2001e6165a15cb905fa

data/CHANGELOG.md

@@ -9,6 +9,17 @@
 - ...
 ---
 
+## v0.10.8
+### Added
+- Custom `#inspect` methods to `Wgit::Url` and `Wgit::Document` classes.
+- `Document.remove_extractors` method, which removes all default and defined extractors.
+
+### Changed/Removed
+- ...
+### Fixed
+- ...
+---
+
 ## v0.10.7
 ### Added
 - ...

data/README.md

@@ -62,7 +62,23 @@ end
 puts JSON.generate(quotes)
 ```
 
-But what if we want to crawl and store the content in a database, so that it can be searched? Wgit makes it easy to index and search HTML using [MongoDB](https://www.mongodb.com/):
+Which outputs:
+
+```text
+[
+    {
+        "quote": "“The person, be it gentleman or lady, who has not pleasure in a good novel, must be intolerably stupid.”",
+        "author": "Jane Austen"
+    },
+    {
+        "quote": "“A day without sunshine is like, you know, night.”",
+        "author": "Steve Martin"
+    },
+    ...
+]
+```
+
+Great! But what if we want to crawl and store the content in a database, so that it can be searched? Wgit makes it easy to index and search HTML using [MongoDB](https://www.mongodb.com/):
 
 ```ruby
 require 'wgit'
@@ -89,6 +105,8 @@ The `search` call (on the last line) will return and output the results:
 Quotes to Scrape
 “I am free of all prejudice. I hate everyone equally. ”
 http://quotes.toscrape.com/tag/humor/page/2/
+
+...
 ```
 
 Using a MongoDB [client](https://robomongo.org/), we can see that the two web pages have been indexed, along with their extracted *quotes* and *authors*:

data/lib/wgit/document.rb

@@ -192,13 +192,27 @@ module Wgit
       Document.send(:remove_method, "init_#{var}_from_object")
 
       @extractors.delete(var.to_sym)
+
       true
     rescue NameError
       false
     end
 
+    # Removes all default and defined extractors by calling
+    # `Document.remove_extractor` underneath. See its documentation.
+    def self.remove_extractors
+      @extractors.each { |var| remove_extractor(var) }
+    end
+
     ### Document Instance Methods ###
 
+    # Overrides String#inspect to shorten the printed output of a Document.
+    #
+    # @return [String] A short textual representation of this Document.
+    def inspect
+      "#<Wgit::Document url=\"#{@url}\" html=#{size} bytes>"
+    end
+
     # Determines if both the url and html match. Use
     # doc.object_id == other.object_id for exact object comparison.
     #

data/lib/wgit/url.rb

@@ -117,6 +117,13 @@ Addressable::URI::InvalidURIError")
       @date_crawled = bool ? Wgit::Utils.time_stamp : nil
     end
 
+    # Overrides String#inspect to distingiush this Url from a String.
+    #
+    # @return [String] A short textual representation of this Url.
+    def inspect
+      "#<Wgit::Url url=\"#{self}\" crawled=#{@crawled}>"
+    end
+
     # Overrides String#replace setting the new_url @uri and String value.
     #
     # @param new_url [Wgit::Url, String] The new URL value.

data/lib/wgit/version.rb

@@ -6,7 +6,7 @@
 # @author Michael Telford
 module Wgit
   # The current gem version of Wgit.
-  VERSION = '0.10.7'
+  VERSION = '0.10.8'
 
   # Returns the current gem version of Wgit as a String.
   def self.version

metadata

@@ -1,14 +1,14 @@
 --- !ruby/object:Gem::Specification
 name: wgit
 version: !ruby/object:Gem::Version
-  version: 0.10.7
+  version: 0.10.8
 platform: ruby
 authors:
 - Michael Telford
 autorequire:
 bindir: bin
 cert_chain: []
-date: 2022-12-01 00:00:00.000000000 Z
+date: 2023-08-18 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: addressable