html2rss 0.1.0 → 0.2.0

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 1cc71ee2722757d0f4cceaf8aea1b9007496acf35fdf4da37a5dea998233258d
-  data.tar.gz: '0009a02fe85a6e2b088aec00944e1dc46233ce6878b8558782286be0e020511b'
+  metadata.gz: e2383144ffd44b49ff516d2ca58b28e83f22b9213c5f8000d3295172804078c2
+  data.tar.gz: 52d7d4cc36986fbad3b1a39136b1b111a3ffe66af8395cf396e0239c5100e0bc
 SHA512:
-  metadata.gz: 2de4befd1f3beec2ee094f2c792ec94a1bde37c3da1f30eb737403ae04eddb36b54a43b86163f8b348229c42a5d38aae0bc7657c677bdbe95a54bee26b1fa6d9
-  data.tar.gz: f344bb3046c0493d9979e9daf53d5f3725798c96093dbbff6164a1339fd80bf54ad60868eb55dbc5a67239584f825cb0f5f6ca18c4e3e7f8f67b6698d26f3adf
+  metadata.gz: bff3938bfa78ed99d27a960828ff4b8d9efe843826a68758ae33d7b3d326047b57e2c6cd0556344fa0fdc1dc2173daaf8bc145cdbab92197640012b376faa78b
+  data.tar.gz: ecf174673a2faffd64e9638b0fada4485b4d1ff9e0edad09e9d1fb610fd8e5b3201cd650f22f0ba578f83069de92bec651efe40686cf8e561337c7813db6f11e

data/CHANGELOG.md

@@ -1,115 +1,40 @@
-<img width="300px" src="https://github.com/gildesmarais/html2rss/raw/master/support/logo.png" />
+# [0.1.0](https://github.com/gildesmarais/html2rss/compare/v0.0.1...v0.1.0) (2018-11-04)
 
-# html2rss
 
-_Generate RSS feeds by scraping websites by providing a config._
+### Bug Fixes
 
+* handling of url query breaks processing ([ace289e](https://github.com/gildesmarais/html2rss/commit/ace289e))
+* only set supported attributes on rss item ([dae0d8e](https://github.com/gildesmarais/html2rss/commit/dae0d8e))
+* **config:** feed generation fails ([7dd5586](https://github.com/gildesmarais/html2rss/commit/7dd5586))
+* **parse_uri:** handle non-absolute paths ([9215025](https://github.com/gildesmarais/html2rss/commit/9215025))
 
 
-## Bugfixes
-  - handling of url query breaks processing
-  ([ace289e9](git@github.com:gildesmarais/html2rss/commit/ace289e911b69cb92433cac6f1ca0403715d8286))
-  - only set supported attributes on rss item
-  ([dae0d8e7](git@github.com:gildesmarais/html2rss/commit/dae0d8e75541e810275e789a23971a61e60a2154))
+### Features
 
-  - **config**
-    - feed generation fails
-  ([7dd55869](git@github.com:gildesmarais/html2rss/commit/7dd55869f79b1de76c004bf0e82d13b16b5b3f0d))
+* **item_extractor:** add static and current_time ([25043dc](https://github.com/gildesmarais/html2rss/commit/25043dc))
+* **item_extractor:** handle absolute urls ([f96be00](https://github.com/gildesmarais/html2rss/commit/f96be00))
+* **item_extractor:** text strips strings ([f598285](https://github.com/gildesmarais/html2rss/commit/f598285))
+* **post_processing:** add configurable post_processing ([#5](https://github.com/gildesmarais/html2rss/issues/5)) ([4cf6cac](https://github.com/gildesmarais/html2rss/commit/4cf6cac)), closes [#1](https://github.com/gildesmarais/html2rss/issues/1)
+* **post_processor:** add substring ([6f2a32a](https://github.com/gildesmarais/html2rss/commit/6f2a32a))
+* **postprocessors:** add Template ([#6](https://github.com/gildesmarais/html2rss/issues/6)) ([f1db542](https://github.com/gildesmarais/html2rss/commit/f1db542)), closes [#4](https://github.com/gildesmarais/html2rss/issues/4)
+* **sanitize_html:** add target="_blank" to anchors ([975a73b](https://github.com/gildesmarais/html2rss/commit/975a73b))
+* add logo [skip ci] ([857a55f](https://github.com/gildesmarais/html2rss/commit/857a55f))
+* do not fail on invalid item, just skip it ([3b83d71](https://github.com/gildesmarais/html2rss/commit/3b83d71))
+* require updated to be present ([e1bedae](https://github.com/gildesmarais/html2rss/commit/e1bedae))
 
-  - **parse_uri**
-    - handle non-absolute paths
-  ([92150257](git@github.com:gildesmarais/html2rss/commit/921502574e4436d65a30e1d34b9b31f238336247))
 
 
+## [0.0.1](https://github.com/gildesmarais/html2rss/compare/219cac8...v0.0.1) (2018-06-03)
 
 
-## Features
-  - add logo [skip ci]
-  ([857a55fd](git@github.com:gildesmarais/html2rss/commit/857a55fd8c932930d96c47c5abe57f0507356df1))
-  - require updated to be present
-  ([e1bedaec](git@github.com:gildesmarais/html2rss/commit/e1bedaecc91e874fe24e96000612abb9cd11e9fe))
-  - do not fail on invalid item, just skip it
-  ([3b83d715](git@github.com:gildesmarais/html2rss/commit/3b83d715619abbc33b124de1945d17cb0dc7edb0))
+### Bug Fixes
 
-  - **item_extractor**
-    - text strips strings
-  ([f5982859](git@github.com:gildesmarais/html2rss/commit/f59828593dca663bdbe8699392594e2d18658f8f))
-    - add static and current_time
-  ([25043dcb](git@github.com:gildesmarais/html2rss/commit/25043dcbd8f0f4901202f4a2f66b355ac48825a8))
-    - handle absolute urls
-  ([f96be008](git@github.com:gildesmarais/html2rss/commit/f96be00857bdcded02d52dd62ec22b9b52c803ed))
+* gem's version and readme-typos ([eab39d9](https://github.com/gildesmarais/html2rss/commit/eab39d9))
 
-  - **post_processing**
-    - add configurable post_processing (#5)
-  ([4cf6caca](git@github.com:gildesmarais/html2rss/commit/4cf6cacac00bd3c0c53d584ca11274ba24b03ef7),
-   [#1](git@github.com:gildesmarais/html2rss/issues/1))
 
-  - **post_processor**
-    - add substring
-  ([6f2a32a6](git@github.com:gildesmarais/html2rss/commit/6f2a32a6304ef9956577711173de681daf93f55f))
+### Features
 
-  - **postprocessors**
-    - add Template (#6)
-  ([f1db542e](git@github.com:gildesmarais/html2rss/commit/f1db542e8c1e9e09a066a3cd6c8514a6ca0aa871),
-   [#4](git@github.com:gildesmarais/html2rss/issues/4))
+* **html2rss:** add initial version of the html2rss gem ([219cac8](https://github.com/gildesmarais/html2rss/commit/219cac8))
 
-  - **sanitize_html**
-    - add target="_blank" to anchors
-  ([975a73bf](git@github.com:gildesmarais/html2rss/commit/975a73bfd396ba5942bc0ea80eebd14cc37ad776))
 
 
-
-
-## Documentation
-  - create the changelog
-  ([5c561db5](git@github.com:gildesmarais/html2rss/commit/5c561db51d4e0b8592b1c82812ab5cdbe9320b70))
-  - add tips and tricks
-  ([ea978240](git@github.com:gildesmarais/html2rss/commit/ea9782408107f3637a4c9665396f511fc07be19b))
-  - update readme
-  ([4743167c](git@github.com:gildesmarais/html2rss/commit/4743167c86959e83524ffb7282c562413a651797))
-  - add note about html2rss-web
-  ([3371c12f](git@github.com:gildesmarais/html2rss/commit/3371c12ffc6c8d3c29073d03ff206886a39401cd))
-  - add a badge for travis-ci
-  ([8818d4f4](git@github.com:gildesmarais/html2rss/commit/8818d4f464a9c163ebc9665d01719e2bab132bd6))
-
-
-
-
-## Test
-  - don't be so lazy when matching strings
-  ([6a0eb627](git@github.com:gildesmarais/html2rss/commit/6a0eb62765523a1405fd269466b2fc57794eac7a))
-
-
-
-
-## Chore
-  - upgrade sanitze gem to version 5.0.0
-  ([8c4bf3a4](git@github.com:gildesmarais/html2rss/commit/8c4bf3a44885758e395568ec452a7cffdb9a0389))
-  - rubocop autocorrect
-  ([af6b9fac](git@github.com:gildesmarais/html2rss/commit/af6b9facca547d3ca3ce9ef0d1227707cd16eaea))
-  - build against latest ruby releases
-  ([17ba79ac](git@github.com:gildesmarais/html2rss/commit/17ba79acd2f68da1fcc984368d3e6de3437cbf1b))
-  - update dependencies
-  ([855279b4](git@github.com:gildesmarais/html2rss/commit/855279b46d584a8a8c2a317529f7a4be550eaf15))
-  - update dependencies
-  ([46e5a283](git@github.com:gildesmarais/html2rss/commit/46e5a2832d1f2fe1353dcc2a8d82a9786f15f6bd))
-  - add simplecov
-  ([b4e1144b](git@github.com:gildesmarais/html2rss/commit/b4e1144b7f8f90126e528cc4a4ec048113d93634))
-
-  - **changelog**
-    - add generation with git-changelog
-  ([07ad5a51](git@github.com:gildesmarais/html2rss/commit/07ad5a513f0951ee988426abda4b8c233411ead7))
-
-  - **travis**
-    - use cache for bundler
-  ([ac76b3b2](git@github.com:gildesmarais/html2rss/commit/ac76b3b2dd94adecd4927de18651800438a7e7ba))
-    - setup autorelease to rubygems
-  ([eb9c8e1b](git@github.com:gildesmarais/html2rss/commit/eb9c8e1b16902dc0e174a0cccb6eb9227307ce82))
-
-
-
-
-
----
-<sub><sup>*Generated with [git-changelog](https://github.com/rafinskipg/git-changelog). If you have any problems or suggestions, create an issue.* :) **Thanks** </sub></sup>
-

data/Gemfile.lock

@@ -1,7 +1,7 @@
 PATH
   remote: .
   specs:
-    html2rss (0.0.1)
+    html2rss (0.1.0)
       faraday (~> 0.15)
       nokogiri (~> 1.8)
       sanitize (~> 5.0)
@@ -20,7 +20,7 @@ GEM
     multipart-post (2.0.0)
     nokogiri (1.8.5)
       mini_portile2 (~> 2.3.0)
-    nokogumbo (2.0.0)
+    nokogumbo (2.0.1)
       nokogiri (~> 1.8, >= 1.8.4)
     rspec (3.8.0)
       rspec-core (~> 3.8.0)

data/README.md

@@ -56,8 +56,7 @@ Bug reports and pull requests are welcome on GitHub at https://github.com/gildes
 
 ## Changelog generation
 
-The `CHANGELOG.md` can be generated automatically.
-Install [git-changelog](https://www.npmjs.com/package/git-changelog) globally and run `git-changelog` afterwards.
+The `CHANGELOG.md` can be generated automatically with [`standard-changelog`](https://github.com/conventional-changelog/conventional-changelog/tree/master/packages/standard-changelog).
 
 ## License
 

data/lib/html2rss/config.rb

@@ -41,6 +41,10 @@ module Html2rss
       feed_config.dig('selectors').fetch(name, {}).merge('channel' => channel_config)
     end
 
+    def categories
+      feed_config.dig('selectors').fetch('categories', [])
+    end
+
     def selector(name)
       feed_config.dig('selectors', name, 'selector')
     end

data/lib/html2rss/feed_builder.rb

@@ -40,9 +40,13 @@ module Html2rss
       items.new_item do |rss_item|
         feed_item.available_attributes.each do |attribute_name|
           rss_item.send("#{attribute_name}=".to_sym, feed_item.send(attribute_name))
+        end
 
-          rss_item.guid.content = Digest::SHA1.hexdigest(feed_item.title)
+        feed_item.categories.each do |category|
+          rss_item.categories.new_category.content = category
         end
+
+        rss_item.guid.content = Digest::SHA1.hexdigest(feed_item.title)
       end
     end
   end

data/lib/html2rss/item.rb

@@ -32,8 +32,8 @@ module Html2rss
     end
 
     def available_attributes
-      # TODO: support optional attributes, e.g. category, enclosure, source
-      @available_attributes ||= (%w[title link description author comments updated] & @config.attribute_names)
+      @available_attributes ||= (%w[title link description author comments updated] &
+        @config.attribute_names) - ['categories']
     end
 
     def valid?
@@ -42,6 +42,10 @@ module Html2rss
       true
     end
 
+    def categories
+      config.categories.map(&method(:method_missing)).uniq.keep_if { |category| category.to_s != '' }
+    end
+
     def self.from_url(url, config)
       connection = Faraday.new(url: url, headers: config.headers)
       page = Nokogiri::HTML(connection.get.body)

data/lib/html2rss/version.rb

@@ -1,3 +1,3 @@
 module Html2rss
-  VERSION = '0.1.0'.freeze
+  VERSION = '0.2.0'.freeze
 end

metadata

@@ -1,14 +1,14 @@
 --- !ruby/object:Gem::Specification
 name: html2rss
 version: !ruby/object:Gem::Version
-  version: 0.1.0
+  version: 0.2.0
 platform: ruby
 authors:
 - Gil Desmarais
 autorequire: 
 bindir: exe
 cert_chain: []
-date: 2018-11-04 00:00:00.000000000 Z
+date: 2018-11-13 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: faraday
@@ -156,7 +156,6 @@ files:
 - lib/html2rss/item.rb
 - lib/html2rss/item_extractor.rb
 - lib/html2rss/version.rb
-- support/changelog.md
 - support/logo.png
 homepage: https://github.com/gildesmarais/html2rss
 licenses:

data/support/changelog.md

@@ -1,15 +0,0 @@
-<% if(logo) { %><img width="300px" src="<%= logo %>" /><%= '\n\n' %><% } %># <%= title %>
-<% if(intro) { %><%= '\n' %>_<%= intro %>_<%= '\n' %><% } %>
-<% if(version && (version.name || version.number)) { %>##<% if(version.name){%> <%= version.name %><% } %> <%= version.number %> <% if(version.date){ %>( <%= version.date %> )<% } %><%= '\n' %><% } %>
-<% _.forEach(sections, function(section){
-  if(section.commitsCount > 0) { %>
-## <%= section.title %>
-<% _.forEach(section.commits, function(commit){ %>  - <%= printCommit(commit, true) %><% }) %>
-<% _.forEach(section.components, function(component){ %>  - **<%= component.name %>**
-<% _.forEach(component.commits, function(commit){ %>    - <%= printCommit(commit, true) %><% }) %>
-<% }) %>
-<% } %>
-<% }) %>
-
----
-<sub><sup>*Generated with [git-changelog](https://github.com/rafinskipg/git-changelog). If you have any problems or suggestions, create an issue.* :) **Thanks** </sub></sup>