feedbag 0.9.4 → 0.10.1

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (5) hide show
  1. checksums.yaml +5 -5
  2. data/COPYING +1 -1
  3. data/README.markdown +28 -17
  4. data/lib/feedbag.rb +14 -9
  5. metadata +44 -12
checksums.yaml CHANGED
@@ -1,7 +1,7 @@
1
1
  ---
2
- SHA1:
3
- metadata.gz: 94365be8a983babf63632ca645a62c54a841de68
4
- data.tar.gz: 740c148f54225e5e8294c57389b8d1d8936909e5
2
+ SHA256:
3
+ metadata.gz: 221831541154a34ade903d403c0c546cd01d7a683c69d27dee92eadd9c6bd2be
4
+ data.tar.gz: a633436162c4eb75fcb7222267d533a4bc05fa08506e55bd66865eb2b6bf29a2
5
5
  SHA512:
6
- metadata.gz: f06c1b71898a144012b1f38b6c5f036776cd0b4899be3e6952fb2b5daa4bbafdccc4d007a653cd73c85aaa79b03f61b0ee34f82b4a712092a0a1849ce3965b27
7
- data.tar.gz: cb16d0536e2dc7ec3b125f3b0c3557412901ee92ffa2f519f8ce19340e279698114f4c836b310166ca2768d9984811fea3214112fed15af197e45986ba23be11
6
+ metadata.gz: d18f37165eb5b0d8ee2095bc6f0d0e7356b8b4247722cb02d115899664fbb97898b4d216ff52f0691c63d5c828e0ddd6c4cdc1bf61e9ae37963e19b3ee641c75
7
+ data.tar.gz: 77c58a1de3a75ec6d0075d2ac98893d47a8711250fdb48259fab329e846424532ebb3858bef3f5923f18a2b75a029da52e7eb5cb144d26b4964bf6f0f09d843a
data/COPYING CHANGED
@@ -1,4 +1,4 @@
1
- Copyright (C) 2008-2014 David Moreno <david@axiombox.com>
1
+ Copyright (C) 2008-2021 David Moreno <damog@damog.net>
2
2
 
3
3
  Permission is hereby granted, free of charge, to any person obtaining
4
4
  a copy of this software and associated documentation files (the
data/README.markdown CHANGED
@@ -5,41 +5,52 @@ Feedbag is Ruby's favorite auto-discovery tool/library!
5
5
 
6
6
  ### Quick synopsis
7
7
 
8
- >> require "feedbag"
9
- => true
10
- >> Feedbag.find "damog.net/blog"
11
- => ["http://damog.net/blog/index.rss", "http://damog.net/blog/tags/feed", "http://damog.net/blog/tags/rfeed"]
12
- >> Feedbag.feed? "perl.org"
13
- => false
14
- >> Feedbag.feed?("http://jobs.perl.org/rss/standard.rss")
15
- => true
8
+ ```ruby
9
+ >> require "feedbag"
10
+ => true
11
+ >> Feedbag.find "damog.net/blog"
12
+ => ["http://damog.net/blog/atom.xml"]
13
+ >> Feedbag.feed? "perl.org"
14
+ => false
15
+ >> Feedbag.feed?("https://m.signalvnoise.com/feed")
16
+ => true
17
+ ```
16
18
 
17
19
  ### Installation
18
20
 
19
- $ gem install feedbag
21
+ $ gem install feedbag
20
22
 
21
23
  Or just grab feedbag.rb and use it on your own project:
22
24
 
23
- $ wget http://github.com/damog/feedbag/raw/master/lib/feedbag.rb
25
+ $ wget https://raw.githubusercontent.com/damog/feedbag/master/lib/feedbag.rb
24
26
 
25
27
  You can also use the command line tool for quick queries, if you install the gem:
26
28
 
27
- $ feedbag http://rubygems.org/profiles/damog
28
- == http://rubygems.org/profiles/damog:
29
- - http://feeds.feedburner.com/gemcutter-latest
29
+ » feedbag https://www.ruby-lang.org/en/
30
+ == https://www.ruby-lang.org/en/:
31
+ - https://www.ruby-lang.org/en/feeds/news.rss
30
32
 
31
33
  ### Why should you use it?
32
34
 
33
35
  - Because it only uses [Nokogiri](http://nokogiri.org/) as dependency.
34
36
  - Because it follows modern feed filename conventions (like those ones used by WordPress blogs, or Blogger, etc).
35
37
  - Because it's a single file you can embed easily in your application.
36
- - Because it's faster than rfeedfinder.
38
+ - Because it's faster than anything else.
39
+
40
+ ### Web Service
41
+
42
+ Now you can also POST directly into an AWS Lambda function webservice that runs `Feedbag.find()`. Don't overuse it. It's [here](https://github.com/damog/aws-lambda-feedbag).
37
43
 
38
44
  ### Author
39
45
 
40
- [David Moreno](http://damog.net/) <[david@axiombox.com](mailto:david@axiombox.com)>.
46
+ [David Moreno](http://damog.net/) <[damog@damog.net](mailto:damog@damog.net)>.
41
47
 
42
- ### Copyright
48
+ ### Donations
43
49
 
44
- This is free software. See [COPYING](http://github.com/damog/feedbag/master/COPYING) for more information.
50
+ ![Superfeedr](https://raw.githubusercontent.com/damog/feedbag/master/img/superfeedr_150.png)
51
+
52
+ [Superfeedr](http://superfeedr.com) has kindly financially [supported](https://github.com/damog/feedbag/issues/9) the development of Feedbag.
53
+
54
+ ### Copyright
45
55
 
56
+ This is and will always be free software. See [COPYING](https://raw.githubusercontent.com/damog/feedbag/master/COPYING) for more information.
data/lib/feedbag.rb CHANGED
@@ -1,6 +1,6 @@
1
1
  #!/usr/bin/ruby
2
2
 
3
- # Copyright (c) 2008-2014 David Moreno <david@axiombox.com>
3
+ # Copyright (c) 2008-2019 David Moreno <damog@damog.net>
4
4
  #
5
5
  # Permission is hereby granted, free of charge, to any person obtaining
6
6
  # a copy of this software and associated documentation files (the
@@ -9,10 +9,10 @@
9
9
  # distribute, sublicense, and/or sell copies of the Software, and to
10
10
  # permit persons to whom the Software is furnished to do so, subject to
11
11
  # the following conditions:
12
- #
12
+ #
13
13
  # The above copyright notice and this permission notice shall be
14
14
  # included in all copies or substantial portions of the Software.
15
- #
15
+ #
16
16
  # THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
17
17
  # EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
18
18
  # MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND
@@ -25,6 +25,7 @@ require "rubygems"
25
25
  require "nokogiri"
26
26
  require "open-uri"
27
27
  require "net/http"
28
+ require "open_uri_redirections"
28
29
 
29
30
  class Feedbag
30
31
 
@@ -35,6 +36,7 @@ class Feedbag
35
36
  'text/xml',
36
37
  'application/rss+xml',
37
38
  'application/rdf+xml',
39
+ 'application/json',
38
40
  ].freeze
39
41
 
40
42
  def self.feed?(url)
@@ -95,7 +97,7 @@ class Feedbag
95
97
  end
96
98
 
97
99
  begin
98
- html = open(url) do |f|
100
+ html = URI.open(url, :allow_redirections => :all) do |f|
99
101
  content_type = f.content_type.downcase
100
102
  if content_type == "application/octet-stream" # open failed
101
103
  content_type = f.meta["content-type"].gsub(/;.*$/, '')
@@ -114,19 +116,22 @@ class Feedbag
114
116
 
115
117
  # first with links
116
118
  (doc/"atom:link").each do |l|
117
- next unless l["rel"]
119
+ next unless l["rel"] && l["href"].present?
118
120
  if l["type"] and CONTENT_TYPES.include?(l["type"].downcase.strip) and l["rel"].downcase == "self"
119
121
  self.add_feed(l["href"], url, @base_uri)
120
122
  end
121
123
  end
122
124
 
123
- (doc/"link").each do |l|
124
- next unless l["rel"]
125
- if l["type"] and CONTENT_TYPES.include?(l["type"].downcase.strip) and (l["rel"].downcase =~ /alternate/i or l["rel"] == "service.feed")
125
+ doc.xpath("//link[@rel='alternate' or @rel='service.feed'][@href][@type]").each do |l|
126
+ if CONTENT_TYPES.include?(l['type'].downcase.strip)
126
127
  self.add_feed(l["href"], url, @base_uri)
127
128
  end
128
129
  end
129
130
 
131
+ doc.xpath("//link[@rel='alternate' and @type='application/json'][@href]").each do |e|
132
+ self.add_feed(e['href'], url, @base_uri) if self.looks_like_feed?(e['href'])
133
+ end
134
+
130
135
  (doc/"a").each do |a|
131
136
  next unless a["href"]
132
137
  if self.looks_like_feed?(a["href"]) and (a["href"] =~ /\// or a["href"] =~ /#{url_uri.host}/)
@@ -161,7 +166,7 @@ class Feedbag
161
166
  end
162
167
 
163
168
  def looks_like_feed?(url)
164
- if url =~ /(\.(rdf|xml|rdf|rss)$|feed=(rss|atom)|(atom|feed)\/?$)/i
169
+ if url =~ /(\.(rdf|xml|rss)(\?([\w'\-%]?(=[\w'\-%.]*)?(&|#)?)+)?(:[\w'\-%]+)?$|feed=(rss|atom)|(atom|feed)\/?$)/i
165
170
  true
166
171
  else
167
172
  false
metadata CHANGED
@@ -1,15 +1,14 @@
1
1
  --- !ruby/object:Gem::Specification
2
2
  name: feedbag
3
3
  version: !ruby/object:Gem::Version
4
- version: 0.9.4
4
+ version: 0.10.1
5
5
  platform: ruby
6
6
  authors:
7
7
  - David Moreno
8
- - Derek Willis
9
8
  autorequire:
10
9
  bindir: bin
11
10
  cert_chain: []
12
- date: 2014-08-03 00:00:00.000000000 Z
11
+ date: 2020-11-28 00:00:00.000000000 Z
13
12
  dependencies:
14
13
  - !ruby/object:Gem::Dependency
15
14
  name: nokogiri
@@ -17,28 +16,48 @@ dependencies:
17
16
  requirements:
18
17
  - - "~>"
19
18
  - !ruby/object:Gem::Version
20
- version: '0'
19
+ version: '1.8'
20
+ - - ">="
21
+ - !ruby/object:Gem::Version
22
+ version: 1.8.2
23
+ type: :runtime
24
+ prerelease: false
25
+ version_requirements: !ruby/object:Gem::Requirement
26
+ requirements:
27
+ - - "~>"
28
+ - !ruby/object:Gem::Version
29
+ version: '1.8'
30
+ - - ">="
31
+ - !ruby/object:Gem::Version
32
+ version: 1.8.2
33
+ - !ruby/object:Gem::Dependency
34
+ name: open_uri_redirections
35
+ requirement: !ruby/object:Gem::Requirement
36
+ requirements:
37
+ - - "~>"
38
+ - !ruby/object:Gem::Version
39
+ version: '0.2'
21
40
  type: :runtime
22
41
  prerelease: false
23
42
  version_requirements: !ruby/object:Gem::Requirement
24
43
  requirements:
25
44
  - - "~>"
26
45
  - !ruby/object:Gem::Version
27
- version: '0'
46
+ version: '0.2'
28
47
  - !ruby/object:Gem::Dependency
29
48
  name: shoulda
30
49
  requirement: !ruby/object:Gem::Requirement
31
50
  requirements:
32
51
  - - "~>"
33
52
  - !ruby/object:Gem::Version
34
- version: '0'
53
+ version: '3'
35
54
  type: :development
36
55
  prerelease: false
37
56
  version_requirements: !ruby/object:Gem::Requirement
38
57
  requirements:
39
58
  - - "~>"
40
59
  - !ruby/object:Gem::Version
41
- version: '0'
60
+ version: '3'
42
61
  - !ruby/object:Gem::Dependency
43
62
  name: mocha
44
63
  requirement: !ruby/object:Gem::Requirement
@@ -59,8 +78,22 @@ dependencies:
59
78
  - - ">="
60
79
  - !ruby/object:Gem::Version
61
80
  version: 0.12.0
62
- description: Ruby's favorite feed auto-discoverty tool
63
- email: david@axiombox.com
81
+ - !ruby/object:Gem::Dependency
82
+ name: webmock
83
+ requirement: !ruby/object:Gem::Requirement
84
+ requirements:
85
+ - - "~>"
86
+ - !ruby/object:Gem::Version
87
+ version: '3'
88
+ type: :development
89
+ prerelease: false
90
+ version_requirements: !ruby/object:Gem::Requirement
91
+ requirements:
92
+ - - "~>"
93
+ - !ruby/object:Gem::Version
94
+ version: '3'
95
+ description: Ruby's favorite feed auto-discovery tool
96
+ email: damog@damog.net
64
97
  executables:
65
98
  - feedbag
66
99
  extensions: []
@@ -94,9 +127,8 @@ required_rubygems_version: !ruby/object:Gem::Requirement
94
127
  - !ruby/object:Gem::Version
95
128
  version: '0'
96
129
  requirements: []
97
- rubyforge_project: feedbag
98
- rubygems_version: 2.2.2
130
+ rubygems_version: 3.1.4
99
131
  signing_key:
100
132
  specification_version: 4
101
- summary: Ruby's favorite feed auto-discovery tool
133
+ summary: RSS/Atom feed auto-discovery tool
102
134
  test_files: []