RubyGems
npm
Organizations
Log in
Sign up
RubyGems
colinramsay-robotstxt
Versions diffs
1.0.2 → 1.0.3
colinramsay-robotstxt 1.0.2 → 1.0.3
Sign up to get
free
protection for your applications and to get access to all the features.
Files changed (2)
hide
show
data/lib/robotstxtparser.rb
+1
-0
metadata
+1
-1
data/lib/robotstxtparser.rb
CHANGED
Viewed
@@ -12,6 +12,7 @@ class RobotsTxtParser
12
12
raw_data = File.open(path)
13
13
end
14
14
rescue
15
+
raw_data = nil
15
16
end
16
17
17
18
@user_agents = Hash.new
metadata
CHANGED
Viewed
@@ -1,7 +1,7 @@
1
1
--- !ruby/object:Gem::Specification
2
2
name: colinramsay-robotstxt
3
3
version: !ruby/object:Gem::Version
4
-
version: 1.0.
2
4
+
version: 1.0.
3
5
5
platform: ruby
6
6
authors:
7
7
- Colin Ramsay